-- Logs begin at Wed 2022-11-02 12:59:39 UTC, end at Wed 2022-11-02 15:24:19 UTC. -- Nov 02 13:30:36.855951 n-d-858238-3 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 13:30:36.864561 n-d-858238-3 devstack@n-api.service[111356]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 13:30:36 2022] *** Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: nodename: n-d-858238-3 Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: machine: x86_64 Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: clock source: unix Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: pcre jit disabled Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: detected number of CPU cores: 4 Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: current working directory: / Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: detected binary path: /usr/bin/uwsgi-core Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: your processes number limit is 47680 Nov 02 13:30:36.866682 n-d-858238-3 devstack@n-api.service[111356]: your memory page size is 4096 bytes Nov 02 13:30:36.867502 n-d-858238-3 devstack@n-api.service[111356]: detected max file descriptor number: 2048 Nov 02 13:30:36.867502 n-d-858238-3 devstack@n-api.service[111356]: lock engine: pthread robust mutexes Nov 02 13:30:36.867502 n-d-858238-3 devstack@n-api.service[111356]: thunder lock: enabled Nov 02 13:30:36.867502 n-d-858238-3 devstack@n-api.service[111356]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 13:30:36.867502 n-d-858238-3 devstack@n-api.service[111356]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 13:30:36.906420 n-d-858238-3 devstack@n-api.service[111356]: Python main interpreter initialized at 0x564578f769c0 Nov 02 13:30:36.906420 n-d-858238-3 devstack@n-api.service[111356]: python threads support enabled Nov 02 13:30:36.906420 n-d-858238-3 devstack@n-api.service[111356]: your server socket listen backlog is limited to 100 connections Nov 02 13:30:36.906420 n-d-858238-3 devstack@n-api.service[111356]: your mercy for graceful operations on workers is 90 seconds Nov 02 13:30:36.906723 n-d-858238-3 devstack@n-api.service[111356]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 13:30:36.906824 n-d-858238-3 devstack@n-api.service[111356]: *** Operational MODE: preforking *** Nov 02 13:30:36.907087 n-d-858238-3 devstack@n-api.service[111356]: *** uWSGI is running in multiple interpreter mode *** Nov 02 13:30:36.907087 n-d-858238-3 devstack@n-api.service[111356]: spawned uWSGI master process (pid: 111356) Nov 02 13:30:36.907291 n-d-858238-3 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 13:30:36.910068 n-d-858238-3 devstack@n-api.service[111356]: spawned uWSGI worker 1 (pid: 111357, cores: 1) Nov 02 13:30:36.910068 n-d-858238-3 devstack@n-api.service[111356]: spawned uWSGI worker 2 (pid: 111358, cores: 1) Nov 02 13:30:36.910068 n-d-858238-3 devstack@n-api.service[111356]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 13:30:37.567373 n-d-858238-3 devstack@n-api.service[111357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:30:37.570280 n-d-858238-3 devstack@n-api.service[111358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:30:38.639291 n-d-858238-3 devstack@n-api.service[111357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:30:38.639291 n-d-858238-3 devstack@n-api.service[111357]: from cryptography.utils import int_from_bytes Nov 02 13:30:38.640364 n-d-858238-3 devstack@n-api.service[111357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:30:38.640364 n-d-858238-3 devstack@n-api.service[111357]: from cryptography.utils import int_from_bytes Nov 02 13:30:38.643299 n-d-858238-3 devstack@n-api.service[111358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:30:38.643299 n-d-858238-3 devstack@n-api.service[111358]: from cryptography.utils import int_from_bytes Nov 02 13:30:38.643720 n-d-858238-3 devstack@n-api.service[111358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:30:38.643720 n-d-858238-3 devstack@n-api.service[111358]: from cryptography.utils import int_from_bytes Nov 02 13:30:41.129197 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:30:41.129844 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:30:41.129937 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:30:41.130306 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:30:41.130553 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:30:41.130932 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.131288 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.131608 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.131921 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.132246 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.132538 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:30:41.132891 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.132980 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:30:41.133059 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.133133 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.133316 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:30:41.133459 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.133678 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:30:41.133766 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.133933 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:30:41.134025 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.134311 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858238-3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.134396 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.134626 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.134725 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.134925 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135012 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135254 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135354 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135566 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135652 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135864 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.135966 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.136180 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.136272 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.136480 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.136573 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.136809 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.136979 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.137089 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138126 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138278 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138385 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858238-3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138520 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138604 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138677 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138760 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138839 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.138915 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.139001 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.139089 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.139191 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.139284 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.139370 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.140062 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.140164 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.140376 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.140468 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.140679 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.140877 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.141070 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858238-3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.141190 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.141383 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.141496 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.141694 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.141807 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.142003 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.142144 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.142408 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.142504 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.142712 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.142801 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143016 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143121 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143360 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143463 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143678 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143778 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.143979 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.144083 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.144300 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.144387 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858238-3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.144614 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.144770 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.144927 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.145014 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.145241 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.145328 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.145536 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.145665 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.145840 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146012 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146141 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146284 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146452 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146601 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146749 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.146914 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147046 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147260 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147362 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147588 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147675 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147902 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.147987 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.148215 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.148310 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.148529 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.148672 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.148772 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.148864 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149003 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149129 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149314 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149440 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149633 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149769 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.149932 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150034 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150238 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150332 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150538 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150633 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150836 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.150934 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.151151 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.151254 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.151451 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.151546 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.151748 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.151842 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.152045 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.152143 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.152293 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.152641 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.152867 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.152955 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.153190 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.153283 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.153490 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.153586 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.153796 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.153882 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.154104 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.154190 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.154410 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.154497 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.154709 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.154794 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155014 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155134 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155382 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155469 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155683 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155775 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.155995 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.156083 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.156308 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.156400 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.156606 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.156702 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.156905 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157071 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157205 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157292 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157516 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157610 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157838 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.157935 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158136 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158222 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158380 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158465 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158722 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158866 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.158961 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.159079 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.159293 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.159424 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.159591 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.159752 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160002 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160121 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160312 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160411 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160607 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160704 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.160907 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161003 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161204 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161310 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161503 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161599 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161797 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.161900 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162093 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162195 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162389 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162478 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162686 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162773 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.162983 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163071 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163303 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163391 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163599 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163686 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163899 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.163983 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.164206 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.164293 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.164503 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.164594 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.164800 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.164895 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165096 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165195 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165393 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165480 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165697 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165802 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.165994 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166097 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166291 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166385 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166592 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166685 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166887 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.166972 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.167214 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.167306 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.167525 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.167624 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.167823 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.167909 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.168121 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.168206 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.168424 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.168517 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.168715 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.168807 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169012 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169163 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169321 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169420 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169620 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169707 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.169918 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170016 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170217 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170323 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170514 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170600 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170834 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.170922 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.171152 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.171243 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.171451 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.171537 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.171746 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.171832 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172038 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172126 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172346 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172441 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172657 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172748 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.172957 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173045 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173256 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173341 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173555 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173640 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173853 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.173946 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.174157 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.174243 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.174463 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.174555 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.174765 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.174853 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.175069 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.175170 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.175393 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.175496 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.175712 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.175799 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.176031 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.176117 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.176337 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.176432 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.176645 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.176732 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.176954 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.177096 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.177255 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.177353 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:30:41.177563 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.177649 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.177870 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.177965 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.178183 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.178272 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.178496 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.178589 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.178822 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.178909 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.179153 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.179314 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.179446 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.179581 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.179762 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.179906 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.180171 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.180323 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.180473 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.180614 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.180765 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.180898 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181040 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181171 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181304 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181444 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181576 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181714 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.181915 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182054 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182225 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182381 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182545 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182674 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182860 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.182995 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.183189 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.183321 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.183495 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.183637 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.183800 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.183948 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.184125 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.184258 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.184434 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.184576 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.184741 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.184876 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185058 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185189 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185365 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185503 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185681 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185816 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.185986 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.186122 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.186808 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.186960 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.187123 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.187255 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.187436 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.187568 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.187743 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.187874 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.188071 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.188201 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.188383 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.188513 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.188703 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.188833 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189012 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189102 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189319 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189450 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189635 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189775 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.189946 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190082 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190252 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190393 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190556 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190687 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190862 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.190992 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.191193 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.191326 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.191471 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.191605 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.191768 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.191903 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.192066 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.192209 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.192380 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.192531 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.192717 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.192863 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193006 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193148 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193287 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193421 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193584 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193721 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.193888 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194038 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194180 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194322 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194479 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194615 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194779 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.194929 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.195085 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.195235 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.195415 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.195504 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.195714 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.195803 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196031 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196118 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196334 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196421 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196635 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196730 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.196950 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197036 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197250 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197336 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197551 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197638 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197859 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.197944 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.198163 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.198255 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.198469 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.198556 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.198774 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.198860 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.199077 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.199238 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.199421 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.199507 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.199729 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.199816 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200035 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200129 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200360 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200449 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200668 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200756 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.200974 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.201069 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.201286 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.201371 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.201598 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.201692 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.202034 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.202729 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.202882 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203019 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203237 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203381 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203519 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203639 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203827 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.203951 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.204141 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.204282 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.204447 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.204575 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.204745 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.204832 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205048 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205135 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205349 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205486 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205649 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205735 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.205948 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.206042 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.206267 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.206354 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.206572 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.206658 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.206872 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207033 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207199 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207288 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207500 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207586 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207823 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.207922 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.208123 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.208209 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.208428 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.208513 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.208737 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.208831 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209043 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209130 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209354 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209479 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209680 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209782 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.209990 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210085 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210293 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210387 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210600 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210688 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210908 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.210994 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.211274 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.211376 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.211582 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.211669 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.211885 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.211971 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.212199 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.212285 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.212505 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.212593 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.212825 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.212920 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.213131 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.213220 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.213445 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.213545 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.213746 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.213833 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214055 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214151 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214368 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214454 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214683 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214775 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.214999 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.215110 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.215338 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.215424 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.215645 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.215733 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.215956 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216055 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216262 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216355 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216569 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216657 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216876 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.216979 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.217183 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.217325 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.217494 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.217646 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.217824 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218012 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218142 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218279 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218408 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218537 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218725 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.218864 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219030 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219217 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219355 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219490 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219655 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219786 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.219963 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.220107 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.220285 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.220421 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.220610 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.220752 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.220920 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221056 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221224 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221367 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221541 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221676 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221843 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.221977 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.222146 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.222294 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.222450 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.222584 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.222749 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.222840 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223050 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223213 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223381 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223512 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223692 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223821 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.223997 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.224138 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.224303 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.224433 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.224604 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.224747 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.224911 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225056 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225215 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225352 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225517 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225605 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225856 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.225992 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.226122 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.226251 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.226421 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.226569 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.226735 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.226867 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227051 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227235 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227377 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227512 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227687 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227830 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.227995 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.228132 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.228309 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.228443 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.228597 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.228736 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.228879 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229011 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229184 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229319 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229486 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229600 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229812 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.229940 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.230114 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.230253 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.230415 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.230505 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.230730 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.230866 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231032 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231199 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231367 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231503 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231675 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231811 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.231981 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.232124 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.232285 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.232419 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.232590 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.232734 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.232896 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233056 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233204 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233342 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233513 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233645 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233819 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.233950 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.234123 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.234255 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.234427 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.234559 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.234741 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.234873 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.235046 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.235213 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.235376 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.235513 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.235726 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.235879 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236012 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236153 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236288 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236432 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236575 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236708 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.236894 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.237103 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.237238 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.237433 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.237564 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.237744 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.237879 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.238055 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.238191 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.238403 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.238554 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.238700 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.238842 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239013 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239176 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239351 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239454 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239661 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239748 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.239979 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.240073 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.240341 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.240543 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.240671 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.240879 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.240965 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.241195 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.241282 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.241514 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.241610 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.241814 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.241906 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.242113 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.242209 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.242416 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.242511 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.242717 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.242804 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243015 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243200 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243337 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243438 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243636 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243726 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.243943 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244030 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244239 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244328 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244544 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244634 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244842 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.244929 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.245157 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.245245 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.245460 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.245556 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.245756 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.245843 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246054 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246145 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246352 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246439 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246658 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246744 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.246967 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.247056 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.247319 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.247406 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.247625 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.247721 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.247939 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.248027 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.248244 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.248330 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.248540 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.248634 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.249397 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.249495 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.249708 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.249795 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250009 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250109 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250310 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250405 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250616 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250703 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.250925 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251025 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251246 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251336 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251553 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251650 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251856 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.251956 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.252160 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.252249 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.252463 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.252550 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.252762 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.252850 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253064 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253151 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253362 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253448 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253671 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253765 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.253975 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254061 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254273 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254359 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254569 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254657 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254871 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.254965 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.255214 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.255315 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.255532 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.255622 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.255844 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.255931 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.256148 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.256252 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.256457 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.256544 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.256752 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.256837 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257050 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257145 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257347 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257434 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257645 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257740 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.257947 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258043 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258246 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258333 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258555 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258647 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258867 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.258985 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.259191 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.259284 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.259492 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.259579 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.259794 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.259883 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.260091 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.260177 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.260390 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.260477 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.260694 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.260784 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261005 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261094 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261316 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261403 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261622 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261711 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.261948 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262046 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262246 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262340 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262550 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262637 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262850 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.262945 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.263181 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.263284 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.263480 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.263566 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.263779 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.263866 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.264074 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.264169 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.264390 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.264506 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.265260 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.265354 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.265570 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.265684 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.265883 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.265970 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.266181 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.266274 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.266481 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.266569 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.266780 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.266873 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.267089 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.267191 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.267420 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.267508 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.267726 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.267814 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268031 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268126 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268338 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268426 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268644 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268731 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.268948 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269034 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269254 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269341 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269561 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269646 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269859 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.269957 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.270162 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.270248 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.270464 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.270549 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.270775 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.270870 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.271167 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.271258 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.271482 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.271568 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.271799 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.271896 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.272108 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.272198 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.272419 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.272505 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.272733 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.272827 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273047 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273145 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273355 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273488 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273651 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273743 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.273955 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274043 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274260 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274346 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274563 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274657 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274867 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.274952 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.275197 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.275288 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.275506 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.275594 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.275813 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.275908 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.276118 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.276205 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.276422 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.276510 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.276727 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.276814 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.277027 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.277114 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.277574 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.277668 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.277889 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.277976 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.278190 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.278288 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.278500 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.278591 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.278801 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.278887 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.279139 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.279243 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.279425 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.279519 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.279724 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.279811 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.280068 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.280169 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.280384 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.280474 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.280693 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.280811 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281005 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281116 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281319 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281409 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281628 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281716 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.281956 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282044 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282270 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282357 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282580 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282666 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282887 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.282980 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.283212 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.283302 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.283525 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.283611 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.283833 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.283922 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.284206 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.284299 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.284511 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.284606 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.284812 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.284899 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.285110 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.285196 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.285414 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.285509 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.285732 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.285820 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286031 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286117 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286328 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286423 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286627 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286714 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.286942 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.287053 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.287342 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.287444 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.287663 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.287757 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.287990 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.288077 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.288298 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.288386 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.288604 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.288691 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.288917 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289041 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289247 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289337 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289555 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289648 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289862 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.289950 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.290167 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.290255 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.290492 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.290588 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.290799 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.290892 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.291157 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.291250 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.291458 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.291565 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.291774 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.291862 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.292090 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.292178 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.292394 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.292561 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.292703 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.292875 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293003 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293189 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293318 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293516 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293653 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293842 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.293930 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.294170 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.294267 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.294479 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.294619 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.294797 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.294936 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.295127 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.295269 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.295459 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.295586 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.295811 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.295928 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.296127 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.296224 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.296443 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.296531 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.296749 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.296836 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297074 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297169 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297380 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297468 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297697 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297792 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.297995 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.298083 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.298300 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.298421 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.298604 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.298747 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.298906 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.299059 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.299224 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.299426 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.299514 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.299758 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.299848 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300065 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300218 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300374 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300476 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300687 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300781 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.300994 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.301082 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.301302 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.301435 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.301598 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.301684 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.301914 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302000 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302218 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302314 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302518 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302608 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302819 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.302906 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.303138 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.303241 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.303449 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.303545 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.303762 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.303848 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.304068 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.304156 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.304387 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.304473 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.304699 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.304786 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305001 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305088 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305325 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305419 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305629 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305718 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.305942 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306029 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306246 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306340 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306551 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306637 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306860 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.306948 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.307179 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.307267 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.307480 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.307584 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.307783 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.307871 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308079 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308170 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308379 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308474 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308677 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308765 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.308978 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.309065 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.309273 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.309369 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.309568 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.309702 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.309863 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310024 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310177 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310337 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310474 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310664 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310787 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.310988 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.311121 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.311854 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.311997 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.312169 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.312270 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.312473 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.312569 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.312779 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.312866 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.313088 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.313177 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.313394 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.313490 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.313696 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.313783 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314001 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314145 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314290 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314433 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314609 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314698 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314893 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.314979 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.315222 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.315314 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.315531 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.315618 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.315837 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.315924 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.316142 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.316230 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.316441 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.316527 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.316746 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.316839 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.317050 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.317137 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.317359 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.317447 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.317695 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.317956 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318064 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318283 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318371 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318592 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318687 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318901 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.318989 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.319229 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.319320 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.319540 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.319627 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.319849 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.319938 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.320155 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.320243 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.320461 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.320548 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.320765 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.320860 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.321070 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.321159 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.321386 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.321472 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.321699 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.321793 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322018 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322216 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322346 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322550 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322659 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322866 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.322955 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.323206 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.323299 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.323524 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.323623 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.323841 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.323967 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.324155 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.324260 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.324467 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.324556 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.324778 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.324866 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.325091 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.325191 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.325403 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.325535 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.325711 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.325814 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.326028 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.326137 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.326326 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.326425 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.326637 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.326748 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.327040 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.327654 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.327892 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328009 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328208 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328314 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328522 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328628 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328845 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.328943 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.329175 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.329363 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.329482 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.329582 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.329792 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.329889 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.330104 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.330202 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.330417 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.330504 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.330732 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.330926 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.331045 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.331265 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.331390 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.331593 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.331709 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.331913 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332010 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332233 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332329 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332543 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332632 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332855 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.332953 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.333176 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.333265 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.333551 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.333638 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.333856 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.333990 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.334167 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.334258 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.334472 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.334570 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.334773 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.334873 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.335108 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.335325 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.335415 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.335645 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.335745 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.335982 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.336071 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.336298 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.336392 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.336622 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.336822 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.336942 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.337169 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.337266 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.337482 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.337573 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.337803 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.337893 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.338121 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.338211 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.338435 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.338523 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.338737 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.338827 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339049 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339219 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339376 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339477 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339679 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339768 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.339991 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.340080 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.340297 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.340397 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.340596 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.340685 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.340899 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.341134 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.341270 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.341489 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.341628 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.341785 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.341920 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.342089 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.342257 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.342403 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.342564 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.342718 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.342850 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343019 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343192 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343343 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343433 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343640 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343734 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.343944 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344045 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344245 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344332 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344544 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344635 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344844 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.344940 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.345144 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.345232 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.345450 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.345538 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.345747 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.345847 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346052 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346140 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346351 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346439 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346656 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346751 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.346981 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.347067 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.347319 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.347412 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.347619 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.347708 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.347924 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348012 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348225 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348318 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348525 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348614 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348829 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.348915 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.349138 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.349225 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.349444 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.349540 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.349767 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.349855 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.350075 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.350175 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.350388 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.350483 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.350694 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.350782 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.351008 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.351273 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.351384 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.351607 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.351695 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.351926 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352014 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352256 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352345 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352586 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352681 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352892 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.352979 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.353194 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.353282 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.353497 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.353584 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.353819 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.353914 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.354128 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.354223 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.354437 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.354531 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.354743 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.354887 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.355050 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.355166 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.355380 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.355635 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.355722 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.355974 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356072 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356278 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356364 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356583 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356680 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356887 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.356975 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.357191 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.357279 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.357497 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.357600 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.357800 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.357897 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.358104 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.358233 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.358439 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.358605 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.358758 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.358844 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.359069 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.359184 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.359403 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.359503 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.359714 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.359801 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360021 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360107 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360326 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360423 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360633 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360719 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.360935 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361021 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361243 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361332 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361551 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361638 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361858 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.361945 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.362168 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.362257 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.362478 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.362573 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.362790 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.363152 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.363243 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.363478 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.363565 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.363797 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.363895 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.364114 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.364203 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.364421 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.364554 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.364734 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.364821 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365047 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365138 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365359 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365448 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365672 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365773 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.365988 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.366076 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.366321 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.366411 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.366637 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.366738 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.366945 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.367033 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.367303 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.367609 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.367704 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.367909 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.367999 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.368209 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.368298 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.368513 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.368613 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.368827 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.368921 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.369131 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.369218 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.369429 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.369534 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.369725 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.369813 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370027 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370124 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370326 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370422 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370623 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370711 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.370920 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.371057 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.371249 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.371414 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.371550 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.371742 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.371831 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372054 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372150 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372363 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372451 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372673 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372768 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.372975 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.373070 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.373273 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.373372 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.373576 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.373663 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.374389 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.374500 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.374689 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.374780 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.374988 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.375076 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.375311 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.375410 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.375610 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.375699 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.375917 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376004 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376225 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376314 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376536 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376624 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376844 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.376948 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.377144 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.377238 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.377447 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.377571 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.377748 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.377833 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378051 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378139 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378356 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378451 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378663 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378758 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.378966 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379054 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379345 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379481 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379603 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379698 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379908 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.379995 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.380220 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.380308 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.380553 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.380649 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.380889 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.380977 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.381208 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.381303 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.381534 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.381630 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.381848 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.381937 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.382147 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.382234 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.382466 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.382555 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.382780 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.382875 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.383109 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.383199 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.383423 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.383512 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.383728 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.383815 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384049 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384136 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384355 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384450 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384659 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384748 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.384962 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385057 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385267 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385362 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385570 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385658 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385878 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.385977 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.386182 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.386269 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.386487 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.386576 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.386795 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.386892 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.387120 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.387210 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.387444 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.387534 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.387767 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.387857 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.388068 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.388155 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.388386 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.388472 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.388707 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.388797 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.389019 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.389105 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.389332 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.389466 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.390210 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.390314 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.390529 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.390618 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.390844 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.390932 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.391187 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.391279 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.391504 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.391592 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.391747 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:30:41.391855 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.392122 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.392440 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.392771 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.393099 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.393414 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.393741 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.394072 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.394421 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.394737 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.395083 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.395437 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.395755 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.396070 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.396377 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:30:41.396621 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:30:41.544648 n-d-858238-3 devstack@n-api.service[111357]: INFO dbcounter [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Registered counter for database nova_api Nov 02 13:30:41.549033 n-d-858238-3 devstack@n-api.service[111358]: INFO dbcounter [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Registered counter for database nova_api Nov 02 13:30:41.567059 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_db.sqlalchemy.engines [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.569184 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_db.sqlalchemy.engines [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.573838 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writer thread running {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.575709 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writer thread running {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.630997 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.context [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=111357) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:30:41.632360 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.context [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=111358) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:30:41.634843 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:41.635345 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:41.636258 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_concurrency.lockutils [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:41.636729 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_concurrency.lockutils [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:41.636940 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:41.637657 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:41.638109 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:41.638314 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_concurrency.lockutils [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:41.639031 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_concurrency.lockutils [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:41.639504 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_concurrency.lockutils [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:41.640186 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:41.641495 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_concurrency.lockutils [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:41.642161 n-d-858238-3 devstack@n-api.service[111357]: INFO dbcounter [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Registered counter for database nova_cell0 Nov 02 13:30:41.643486 n-d-858238-3 devstack@n-api.service[111358]: INFO dbcounter [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Registered counter for database nova_cell0 Nov 02 13:30:41.646243 n-d-858238-3 devstack@n-api.service[111357]: INFO dbcounter [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Registered counter for database nova_cell1 Nov 02 13:30:41.647711 n-d-858238-3 devstack@n-api.service[111358]: INFO dbcounter [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Registered counter for database nova_cell1 Nov 02 13:30:41.653818 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_db.sqlalchemy.engines [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.656152 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_db.sqlalchemy.engines [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.656995 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_db.sqlalchemy.engines [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.659601 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_db.sqlalchemy.engines [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.663338 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writer thread running {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.664180 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writer thread running {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.664819 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writer thread running {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.669540 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writer thread running {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.810853 n-d-858238-3 devstack@n-api.service[111357]: INFO dbcounter [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Registered counter for database nova_cell0 Nov 02 13:30:41.811943 n-d-858238-3 devstack@n-api.service[111358]: INFO dbcounter [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Registered counter for database nova_cell0 Nov 02 13:30:41.819796 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_db.sqlalchemy.engines [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.821520 n-d-858238-3 devstack@n-api.service[111358]: DEBUG oslo_db.sqlalchemy.engines [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:30:41.824559 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writer thread running {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:41.826134 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writer thread running {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:30:42.159134 n-d-858238-3 devstack@n-api.service[111357]: WARNING keystonemiddleware.auth_token [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:30:42.163586 n-d-858238-3 devstack@n-api.service[111358]: WARNING keystonemiddleware.auth_token [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:30:42.166396 n-d-858238-3 devstack@n-api.service[111357]: WARNING keystonemiddleware.auth_token [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:30:42.171335 n-d-858238-3 devstack@n-api.service[111358]: WARNING keystonemiddleware.auth_token [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:30:42.505915 n-d-858238-3 devstack@n-api.service[111357]: WARNING keystonemiddleware.auth_token [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:30:42.511942 n-d-858238-3 devstack@n-api.service[111357]: WARNING keystonemiddleware.auth_token [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:30:42.513067 n-d-858238-3 devstack@n-api.service[111358]: WARNING keystonemiddleware.auth_token [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:30:42.517719 n-d-858238-3 devstack@n-api.service[111357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564578f769c0 pid: 111357 (default app) Nov 02 13:30:42.519538 n-d-858238-3 devstack@n-api.service[111358]: WARNING keystonemiddleware.auth_token [None req-1a086ad3-9c5a-47f7-94e0-1ab84748f478 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:30:42.519786 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:42.520956 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Nov 02 13:30:42.521351 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Nov 2 13:30:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:42.524886 n-d-858238-3 devstack@n-api.service[111358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564578f769c0 pid: 111358 (default app) Nov 02 13:32:03.610424 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:03.612220 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Nov 02 13:32:03.613017 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:03.630246 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_api:SELECT=3 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:03.631383 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_cell0:SELECT=3 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:03.632215 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_cell1:SELECT=3 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:03.633186 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:04.505433 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-8edea335-8087-480c-ba47-211133f91966 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:04.538344 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-8edea335-8087-480c-ba47-211133f91966 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918917 Nov 02 13:32:04.540870 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 13:32:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:07.196798 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:07.198418 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-a187c44e-0292-49b3-aadb-b84d9692f295 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Nov 02 13:32:07.201268 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:07.757061 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-87678955-8c9e-4061-8326-76792e9c358c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "id": "c1", "swap": 0, "name": "cirros256", "disk": 1}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:07.809069 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-87678955-8c9e-4061-8326-76792e9c358c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.604608 Nov 02 13:32:07.810247 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:07.827250 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_api:SELECT=3 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:07.828096 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_cell0:SELECT=3 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:07.830145 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_cell1:SELECT=3 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:07.830913 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:08.054912 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-ee57ae47-8faf-4536-a403-88765f0ae486 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:08.133951 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-ee57ae47-8faf-4536-a403-88765f0ae486 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.314574 Nov 02 13:32:08.134867 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 13:32:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:10.909868 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-87678955-8c9e-4061-8326-76792e9c358c admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:10.910885 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-87678955-8c9e-4061-8326-76792e9c358c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 02 13:32:10.911317 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:12.002804 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-8eeec3d0-5d4e-40bf-b3ce-2cd09c4839c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:12.082124 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-8eeec3d0-5d4e-40bf-b3ce-2cd09c4839c7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.163885 Nov 02 13:32:12.092849 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:12.101951 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-6607e5b9-ddaa-47b1-a26b-e4acfbb02b84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:12.162008 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-6607e5b9-ddaa-47b1-a26b-e4acfbb02b84 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064086 Nov 02 13:32:12.163232 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 13:32:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:15.042693 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-8eeec3d0-5d4e-40bf-b3ce-2cd09c4839c7 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:15.044323 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-8eeec3d0-5d4e-40bf-b3ce-2cd09c4839c7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Nov 02 13:32:15.054968 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:15.658423 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-41736282-7441-446f-b29f-0ca17a9f8c49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:15.693644 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-41736282-7441-446f-b29f-0ca17a9f8c49 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.641575 Nov 02 13:32:15.694281 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:15.719196 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-1ffbf1a8-7284-4209-a520-6d2db0ba1235 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:15.757692 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-1ffbf1a8-7284-4209-a520-6d2db0ba1235 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052614 Nov 02 13:32:15.758588 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 13:32:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:18.520777 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-41736282-7441-446f-b29f-0ca17a9f8c49 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:18.521788 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-41736282-7441-446f-b29f-0ca17a9f8c49 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 02 13:32:18.522933 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:19.216625 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-a98fb595-8a46-47cc-9bee-8068a7c81335 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:19.246921 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-a98fb595-8a46-47cc-9bee-8068a7c81335 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717769 Nov 02 13:32:19.248253 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:19.261555 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4da5ea1f-c697-4c3a-94c2-245728b1f2a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:19.299132 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4da5ea1f-c697-4c3a-94c2-245728b1f2a5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040773 Nov 02 13:32:19.299831 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 13:32:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:22.031878 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-a98fb595-8a46-47cc-9bee-8068a7c81335 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:22.034263 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-a98fb595-8a46-47cc-9bee-8068a7c81335 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002848 Nov 02 13:32:22.040004 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:22.515447 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-9b234f7f-20f1-448a-a758-6a1f012a87f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "ram": 4096}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:22.539977 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-9b234f7f-20f1-448a-a758-6a1f012a87f5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498450 Nov 02 13:32:22.540570 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:22.553357 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-d14179bd-4428-4cbf-ad8c-96d686b4205d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:22.579650 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-d14179bd-4428-4cbf-ad8c-96d686b4205d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029951 Nov 02 13:32:22.584128 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 13:32:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:25.334906 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-9b234f7f-20f1-448a-a758-6a1f012a87f5 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:25.336067 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-9b234f7f-20f1-448a-a758-6a1f012a87f5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Nov 02 13:32:25.336589 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:25.804652 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-e89f983e-af31-46bb-9d2d-428c65873d10 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:25.829909 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-e89f983e-af31-46bb-9d2d-428c65873d10 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.484147 Nov 02 13:32:25.830394 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 13:32:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:28.415781 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-9b234f7f-20f1-448a-a758-6a1f012a87f5 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:28.416836 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-9b234f7f-20f1-448a-a758-6a1f012a87f5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Nov 02 13:32:28.417246 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:28.856850 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-06f79786-a863-498e-94ea-d8984649999d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:28.878675 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-06f79786-a863-498e-94ea-d8984649999d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454218 Nov 02 13:32:28.879256 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:32:28.891973 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-17bfe103-23b3-4c63-bfdd-0ac1bc850c0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:28.920588 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-17bfe103-23b3-4c63-bfdd-0ac1bc850c0a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032905 Nov 02 13:32:28.921273 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 13:32:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:31.829680 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-06f79786-a863-498e-94ea-d8984649999d admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:31.830609 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-06f79786-a863-498e-94ea-d8984649999d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Nov 02 13:32:31.831014 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:32.228210 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-6e4e435f-eac3-49dc-9c8a-3eb7a2b6b4c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "swap": 0, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:32.246842 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-6e4e435f-eac3-49dc-9c8a-3eb7a2b6b4c3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409426 Nov 02 13:32:32.247502 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:32.260141 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-1c48ee9f-6392-4b74-92e3-d83becb2971f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:32.284787 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-1c48ee9f-6392-4b74-92e3-d83becb2971f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028285 Nov 02 13:32:32.285359 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 13:32:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:34.915386 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-6e4e435f-eac3-49dc-9c8a-3eb7a2b6b4c3 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:34.916436 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-6e4e435f-eac3-49dc-9c8a-3eb7a2b6b4c3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Nov 02 13:32:34.916840 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:35.336238 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-936bc554-d8d0-45e7-9a57-35cc161f803d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:35.355897 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-936bc554-d8d0-45e7-9a57-35cc161f803d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431794 Nov 02 13:32:35.356460 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:35.368578 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-1253320f-8bd5-4f5f-987d-66ab683ea42a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:35.373479 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:35.400280 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-1253320f-8bd5-4f5f-987d-66ab683ea42a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035303 Nov 02 13:32:35.404663 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 13:32:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:38.042696 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-936bc554-d8d0-45e7-9a57-35cc161f803d admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.044341 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-936bc554-d8d0-45e7-9a57-35cc161f803d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Nov 02 13:32:38.044870 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:38.489927 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-5f591201-b12a-42bb-92ca-6304f81a89a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:38.513531 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-5f591201-b12a-42bb-92ca-6304f81a89a1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462453 Nov 02 13:32:38.514089 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:38.526947 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-bfda63f3-4aa5-43d6-a9ad-03473b485f4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:38.532746 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:38.556518 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-bfda63f3-4aa5-43d6-a9ad-03473b485f4b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033164 Nov 02 13:32:38.559513 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 13:32:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:41.197841 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-5f591201-b12a-42bb-92ca-6304f81a89a1 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:41.198941 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-5f591201-b12a-42bb-92ca-6304f81a89a1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 02 13:32:41.199581 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:32:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:41.648185 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-229723b6-ae45-4d99-8d47-3beec4954925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "name": "m1.xlarge"}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:41.668521 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-229723b6-ae45-4d99-8d47-3beec4954925 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460871 Nov 02 13:32:41.669111 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 13:32:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:32:41.682056 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-d12fd4c2-2d9f-4f76-93b1-f1de71a8d439 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:41.707469 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-d12fd4c2-2d9f-4f76-93b1-f1de71a8d439 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029814 Nov 02 13:32:41.708112 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 13:32:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:02.746534 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-229723b6-ae45-4d99-8d47-3beec4954925 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:02.747581 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-229723b6-ae45-4d99-8d47-3beec4954925 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Nov 02 13:33:02.747970 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:33:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:02.758933 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:03.136577 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-b1fc6e7a-dc38-44fa-bd96-93e8c7da368e admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:03.154235 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-b1fc6e7a-dc38-44fa-bd96-93e8c7da368e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399799 Nov 02 13:33:03.154772 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 13:33:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:04.468351 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-229723b6-ae45-4d99-8d47-3beec4954925 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:04.469342 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-229723b6-ae45-4d99-8d47-3beec4954925 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 02 13:33:04.469761 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:05.000833 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-d1007fb6-14d1-424c-ac03-9b943fd19e39 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.006078 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.wsgi [None req-d1007fb6-14d1-424c-ac03-9b943fd19e39 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-d1007fb6-14d1-424c-ac03-9b943fd19e39 admin admin] Request method failure captured: Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Accept: application/json Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Accept-Encoding: gzip, deflate Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Connection: keep-alive Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Content-Length: 0 Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Host: 10.222.0.18 Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Openstack-Api-Version: compute 2.92 Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: Openstack-System-Scope: None Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: User-Agent: python-novaclient Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Auth-Token: gAAAAABjYnGQheSN5iPu9ygkiqVY-KWu3wwF612Q7L9ghI19X-TBt6rBGq9_uQjwNDP-CsCwt2SIoXcUkhSWDWvZLA18Qsh0OWQajg8HCWc8UisEG8g3z5Ey-x6RMeUfnjFcJ-2yV7nIytCojW_D_LmT02T7lvZhmy641NhNucT9F0pz5f33uLY Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Domain-Id: None Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Domain-Name: None Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Identity-Status: Confirmed Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Is-Admin-Project: True Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Domain-Id: default Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Domain-Name: Default Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Name: admin Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Role: member,admin,reader Nov 02 13:33:05.009314 n-d-858238-3 devstack@n-api.service[111358]: X-Roles: member,admin,reader Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cae8ade2bc4407083a6b2cd21fe1353"}]}] Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant: admin Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant-Name: admin Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-User: admin Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-User-Domain-Id: default Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-User-Domain-Name: Default Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-User-Id: f87e3ccb862a435e8f437a632d31d926 Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: X-User-Name: admin Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: method: > Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: exception: Flavor 42 could not be found. Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: action_args: {'id': '42'} Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:05.011056 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:05.012007 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.013172 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-d1007fb6-14d1-424c-ac03-9b943fd19e39 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:05.014274 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-d1007fb6-14d1-424c-ac03-9b943fd19e39 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388447 Nov 02 13:33:05.014594 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 13:33:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:33:05.020800 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-3fecd5b6-58f9-4ac1-ba72-8f50559c61b2 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.024876 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:05.044622 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-3fecd5b6-58f9-4ac1-ba72-8f50559c61b2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027453 Nov 02 13:33:05.045153 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:05.057047 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-0fdcb53d-841c-418a-8a1e-ddea60fe1826 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.078621 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-0fdcb53d-841c-418a-8a1e-ddea60fe1826 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026212 Nov 02 13:33:05.079177 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:05.089411 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-75a684b7-1505-45f3-818a-b280a16ee642 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.095702 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.wsgi [None req-75a684b7-1505-45f3-818a-b280a16ee642 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-75a684b7-1505-45f3-818a-b280a16ee642 admin admin] Request method failure captured: Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Accept: application/json Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Accept-Encoding: gzip, deflate Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Connection: keep-alive Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Content-Length: 0 Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Host: 10.222.0.18 Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Openstack-Api-Version: compute 2.92 Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: Openstack-System-Scope: None Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: User-Agent: python-novaclient Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Auth-Token: gAAAAABjYnGQheSN5iPu9ygkiqVY-KWu3wwF612Q7L9ghI19X-TBt6rBGq9_uQjwNDP-CsCwt2SIoXcUkhSWDWvZLA18Qsh0OWQajg8HCWc8UisEG8g3z5Ey-x6RMeUfnjFcJ-2yV7nIytCojW_D_LmT02T7lvZhmy641NhNucT9F0pz5f33uLY Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Domain-Id: None Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Domain-Name: None Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Identity-Status: Confirmed Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Is-Admin-Project: True Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Domain-Id: default Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Domain-Name: Default Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Name: admin Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Role: member,admin,reader Nov 02 13:33:05.098910 n-d-858238-3 devstack@n-api.service[111357]: X-Roles: member,admin,reader Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cae8ade2bc4407083a6b2cd21fe1353"}]}] Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant: admin Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant-Name: admin Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-User: admin Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-User-Domain-Id: default Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-User-Domain-Name: Default Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-User-Id: f87e3ccb862a435e8f437a632d31d926 Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: X-User-Name: admin Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: method: > Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: exception: Flavor 42 could not be found. Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: action_args: {'id': '42'} Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:05.100993 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:05.102100 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:05.103428 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-75a684b7-1505-45f3-818a-b280a16ee642 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:05.104640 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-75a684b7-1505-45f3-818a-b280a16ee642 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015342 Nov 02 13:33:05.104640 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 13:33:06.299371 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-0fdcb53d-841c-418a-8a1e-ddea60fe1826 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.300387 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-0fdcb53d-841c-418a-8a1e-ddea60fe1826 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Nov 02 13:33:06.300787 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:06.828593 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-f0bba50a-4b34-4583-a84f-5be2a9fbe1e0 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.834287 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.wsgi [None req-f0bba50a-4b34-4583-a84f-5be2a9fbe1e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-f0bba50a-4b34-4583-a84f-5be2a9fbe1e0 admin admin] Request method failure captured: Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Accept: application/json Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Accept-Encoding: gzip, deflate Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Connection: keep-alive Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Content-Length: 0 Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Host: 10.222.0.18 Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Openstack-Api-Version: compute 2.92 Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: Openstack-System-Scope: None Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: User-Agent: python-novaclient Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Auth-Token: gAAAAABjYnGSC-He89op9zg32uu4B4rW1HYh_UfBNL4hAYuefji8BhXGMc7X3Ff12KNLgBWqmencYcbxZbCz3sNcv0VdSu245wvOZVKebHGvyXPx-ZtVZiR4EsxDckeQROaXySK6kqkK2I9I96oDcVE2xnW7jQNpqGqhII8XLw4swXISWkPfK0U Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Domain-Id: None Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Domain-Name: None Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Identity-Status: Confirmed Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Is-Admin-Project: True Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Domain-Id: default Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Domain-Name: Default Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Name: admin Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Role: member,admin,reader Nov 02 13:33:06.835826 n-d-858238-3 devstack@n-api.service[111357]: X-Roles: member,admin,reader Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cae8ade2bc4407083a6b2cd21fe1353"}]}] Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant: admin Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant-Name: admin Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-User: admin Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-User-Domain-Id: default Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-User-Domain-Name: Default Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-User-Id: f87e3ccb862a435e8f437a632d31d926 Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: X-User-Name: admin Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: method: > Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: exception: Flavor 84 could not be found. Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: action_args: {'id': '84'} Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:06.837329 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.838276 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.839712 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-f0bba50a-4b34-4583-a84f-5be2a9fbe1e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:06.840984 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-f0bba50a-4b34-4583-a84f-5be2a9fbe1e0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398421 Nov 02 13:33:06.840984 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:33:06.846968 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-7d028772-12ae-40b0-bac3-c592ef8a58f7 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.862570 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-7d028772-12ae-40b0-bac3-c592ef8a58f7 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019150 Nov 02 13:33:06.863222 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:06.872797 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-26a863e4-2454-4d18-9c7b-bb09b966b428 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.888562 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-26a863e4-2454-4d18-9c7b-bb09b966b428 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019263 Nov 02 13:33:06.889239 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:06.898158 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-9cda0f54-c48a-4959-9bdc-94eca686cffc admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.903040 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.wsgi [None req-9cda0f54-c48a-4959-9bdc-94eca686cffc admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-9cda0f54-c48a-4959-9bdc-94eca686cffc admin admin] Request method failure captured: Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Accept: application/json Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Accept-Encoding: gzip, deflate Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Connection: keep-alive Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Content-Length: 0 Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Host: 10.222.0.18 Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Openstack-Api-Version: compute 2.92 Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: Openstack-System-Scope: None Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: User-Agent: python-novaclient Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Auth-Token: gAAAAABjYnGSC-He89op9zg32uu4B4rW1HYh_UfBNL4hAYuefji8BhXGMc7X3Ff12KNLgBWqmencYcbxZbCz3sNcv0VdSu245wvOZVKebHGvyXPx-ZtVZiR4EsxDckeQROaXySK6kqkK2I9I96oDcVE2xnW7jQNpqGqhII8XLw4swXISWkPfK0U Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Domain-Id: None Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Domain-Name: None Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Identity-Status: Confirmed Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Is-Admin-Project: True Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Domain-Id: default Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Domain-Name: Default Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Name: admin Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Role: member,admin,reader Nov 02 13:33:06.904550 n-d-858238-3 devstack@n-api.service[111358]: X-Roles: member,admin,reader Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cae8ade2bc4407083a6b2cd21fe1353"}]}] Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant: admin Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant-Name: admin Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-User: admin Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-User-Domain-Id: default Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-User-Domain-Name: Default Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-User-Id: f87e3ccb862a435e8f437a632d31d926 Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: X-User-Name: admin Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: method: > Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: exception: Flavor 84 could not be found. Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: action_args: {'id': '84'} Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:06.906251 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.907077 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.908214 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-9cda0f54-c48a-4959-9bdc-94eca686cffc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:06.909201 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-9cda0f54-c48a-4959-9bdc-94eca686cffc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011463 Nov 02 13:33:06.909201 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:33:08.110012 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-26a863e4-2454-4d18-9c7b-bb09b966b428 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.111204 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-26a863e4-2454-4d18-9c7b-bb09b966b428 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 02 13:33:08.111600 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:08.636577 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4f293766-a71b-4b85-a2f7-e79f0e1edf95 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.642217 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.wsgi [None req-4f293766-a71b-4b85-a2f7-e79f0e1edf95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4f293766-a71b-4b85-a2f7-e79f0e1edf95 admin admin] Request method failure captured: Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Accept: application/json Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Accept-Encoding: gzip, deflate Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Connection: keep-alive Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Content-Length: 0 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Host: 10.222.0.18 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Openstack-Api-Version: compute 2.92 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: Openstack-System-Scope: None Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: User-Agent: python-novaclient Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Auth-Token: gAAAAABjYnGUzTige3AOzK0oFwLhJD_-H46G0JiROxrGifqo_iUOk9bWdz6kmHqtv_Gr2yo4Sq27yQ9BszQtTDidhlbQM0moMyNcMi_ujxxKnQnuLfl012EmD4huveE3wdZ4n-UKC1ZojoD26nQI1sx6fNTzIqTM9_DE1-6iSOZ0Rsf6QYgwoS0 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Domain-Id: None Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Domain-Name: None Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Identity-Status: Confirmed Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Is-Admin-Project: True Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Domain-Id: default Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Domain-Name: Default Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Project-Name: admin Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Role: member,admin,reader Nov 02 13:33:08.643773 n-d-858238-3 devstack@n-api.service[111358]: X-Roles: member,admin,reader Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cae8ade2bc4407083a6b2cd21fe1353"}]}] Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant: admin Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-Tenant-Name: admin Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-User: admin Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-User-Domain-Id: default Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-User-Domain-Name: Default Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-User-Id: f87e3ccb862a435e8f437a632d31d926 Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: X-User-Name: admin Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: method: > Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: exception: Flavor 451 could not be found. Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: action_args: {'id': '451'} Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:08.645285 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:08.646127 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.647195 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4f293766-a71b-4b85-a2f7-e79f0e1edf95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:08.648307 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4f293766-a71b-4b85-a2f7-e79f0e1edf95 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395566 Nov 02 13:33:08.648307 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:33:08.654564 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-1dec8ba9-374a-4383-89ff-6f289598e39f admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.669374 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-1dec8ba9-374a-4383-89ff-6f289598e39f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018300 Nov 02 13:33:08.669891 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:08.679614 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.694814 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018715 Nov 02 13:33:08.695378 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:08.704417 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-eb04b325-489d-4a51-9977-0df4a50a843a admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.709202 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.wsgi [None req-eb04b325-489d-4a51-9977-0df4a50a843a admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-eb04b325-489d-4a51-9977-0df4a50a843a admin admin] Request method failure captured: Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Accept: application/json Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Accept-Encoding: gzip, deflate Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Connection: keep-alive Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Content-Length: 0 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Host: 10.222.0.18 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Openstack-Api-Version: compute 2.92 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: Openstack-System-Scope: None Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: User-Agent: python-novaclient Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Auth-Token: gAAAAABjYnGUzTige3AOzK0oFwLhJD_-H46G0JiROxrGifqo_iUOk9bWdz6kmHqtv_Gr2yo4Sq27yQ9BszQtTDidhlbQM0moMyNcMi_ujxxKnQnuLfl012EmD4huveE3wdZ4n-UKC1ZojoD26nQI1sx6fNTzIqTM9_DE1-6iSOZ0Rsf6QYgwoS0 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Domain-Id: None Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Domain-Name: None Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Identity-Status: Confirmed Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Is-Admin-Project: True Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Domain-Id: default Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Domain-Name: Default Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Project-Name: admin Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Role: member,admin,reader Nov 02 13:33:08.710702 n-d-858238-3 devstack@n-api.service[111357]: X-Roles: member,admin,reader Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8cae8ade2bc4407083a6b2cd21fe1353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8cae8ade2bc4407083a6b2cd21fe1353"}]}] Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant: admin Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant-Id: 8cae8ade2bc4407083a6b2cd21fe1353 Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-Tenant-Name: admin Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-User: admin Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-User-Domain-Id: default Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-User-Domain-Name: Default Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-User-Id: f87e3ccb862a435e8f437a632d31d926 Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: X-User-Name: admin Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: method: > Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: exception: Flavor 451 could not be found. Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: action_args: {'id': '451'} Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:08.712265 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:08.714037 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: ERROR nova.api.openstack.wsgi Nov 02 13:33:08.715432 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-eb04b325-489d-4a51-9977-0df4a50a843a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:08.716479 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-eb04b325-489d-4a51-9977-0df4a50a843a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011086 Nov 02 13:33:08.716479 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:33:09.945478 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:09.946489 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 02 13:33:09.946880 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:10.485157 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-551609c9-4e55-4fa6-93ae-1a1ef67b435c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:10.505183 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-551609c9-4e55-4fa6-93ae-1a1ef67b435c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.420492 Nov 02 13:33:10.505731 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 13:33:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:33:11.703854 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:11.705540 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Nov 02 13:33:11.705935 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:12.222063 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-e3155753-48d4-456e-b41f-df6c28f8fa89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:12.240900 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-e3155753-48d4-456e-b41f-df6c28f8fa89 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398553 Nov 02 13:33:12.241439 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 13:33:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:33:13.438525 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:13.440099 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Nov 02 13:33:13.440490 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:13.958176 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-8c26b5b5-2220-45e7-9a99-dec0af06e32a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:13.977048 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-8c26b5b5-2220-45e7-9a99-dec0af06e32a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399452 Nov 02 13:33:13.977586 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 13:33:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:33:15.186234 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.187324 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 02 13:33:15.187748 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:15.706650 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-1b4a701d-3306-4dac-906b-781c2f05722c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:15.725178 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-1b4a701d-3306-4dac-906b-781c2f05722c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399926 Nov 02 13:33:15.725733 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 13:33:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:33:16.918566 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:16.919601 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 02 13:33:16.919996 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:17.437696 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-a0f3b9e0-7b3b-447c-89a8-a385467e2bf0 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:17.457949 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-a0f3b9e0-7b3b-447c-89a8-a385467e2bf0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402016 Nov 02 13:33:17.458464 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Nov 2 13:33:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:34:14.014223 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.015178 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-4bae0644-19fc-483a-bea9-a42e93d973e6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 02 13:34:14.015581 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:14.026096 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:14.430092 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-47404d23-52ef-4843-8372-99a764d57cdc admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.450623 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-47404d23-52ef-4843-8372-99a764d57cdc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429134 Nov 02 13:34:14.451730 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:34:14.473289 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_api:SELECT=14 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:14.477106 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-2870b010-4381-4479-aa67-b06b4c6468ed admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.485154 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-2870b010-4381-4479-aa67-b06b4c6468ed admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013292 Nov 02 13:34:14.485691 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:14.497616 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-e4af25cf-72ec-4cc0-bdca-aa6359cef9c0 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.504857 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-e4af25cf-72ec-4cc0-bdca-aa6359cef9c0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010815 Nov 02 13:34:14.505374 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:14.517255 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-05793563-6542-405c-8598-093068240b88 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.524669 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-05793563-6542-405c-8598-093068240b88 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011595 Nov 02 13:34:14.532356 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:14.538201 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-33750c99-3ded-4843-aea5-79406b450074 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.545674 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-33750c99-3ded-4843-aea5-79406b450074 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011059 Nov 02 13:34:14.546190 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:24.968780 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-05793563-6542-405c-8598-093068240b88 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:24.969789 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-05793563-6542-405c-8598-093068240b88 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 02 13:39:24.970181 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:25.110696 n-d-858238-3 devstack@n-api.service[111357]: DEBUG dbcounter [-] [111357] Writing DB stats nova_api:SELECT=6 {{(pid=111357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:25.257736 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:25.263222 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.263700 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.264128 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.264838 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.265296 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.265713 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.304590 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-b4a852d9-d01a-4599-afe3-a47bc4ec903c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.195104 Nov 02 13:39:25.305160 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:39:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:26.355531 n-d-858238-3 devstack@n-api.service[111358]: DEBUG nova.api.openstack.wsgi [None req-05793563-6542-405c-8598-093068240b88 admin admin] Calling method '>' {{(pid=111358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.356527 n-d-858238-3 devstack@n-api.service[111358]: INFO nova.api.openstack.requestlog [None req-05793563-6542-405c-8598-093068240b88 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 02 13:39:26.356921 n-d-858238-3 devstack@n-api.service[111358]: [pid: 111358|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 13:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:26.547016 n-d-858238-3 devstack@n-api.service[111357]: DEBUG nova.api.openstack.wsgi [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Calling method '>' {{(pid=111357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.550371 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.550843 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.551295 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.551997 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.552435 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.552851 n-d-858238-3 devstack@n-api.service[111357]: DEBUG oslo_concurrency.lockutils [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.575529 n-d-858238-3 devstack@n-api.service[111357]: INFO nova.api.openstack.requestlog [None req-e32c2787-975f-4173-99b6-a31e69512e18 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080301 Nov 02 13:39:26.576001 n-d-858238-3 devstack@n-api.service[111357]: [pid: 111357|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:39:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:11.989220 n-d-858238-3 devstack@n-api.service[111356]: Wed Nov 2 13:40:11 2022 - graceful shutdown triggered... Nov 02 13:40:11.989753 n-d-858238-3 devstack@n-api.service[111357]: Gracefully killing worker 1 (pid: 111357)... Nov 02 13:40:11.990114 n-d-858238-3 devstack@n-api.service[111358]: Gracefully killing worker 2 (pid: 111358)... Nov 02 13:40:11.991301 n-d-858238-3 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 13:40:12.116347 n-d-858238-3 devstack@n-api.service[111358]: DEBUG dbcounter [-] [111358] Writing DB stats nova_api:SELECT=4 {{(pid=111358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:12.990351 n-d-858238-3 devstack@n-api.service[111356]: worker 1 buried after 1 seconds Nov 02 13:40:12.990351 n-d-858238-3 devstack@n-api.service[111356]: worker 2 buried after 1 seconds Nov 02 13:40:12.990936 n-d-858238-3 devstack@n-api.service[111356]: goodbye to uWSGI. Nov 02 13:40:12.991966 n-d-858238-3 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 13:40:12.992548 n-d-858238-3 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 13:40:12.995276 n-d-858238-3 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 13:40:13.015817 n-d-858238-3 devstack@n-api.service[137543]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 13:40:13 2022] *** Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: nodename: n-d-858238-3 Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: machine: x86_64 Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: clock source: unix Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: pcre jit disabled Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: detected number of CPU cores: 4 Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: current working directory: / Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: detected binary path: /usr/bin/uwsgi-core Nov 02 13:40:13.034722 n-d-858238-3 devstack@n-api.service[137543]: your processes number limit is 47680 Nov 02 13:40:13.035618 n-d-858238-3 devstack@n-api.service[137543]: your memory page size is 4096 bytes Nov 02 13:40:13.035618 n-d-858238-3 devstack@n-api.service[137543]: detected max file descriptor number: 2048 Nov 02 13:40:13.035618 n-d-858238-3 devstack@n-api.service[137543]: lock engine: pthread robust mutexes Nov 02 13:40:13.035618 n-d-858238-3 devstack@n-api.service[137543]: thunder lock: enabled Nov 02 13:40:13.035618 n-d-858238-3 devstack@n-api.service[137543]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 13:40:13.035618 n-d-858238-3 devstack@n-api.service[137543]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 13:40:13.076367 n-d-858238-3 devstack@n-api.service[137543]: Python main interpreter initialized at 0x555ae35579c0 Nov 02 13:40:13.076367 n-d-858238-3 devstack@n-api.service[137543]: python threads support enabled Nov 02 13:40:13.076367 n-d-858238-3 devstack@n-api.service[137543]: your server socket listen backlog is limited to 100 connections Nov 02 13:40:13.076367 n-d-858238-3 devstack@n-api.service[137543]: your mercy for graceful operations on workers is 90 seconds Nov 02 13:40:13.076830 n-d-858238-3 devstack@n-api.service[137543]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 13:40:13.076830 n-d-858238-3 devstack@n-api.service[137543]: *** Operational MODE: preforking *** Nov 02 13:40:13.077058 n-d-858238-3 devstack@n-api.service[137543]: *** uWSGI is running in multiple interpreter mode *** Nov 02 13:40:13.077058 n-d-858238-3 devstack@n-api.service[137543]: spawned uWSGI master process (pid: 137543) Nov 02 13:40:13.077282 n-d-858238-3 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 13:40:13.077963 n-d-858238-3 devstack@n-api.service[137543]: spawned uWSGI worker 1 (pid: 137558, cores: 1) Nov 02 13:40:13.078280 n-d-858238-3 devstack@n-api.service[137543]: spawned uWSGI worker 2 (pid: 137559, cores: 1) Nov 02 13:40:13.078440 n-d-858238-3 devstack@n-api.service[137543]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 13:40:13.739978 n-d-858238-3 devstack@n-api.service[137559]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:40:13.740559 n-d-858238-3 devstack@n-api.service[137558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:40:14.993603 n-d-858238-3 devstack@n-api.service[137559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:40:14.993603 n-d-858238-3 devstack@n-api.service[137559]: from cryptography.utils import int_from_bytes Nov 02 13:40:14.994227 n-d-858238-3 devstack@n-api.service[137559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:40:14.994227 n-d-858238-3 devstack@n-api.service[137559]: from cryptography.utils import int_from_bytes Nov 02 13:40:14.994385 n-d-858238-3 devstack@n-api.service[137558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:40:14.994385 n-d-858238-3 devstack@n-api.service[137558]: from cryptography.utils import int_from_bytes Nov 02 13:40:14.994927 n-d-858238-3 devstack@n-api.service[137558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:40:14.994927 n-d-858238-3 devstack@n-api.service[137558]: from cryptography.utils import int_from_bytes Nov 02 13:40:17.432878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:40:17.433587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:40:17.433670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:40:17.434024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:40:17.434845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:40:17.435266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.435596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.435916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.436235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.436561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.436869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.437190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.437508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.437831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.438087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.438399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.438720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858238-3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.439039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.439389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.439700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.440016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.440317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.440650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.440938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.441440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.442822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.442822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.442822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.442822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.443444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.443444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.443891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.444134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.444350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.444590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.445048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858238-3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.445303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.445634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.446070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.446700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.446957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.447240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.447634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.447969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.448283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.448602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.448923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.449101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:40:17.449615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.449811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:40:17.450002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.450002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.450293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:40:17.450467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.450645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:40:17.450810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.450962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:40:17.451146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.451370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.451627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.451788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.451932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.452991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.453134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.453283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.453438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.453438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.453728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.453881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.454102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.454263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.454408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.454564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.454727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.454878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858238-3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.455968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.456120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.456273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.456423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.456565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.457113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.457277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.457433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.457589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.457741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.457902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.458971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.459180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.459332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.459487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.459649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.459801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.459953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.460102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.460254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.460405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.460556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.460708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.460866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.461017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.461173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.461173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.461599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858238-3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.461790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.461945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.462098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.462249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.462411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.462556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.462709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.462860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.463944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.464968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.465111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.465268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.465426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.465587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.465731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.465873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.466896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.467048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.467242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.467413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.467568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.467718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.467885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.468932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.469976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.470138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.470290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.470434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.470576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.470726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.470885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.471030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.471211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.471356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.471509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.471660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.471816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.473183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.473374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.473537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.473700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.473847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.474783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.475086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.475334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.475494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.475640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.475794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.475946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.476090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.476241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.476397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.476548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.476701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.476858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.477016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.477304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.477459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.477604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.477758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.477903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.478933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.479086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.479086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.479418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.479563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.479713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.479857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.480000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.480142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.480357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.480357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.480660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.480821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.480966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.481632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.481787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.481938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.482082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.482224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.482407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.482572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.482717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.482871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.483020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.483248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.483397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.483565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.483718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.483876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.484028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.484180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.484324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.484476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.484638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.484790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.484951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.485125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.485289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.485444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.485600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.485746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.485887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.486036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.486189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.486342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.486486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.486628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.486778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.486939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.487110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.487263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.487406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.487560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.487704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.487865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.488011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.488161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.488305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.488460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.488604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.488754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.488909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.489052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.489194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.489345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.489496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.489653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.489798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.489948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.490099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.490251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.490402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.490554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.490715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.490859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.491015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.491264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.491412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.491562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.491707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.491856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.492014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.492169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.492386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.492521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.492649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.492746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.492836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.492918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.493016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.493109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.493209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.493302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.493392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.493493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.493578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.493661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.493661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.493819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.493910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.494007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.494092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.494175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.494258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.494340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.494422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.494518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.494610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.494695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.494786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.494870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.494969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:40:17.495062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.495949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.496964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.497924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.498101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.498250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.498395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.498551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.498708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.498860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.499956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.500099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.500256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.500408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.500551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.500706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.500850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.501893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.502054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.502198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.502350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.502553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.502705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.502927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.503108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.503264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.503421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.503567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.503717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.503870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.504911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.505955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.506097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.506247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.506398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.506552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.506703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.506848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.507980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.508123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.508275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.508540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.508697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.508850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.509740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.510919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.511985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.512129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.512776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.512942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.513993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.514149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.514292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.514441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.514584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.514734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.514893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.515055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.515258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.515428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.515587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.515738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.515895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.516948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.517100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.517274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.517441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.517602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.517762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.518978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.519956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.520256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.520413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.520576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.520751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.520919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.521070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.521227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.521379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.521556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.521714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.521864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.522933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.523124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.523300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.523461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.523621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.523783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.523783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.524200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.524362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.524522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.524672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.524839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.525599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.525766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.525932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.526091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.526242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.526405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.526405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.526699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.526699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.527005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.527179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.527336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.527499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.527662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.527662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.528493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.528768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.528932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.529083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.529248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.529406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.529564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.529716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.529873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.530965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.531191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.531350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.531501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.531659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.531818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.532232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.532384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.532533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.532682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.532840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.533005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.533178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.533405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.533570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.533729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.533888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.534039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.534268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.534429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.534588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.534747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.534906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.535057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.535254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.535408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.535570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.535721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.535878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.536974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.537127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.537283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.537441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.537615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.537766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.537766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.538081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.538231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.538380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.538540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.538690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.538849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.539006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.539216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.539374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.539543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.539694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.539854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.540939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.541906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.542948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.543980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.544959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.545993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.546166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.546290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.546475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.546598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.546769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.546927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.547087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.547249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.547416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.547593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.547721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.547847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.548994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.549154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.549401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.549551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.549688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.549831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.549974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.550958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.551995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.552141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.552302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.552439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.552605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.552744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.552915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.553052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.553223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.553373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.553513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.553645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.553859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.554998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.555331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.555475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.555607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.555746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.555880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.556958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.557104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.557281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.557419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.557614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.557759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.557943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.558993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.559189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.559341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.559571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.559718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.559858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.559990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.560123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.560331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.560480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.560611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.560743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.560883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.561970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.562110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.562252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.562425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.562570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.562716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.562856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.563918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.564956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.565111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.565257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.565400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.565534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.565698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.565833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.566929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.567175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.567320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.567462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.567594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.567726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.567857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.568984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.569134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.569274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.569415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.569563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.569798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.569933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.570063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.570191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.570354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.570497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.570644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.570781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.571890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.572977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.573115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.573260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.573393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.573568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.573715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.573870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.574015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.574176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.574311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.574479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.574621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.575310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.575467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.575627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.575769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.575934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.576996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.577161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.577328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.577470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.577601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.577756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.577891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.578127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.578343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.578343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.578602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.578742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.578887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.579867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.580876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.581042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.581353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.581487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.581658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.581802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.581964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.582102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.582268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.582417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.582557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.582689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.582862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.583006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.583191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.583348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.583490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.583629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.583868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.584845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.585949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.586088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.586262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.586407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.586653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.586796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.586943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.587922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.588983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.589119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.589304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.589450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.589618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.589761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.589931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.590067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.590253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.590440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.591143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.591284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.591474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.591611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.591780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.591932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.592093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.592237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.592407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.592550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.592718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.592944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.593948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.594972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.595170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.595311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.595531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.595637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.595844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.595955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.596153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.596251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.596479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.596586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.596792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.596902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.597093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.597207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.597395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.597496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.597701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.597801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.598001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.598106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.598304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.598405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.598624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.598930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.599037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.599265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.599399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.599579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.599701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.599891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.600937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.601096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.601246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.601419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.601563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.601733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.601870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.602055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.602306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.602439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.602571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.602777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.602913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.603087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.603271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.603416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.603564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.603705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.603844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.604953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.605088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.605276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.605421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.605583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.605730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.605906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.606061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.606304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.606440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.606637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.606783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.606949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.607084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.607290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.607427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.607602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.607745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.607920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.608946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.609120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.609264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.609425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.609653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.609789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.609957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.610879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.611049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.611249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.611384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.611517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.611695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.611833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.612975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.613118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.613277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.613422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.613619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.613764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.613925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.614068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.614255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.614469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.614605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.614737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.614868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.615953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.616131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.616280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.616438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.616573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.616754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.616891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.617068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.617212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.617413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.617561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.617743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.617945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.618072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.618212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.618353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.618524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.618661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.618895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.619076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.619247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.619427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.619572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.619729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.619863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.620042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.620171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.620357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.620516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.620671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.620837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.621905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.622044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.622216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.622353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.622546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.622695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.622866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.623012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.623216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.623354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.623551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.623689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.623872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.624949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.625135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.625272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.625461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.625598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.625763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.625899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.626952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.627121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.627293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.627431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.627604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.627739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.627906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.628966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.629132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.629273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.629449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.629585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.629758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.629901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.630986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.631149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.631344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.631528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.631675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.631842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.631988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.632175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.632319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.632499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.632637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.632824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.632961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.633141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.633285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.633581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.633717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.633857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.633991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.634931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.635072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.635271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.635417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.635597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.635735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.635911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.636170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.636306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.636508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.636624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.636826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.636930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.637148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.637933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.638321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.638418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.638510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.638602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.638701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.638909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.639021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.639258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.639363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.639575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.639680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.639887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.640963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.641141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.641288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.641436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.641576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.641742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.641881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.642038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.642698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.642855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.642999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.643168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.643313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.643450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.643596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.643730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.643862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.644899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.645984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.646118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.646270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.646411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.646583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.646718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.646864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.647874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.648863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.649288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.649431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.649572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.649711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.649851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.649988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.650909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.651045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.651296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.651433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.651609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.651731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.651919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.652140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.652272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.652473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.652595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.652792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.652988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.653177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.653309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.653492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.653628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.653800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.653946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.654105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.654240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.654411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.654549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.654733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.654944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.655082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.655321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.655458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.655638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.655788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.655962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.656098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.656272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.656408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.656582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.656728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.656870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.657248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.657444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.657579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.657754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.657904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.658980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.659144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.659314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.659458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.659625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.659771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.659934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.660998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.661175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.661321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.661465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.661606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.661772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.661910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.662988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.663169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.663315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.663455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.663612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.663749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.663926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.664076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.664232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.664368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.664543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.664794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.664939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.665937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.666079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.666211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.666407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.666544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.666714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.666850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.667020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.667184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.667369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.667505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.667690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.667836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.668969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.669112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.669278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.669423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.669591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.669941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.670903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.671970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.672116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.672280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.672425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.672580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.672724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.672882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.673913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.674990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.675190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.675317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.675492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.675639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.675772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.675910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.676101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.676246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.676413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.676561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.676726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.676870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.677955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.678099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.678274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.678411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.678590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.678726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.678901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.679982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.680153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.680412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.680555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.680690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.680823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.680957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.681982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.682118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.682287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.682424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.682611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.682758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.682927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.683071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.683257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.683391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.683572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.683707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.683883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.684019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.684720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.684868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.685966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.686103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.686276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.686413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.686591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.686740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.686901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.687045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.687238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.687386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.687555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.687705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.687867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.688924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.689101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.689796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.689938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.690914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.691980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.692112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.692246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.692377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:40:17.692519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.692519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.692776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.692931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.693237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.693541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.693847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.694180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.694513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.694834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.695183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.695497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.695823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.696135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.696467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.696782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.697099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.697412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.697749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.698060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.698379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.698695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.699018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.699352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.699663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.700040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.700369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.700677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.701019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.701328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.701650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.701970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.702284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.702613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.702928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.703268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.703582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.703898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.704212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.704528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.704842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.705157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.705478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.705798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.706128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.706452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.706766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.707110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.707445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.707794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.708110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.708460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.708792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.709108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.709428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.709733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:40:17.709979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:40:17.753799 n-d-858238-3 devstack@n-api.service[137559]: INFO dbcounter [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Registered counter for database nova_api Nov 02 13:40:17.772153 n-d-858238-3 devstack@n-api.service[137558]: INFO dbcounter [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Registered counter for database nova_api Nov 02 13:40:17.774246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_db.sqlalchemy.engines [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:17.781697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writer thread running {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:17.792717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_db.sqlalchemy.engines [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:17.800044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writer thread running {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:17.838427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.context [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=137559) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:40:17.843022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.843515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.845101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.845801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.846240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.848281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.850287 n-d-858238-3 devstack@n-api.service[137559]: INFO dbcounter [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Registered counter for database nova_cell0 Nov 02 13:40:17.854515 n-d-858238-3 devstack@n-api.service[137559]: INFO dbcounter [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Registered counter for database nova_cell1 Nov 02 13:40:17.857078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.context [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=137558) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:40:17.861114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.861593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.863037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_db.sqlalchemy.engines [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:17.863252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.864077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.864549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_db.sqlalchemy.engines [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:17.864675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.866671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.868954 n-d-858238-3 devstack@n-api.service[137558]: INFO dbcounter [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Registered counter for database nova_cell0 Nov 02 13:40:17.871803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writer thread running {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:17.873461 n-d-858238-3 devstack@n-api.service[137558]: INFO dbcounter [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Registered counter for database nova_cell1 Nov 02 13:40:17.875213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writer thread running {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:17.881100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_db.sqlalchemy.engines [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:17.883518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_db.sqlalchemy.engines [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:17.888629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writer thread running {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:17.891318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writer thread running {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:18.025692 n-d-858238-3 devstack@n-api.service[137559]: INFO dbcounter [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Registered counter for database nova_cell0 Nov 02 13:40:18.033687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_db.sqlalchemy.engines [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:18.039330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writer thread running {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:18.040508 n-d-858238-3 devstack@n-api.service[137558]: INFO dbcounter [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Registered counter for database nova_cell0 Nov 02 13:40:18.049443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_db.sqlalchemy.engines [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:40:18.054136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writer thread running {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:40:18.367274 n-d-858238-3 devstack@n-api.service[137559]: WARNING keystonemiddleware.auth_token [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:40:18.375278 n-d-858238-3 devstack@n-api.service[137559]: WARNING keystonemiddleware.auth_token [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:40:18.389452 n-d-858238-3 devstack@n-api.service[137558]: WARNING keystonemiddleware.auth_token [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:40:18.396836 n-d-858238-3 devstack@n-api.service[137558]: WARNING keystonemiddleware.auth_token [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:40:18.742082 n-d-858238-3 devstack@n-api.service[137558]: WARNING keystonemiddleware.auth_token [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:40:18.748336 n-d-858238-3 devstack@n-api.service[137559]: WARNING keystonemiddleware.auth_token [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:40:18.748720 n-d-858238-3 devstack@n-api.service[137558]: WARNING keystonemiddleware.auth_token [None req-68207831-04cc-47fa-bbae-799c3adea929 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:40:18.753973 n-d-858238-3 devstack@n-api.service[137558]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555ae35579c0 pid: 137558 (default app) Nov 02 13:40:18.756745 n-d-858238-3 devstack@n-api.service[137559]: WARNING keystonemiddleware.auth_token [None req-61da66f8-27dc-4a19-9a57-82c6ae0e678f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:40:18.766782 n-d-858238-3 devstack@n-api.service[137559]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555ae35579c0 pid: 137559 (default app) Nov 02 13:40:57.319589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:57.321291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:57.322355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:57.323243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:58.472497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Calling method '.version_select at 0x7f6f83688f70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:58.483123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=137558) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 13:40:58.483877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.484333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.484764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.514050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.514532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.515311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.528458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.528934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.529369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.536024 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e555db6f-d0d7-4ae8-94be-571f46f7eb67 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.230806 Nov 02 13:40:58.536600 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1208 bytes} [Wed Nov 2 13:40:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:58.802327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a99b224d-c7fd-4c26-8833-4dc346d93d5f tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-656716783"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:58.823054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-a99b224d-c7fd-4c26-8833-4dc346d93d5f tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Generated uuid 2169e367-7478-4683-8a28-03f817fff938 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:40:58.831855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:58.832887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:58.833859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:58.834752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:58.928200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a99b224d-c7fd-4c26-8833-4dc346d93d5f tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.368700 Nov 02 13:40:58.929128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1/2] 10.222.0.18 () {62 vars in 1205 bytes} [Wed Nov 2 13:40:58 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:40:58.941724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-90f40bd4-f191-4b69-8938-8a1fb3b300a2 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1233630355"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:59.114860 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-90f40bd4-f191-4b69-8938-8a1fb3b300a2 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.177608 Nov 02 13:40:59.116038 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2/3] 10.222.0.18 () {62 vars in 1210 bytes} [Wed Nov 2 13:40:58 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:40:59.129979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86de203a-b941-44bc-bbca-0f9fff82eb48 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:59.156079 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86de203a-b941-44bc-bbca-0f9fff82eb48 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.031652 Nov 02 13:40:59.157487 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2/4] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 13:40:59 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:40:59.170081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a48441d-3402-46c0-b238-e6fd4c3cb264 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:59.189157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a48441d-3402-46c0-b238-e6fd4c3cb264 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:59.192029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a48441d-3402-46c0-b238-e6fd4c3cb264 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:59.193027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a48441d-3402-46c0-b238-e6fd4c3cb264 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.634755 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8a48441d-3402-46c0-b238-e6fd4c3cb264 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.468734 Nov 02 13:41:00.637104 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 3/5] 10.222.0.18 () {62 vars in 1232 bytes} [Wed Nov 2 13:40:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:00.669865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc97b857-b40f-4415-8cb3-f53904439b14 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:00.715357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc97b857-b40f-4415-8cb3-f53904439b14 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:00.717127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc97b857-b40f-4415-8cb3-f53904439b14 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:00.718065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc97b857-b40f-4415-8cb3-f53904439b14 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.038561 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc97b857-b40f-4415-8cb3-f53904439b14 tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.386519 Nov 02 13:41:01.039197 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 4/6] 10.222.0.18 () {62 vars in 1232 bytes} [Wed Nov 2 13:41:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:01.310793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1759973149", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:01.404708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-421142e8-a75f-48fe-8492-54318e05d8bd tempest-AZAdminNegativeTestJSON-2104348646 tempest-AZAdminNegativeTestJSON-2104348646-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:01.406267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-421142e8-a75f-48fe-8492-54318e05d8bd tempest-AZAdminNegativeTestJSON-2104348646 tempest-AZAdminNegativeTestJSON-2104348646-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '46e8a57667bd432daee2a03efd235b74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed57693483a4892a717604466160400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-421142e8-a75f-48fe-8492-54318e05d8bd tempest-AZAdminNegativeTestJSON-2104348646 tempest-AZAdminNegativeTestJSON-2104348646-project] Request method failure captured: Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNpnr59-b05SHFrV1pMh_-J5ivLeCSVQp65MfEupraMCUDc5OMpe5GkxcdmV6ONNTFVKy5Re3SmiD5BEqSK63j7c0rlNuVReU3LsxS2wqsEFxOjFvjMAfB_gMiIOcwoP9LG1X3NznfmHXxtRyZDa5KziPcaBxLEtMwYl9t4vex_WT0 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9ed57693483a4892a717604466160400 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2104348646 Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:01.414360 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ed57693483a4892a717604466160400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9ed57693483a4892a717604466160400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ed57693483a4892a717604466160400"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9ed57693483a4892a717604466160400"}]}] Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AZAdminNegativeTestJSON-2104348646 Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9ed57693483a4892a717604466160400 Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2104348646 Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AZAdminNegativeTestJSON-2104348646-project Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 46e8a57667bd432daee2a03efd235b74 Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AZAdminNegativeTestJSON-2104348646-project Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 13:41:01.416065 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:01.417004 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:01.442917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-421142e8-a75f-48fe-8492-54318e05d8bd tempest-AZAdminNegativeTestJSON-2104348646 tempest-AZAdminNegativeTestJSON-2104348646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:01.457102 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-421142e8-a75f-48fe-8492-54318e05d8bd tempest-AZAdminNegativeTestJSON-2104348646 tempest-AZAdminNegativeTestJSON-2104348646-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.205648 Nov 02 13:41:01.457102 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 13:41:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1210 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:01.973113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '.version_select at 0x7f6f82c8a160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:01.980538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=137559) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 13:41:01.983585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.984084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.984520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.036002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.036495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.036932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.064088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.064844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.065657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.079238 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7319915e-8b6f-439b-bf95-6b31a3b8beaf tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.645818 Nov 02 13:41:02.081555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 13:41:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:02.091998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f11fbde-56e8-4216-acd6-04e56e699e0f tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:02.126892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f11fbde-56e8-4216-acd6-04e56e699e0f tempest-AggregatesAdminTestV241-1469412543 tempest-AggregatesAdminTestV241-1469412543-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.042681 Nov 02 13:41:02.128326 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 5/9] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:41:02 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:02.234977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:02.434945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e24b2a43-ac03-4f17-a787-47ccf2e090ba tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1412769469", "id": 2049778747, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:02.509862 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e24b2a43-ac03-4f17-a787-47ccf2e090ba tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.380449 Nov 02 13:41:02.519576 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 6/10] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:41:02 2022] POST /compute/v2.1/flavors => generated 449 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:02.875845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58016b72-15f2-4d26-be18-931ae593533b tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1689180867", "id": 310849513, "os-flavor-access:is_public": "False"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:02.917982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58016b72-15f2-4d26-be18-931ae593533b tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.397288 Nov 02 13:41:02.919149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 7/11] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:02 2022] POST /compute/v2.1/flavors => generated 428 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:02.941423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ceaccc22-ddbb-4cba-854d-c2ce08bf749e tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-867545047", "name": "tempest-test_aggregate-1595912168"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:02.966098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:02.966466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:02.966908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:02.967340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:02.967732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:02.970182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-ceaccc22-ddbb-4cba-854d-c2ce08bf749e tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid df7f0a33-4282-4774-a769-0f285f419d7d for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:03.015842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:03.016411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:03.016847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.018025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:03.021509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:03.022168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.025280 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ceaccc22-ddbb-4cba-854d-c2ce08bf749e tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.087456 Nov 02 13:41:03.026375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 8/12] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Nov 2 13:41:02 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:03.097582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Getting quotas for project b63f9d4f2a534ce6b03bba55cfc49e76. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:03.113661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Getting quotas for user a6caa3a4f63a4f729948679403b2fe21 and project b63f9d4f2a534ce6b03bba55cfc49e76. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:03.142746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:03.151981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:03.272259 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f7f4fb20-f383-4679-84a5-053fed5a5f16 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.228112 Nov 02 13:41:03.275949 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 5/13] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:41:03.288416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0a788021-52f1-4aaf-b6e9-da5f68f1b745 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1636c2827c6247a085f0ab1759db35b6"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:03.660502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8eeb5ff4-57e2-494d-91b8-1fb80c11e38a tempest-FlavorsV255TestJSON-167270660 tempest-FlavorsV255TestJSON-167270660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:03.711623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8eeb5ff4-57e2-494d-91b8-1fb80c11e38a tempest-FlavorsV255TestJSON-167270660 tempest-FlavorsV255TestJSON-167270660-project] 10.222.0.18 "GET /compute/v2.1/flavors/2049778747" status: 200 len: 449 microversion: 2.55 time: 0.680063 Nov 02 13:41:03.719254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 9/14] 10.222.0.18 () {60 vars in 1199 bytes} [Wed Nov 2 13:41:03 2022] GET /compute/v2.1/flavors/2049778747 => generated 449 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:03.741286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e3d21e7f-260e-486b-bd20-c949001e2688 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:03.770696 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e3d21e7f-260e-486b-bd20-c949001e2688 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.050096 Nov 02 13:41:03.773707 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 10/15] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:41:03 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:03.780641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e77c25f-fc76-42e5-861e-402034ef54ab tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:03.785105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4e77c25f-fc76-42e5-861e-402034ef54ab tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:04.499824 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0a788021-52f1-4aaf-b6e9-da5f68f1b745 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/310849513/action" status: 200 len: 96 microversion: 2.1 time: 1.222350 Nov 02 13:41:04.506563 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 6/16] 10.222.0.18 () {60 vars in 1197 bytes} [Wed Nov 2 13:41:03 2022] POST /compute/v2.1/flavors/310849513/action => generated 96 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:04.512361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-23ea57e0-d42a-442e-9117-153889e6b4f4 tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] Action: 'update', calling method: .version_select at 0x7f6f83a58f70>, body: {"flavor": {"description": "new"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:04.556794 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-23ea57e0-d42a-442e-9117-153889e6b4f4 tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/2049778747" status: 200 len: 450 microversion: 2.55 time: 0.048853 Nov 02 13:41:04.557778 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 7/17] 10.222.0.18 () {62 vars in 1219 bytes} [Wed Nov 2 13:41:04 2022] PUT /compute/v2.1/flavors/2049778747 => generated 450 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:04.564194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a524708-f493-4a7d-b6cd-fba9f4f3eea0 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:04.577718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a524708-f493-4a7d-b6cd-fba9f4f3eea0 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:04.578501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a524708-f493-4a7d-b6cd-fba9f4f3eea0 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:04.579067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a524708-f493-4a7d-b6cd-fba9f4f3eea0 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:04.892130 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a524708-f493-4a7d-b6cd-fba9f4f3eea0 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.1 time: 0.332981 Nov 02 13:41:04.894374 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 8/18] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:05.285572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-407420b0-36e8-45e9-8ba2-f7c7a05a4690 tempest-FlavorsAccessTestJSON-1673592189 tempest-FlavorsAccessTestJSON-1673592189-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:05.393617 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-407420b0-36e8-45e9-8ba2-f7c7a05a4690 tempest-FlavorsAccessTestJSON-1673592189 tempest-FlavorsAccessTestJSON-1673592189-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5827 microversion: 2.1 time: 0.497843 Nov 02 13:41:05.395060 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 9/19] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:04 2022] GET /compute/v2.1/flavors/detail => generated 5827 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:05.423258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b6a25786-19ad-4cc9-877f-bc6260e39e62 tempest-FlavorsV255TestJSON-167270660 tempest-FlavorsV255TestJSON-167270660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:05.498621 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b6a25786-19ad-4cc9-877f-bc6260e39e62 tempest-FlavorsV255TestJSON-167270660 tempest-FlavorsV255TestJSON-167270660-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.087589 Nov 02 13:41:05.511834 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:05 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:05.557265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e77c25f-fc76-42e5-861e-402034ef54ab tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:05.574725 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e77c25f-fc76-42e5-861e-402034ef54ab tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1220 microversion: 2.1 time: 1.798277 Nov 02 13:41:05.576018 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:03 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1220 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:05.581022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9560a3b5-e1e8-44ad-9a88-67088a4446e9 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1636c2827c6247a085f0ab1759db35b6"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:06.078377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2127211819", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "availability_zone": "tempest-test_az-867545047"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:06.111598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.112479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.113119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.114050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.114744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.124684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.220087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:06.603380 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9560a3b5-e1e8-44ad-9a88-67088a4446e9 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/310849513/action" status: 200 len: 21 microversion: 2.1 time: 1.025561 Nov 02 13:41:06.604926 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 12/22] 10.222.0.18 () {60 vars in 1197 bytes} [Wed Nov 2 13:41:05 2022] POST /compute/v2.1/flavors/310849513/action => generated 21 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:06.614211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f98d9709-5913-4763-9961-6004b16913fa tempest-FlavorsV255TestJSON-167270660 tempest-FlavorsV255TestJSON-167270660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:06.648804 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f98d9709-5913-4763-9961-6004b16913fa tempest-FlavorsV255TestJSON-167270660 tempest-FlavorsV255TestJSON-167270660-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.042229 Nov 02 13:41:06.652239 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 13/23] 10.222.0.18 () {60 vars in 1166 bytes} [Wed Nov 2 13:41:06 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:06.657816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:06.659071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:06.679083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.679903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.685816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.686878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.689366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.690064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.713477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:06.714549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:06.715780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:06.716965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:06.717475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:06.737052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.740857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.741529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.743936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.746396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.747539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.784543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Getting quotas for project 79a2115449bc41f084281dd7f6e060fb. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:06.790110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Getting quotas for user 961cce2a8c2540dd8808c6efce1fe5fd and project 79a2115449bc41f084281dd7f6e060fb. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:06.806266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:06.808969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:06.941381 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d5c22c3e-0236-4ab4-a7dc-51ad6334838a tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427248 Nov 02 13:41:06.955816 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 11/24] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:41:06.965730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9757207d-3656-4c3f-87f2-e143191f1202 tempest-FlavorsAccessTestJSON-1673592189 tempest-FlavorsAccessTestJSON-1673592189-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.001904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.016267 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c722914-96a7-4a09-9ac6-b630ae64405e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1290 microversion: 2.1 time: 0.362612 Nov 02 13:41:07.017091 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:06 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1290 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:07.018129 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9757207d-3656-4c3f-87f2-e143191f1202 tempest-FlavorsAccessTestJSON-1673592189 tempest-FlavorsAccessTestJSON-1673592189-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.060688 Nov 02 13:41:07.031359 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:06 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:07.036701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5fa0c894-ac4f-4ea0-9dcb-8f2b430f725b tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.144339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5fa0c894-ac4f-4ea0-9dcb-8f2b430f725b tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2049778747" status: 202 len: 0 microversion: 2.55 time: 0.125483 Nov 02 13:41:07.145734 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 15/27] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Nov 2 13:41:07 2022] DELETE /compute/v2.1/flavors/2049778747 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:41:07.165665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28c7f7c0-54b7-44ed-b673-c28abe7d809c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.166319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28c7f7c0-54b7-44ed-b673-c28abe7d809c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:07.352974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28c7f7c0-54b7-44ed-b673-c28abe7d809c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.367087 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28c7f7c0-54b7-44ed-b673-c28abe7d809c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1242 microversion: 2.1 time: 0.217464 Nov 02 13:41:07.369962 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:07.375429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e91c46b-c6e2-460a-a704-b141fe37c511 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.426005 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e91c46b-c6e2-460a-a704-b141fe37c511 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/310849513" status: 202 len: 0 microversion: 2.1 time: 0.054607 Nov 02 13:41:07.429301 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 17/29] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:41:07 2022] DELETE /compute/v2.1/flavors/310849513 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:07.439783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-003286e2-f48c-44e7-9e92-3d91af66d87e tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.512242 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-003286e2-f48c-44e7-9e92-3d91af66d87e tempest-FlavorsV255TestJSON-1604911110 tempest-FlavorsV255TestJSON-1604911110-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.081190 Nov 02 13:41:07.540421 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 18/30] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:07.563859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.575180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.576873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.577864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.579830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.584539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.587198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.592357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b24f9e6-8675-465a-9a4c-183a1f2f25c0 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.636022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b24f9e6-8675-465a-9a4c-183a1f2f25c0 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090143 Nov 02 13:41:07.638277 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 19/31] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:07.666662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d367b820-3220-4235-ba59-51abdb5ea855 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-587358161", "id": 1437740695, "os-flavor-access:is_public": "False"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:07.675262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e8d60459-fe94-45b8-8144-7b57a8b2e388 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.649183 Nov 02 13:41:07.676420 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 13/32] 10.222.0.18 () {58 vars in 1164 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:07.692417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.694908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.696456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.697348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.698814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.699643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.701541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.737704 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d367b820-3220-4235-ba59-51abdb5ea855 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.077456 Nov 02 13:41:07.740928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 20/33] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:07 2022] POST /compute/v2.1/flavors => generated 430 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:07.747701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:07.756110 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-841de8cd-3d48-468d-9829-5dde0d40f770 tempest-AZAdminV2TestJSON-523958187 tempest-AZAdminV2TestJSON-523958187-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.070306 Nov 02 13:41:07.758145 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 14/34] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:07.768103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebcee97f-7888-44ff-a580-4ac0d100994f tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.804566 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ebcee97f-7888-44ff-a580-4ac0d100994f tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1437740695/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.057600 Nov 02 13:41:07.814544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 21/35] 10.222.0.18 () {58 vars in 1209 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/flavors/1437740695/os-flavor-access => generated 21 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:07.827852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf72d899-bb3d-4ef1-8f3c-277922fc9b24 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.902102 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cf72d899-bb3d-4ef1-8f3c-277922fc9b24 tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1437740695" status: 202 len: 0 microversion: 2.1 time: 0.089339 Nov 02 13:41:07.903766 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 15/36] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:41:07 2022] DELETE /compute/v2.1/flavors/1437740695 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:07.914009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0d33b66-bfbe-41b0-b8ec-ff25c234685b tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.939197 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0d33b66-bfbe-41b0-b8ec-ff25c234685b tempest-FlavorsAccessTestJSON-258426177 tempest-FlavorsAccessTestJSON-258426177-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030150 Nov 02 13:41:07.956771 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 22/37] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:08.044758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:08.045660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:08.094826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.094826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.094826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.100212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.102708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.103801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.398072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c570dfe-b64d-434e-9504-0f6a1e2d99fb tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:08.398749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c570dfe-b64d-434e-9504-0f6a1e2d99fb tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:08.552715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c570dfe-b64d-434e-9504-0f6a1e2d99fb tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.562073 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c570dfe-b64d-434e-9504-0f6a1e2d99fb tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1242 microversion: 2.1 time: 0.169250 Nov 02 13:41:08.562660 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 23/38] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:08 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1242 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:08.805236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.824218 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-644e166a-9a8e-4463-ad41-e25b9f296b97 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.785852 Nov 02 13:41:08.841242 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 16/39] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:08 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:09.587700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:09.588402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:09.605459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.618171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.618883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.626908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.631847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.632530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.857245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:09.859974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:09.881167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.888250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.895226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.898462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.904830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.906494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.430950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:10.447224 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd453509-2822-4ea7-9c88-ca303df881d3 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1298 microversion: 2.1 time: 0.860400 Nov 02 13:41:10.447878 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 24/40] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:09 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1298 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:11.476040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:11.483705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:11.490424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:11.491230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:11.491975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:11.494326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:11.495207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:11.495826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:11.768988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:11.784667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2e2dac4-6f68-4d61-8e43-f29530754c42 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1296 microversion: 2.1 time: 0.312390 Nov 02 13:41:11.787243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 25/41] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:11 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1296 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:11.928537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:11.940794 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e112fc90-91a7-4c79-8c7a-d41951974fc2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 2.088711 Nov 02 13:41:11.955957 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 17/42] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:09 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:12.068660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:12.073023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.074384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.078198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.079878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.084350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.085120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.174895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1495979c-3ed5-42fb-ad7a-204de9bb1d36 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.309425 Nov 02 13:41:12.190704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 26/43] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:41:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:12.814975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:12.816281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:12.832452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.837872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.841283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.842946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.844236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.849415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.975954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:12.976581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:12.988474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.988973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.989416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.990135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.990593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.991019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.226972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:13.251058 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8bba845d-d0ad-46e7-9984-47a3c3733c39 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1296 microversion: 2.1 time: 0.440043 Nov 02 13:41:13.268785 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 18/44] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:12 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1296 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:14.015366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:14.031667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcb3db44-687b-4749-a5b8-c0d168a29285 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 1.061089 Nov 02 13:41:14.049039 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 27/45] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:12 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:14.286137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:14.287349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:14.303903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.304823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.307588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.309124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.313935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.314725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.056447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:15.057128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:15.060922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:15.065097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.065790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.066411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.067366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.067975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.068769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.551390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.564521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e2fcd7d-0282-464f-956f-b50654b66cbd tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1296 microversion: 2.1 time: 1.283674 Nov 02 13:41:15.583686 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 19/46] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:14 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1296 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:15.666591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.681222 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-934d4ff7-761b-4e2e-9b46-062dda94cdba tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.628854 Nov 02 13:41:15.698848 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 28/47] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:15 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:16.592214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:16.593445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:16.612027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.612941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.614409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.615828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.617404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.618887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.706139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:16.706837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:16.728619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.741036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.744139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.745058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.751504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.751812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.801509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=12 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:17.194724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:17.226065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-be34c969-660a-45e9-abef-cd244e4d9cd0 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1296 microversion: 2.1 time: 0.637156 Nov 02 13:41:17.233285 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 20/48] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:16 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1296 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:17.714623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:17.805067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8d3824-1588-4be6-af45-b90614454f00", "tag": "1a7f665b-8989-42ac-b8ef-3ab4e30f6815"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:17.849693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.852173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.853553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.950098 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Creating event network-changed:1a7f665b-8989-42ac-b8ef-3ab4e30f6815 for instance 1c8d3824-1588-4be6-af45-b90614454f00 on n-h2-858238-3 Nov 02 13:41:17.951964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:41:17.952775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a883fa85-9a6f-4410-a13b-26f7d4a5acee req-0b448523-a419-4e8c-bb30-9d03f1642d7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:41:17.954662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.959040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.961972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.963219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.965211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.969165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.031554 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.compute.rpcapi [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 13:41:18.038892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] Releasing lock "compute-rpcapi-router" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:41:18.099955 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54eff5a6-cc81-4428-9b70-27d3dd9b229e None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.858654 Nov 02 13:41:18.111670 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 21/49] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:18.131787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:18.144700 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3048fea4-4e8e-40da-97c6-67a7536577b8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 1.441102 Nov 02 13:41:18.145325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 29/50] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:16 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:18.257527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:18.258576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:18.279830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:18.280486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:18.283338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.286883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:18.287850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:18.295185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.567308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:18.579188 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8bcb0964-7d67-4a2e-83f0-af41198c806d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1296 microversion: 2.1 time: 0.326933 Nov 02 13:41:18.591618 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 22/51] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:18 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1296 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:19.173915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:19.174529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:19.193044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:19.210919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:19.211752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:19.212456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:19.213333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:19.213937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:19.215193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:19.607815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:19.609296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:19.628708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:19.629392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:19.629846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:19.630623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:19.631084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:19.647577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:20.045560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:20.078277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3cb93e8-6ef7-49e8-a673-a4a88690dec9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.892061 Nov 02 13:41:20.078977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 30/52] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:19 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:20.546401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:20.571202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-def2d3e8-e16b-4e6a-8eaa-cf5ef4b873d1 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 0.961689 Nov 02 13:41:20.576558 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 23/53] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:19 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:21.109760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:21.110994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:21.145506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:21.146701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:21.147548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:21.156765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:21.161984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:21.162994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:21.603158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:21.604700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:21.620745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:21.621761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:21.622857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:21.625895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:21.633985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:21.638427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:22.128729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:22.275674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:22.289866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2709cfb0-5897-414e-80a2-84dd1b7efe60 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 1.185557 Nov 02 13:41:22.291375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 31/54] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:21 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:23.399570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Calling method '.version_select at 0x7f6f82b08820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:23.403792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.404274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.404704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.409484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.409797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.410234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.461985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.477082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-67585c28-05db-4087-9055-82735037be09 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 1.878637 Nov 02 13:41:23.478235 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 24/55] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:21 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:23.532905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62e67a71-b848-48eb-b85f-b8bdbc255d46 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 1.240144 Nov 02 13:41:23.538315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 32/56] 10.222.0.18 () {58 vars in 1128 bytes} [Wed Nov 2 13:41:22 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:23.550074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:23.555812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:23.596748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.597262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.597683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.607533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.608969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.612533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.932182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a686fea-53d0-4075-91e9-2c74e178693e tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-815706064", "id": 1059293247, "os-flavor-access:is_public": "False"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:24.018423 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a686fea-53d0-4075-91e9-2c74e178693e tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.537840 Nov 02 13:41:24.019045 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 25/57] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:23 2022] POST /compute/v2.1/flavors => generated 438 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:24.247135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:24.259184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6e63466-63d0-4d66-8740-425f1c95d418 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.717957 Nov 02 13:41:24.279113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 33/58] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:23 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:24.290479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d1b403-a5b1-418e-b179-ef4729e45a89", "tag": "1282ecb9-f390-46fe-a8ad-931398cb8367"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:24.319754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.322629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.323289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:24.369434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Creating event network-changed:1282ecb9-f390-46fe-a8ad-931398cb8367 for instance 21d1b403-a5b1-418e-b179-ef4729e45a89 on n-h1-858238-3 Nov 02 13:41:24.370676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:41:24.374805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b48eaf93-12b2-42e1-be7e-7b4bbbbbb406 req-7311d492-c264-4797-b72b-d9f5542b82a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:41:24.376725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.377348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.380063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:24.380820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.384212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.386627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:24.412291 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.rpcapi [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 13:41:24.414106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] Releasing lock "compute-rpcapi-router" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:41:24.447724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-996ad2c9-da06-4036-b851-4f9d74c6225e None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166798 Nov 02 13:41:24.449041 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 34/59] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:24.455807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c8a2356-2cc4-45ab-9936-cff395d12443 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Calling method '.version_select at 0x7f6f82a71b80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:24.461636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e6d1c0d-809e-4580-ac6e-00394ef4459b tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:24.472280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c8a2356-2cc4-45ab-9936-cff395d12443 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'bdbde8571537415faab919690206c4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e63ab9476504ea182edc999531a414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c8a2356-2cc4-45ab-9936-cff395d12443 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Request method failure captured: Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN-_MOeVOB6ckh1aIwIxSALpNMpoadt_Ko6lxhXpyx_lyWijEO1ma518PwmW-_TkY1GnaD0-nRUOGhDiOTclbRWoh0L8zav7PBJBKcxbUK6qoYLZDXnqc460m0DjbVUFdN8Q7yBnuVL71FNp3xA9lszlyq_4nyiGaoctFS2RuhJBDs Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:24.503229 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e63ab9476504ea182edc999531a414a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e63ab9476504ea182edc999531a414a"}]}] Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bdbde8571537415faab919690206c4b0 Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: action_args: {} Nov 02 13:41:24.504359 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:24.505015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 13:41:24.505961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:24.512941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c8a2356-2cc4-45ab-9936-cff395d12443 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:24.522792 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c8a2356-2cc4-45ab-9936-cff395d12443 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.502636 Nov 02 13:41:24.529281 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 26/60] 10.222.0.18 () {58 vars in 1128 bytes} [Wed Nov 2 13:41:24 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 509 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:24.536229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:24.537288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:24.545346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.546287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.547137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:24.548609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.549288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.550022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:25.015910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e6d1c0d-809e-4580-ac6e-00394ef4459b tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1059293247/action" status: 200 len: 97 microversion: 2.1 time: 0.559836 Nov 02 13:41:25.016735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 35/61] 10.222.0.18 () {60 vars in 1200 bytes} [Wed Nov 2 13:41:24 2022] POST /compute/v2.1/flavors/1059293247/action => generated 97 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:25.157800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-140ffbd4-4cfa-4507-acab-d79dd4a302ac tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1948466122", "id": 1757110842, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:25.206859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-140ffbd4-4cfa-4507-acab-d79dd4a302ac tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.182334 Nov 02 13:41:25.217204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 36/62] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:41:25 2022] POST /compute/v2.1/flavors => generated 468 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:25.235055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87df7237-01d0-483d-9ce5-867c31071c67 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Calling method '.version_select at 0x7f6f82aa3d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:25.241875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87df7237-01d0-483d-9ce5-867c31071c67 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'bdbde8571537415faab919690206c4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e63ab9476504ea182edc999531a414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87df7237-01d0-483d-9ce5-867c31071c67 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Request method failure captured: Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hosts/n-d-858238-3/reboot HTTP/1.1 Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN-_MOeVOB6ckh1aIwIxSALpNMpoadt_Ko6lxhXpyx_lyWijEO1ma518PwmW-_TkY1GnaD0-nRUOGhDiOTclbRWoh0L8zav7PBJBKcxbUK6qoYLZDXnqc460m0DjbVUFdN8Q7yBnuVL71FNp3xA9lszlyq_4nyiGaoctFS2RuhJBDs Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:25.251474 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e63ab9476504ea182edc999531a414a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e63ab9476504ea182edc999531a414a"}]}] Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: bdbde8571537415faab919690206c4b0 Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'n-d-858238-3'} Nov 02 13:41:25.253137 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:25.254146 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 13:41:25.255649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.259975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87df7237-01d0-483d-9ce5-867c31071c67 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:25.261272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87df7237-01d0-483d-9ce5-867c31071c67 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858238-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.042906 Nov 02 13:41:25.264399 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 37/63] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Nov 2 13:41:25 2022] GET /compute/v2.1/os-hosts/n-d-858238-3/reboot => generated 111 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:25.299688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05bed07b-1682-466c-a3cb-05ac83163c84 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:25.455141 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-05bed07b-1682-466c-a3cb-05ac83163c84 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project d3b14a9a7b5346f5a371559efb3c1239 combination. Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05bed07b-1682-466c-a3cb-05ac83163c84 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Request method failure captured: Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/flavors/1059293247/action HTTP/1.1 Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 67 Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOBMDFK15APLLzCAgWHaPwStUpzzAo8qsKDMRQ1sGsJMLYb5ycUoNlK2TEavb7GU_7ai1ZjqERTRflZHgPljiHr4njfYWNR_NVkgy3Np4eq3iDnlMclo7LFHH8eahKGxrVGkw5Nb9tgQeGUBekIqR22w2jnHlpcx09imOPAx7KEQZ4 Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e25e919744404cb9b2064f572b2aed6f Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:25.498628 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e25e919744404cb9b2064f572b2aed6f"}]}] Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e25e919744404cb9b2064f572b2aed6f Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: feed4f55572b43fc8216530598005de3 Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: {"addTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} Nov 02 13:41:25.500062 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: exception: Flavor access already exists for flavor 18 and project d3b14a9a7b5346f5a371559efb3c1239 combination. Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1059293247', 'body': {'addTenantAccess': {'tenant': 'd3b14a9a7b5346f5a371559efb3c1239'}}} Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:41:25.500817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-d3b14a9a7b5346f5a371559efb3c1239' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 13:41:25.501893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 13:41:25.503033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:41:25.504136 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-d3b14a9a7b5346f5a371559efb3c1239' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 13, 41, 25, 443495), 'updated_at': None, 'flavor_id': 18, 'project_id': 'd3b14a9a7b5346f5a371559efb3c1239'}] Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:25.505286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project d3b14a9a7b5346f5a371559efb3c1239 combination. Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:25.506296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project d3b14a9a7b5346f5a371559efb3c1239 combination. Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:25.507480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:25.508766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project d3b14a9a7b5346f5a371559efb3c1239 combination. Nov 02 13:41:25.508766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.514010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05bed07b-1682-466c-a3cb-05ac83163c84 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project d3b14a9a7b5346f5a371559efb3c1239 combination. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:25.515639 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05bed07b-1682-466c-a3cb-05ac83163c84 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1059293247/action" status: 409 len: 152 microversion: 2.1 time: 0.242809 Nov 02 13:41:25.520152 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 38/64] 10.222.0.18 () {60 vars in 1200 bytes} [Wed Nov 2 13:41:25 2022] POST /compute/v2.1/flavors/1059293247/action => generated 152 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:25.778492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:25.790702 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4d319cf0-4323-4895-b427-6dae93f46bc4 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 1.257984 Nov 02 13:41:25.802892 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 27/65] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:24 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:25.813833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-041799a3-6933-4efb-94d1-b79a79a63f55 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Calling method '.version_select at 0x7f6f83ef2310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:25.856844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de7cb5d5-482d-42d2-a238-7a2fffd9e29b tempest-FlavorsV261TestJSON-49502401 tempest-FlavorsV261TestJSON-49502401-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:25.862569 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-041799a3-6933-4efb-94d1-b79a79a63f55 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:25.887025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de7cb5d5-482d-42d2-a238-7a2fffd9e29b tempest-FlavorsV261TestJSON-49502401 tempest-FlavorsV261TestJSON-49502401-project] 10.222.0.18 "GET /compute/v2.1/flavors/1757110842" status: 200 len: 468 microversion: 2.61 time: 0.365456 Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-041799a3-6933-4efb-94d1-b79a79a63f55 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:25.888676 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:41:25.889974 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:25.890848 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 13:41:25.891987 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:25.893416 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:25.895355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-041799a3-6933-4efb-94d1-b79a79a63f55 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:25.912408 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 39/66] 10.222.0.18 () {60 vars in 1199 bytes} [Wed Nov 2 13:41:25 2022] GET /compute/v2.1/flavors/1757110842 => generated 468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:25.917638 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-041799a3-6933-4efb-94d1-b79a79a63f55 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.113293 Nov 02 13:41:25.918215 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 28/67] 10.222.0.18 () {58 vars in 1212 bytes} [Wed Nov 2 13:41:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:25.947151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3012a7ee-6b6e-443b-8374-d87af70c0522 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:25.948880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:25.956156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:25.984947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:25.991844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:25.992614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:26.000121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:26.000956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:26.002039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:26.167488 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3012a7ee-6b6e-443b-8374-d87af70c0522 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1059293247/action" status: 200 len: 21 microversion: 2.1 time: 0.231058 Nov 02 13:41:26.178233 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 29/68] 10.222.0.18 () {60 vars in 1200 bytes} [Wed Nov 2 13:41:25 2022] POST /compute/v2.1/flavors/1059293247/action => generated 21 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:26.183544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-44e4894e-8061-45ba-9029-c709cfcc31b5 tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:26.265578 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-44e4894e-8061-45ba-9029-c709cfcc31b5 tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1757110842" status: 200 len: 469 microversion: 2.61 time: 0.085800 Nov 02 13:41:26.282712 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 30/69] 10.222.0.18 () {62 vars in 1219 bytes} [Wed Nov 2 13:41:26 2022] PUT /compute/v2.1/flavors/1757110842 => generated 469 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:26.295225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a346b42a-35ae-4a6a-8398-1a8d3f0495ef tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Calling method '.version_select at 0x7f6f828e5550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.297198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a346b42a-35ae-4a6a-8398-1a8d3f0495ef tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'bdbde8571537415faab919690206c4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e63ab9476504ea182edc999531a414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a346b42a-35ae-4a6a-8398-1a8d3f0495ef tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Request method failure captured: Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hosts/n-d-858238-3 HTTP/1.1 Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN-_MOeVOB6ckh1aIwIxSALpNMpoadt_Ko6lxhXpyx_lyWijEO1ma518PwmW-_TkY1GnaD0-nRUOGhDiOTclbRWoh0L8zav7PBJBKcxbUK6qoYLZDXnqc460m0DjbVUFdN8Q7yBnuVL71FNp3xA9lszlyq_4nyiGaoctFS2RuhJBDs Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:26.298834 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e63ab9476504ea182edc999531a414a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e63ab9476504ea182edc999531a414a"}]}] Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bdbde8571537415faab919690206c4b0 Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'n-d-858238-3'} Nov 02 13:41:26.300147 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:26.300860 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 13:41:26.305114 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.306926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a346b42a-35ae-4a6a-8398-1a8d3f0495ef tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.306926 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a346b42a-35ae-4a6a-8398-1a8d3f0495ef tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858238-3" status: 403 len: 109 microversion: 2.1 time: 0.018449 Nov 02 13:41:26.310543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 31/70] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/os-hosts/n-d-858238-3 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:26.322716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-774271e7-03f4-4011-abe5-97e0d8898656 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.344639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.359563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ab0b11e-f41b-4206-893c-e75933707d76 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.441373 Nov 02 13:41:26.375564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 40/71] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:25 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:26.383534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76ac1de3-1e39-42b5-aff4-f22f56cfc959 tempest-FlavorsV261TestJSON-49502401 tempest-FlavorsV261TestJSON-49502401-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.400436 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-774271e7-03f4-4011-abe5-97e0d8898656 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1059293247" status: 202 len: 0 microversion: 2.1 time: 0.085555 Nov 02 13:41:26.421259 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 32/72] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:41:26 2022] DELETE /compute/v2.1/flavors/1059293247 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:26.433558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-adfe0311-ea5a-4c2d-913b-53ba1fa4dba3 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Calling method '.version_select at 0x7f6f82ab1dc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.436784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76ac1de3-1e39-42b5-aff4-f22f56cfc959 tempest-FlavorsV261TestJSON-49502401 tempest-FlavorsV261TestJSON-49502401-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.059849 Nov 02 13:41:26.451249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 41/73] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:26.454180 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-adfe0311-ea5a-4c2d-913b-53ba1fa4dba3 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-adfe0311-ea5a-4c2d-913b-53ba1fa4dba3 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:26.456055 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:41:26.457173 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.457826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.458847 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.460584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3cec9e0-1fec-4a5f-a03a-8357af1bd91f tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.461083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-adfe0311-ea5a-4c2d-913b-53ba1fa4dba3 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.462034 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-adfe0311-ea5a-4c2d-913b-53ba1fa4dba3 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039392 Nov 02 13:41:26.468570 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 33/74] 10.222.0.18 () {58 vars in 1191 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:26.484439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-03f7f3b5-14bc-4dd0-a432-481a11e745d8 tempest-FlavorsV261TestJSON-49502401 tempest-FlavorsV261TestJSON-49502401-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.488458 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3cec9e0-1fec-4a5f-a03a-8357af1bd91f tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.035813 Nov 02 13:41:26.504261 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 42/75] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:26.510298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e405163-c04e-4548-b7d1-01fce980dfdc tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Calling method '.version_select at 0x7f6f82821d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.512438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e405163-c04e-4548-b7d1-01fce980dfdc tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'bdbde8571537415faab919690206c4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e63ab9476504ea182edc999531a414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e405163-c04e-4548-b7d1-01fce980dfdc tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Request method failure captured: Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hosts/n-d-858238-3/shutdown HTTP/1.1 Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN-_MOeVOB6ckh1aIwIxSALpNMpoadt_Ko6lxhXpyx_lyWijEO1ma518PwmW-_TkY1GnaD0-nRUOGhDiOTclbRWoh0L8zav7PBJBKcxbUK6qoYLZDXnqc460m0DjbVUFdN8Q7yBnuVL71FNp3xA9lszlyq_4nyiGaoctFS2RuhJBDs Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:26.514025 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e63ab9476504ea182edc999531a414a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e63ab9476504ea182edc999531a414a"}]}] Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: bdbde8571537415faab919690206c4b0 Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'n-d-858238-3'} Nov 02 13:41:26.516073 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:26.517066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 13:41:26.518668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.520755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e405163-c04e-4548-b7d1-01fce980dfdc tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.520755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e405163-c04e-4548-b7d1-01fce980dfdc tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858238-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010573 Nov 02 13:41:26.520755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 43/76] 10.222.0.18 () {58 vars in 1194 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/os-hosts/n-d-858238-3/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:26.525171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ce08c5b-c21b-4d2b-bcc4-cc3c6ef9f767 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1302649406", "id": 1711068616, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:26.540583 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-03f7f3b5-14bc-4dd0-a432-481a11e745d8 tempest-FlavorsV261TestJSON-49502401 tempest-FlavorsV261TestJSON-49502401-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.070854 Nov 02 13:41:26.559311 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 34/77] 10.222.0.18 () {60 vars in 1166 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:26.576861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b5200e5-e5dc-454d-8b22-d477e5f286e9 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Calling method '.version_select at 0x7f6f82ad8b80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.577631 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ce08c5b-c21b-4d2b-bcc4-cc3c6ef9f767 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.056091 Nov 02 13:41:26.578429 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 44/78] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:26 2022] POST /compute/v2.1/flavors => generated 438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:26.587204 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-1b5200e5-e5dc-454d-8b22-d477e5f286e9 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b5200e5-e5dc-454d-8b22-d477e5f286e9 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:26.589148 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:41:26.590229 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:26.591479 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 13:41:26.592538 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.595464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b5200e5-e5dc-454d-8b22-d477e5f286e9 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.597180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2629f7b4-0179-4c31-9b1a-14c01b02608d tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.597261 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b5200e5-e5dc-454d-8b22-d477e5f286e9 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.029726 Nov 02 13:41:26.597951 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 35/79] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:26.613141 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2629f7b4-0179-4c31-9b1a-14c01b02608d tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1757110842" status: 202 len: 0 microversion: 2.61 time: 0.032743 Nov 02 13:41:26.613980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1352b6c-52fa-4653-a436-bf4bb0099013 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.624528 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b1352b6c-52fa-4653-a436-bf4bb0099013 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1352b6c-52fa-4653-a436-bf4bb0099013 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Request method failure captured: Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/flavors/1711068616/os-flavor-access HTTP/1.1 Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBMDFK15APLLzCAgWHaPwStUpzzAo8qsKDMRQ1sGsJMLYb5ycUoNlK2TEavb7GU_7ai1ZjqERTRflZHgPljiHr4njfYWNR_NVkgy3Np4eq3iDnlMclo7LFHH8eahKGxrVGkw5Nb9tgQeGUBekIqR22w2jnHlpcx09imOPAx7KEQZ4 Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e25e919744404cb9b2064f572b2aed6f Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:26.627172 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e25e919744404cb9b2064f572b2aed6f"}]}] Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e25e919744404cb9b2064f572b2aed6f Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: feed4f55572b43fc8216530598005de3 Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: exception: Access list not available for public flavors. Nov 02 13:41:26.628623 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1711068616'} Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 13:41:26.629371 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.632887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1352b6c-52fa-4653-a436-bf4bb0099013 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.634345 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1352b6c-52fa-4653-a436-bf4bb0099013 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1711068616/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035277 Nov 02 13:41:26.635468 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 36/80] 10.222.0.18 () {58 vars in 1209 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/flavors/1711068616/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:26.636703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 45/81] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Nov 2 13:41:26 2022] DELETE /compute/v2.1/flavors/1757110842 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:41:26.652407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-111e10ab-036d-4fda-936a-f54f5115e8d2 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.676461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b12d6d15-2d4a-43b6-a5c0-67b627d2b65f tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Calling method '.version_select at 0x7f6f83ef2310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.687789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b12d6d15-2d4a-43b6-a5c0-67b627d2b65f tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'bdbde8571537415faab919690206c4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e63ab9476504ea182edc999531a414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.688721 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-111e10ab-036d-4fda-936a-f54f5115e8d2 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1711068616" status: 202 len: 0 microversion: 2.1 time: 0.047602 Nov 02 13:41:26.689866 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 46/82] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:41:26 2022] DELETE /compute/v2.1/flavors/1711068616 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b12d6d15-2d4a-43b6-a5c0-67b627d2b65f tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Request method failure captured: Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hosts/n-d-858238-3/startup HTTP/1.1 Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN-_MOeVOB6ckh1aIwIxSALpNMpoadt_Ko6lxhXpyx_lyWijEO1ma518PwmW-_TkY1GnaD0-nRUOGhDiOTclbRWoh0L8zav7PBJBKcxbUK6qoYLZDXnqc460m0DjbVUFdN8Q7yBnuVL71FNp3xA9lszlyq_4nyiGaoctFS2RuhJBDs Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:26.690999 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e63ab9476504ea182edc999531a414a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e63ab9476504ea182edc999531a414a"}]}] Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bdbde8571537415faab919690206c4b0 Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'n-d-858238-3'} Nov 02 13:41:26.692520 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:26.693196 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 13:41:26.696974 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.701031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b12d6d15-2d4a-43b6-a5c0-67b627d2b65f tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.701031 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b12d6d15-2d4a-43b6-a5c0-67b627d2b65f tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858238-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.056276 Nov 02 13:41:26.701031 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 37/83] 10.222.0.18 () {58 vars in 1191 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/os-hosts/n-d-858238-3/startup => generated 110 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:26.707664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48af17b0-2e93-43de-8344-42658b4599d9 tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.709447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2f472c49-da85-4de4-9d3e-5ba2e1a7598c tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.762905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48af17b0-2e93-43de-8344-42658b4599d9 tempest-FlavorsV261TestJSON-40792251 tempest-FlavorsV261TestJSON-40792251-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.071052 Nov 02 13:41:26.769104 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 47/84] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:26.775332 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2f472c49-da85-4de4-9d3e-5ba2e1a7598c tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072278 Nov 02 13:41:26.776245 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 38/85] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:26.790657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bee5541b-7f95-4ecd-8dbc-fa5cf99bc5ad tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Calling method '.version_select at 0x7f6f82b26ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.810690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d992f987-25f6-4f39-bb21-ed2295b87527 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2133139311", "id": 727798558, "os-flavor-access:is_public": "False"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:26.836771 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-bee5541b-7f95-4ecd-8dbc-fa5cf99bc5ad tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bee5541b-7f95-4ecd-8dbc-fa5cf99bc5ad tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:26.853016 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:41:26.854287 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:26.854933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 13:41:26.855919 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bee5541b-7f95-4ecd-8dbc-fa5cf99bc5ad tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.856976 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bee5541b-7f95-4ecd-8dbc-fa5cf99bc5ad tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.084608 Nov 02 13:41:26.863585 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 48/86] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:26.879444 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d992f987-25f6-4f39-bb21-ed2295b87527 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.069751 Nov 02 13:41:26.881558 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 39/87] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:26 2022] POST /compute/v2.1/flavors => generated 436 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:26.882402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:26.896997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9201c181-a24a-4f5d-a2de-a0768d5a65af tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Action: 'update', calling method: .version_select at 0x7f6f836acd30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:26.897945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:26.914763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:26.915686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:26.916332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:26.917416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:26.918055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:26.918863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9201c181-a24a-4f5d-a2de-a0768d5a65af tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/os-hosts/n-d-858238-3 HTTP/1.1 Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 51 Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:26.931655 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:26.933120 n-d-858238-3 devstack@n-api.service[137558]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'n-d-858238-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.933941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:26.936285 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9201c181-a24a-4f5d-a2de-a0768d5a65af tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9201c181-a24a-4f5d-a2de-a0768d5a65af tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858238-3" status: 400 len: 199 microversion: 2.1 time: 0.041817 Nov 02 13:41:26.937451 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 40/88] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:26 2022] PUT /compute/v2.1/os-hosts/n-d-858238-3 => generated 199 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:41:27.209998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-182a4484-6cc8-42dc-87f8-3dfc8b0d0182 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:27.214951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-182a4484-6cc8-42dc-87f8-3dfc8b0d0182 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f24af642f30847ee99df41680c6ea3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b14a9a7b5346f5a371559efb3c1239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-182a4484-6cc8-42dc-87f8-3dfc8b0d0182 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Request method failure captured: Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/flavors/727798558/action HTTP/1.1 Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 67 Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN-fpVW47vibKH8cVwptbBt0IYnXL2CV9whnsAkeUUSoeB6SPfA60DAIuVi-Cw0mZo1RTCtPjkblmPHh2kair0j-I-rfkRWv4UNzE1JhlpZTWNaIsM-Xmnq-btm4LxsOB3dQn4XHoRdz2eyoZOLiVvpgqaQ37BSc7kak4TD7x6ilms Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d3b14a9a7b5346f5a371559efb3c1239 Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-26615246 Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:27.219972 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d3b14a9a7b5346f5a371559efb3c1239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d3b14a9a7b5346f5a371559efb3c1239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d3b14a9a7b5346f5a371559efb3c1239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d3b14a9a7b5346f5a371559efb3c1239"}]}] Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-26615246 Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d3b14a9a7b5346f5a371559efb3c1239 Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-26615246 Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsAccessNegativeTestJSON-26615246-project Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: f24af642f30847ee99df41680c6ea3de Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-26615246-project Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: {"addTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} Nov 02 13:41:27.221287 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '727798558', 'body': {'addTenantAccess': {'tenant': 'd3b14a9a7b5346f5a371559efb3c1239'}}} Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:27.221914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 13:41:27.222954 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.227922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-182a4484-6cc8-42dc-87f8-3dfc8b0d0182 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:27.232061 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-182a4484-6cc8-42dc-87f8-3dfc8b0d0182 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] 10.222.0.18 "POST /compute/v2.1/flavors/727798558/action" status: 403 len: 130 microversion: 2.1 time: 0.296804 Nov 02 13:41:27.233387 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 41/89] 10.222.0.18 () {60 vars in 1197 bytes} [Wed Nov 2 13:41:26 2022] POST /compute/v2.1/flavors/727798558/action => generated 130 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:27.244728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e0c6c2a-824b-43bf-9b06-d4c90fc9bd45 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Action: 'update', calling method: .version_select at 0x7f6f82ae7ca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e0c6c2a-824b-43bf-9b06-d4c90fc9bd45 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/os-hosts/n-d-858238-3 HTTP/1.1 Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 51 Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:27.253486 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:27.254785 n-d-858238-3 devstack@n-api.service[137558]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'n-d-858238-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.255670 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.257142 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.258161 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.258161 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:41:27.258161 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:41:27.258161 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:41:27.258161 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.260953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e0c6c2a-824b-43bf-9b06-d4c90fc9bd45 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:27.264102 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e0c6c2a-824b-43bf-9b06-d4c90fc9bd45 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858238-3" status: 400 len: 189 microversion: 2.1 time: 0.029489 Nov 02 13:41:27.264898 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 42/90] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:27 2022] PUT /compute/v2.1/os-hosts/n-d-858238-3 => generated 189 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:41:27.276968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c70ba5f7-e0b7-4237-951b-25104c300241 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:27.344125 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c70ba5f7-e0b7-4237-951b-25104c300241 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/727798558" status: 202 len: 0 microversion: 2.1 time: 0.075855 Nov 02 13:41:27.345197 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 43/91] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:41:27 2022] DELETE /compute/v2.1/flavors/727798558 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:27.361870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75b93f12-b1b2-4db2-90c9-2837cd5cc1f0 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Action: 'update', calling method: .version_select at 0x7f6f82ba00d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:27.366866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75b93f12-b1b2-4db2-90c9-2837cd5cc1f0 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'bdbde8571537415faab919690206c4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e63ab9476504ea182edc999531a414a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75b93f12-b1b2-4db2-90c9-2837cd5cc1f0 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Request method failure captured: Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/os-hosts/n-d-858238-3 HTTP/1.1 Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 50 Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN-_MOeVOB6ckh1aIwIxSALpNMpoadt_Ko6lxhXpyx_lyWijEO1ma518PwmW-_TkY1GnaD0-nRUOGhDiOTclbRWoh0L8zav7PBJBKcxbUK6qoYLZDXnqc460m0DjbVUFdN8Q7yBnuVL71FNp3xA9lszlyq_4nyiGaoctFS2RuhJBDs Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:27.373037 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1e63ab9476504ea182edc999531a414a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1e63ab9476504ea182edc999531a414a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1e63ab9476504ea182edc999531a414a"}]}] Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1e63ab9476504ea182edc999531a414a Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-709288799 Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bdbde8571537415faab919690206c4b0 Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HostsAdminNegativeTestJSON-709288799-project Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 13:41:27.374392 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'n-d-858238-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:27.375215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 13:41:27.376212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.383860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75b93f12-b1b2-4db2-90c9-2837cd5cc1f0 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:27.385877 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75b93f12-b1b2-4db2-90c9-2837cd5cc1f0 tempest-HostsAdminNegativeTestJSON-709288799 tempest-HostsAdminNegativeTestJSON-709288799-project] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858238-3" status: 403 len: 111 microversion: 2.1 time: 0.032176 Nov 02 13:41:27.396140 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 44/92] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:27 2022] PUT /compute/v2.1/os-hosts/n-d-858238-3 => generated 111 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:27.402070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-425de324-7e6d-4e40-a235-9e58c58b4c05 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:27.459854 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-425de324-7e6d-4e40-a235-9e58c58b4c05 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062143 Nov 02 13:41:27.460639 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 45/93] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:27.470614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:27.475425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:27.492914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:27.493402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:27.493838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:27.494555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:27.495012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:27.498531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:27.500825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:27.509650 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-320b4de4-8073-414e-853d-f4d0cf642801 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 0.641842 Nov 02 13:41:27.513942 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:26 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:27.522816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44bf5caf-4554-44e1-9f28-be021197c797 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Action: 'update', calling method: .version_select at 0x7f6f82b08820>, body: {"status": null, "maintenance_mode": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:27.524913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=87 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44bf5caf-4554-44e1-9f28-be021197c797 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/os-hosts/n-d-858238-3 HTTP/1.1 Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 42 Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:27.558346 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: {"status": null, "maintenance_mode": null} Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 13:41:27.560174 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'n-d-858238-3', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi None Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.560916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.562202 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.563183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:41:27.563183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:41:27.563183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 13:41:27.563183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.563741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44bf5caf-4554-44e1-9f28-be021197c797 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:27.566353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44bf5caf-4554-44e1-9f28-be021197c797 tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858238-3" status: 400 len: 127 microversion: 2.1 time: 0.049614 Nov 02 13:41:27.570933 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 50/95] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:27 2022] PUT /compute/v2.1/os-hosts/n-d-858238-3 => generated 127 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:41:27.595068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c477fec8-a0ee-4131-a5f4-f8690e481d5f tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-149974892", "id": 1396329025, "os-flavor-access:is_public": "False"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:27.664202 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c477fec8-a0ee-4131-a5f4-f8690e481d5f tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.093951 Nov 02 13:41:27.664832 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 51/96] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:27 2022] POST /compute/v2.1/flavors => generated 438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:27.687940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01338e63-560d-418b-8793-c2000594e48c tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Action: 'update', calling method: .version_select at 0x7f6f82760ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:27.712257 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.hosts [None req-01338e63-560d-418b-8793-c2000594e48c tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Enabling host nonexistent_hostname. Nov 02 13:41:27.744017 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-01338e63-560d-418b-8793-c2000594e48c tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01338e63-560d-418b-8793-c2000594e48c tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Request method failure captured: Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 50 Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOBVvN8MvT35Bx_tNCoqmJ_rQfInEQl8QneH9rnvXX8QGUNwwEHj9lnjrfh5-Kb0S9r81crQrJ3Hr65BpT-6s7g4JfbDTo89E58E4ooE4xFkwmnBPNiX6BAAZduUrt_ntuQgxX-rU1egPNn0ryj9FmFMcztwkpH63jTNk-uXTFi5Ho Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:27.752214 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f2d5ba9e3cc485ba99926c894ee81ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f2d5ba9e3cc485ba99926c894ee81ad"}]}] Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4f2d5ba9e3cc485ba99926c894ee81ad Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1622620778 Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b272a39149f04e3dbebeffc994cec137 Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1622620778-project-admin Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:27.753450 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:27.754149 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:27.755234 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.758427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01338e63-560d-418b-8793-c2000594e48c tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:27.761971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01338e63-560d-418b-8793-c2000594e48c tempest-HostsAdminNegativeTestJSON-1622620778 tempest-HostsAdminNegativeTestJSON-1622620778-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.095981 Nov 02 13:41:27.768597 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 52/97] 10.222.0.18 () {60 vars in 1211 bytes} [Wed Nov 2 13:41:27 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:27.795010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-846e4b1a-6d72-44ff-a0b1-c202e89d0c50 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:28.018588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:28.487459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:28.500429 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ea51105d-f3e9-47fc-8240-290e5c45fa4c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 1.037263 Nov 02 13:41:28.502909 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 46/98] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:27 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:28.536442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:28.537212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:28.559015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:28.559715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:28.560385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:28.562589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:28.565626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:28.568710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:28.644024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-846e4b1a-6d72-44ff-a0b1-c202e89d0c50 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1396329025/action" status: 200 len: 97 microversion: 2.1 time: 0.869549 Nov 02 13:41:28.644678 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 53/99] 10.222.0.18 () {60 vars in 1200 bytes} [Wed Nov 2 13:41:27 2022] POST /compute/v2.1/flavors/1396329025/action => generated 97 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:28.677609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4ee619f-3014-4e34-99a8-151e9c424ea0 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:28.688023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c4ee619f-3014-4e34-99a8-151e9c424ea0 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f24af642f30847ee99df41680c6ea3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3b14a9a7b5346f5a371559efb3c1239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4ee619f-3014-4e34-99a8-151e9c424ea0 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Request method failure captured: Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/flavors/1396329025/action HTTP/1.1 Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 70 Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN-fpVW47vibKH8cVwptbBt0IYnXL2CV9whnsAkeUUSoeB6SPfA60DAIuVi-Cw0mZo1RTCtPjkblmPHh2kair0j-I-rfkRWv4UNzE1JhlpZTWNaIsM-Xmnq-btm4LxsOB3dQn4XHoRdz2eyoZOLiVvpgqaQ37BSc7kak4TD7x6ilms Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d3b14a9a7b5346f5a371559efb3c1239 Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-26615246 Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:28.710216 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d3b14a9a7b5346f5a371559efb3c1239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d3b14a9a7b5346f5a371559efb3c1239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d3b14a9a7b5346f5a371559efb3c1239"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d3b14a9a7b5346f5a371559efb3c1239"}]}] Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-26615246 Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d3b14a9a7b5346f5a371559efb3c1239 Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-26615246 Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FlavorsAccessNegativeTestJSON-26615246-project Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f24af642f30847ee99df41680c6ea3de Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-26615246-project Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: {"removeTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} Nov 02 13:41:28.711678 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1396329025', 'body': {'removeTenantAccess': {'tenant': 'd3b14a9a7b5346f5a371559efb3c1239'}}} Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can( Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:28.712435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 13:41:28.713630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:28.714776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4ee619f-3014-4e34-99a8-151e9c424ea0 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:28.714776 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4ee619f-3014-4e34-99a8-151e9c424ea0 tempest-FlavorsAccessNegativeTestJSON-26615246 tempest-FlavorsAccessNegativeTestJSON-26615246-project] 10.222.0.18 "POST /compute/v2.1/flavors/1396329025/action" status: 403 len: 133 microversion: 2.1 time: 0.049060 Nov 02 13:41:28.732119 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 54/100] 10.222.0.18 () {60 vars in 1200 bytes} [Wed Nov 2 13:41:28 2022] POST /compute/v2.1/flavors/1396329025/action => generated 133 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:28.754209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10067748-bb8e-49d1-8e3d-ee8dc01d9550 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d3b14a9a7b5346f5a371559efb3c1239"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:29.139929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10067748-bb8e-49d1-8e3d-ee8dc01d9550 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1396329025/action" status: 200 len: 21 microversion: 2.1 time: 0.406273 Nov 02 13:41:29.140823 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 55/101] 10.222.0.18 () {60 vars in 1200 bytes} [Wed Nov 2 13:41:28 2022] POST /compute/v2.1/flavors/1396329025/action => generated 21 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:29.402804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:29.433276 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7fc96709-5fd1-46f5-9546-ccedc61dc3ec tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 0.885279 Nov 02 13:41:29.443721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8bcbce1-6ae5-4c58-ba05-9239c6ec58c5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:29.448029 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 47/102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:28 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:29.464155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7b6eb2b1-697f-4aa5-bef5-7c4baf6b2cc6 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:29.482501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8bcbce1-6ae5-4c58-ba05-9239c6ec58c5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.336779 Nov 02 13:41:29.494838 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 56/103] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:29.523623 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7b6eb2b1-697f-4aa5-bef5-7c4baf6b2cc6 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1396329025" status: 202 len: 0 microversion: 2.1 time: 0.074032 Nov 02 13:41:29.524810 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 48/104] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:41:29 2022] DELETE /compute/v2.1/flavors/1396329025 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:29.533840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:29.535807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:29.572351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:29.576304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:29.577100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:29.578563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:29.584547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:29.588534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:30.066406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9348012f-b058-48ee-8f45-7f858d462de7 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-394768657", "id": 1086109857, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:30.135913 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9348012f-b058-48ee-8f45-7f858d462de7 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.615083 Nov 02 13:41:30.144003 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 57/105] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:29 2022] POST /compute/v2.1/flavors => generated 424 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:30.157541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c6bea23-4466-4d30-8963-ad24b275a968 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:30.212843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c6bea23-4466-4d30-8963-ad24b275a968 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.065681 Nov 02 13:41:30.218486 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 58/106] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:30 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:30.233593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab6a4d24-3b2a-4a3d-904d-fab289a9b597 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:30.245504 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab6a4d24-3b2a-4a3d-904d-fab289a9b597 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025326 Nov 02 13:41:30.247556 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 59/107] 10.222.0.18 () {58 vars in 1182 bytes} [Wed Nov 2 13:41:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:30.267589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-72d4a02c-5f12-47b1-9b57-af363a38cd2f tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-881934173", "id": 583930324, "os-flavor-access:is_public": "False"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:30.321618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-72d4a02c-5f12-47b1-9b57-af363a38cd2f tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.065592 Nov 02 13:41:30.323928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 60/108] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:30 2022] POST /compute/v2.1/flavors => generated 435 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:30.332894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19c313b4-4299-47a1-a68a-7c3d9cbe5699 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1256451525", "id": 1960985029, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:30.344082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:30.353512 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-11762b9d-7438-4e28-8c50-4a0bed5b8455 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.827237 Nov 02 13:41:30.353928 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 49/109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:29 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:30.374903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15038683-7e72-49f4-bec9-3c07afa347fc tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "19a035d1c1ff44939c6a6caaa23346e6"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:30.417252 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19c313b4-4299-47a1-a68a-7c3d9cbe5699 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.087966 Nov 02 13:41:30.421636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 61/110] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:30 2022] POST /compute/v2.1/flavors => generated 425 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:30.460451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9cbffb71-869f-4f6a-bffc-c6f9fb49c841 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:30.485352 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9cbffb71-869f-4f6a-bffc-c6f9fb49c841 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047204 Nov 02 13:41:30.488552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 62/111] 10.222.0.18 () {58 vars in 1182 bytes} [Wed Nov 2 13:41:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:41:30.507049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:30.508612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:30.515574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:30.539778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:30.542600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:30.544935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:30.547258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:30.549230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:30.551007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:30.572417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=81 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:30.860521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:30.873366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7a52bfa-c812-421c-aa70-b841549fee25 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 0.382972 Nov 02 13:41:30.889006 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 63/112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:30 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:30.889006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2890896-c082-45f1-ac19-8b20b4bae511 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Action: 'create', calling method: .version_select at 0x7f6f82a79c10>, body: {"keypair": {"name": "tempest-keypair-390475980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPja8m9qwFUQ/Hux+n7kkWcjNvGZ8aa8GCRVK+CeFyzUcl9KG/UxNS3wzyfWwgrb5YZW0XC/rHYZjNbXO2pa4MMIYIVkjdCUe9yWENqYL22bIkFsbeYkyzSspNvr1PBovw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:30.927582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d2890896-c082-45f1-ac19-8b20b4bae511 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Getting quotas for project ae2d07f95c10416ebb9d30228f5e907e. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:30.943718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d2890896-c082-45f1-ac19-8b20b4bae511 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Getting quotas for user 351f7415c03346aa81dfbd73a686327f and project ae2d07f95c10416ebb9d30228f5e907e. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:30.971861 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-15038683-7e72-49f4-bec9-3c07afa347fc tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] HTTP exception thrown: Flavor access not found for 24 / 19a035d1c1ff44939c6a6caaa23346e6 combination. Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15038683-7e72-49f4-bec9-3c07afa347fc tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Request method failure captured: Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/flavors/583930324/action HTTP/1.1 Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 70 Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOBMDFK15APLLzCAgWHaPwStUpzzAo8qsKDMRQ1sGsJMLYb5ycUoNlK2TEavb7GU_7ai1ZjqERTRflZHgPljiHr4njfYWNR_NVkgy3Np4eq3iDnlMclo7LFHH8eahKGxrVGkw5Nb9tgQeGUBekIqR22w2jnHlpcx09imOPAx7KEQZ4 Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e25e919744404cb9b2064f572b2aed6f Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:30.977179 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e25e919744404cb9b2064f572b2aed6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e25e919744404cb9b2064f572b2aed6f"}]}] Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e25e919744404cb9b2064f572b2aed6f Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-761508046 Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: feed4f55572b43fc8216530598005de3 Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: {"removeTenantAccess": {"tenant": "19a035d1c1ff44939c6a6caaa23346e6"}} Nov 02 13:41:30.978524 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: exception: Flavor access not found for 24 / 19a035d1c1ff44939c6a6caaa23346e6 combination. Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '583930324', 'body': {'removeTenantAccess': {'tenant': '19a035d1c1ff44939c6a6caaa23346e6'}}} Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 13:41:30.979443 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 19a035d1c1ff44939c6a6caaa23346e6 combination. Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 19a035d1c1ff44939c6a6caaa23346e6 combination. Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:30.980722 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:30.983561 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:30.983561 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:30.983561 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:30.983561 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:30.983561 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 19a035d1c1ff44939c6a6caaa23346e6 combination. Nov 02 13:41:30.983561 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:31.000914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15038683-7e72-49f4-bec9-3c07afa347fc tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Returning 404 to user: Flavor access not found for 24 / 19a035d1c1ff44939c6a6caaa23346e6 combination. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:31.002252 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-15038683-7e72-49f4-bec9-3c07afa347fc tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/583930324/action" status: 404 len: 124 microversion: 2.1 time: 0.647272 Nov 02 13:41:31.011936 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 50/113] 10.222.0.18 () {60 vars in 1197 bytes} [Wed Nov 2 13:41:30 2022] POST /compute/v2.1/flavors/583930324/action => generated 124 bytes in 657 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:31.023477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4ecbc7a4-42c2-4f4a-bfb5-4603976ad1be tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:31.024612 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2890896-c082-45f1-ac19-8b20b4bae511 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147991 Nov 02 13:41:31.025998 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 64/114] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:41:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:31.079594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=17,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:31.091108 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4ecbc7a4-42c2-4f4a-bfb5-4603976ad1be tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/583930324" status: 202 len: 0 microversion: 2.1 time: 0.076858 Nov 02 13:41:31.091999 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 51/115] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:41:31 2022] DELETE /compute/v2.1/flavors/583930324 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:31.101031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f9fe312-92ff-4a6e-9558-a40f1d24c8e6 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:31.155334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f9fe312-92ff-4a6e-9558-a40f1d24c8e6 tempest-FlavorsAccessNegativeTestJSON-761508046 tempest-FlavorsAccessNegativeTestJSON-761508046-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.059151 Nov 02 13:41:31.157452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 65/116] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:31 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:31.382211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:31.383001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:31.409648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:31.411586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:31.413711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:31.414773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:31.415473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:31.416156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:31.896692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:31.897691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:31.906002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:31.912643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:31.918598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:31.921380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:31.923262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:31.923897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.174115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:32.185118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d74f77f0-1d46-40dd-8476-f4293244428e tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 0.291611 Nov 02 13:41:32.188852 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 66/117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:31 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:32.594789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:32.604286 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f1439ce4-c2fa-4637-899b-55d95fe4f2e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 1.226395 Nov 02 13:41:32.607372 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 52/118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:31 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:33.213882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:33.215758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:33.225337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.229284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.229922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.230803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.233075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.233661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.627944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:33.628556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:33.642278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.642773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.643304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.644008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.644456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.644874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.947193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:33.957576 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-274aafb9-8b51-4fd8-84c0-d99817453b9c tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.333556 Nov 02 13:41:33.959697 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 53/119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:33 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:34.211132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:34.227771 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8dafd0dd-ffbd-4e44-8703-afe77a1ad31d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 1.017561 Nov 02 13:41:34.228405 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 67/120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:33 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:34.782396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-889046515", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "1960985029", "adminPass": "***", "networks": [{"uuid": "9a1f410c-4d86-44fe-b1f7-c4d888001bb0"}], "security_groups": [{"name": "tempest-securitygroup--2060794844"}], "key_name": "tempest-keypair-390475980", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:34.812682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:35.063560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] validate_networks() for [('9a1f410c-4d86-44fe-b1f7-c4d888001bb0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:35.225371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-622a5efb-1261-4e39-9903-d3be080ce47d req-37fb6d99-5ac0-400a-9cd9-43bf00eacd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d1b403-a5b1-418e-b179-ef4729e45a89", "name": "network-vif-plugged", "status": "completed", "tag": "1282ecb9-f390-46fe-a8ad-931398cb8367"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:35.248867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-622a5efb-1261-4e39-9903-d3be080ce47d req-37fb6d99-5ac0-400a-9cd9-43bf00eacd8a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.249352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-622a5efb-1261-4e39-9903-d3be080ce47d req-37fb6d99-5ac0-400a-9cd9-43bf00eacd8a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.249784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-622a5efb-1261-4e39-9903-d3be080ce47d req-37fb6d99-5ac0-400a-9cd9-43bf00eacd8a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.272468 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-622a5efb-1261-4e39-9903-d3be080ce47d req-37fb6d99-5ac0-400a-9cd9-43bf00eacd8a service nova] Creating event network-vif-plugged:1282ecb9-f390-46fe-a8ad-931398cb8367 for instance 21d1b403-a5b1-418e-b179-ef4729e45a89 on n-h1-858238-3 Nov 02 13:41:35.285195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-622a5efb-1261-4e39-9903-d3be080ce47d req-37fb6d99-5ac0-400a-9cd9-43bf00eacd8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.694724 Nov 02 13:41:35.287648 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 54/121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:35.302509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:35.303348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:35.320971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.324241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.327122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.329213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.329859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.332547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.808188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:35.819631 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d4227d96-9dc8-4902-83ae-48bf643dd9f9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.530620 Nov 02 13:41:35.821717 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 55/122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:35 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:35.827543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:35.828535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:35.841917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.842669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.843454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.853080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.858996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.859777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.312980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:36.333731 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-90ab7aaf-b6cf-4c32-b477-c434a68a39d7 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 0.510563 Nov 02 13:41:36.334527 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 56/123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:35 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:36.778557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f83ef2280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:36.780623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.781181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.781559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.800634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.801722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.802331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.816014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.816736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.817336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.834174 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45e47bff-ef7c-45ec-b17a-b09d400967a4 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.475983 Nov 02 13:41:36.834174 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 57/124] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:36.902751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Calling method '.version_select at 0x7f6f82ba09d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:36.905569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.906102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.906536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.924937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.925433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.925867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.944511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.945014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.946930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.957509 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-80a1aac5-bb86-4583-b310-9d69645dbb7f tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.129139 Nov 02 13:41:36.958330 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 58/125] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:36.971837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f8374ef70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:36.973779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.974399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.975479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.992694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.993417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.993992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.009843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.010494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.011122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.018720 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-253e44a7-448b-4e4d-a222-f45c09834338 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.052784 Nov 02 13:41:37.031835 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 59/126] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 13:41:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:37.038022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.038779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:37.047812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.048297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.048730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.049481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.051007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.051462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.061392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:37.062641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:37.063499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:37.064058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:37.064644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:37.085874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.086652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.087414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.088583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.089047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.089661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.140935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Getting quotas for project ae2d07f95c10416ebb9d30228f5e907e. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:37.148498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Getting quotas for user 351f7415c03346aa81dfbd73a686327f and project ae2d07f95c10416ebb9d30228f5e907e. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:37.163191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:37.166411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:37.278872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:37.279635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53a11b3f-be36-47f5-ae32-46f00f87bcc4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.500121 Nov 02 13:41:37.282666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 68/127] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:41:37.290310 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ab12953f-8e77-46fa-9696-d0a9f3d44504 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.254901 Nov 02 13:41:37.291632 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 60/128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:37.301436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Calling method '.version_select at 0x7f6f826dcf70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.303595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.308215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.310230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.328740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f82ab1a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.351706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.352194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.354118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.367684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.368510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.370633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.412498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.412498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.414114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.499634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.507369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.519995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.581709 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1e723a7-17ad-4e18-b54c-66f2a1deb899 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.248811 Nov 02 13:41:37.581709 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 61/129] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:37.581989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.581989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.581989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.582172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cc226a79-73bf-4f4d-a153-fe9b510bbecd tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.582172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cc226a79-73bf-4f4d-a153-fe9b510bbecd tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:37.608675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5968fd9-d894-4a88-a47f-40e3e342de2b tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h1-858238-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.314286 Nov 02 13:41:37.611195 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 69/130] 10.222.0.18 () {58 vars in 1212 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-858238-3/servers => generated 196 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:37.632726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.633418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:37.662573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.669796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.670317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.671542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.672165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.674285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.765883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cc226a79-73bf-4f4d-a153-fe9b510bbecd tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:37.779897 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cc226a79-73bf-4f4d-a153-fe9b510bbecd tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1263 microversion: 2.1 time: 0.214175 Nov 02 13:41:37.781048 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 62/131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1263 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:37.785858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f82875c10>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.789362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.789951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.791632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.817281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.818260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.818892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.827392 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9428b2ac-c2bd-4276-b0d0-e07c43c68689 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.045049 Nov 02 13:41:37.828271 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:37.844497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Calling method '.version_select at 0x7f6f82875550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.846425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.847015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.847570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.874601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.879643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.880542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.900950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.901730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.902314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.912614 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-92c18c45-00c0-4d66-8f05-1f3b2dca36c8 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071653 Nov 02 13:41:37.913240 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 64/133] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:37.918523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ab5c554-a1fd-4247-a544-8430350e7c43 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f82ab1790>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.920808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab5c554-a1fd-4247-a544-8430350e7c43 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.921549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab5c554-a1fd-4247-a544-8430350e7c43 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.921983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab5c554-a1fd-4247-a544-8430350e7c43 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.949217 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ab5c554-a1fd-4247-a544-8430350e7c43 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.034750 Nov 02 13:41:37.957712 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 65/134] 10.222.0.18 () {58 vars in 1179 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:37.957712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Calling method '.version_select at 0x7f6f82ba0670>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.958313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.958572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.959006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.985971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.987745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.988187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.998970 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-092c04b7-f1c4-4991-9ebe-8a031bf679f4 tempest-HypervisorAdminUnderV252Test-1002328167 tempest-HypervisorAdminUnderV252Test-1002328167-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h1-858238-3/search" status: 200 len: 104 microversion: 2.1 time: 0.046990 Nov 02 13:41:37.999950 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 66/135] 10.222.0.18 () {58 vars in 1209 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-858238-3/search => generated 104 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:38.005353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f82a825e0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.014855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.016982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.018391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.059967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.060481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.060915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.091762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.092246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.092674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.109045 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5ebb468a-52e3-422d-8efd-d38adb52df96 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.107646 Nov 02 13:41:38.110348 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 67/136] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:38.122458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f828e58b0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.125693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.125693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.125693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.146763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.147430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.148198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.158130 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cf155621-7ca7-4a83-b969-c751993d3ae9 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039616 Nov 02 13:41:38.159231 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 68/137] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:38.176690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f82ab1e50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.179656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.180258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.181488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.192899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:38.207586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.208248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.208791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.224904 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d704c9c-4ea6-422d-99a9-454783f5ae42 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.051745 Nov 02 13:41:38.226077 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 69/138] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:38.245799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Calling method '.version_select at 0x7f6f828e5c10>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.248829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.249737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.251059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.267241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.267976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.268618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.284671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.285451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.286027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.364453 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-77233bd1-2cbb-42aa-9693-eb275844ff00 tempest-HypervisorAdminTestJSON-671482416 tempest-HypervisorAdminTestJSON-671482416-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.123806 Nov 02 13:41:38.366337 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1173 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:38.376575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.379548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:38.388495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.390064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.390709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.391635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.392284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.393098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.644422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:38.658296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c616b6b7-8bd2-4915-8606-db989a3746a3 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.290303 Nov 02 13:41:38.658893 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 71/140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:38.701328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:38.735457 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7263eabe-79a1-49e7-9934-eade20405ec8 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1338 microversion: 2.1 time: 1.121980 Nov 02 13:41:38.737072 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 70/141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1338 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:38.810253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.811060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:38.827063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.830517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.831610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.834431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.835575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.837108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.261271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:39.278991 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29d761a6-55da-42dc-9402-740909f86e84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1315 microversion: 2.1 time: 0.472593 Nov 02 13:41:39.280788 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 72/142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:39.691720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:39.693151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:39.718477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:39.719651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:39.720437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.721986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:39.723468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:39.724743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.763148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:39.763821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:39.787914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:39.788388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:39.788829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.789582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:39.790048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:39.790480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.120910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:40.132444 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5ec72b79-fcfd-4cfa-8999-4cc22ad7448c tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1487 microversion: 2.1 time: 0.373895 Nov 02 13:41:40.143269 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 73/143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:39 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:40.164867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:40.166715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:40.181378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.182044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.182722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.183583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.184212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.184689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.528986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:40.546108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17e32d6a-7583-4edc-a26b-05f07217af05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.860111 Nov 02 13:41:40.584584 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 71/144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:39 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:40.604050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:40.605429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:40.614211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.616289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.617412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.618457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.619065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.619818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.678048 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-475a14ff-3a37-4c0c-80c1-d380d5789071 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1638 microversion: 2.1 time: 0.523545 Nov 02 13:41:40.680683 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 74/145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:40 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1638 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:40.706621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:40.707755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:40.722183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.723381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.724482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.725322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.725859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.726279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.785307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:41:40.798484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:40.810866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26519605-6215-4686-9201-d1a31c067b13 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1321 microversion: 2.1 time: 0.224555 Nov 02 13:41:40.812282 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 72/146] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:40 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:41.017340 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d66c9171-e990-497a-8490-eabeed426f08 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 204 len: 0 microversion: 2.1 time: 0.316015 Nov 02 13:41:41.019237 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 75/147] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:41:40 2022] DELETE /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:41:41.032144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:41.036230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:41.047141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.051278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.052454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.054497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.055750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.056750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.566781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:41.582788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:41.583829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:41.589531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bcaa4e4b-acec-4d2a-a06e-f5d256ad1b85 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1493 microversion: 2.1 time: 0.565812 Nov 02 13:41:41.602121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 73/148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:41 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1493 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:41.603231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.603964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.604612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.605511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.606391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.607112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.824155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f40d0ab8-0104-4778-95cc-7a2efbd9c798 req-6860008e-3fb2-491d-9959-655716047b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8d3824-1588-4be6-af45-b90614454f00", "name": "network-vif-plugged", "status": "completed", "tag": "1a7f665b-8989-42ac-b8ef-3ab4e30f6815"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:41.849601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f40d0ab8-0104-4778-95cc-7a2efbd9c798 req-6860008e-3fb2-491d-9959-655716047b47 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.851672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f40d0ab8-0104-4778-95cc-7a2efbd9c798 req-6860008e-3fb2-491d-9959-655716047b47 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.853358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f40d0ab8-0104-4778-95cc-7a2efbd9c798 req-6860008e-3fb2-491d-9959-655716047b47 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.884320 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f40d0ab8-0104-4778-95cc-7a2efbd9c798 req-6860008e-3fb2-491d-9959-655716047b47 service nova] Creating event network-vif-plugged:1a7f665b-8989-42ac-b8ef-3ab4e30f6815 for instance 1c8d3824-1588-4be6-af45-b90614454f00 on n-h2-858238-3 Nov 02 13:41:41.894122 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f40d0ab8-0104-4778-95cc-7a2efbd9c798 req-6860008e-3fb2-491d-9959-655716047b47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074377 Nov 02 13:41:41.896161 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 74/149] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:41.904087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:41.905294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:41.919140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.920031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.920699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.928880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.929956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.930667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.608031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:42.627715 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fbaaffc3-d8ca-42d8-ba39-9ad1e7c5f8e9 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 1.050356 Nov 02 13:41:42.628313 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 76/150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:41 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:42.984411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Calling method '.version_select at 0x7f6f828e5280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:42.986430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.986911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.987513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.019837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.020331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.020772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.050470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.051235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.051838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.066130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:43.070293 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-daad24f8-5139-420e-a823-9bb35f0e5b42 tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.439463 Nov 02 13:41:43.071109 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 77/151] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:41:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:43.073994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f2910a4-753f-45e6-8e13-f7395b5d6ef3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 1.175702 Nov 02 13:41:43.074569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 75/152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:41 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:43.085745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:43.086369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:43.097479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Calling method '.version_select at 0x7f6f825f5820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:43.099578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.099717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.100081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.100335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.100764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.101043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.101901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.102520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.103110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.135377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.138029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.139683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.149668 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04cfc6a2-45c7-4ef4-a8dc-2bdf89a9950c tempest-HypervisorAdminV228Test-195975968 tempest-HypervisorAdminV228Test-195975968-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.060787 Nov 02 13:41:43.151146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 76/153] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:41:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:43.301519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:43.310871 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31e61eba-bb49-4c54-8573-49407f42c044 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1493 microversion: 2.1 time: 0.237210 Nov 02 13:41:43.311759 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 78/154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:43 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1493 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:43.653867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:43.654521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:43.665540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.666185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.666443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.667177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.667633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.674329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.101718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:44.102422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:44.115405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:44.115992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:44.116488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.117206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:44.117655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:44.127541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.237829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:44.266222 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5e85eb5-0282-455f-b066-8b285e40fa24 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1320 microversion: 2.1 time: 0.616077 Nov 02 13:41:44.266858 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 77/155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:43 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:44.346624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:44.347654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:44.379199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:44.381121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:44.383842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.384889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:44.390105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:44.392454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.616686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:44.630927 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-58677439-784d-421b-9ec5-b3db144ca090 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.525457 Nov 02 13:41:44.642906 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 79/156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:44 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:44.673015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961cce2a8c2540dd8808c6efce1fe5fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a2115449bc41f084281dd7f6e060fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:44.695400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3001d5f-a009-4069-a98e-dc4d27428bb2 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 200 len: 1451 microversion: 2.1 time: 0.355810 Nov 02 13:41:44.713062 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 78/157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:44 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 1451 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:45.000863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-282255c8-1d1c-448f-9e24-9caf4965b652 req-2c4e576a-9c0e-4013-afb5-5a52df433e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d1b403-a5b1-418e-b179-ef4729e45a89", "name": "network-vif-deleted", "tag": "1282ecb9-f390-46fe-a8ad-931398cb8367"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:45.029068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-282255c8-1d1c-448f-9e24-9caf4965b652 req-2c4e576a-9c0e-4013-afb5-5a52df433e09 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.030778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-282255c8-1d1c-448f-9e24-9caf4965b652 req-2c4e576a-9c0e-4013-afb5-5a52df433e09 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.031611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-282255c8-1d1c-448f-9e24-9caf4965b652 req-2c4e576a-9c0e-4013-afb5-5a52df433e09 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.080949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-282255c8-1d1c-448f-9e24-9caf4965b652 req-2c4e576a-9c0e-4013-afb5-5a52df433e09 service nova] Creating event network-vif-deleted:1282ecb9-f390-46fe-a8ad-931398cb8367 for instance 21d1b403-a5b1-418e-b179-ef4729e45a89 on n-h1-858238-3 Nov 02 13:41:45.096926 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-282255c8-1d1c-448f-9e24-9caf4965b652 req-2c4e576a-9c0e-4013-afb5-5a52df433e09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107841 Nov 02 13:41:45.098367 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 80/158] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:45.300285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.301790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.315385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.316095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.318782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.320023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.332070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.332821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.983008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Calling method '.version_select at 0x7f6f82711ee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.988136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.993178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.993956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.025995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.025995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.025995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.079146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.080240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.080900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.100845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.101243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.101840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.138137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.142845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.143509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.159406 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ee27dbde-7e88-4439-aebc-e2d93146c9d8 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.834206 Nov 02 13:41:46.160773 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 81/159] 10.222.0.18 () {60 vars in 1243 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:46.303440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:46.334062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73d21d70-e623-4134-90ce-76e57f12c23f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1470 microversion: 2.1 time: 1.041009 Nov 02 13:41:46.347328 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 79/160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1470 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:46.347328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:46.347328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:46.354321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.355132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.357034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.358001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.363231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.368120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.576950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ef6a385-451e-4cff-a979-1f50cc17576b tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:46.587133 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ef6a385-451e-4cff-a979-1f50cc17576b tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.412542 Nov 02 13:41:46.599989 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 82/161] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:46.607760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:46.609057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:46.619341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.620057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.620667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.623898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.624571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.625177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.641663 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] HTTP exception thrown: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Request method failure captured: Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 HTTP/1.1 Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNqAl5-1H2yVef0ANT704dpAAuKxQB15oHkGtEYkDmZgLpyYFKPabU_ps9JJZJvipNNAq3nHO_NFBz9mXqDD9nfZ_6a_KyBmwFJVO96NETJkKwIUF6NSGoysvg_SlqsRJhPvCzs3lgtfSzY1zgNX2wcP6cTsOBhcGFiqCigWyNT2qE Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 79a2115449bc41f084281dd7f6e060fb Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:46.649710 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79a2115449bc41f084281dd7f6e060fb"}]}] Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 79a2115449bc41f084281dd7f6e060fb Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminTestJSON-710196382-project Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 961cce2a8c2540dd8808c6efce1fe5fd Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminTestJSON-710196382-project Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:46.651016 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '21d1b403-a5b1-418e-b179-ef4729e45a89'} Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:46.651713 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:46.653038 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:46.656512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Returning 404 to user: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:46.658053 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dc042d05-a8bd-4284-a3d6-7bef0dea27dc tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 404 len: 111 microversion: 2.1 time: 0.056545 Nov 02 13:41:46.658912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 83/162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:46.664287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Calling method '.version_select at 0x7f6f8279c430>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:46.670054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.670835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.671533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.695793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.696916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.697640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.713302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.714128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.714761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.729906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.730597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.731818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.766580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:46.769435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.769927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.770536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.774842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:46.785151 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76fb36f7-ee13-4843-b2c0-a879e7281b97 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.124135 Nov 02 13:41:46.787301 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 84/163] 10.222.0.18 () {60 vars in 1222 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:46.813094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:46.824869 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8c371e03-815e-443f-8500-986a85e3c3c9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.489009 Nov 02 13:41:46.832641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 80/164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:46.840221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1181dd87-b15d-4b3e-aecf-6f064cc271a9 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.053702 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1181dd87-b15d-4b3e-aecf-6f064cc271a9 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.219535 Nov 02 13:41:47.054764 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 81/165] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:47.074302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ea8fd2d-5b45-4a82-834e-a26f2356a3e8 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:47.104912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ea8fd2d-5b45-4a82-834e-a26f2356a3e8 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.105806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ea8fd2d-5b45-4a82-834e-a26f2356a3e8 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.106492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ea8fd2d-5b45-4a82-834e-a26f2356a3e8 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.115216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.116304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:47.125506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:47.127707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.128601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.129392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.130338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.130968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.131780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.172863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:41:47.173071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:47.354420 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45cdf6d0-f2b5-4f38-8705-04d33956036b tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 204 len: 0 microversion: 2.1 time: 0.563727 Nov 02 13:41:47.358292 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 85/166] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:41:46 2022] DELETE /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:41:47.368058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Calling method '.version_select at 0x7f6f82832280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.372379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.372878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.373314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.393525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.394016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.394441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.404117 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-afbcb327-86e4-4f54-b094-106abb93bdd6 tempest-HypervisorAdminV253TestBase-1543087867 tempest-HypervisorAdminV253TestBase-1543087867-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/42203c17-f808-4c9a-9f73-ac70e8081b96" status: 200 len: 791 microversion: 2.53 time: 0.044410 Nov 02 13:41:47.417197 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 86/167] 10.222.0.18 () {60 vars in 1298 bytes} [Wed Nov 2 13:41:47 2022] GET /compute/v2.1/os-hypervisors/42203c17-f808-4c9a-9f73-ac70e8081b96 => generated 791 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:47.423682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e282ef54-0d79-49f2-ab08-aba21e15fe51 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.441555 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e282ef54-0d79-49f2-ab08-aba21e15fe51 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031783 Nov 02 13:41:47.442387 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 87/168] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:47.446917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-91c3db03-26e4-4594-a87f-b00a93f3d1fd req-26570a19-9bc9-4293-b707-f5b7940665fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1c6755-70f9-4cac-9d48-00f65b4a9507", "tag": "076b4d52-c42b-4920-a944-59b40ffa9b3c"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:47.460894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-91c3db03-26e4-4594-a87f-b00a93f3d1fd req-26570a19-9bc9-4293-b707-f5b7940665fe service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.461361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-91c3db03-26e4-4594-a87f-b00a93f3d1fd req-26570a19-9bc9-4293-b707-f5b7940665fe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.461781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-91c3db03-26e4-4594-a87f-b00a93f3d1fd req-26570a19-9bc9-4293-b707-f5b7940665fe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.476271 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-91c3db03-26e4-4594-a87f-b00a93f3d1fd req-26570a19-9bc9-4293-b707-f5b7940665fe service nova] Creating event network-changed:076b4d52-c42b-4920-a944-59b40ffa9b3c for instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 on n-h2-858238-3 Nov 02 13:41:47.484719 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-91c3db03-26e4-4594-a87f-b00a93f3d1fd req-26570a19-9bc9-4293-b707-f5b7940665fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039971 Nov 02 13:41:47.486514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 88/169] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:47.527660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.530073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:47.546468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.547199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.547806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.548513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.549053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.549925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.759746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ea8fd2d-5b45-4a82-834e-a26f2356a3e8 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.704148 Nov 02 13:41:47.763931 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 82/170] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:47 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:47.775753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:47.779390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfc4ae7f-25c8-4c5c-81b5-2680586422aa tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.807307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfc4ae7f-25c8-4c5c-81b5-2680586422aa tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037977 Nov 02 13:41:47.818141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 83/171] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:47.833433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:47.833592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-460a97ac-e0d0-44d4-9d82-125faeff6ee2 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.844558 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47927c1a-1173-4422-9ff1-ab60a9d1df03 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1476 microversion: 2.1 time: 0.355892 Nov 02 13:41:47.851631 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 89/172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:47 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:47.861408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2db0c166-11ee-4f8a-bebf-c63653b81ad1 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.891726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-460a97ac-e0d0-44d4-9d82-125faeff6ee2 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.071320 Nov 02 13:41:47.893831 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 84/173] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:47 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:47.901216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:47.905200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:47.925202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.926479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.933927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.933927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:47.933927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:47.934172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:47.961512 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2db0c166-11ee-4f8a-bebf-c63653b81ad1 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.104179 Nov 02 13:41:47.962135 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 90/174] 10.222.0.18 () {58 vars in 1165 bytes} [Wed Nov 2 13:41:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:47.982982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4d25d478-42e1-44ab-9c30-8e18a4fdf764 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-883583113"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:47.998075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-4d25d478-42e1-44ab-9c30-8e18a4fdf764 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid 1d548bbb-5f3e-43f7-b8da-e7a050d04396 for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:48.063465 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4d25d478-42e1-44ab-9c30-8e18a4fdf764 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.097422 Nov 02 13:41:48.064498 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 91/175] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.070114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-22c0c30e-858c-4475-a9e5-8975a0946ae0 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.088375 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-22c0c30e-858c-4475-a9e5-8975a0946ae0 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022649 Nov 02 13:41:48.089370 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 92/176] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.095620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1239632d-33fa-4200-ba86-85300ff53813 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:48.116476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1239632d-33fa-4200-ba86-85300ff53813 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.117080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1239632d-33fa-4200-ba86-85300ff53813 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.117445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1239632d-33fa-4200-ba86-85300ff53813 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.334747 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1239632d-33fa-4200-ba86-85300ff53813 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.244533 Nov 02 13:41:48.335386 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 93/177] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.344865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4650b6e5-cdef-4f9f-b809-d0a253345f1d tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.426448 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4650b6e5-cdef-4f9f-b809-d0a253345f1d tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.083967 Nov 02 13:41:48.426742 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 94/178] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.436729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a333b425-67e7-430f-91d4-1fb0a6b8f8e6 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.461125 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a333b425-67e7-430f-91d4-1fb0a6b8f8e6 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.029796 Nov 02 13:41:48.462259 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 95/179] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.473666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c9f04d0-5539-41f6-9be2-5bad3fc87a0d tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.492933 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c9f04d0-5539-41f6-9be2-5bad3fc87a0d tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029089 Nov 02 13:41:48.504188 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 96/180] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.515270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc66124b-26a7-4ecc-bb22-b3f1db594922 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:48.531066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc66124b-26a7-4ecc-bb22-b3f1db594922 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.533088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc66124b-26a7-4ecc-bb22-b3f1db594922 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.533451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc66124b-26a7-4ecc-bb22-b3f1db594922 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.574112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:48.588482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dbc74c16-bbfd-41e2-9ca2-112534494c9f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.693353 Nov 02 13:41:48.589073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 85/181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:47 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.622125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f62d09fb-0dc0-416d-9fda-1d921c6ecb80 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.633198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f62d09fb-0dc0-416d-9fda-1d921c6ecb80 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031704 Nov 02 13:41:48.658454 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 86/182] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.667864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-158c33b3-a48e-4179-a31c-2a89b5906035 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.740005 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-158c33b3-a48e-4179-a31c-2a89b5906035 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.076447 Nov 02 13:41:48.751137 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 87/183] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.773009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb716190-dfbd-41d8-b21c-afd034ab7c58 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.794948 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc66124b-26a7-4ecc-bb22-b3f1db594922 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.285148 Nov 02 13:41:48.797479 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 97/184] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.807637 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb716190-dfbd-41d8-b21c-afd034ab7c58 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050054 Nov 02 13:41:48.812789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4325b3ae-0985-4600-ad49-fd0d92b282a9 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.820316 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 88/185] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.832897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3be0007c-6a76-40fd-af22-eb7e05dcf5f7 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.897906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3be0007c-6a76-40fd-af22-eb7e05dcf5f7 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.075310 Nov 02 13:41:48.903474 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4325b3ae-0985-4600-ad49-fd0d92b282a9 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.097767 Nov 02 13:41:48.904645 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 98/186] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:48 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:48.919759 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 89/187] 10.222.0.18 () {58 vars in 1144 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.922424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.923981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:48.932106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3962cfd8-dabe-42cf-b97d-8881895a872a tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.942595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.943468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.944188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.945511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.946409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.947047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.950045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3962cfd8-dabe-42cf-b97d-8881895a872a tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025286 Nov 02 13:41:48.954067 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 90/188] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.973210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d37d121b-3249-48f0-b612-37d9a4683bed tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-602025223"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:48.980432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-d37d121b-3249-48f0-b612-37d9a4683bed tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid c2d8e8b9-8961-4082-aca2-cbe4d8fda3c7 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:49.024003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d37d121b-3249-48f0-b612-37d9a4683bed tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.056003 Nov 02 13:41:49.037443 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 91/189] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:49.047743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01b7ee65-a130-478c-ba42-d1d93a357d76 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.085304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:49.098692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01b7ee65-a130-478c-ba42-d1d93a357d76 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.059710 Nov 02 13:41:49.099619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 92/190] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:49.112113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9eabe844-8a83-42ed-acc4-af14c6f5f2db tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:49.125589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eabe844-8a83-42ed-acc4-af14c6f5f2db tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:49.126242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eabe844-8a83-42ed-acc4-af14c6f5f2db tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:49.126803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eabe844-8a83-42ed-acc4-af14c6f5f2db tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:49.163602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:49.210300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:49.224245 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-124d9d1d-8d42-42bc-bdb4-4c7341e244c2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1476 microversion: 2.1 time: 0.316350 Nov 02 13:41:49.237675 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 99/191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:49.328617 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9eabe844-8a83-42ed-acc4-af14c6f5f2db tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.224123 Nov 02 13:41:49.329884 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 93/192] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:49 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:49.335156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-acc8ca0a-9a4a-4076-8899-b5efe4f287c6 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.353464 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-acc8ca0a-9a4a-4076-8899-b5efe4f287c6 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022264 Nov 02 13:41:49.354162 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 94/193] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:49.488854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1772781641", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e66fe5e6-396f-407f-9138-ece1c71d4efa"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:49.559714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a67310bb-ede2-41ad-9f67-e838091d54be tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.564623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a67310bb-ede2-41ad-9f67-e838091d54be tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 13:41:49.567311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] validate_networks() for [('e66fe5e6-396f-407f-9138-ece1c71d4efa', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a67310bb-ede2-41ad-9f67-e838091d54be tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin] Request method failure captured: Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOcaQ3pV6nYPIw0oeZOrPNacsNZfsEudF0nYTevbN3W4y3W1KvaGIh8UQbVHhX1qhQ4dfb3rG27wq4ss0BAiUPK6Rq4HPQdGY_ErcrHvoRp7UyBhZ366hn0dq6DcaWYluIxSQRMcK7osm7fE2YLWyTsLUiUd_151_GkaG5ikKQZv5M Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e5bc9978f54b4f398daac84f2bcf7f94 Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:49.576407 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e5bc9978f54b4f398daac84f2bcf7f94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e5bc9978f54b4f398daac84f2bcf7f94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e5bc9978f54b4f398daac84f2bcf7f94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e5bc9978f54b4f398daac84f2bcf7f94"}]}] Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e5bc9978f54b4f398daac84f2bcf7f94 Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: eccd9be6428a4df984b95dee90bb92e7 Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:49.577776 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid timestamp for date invalid_time Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'invalid_time'} Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:49.578359 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 13:41:49.579418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.580078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a67310bb-ede2-41ad-9f67-e838091d54be tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:49.581843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a67310bb-ede2-41ad-9f67-e838091d54be tempest-InstanceUsageAuditLogNegativeTestJSON-388848486 tempest-InstanceUsageAuditLogNegativeTestJSON-388848486-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.225455 Nov 02 13:41:49.582452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 95/194] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:41:49.587948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-934f68b2-0d5f-4d04-a693-3bc036de109d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.596838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-934f68b2-0d5f-4d04-a693-3bc036de109d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.012789 Nov 02 13:41:49.598295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 96/195] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:49.602949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fa5773c-0337-46b5-9eba-9231237273dd tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.612002 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fa5773c-0337-46b5-9eba-9231237273dd tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012148 Nov 02 13:41:49.613956 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 97/196] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:49.943476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79909bd4-3d3f-43fe-83a8-0103f269327c tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.945944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79909bd4-3d3f-43fe-83a8-0103f269327c tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3a44901d48934e3f8cbe0d001061a8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a93d2171874a978b8c88abb13f7ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79909bd4-3d3f-43fe-83a8-0103f269327c tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Request method failure captured: Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnObSrPY8wLd53c1FapAN99oCxPGAILXeJa1bvBr7WMjDn9I5UQhTy82nOKZBudE7cekohl5MzFPPXP60idT_0hCv4Fzcdb9AXVNL268wOffA4BP4xr7LrllHH3a8ok6hW7sNZq4sMSgJrTPU_5ONdNMPOUJ8SmJ3bmPQf3Lgd1MA8U Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f8a93d2171874a978b8c88abb13f7ae2 Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:49.947747 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8a93d2171874a978b8c88abb13f7ae2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8a93d2171874a978b8c88abb13f7ae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8a93d2171874a978b8c88abb13f7ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8a93d2171874a978b8c88abb13f7ae2"}]}] Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f8a93d2171874a978b8c88abb13f7ae2 Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3a44901d48934e3f8cbe0d001061a8fa Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project Nov 02 13:41:49.949398 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:49.949985 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 13:41:49.957925 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:49.960908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79909bd4-3d3f-43fe-83a8-0103f269327c tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:49.960908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79909bd4-3d3f-43fe-83a8-0103f269327c tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.334513 Nov 02 13:41:49.960908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 98/197] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:49.960908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4d533d1-65bc-4eda-9259-64939602685d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:49.988095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4d533d1-65bc-4eda-9259-64939602685d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:49.989583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4d533d1-65bc-4eda-9259-64939602685d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:49.990019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4d533d1-65bc-4eda-9259-64939602685d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.221532 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4d533d1-65bc-4eda-9259-64939602685d tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.268966 Nov 02 13:41:50.222893 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 99/198] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:49 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:50.231855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:50.236362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:50.251410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:50.252600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:50.256099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.258164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:50.258842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:50.259663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.612140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:50.621291 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b5295b4-26d5-45ab-9253-e8960e7516ab tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.396930 Nov 02 13:41:50.625846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 100/199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:50 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:50.630764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ee19637-0efc-4c70-beb6-4211309113f7 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:50.656539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ee19637-0efc-4c70-beb6-4211309113f7 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.029395 Nov 02 13:41:50.657751 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 101/200] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:50 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:50.674198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40a5556a-adf5-4a02-a2c9-65def4685d91 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:50.676898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40a5556a-adf5-4a02-a2c9-65def4685d91 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3a44901d48934e3f8cbe0d001061a8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a93d2171874a978b8c88abb13f7ae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40a5556a-adf5-4a02-a2c9-65def4685d91 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Request method failure captured: Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2013:41:49 HTTP/1.1 Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnObSrPY8wLd53c1FapAN99oCxPGAILXeJa1bvBr7WMjDn9I5UQhTy82nOKZBudE7cekohl5MzFPPXP60idT_0hCv4Fzcdb9AXVNL268wOffA4BP4xr7LrllHH3a8ok6hW7sNZq4sMSgJrTPU_5ONdNMPOUJ8SmJ3bmPQf3Lgd1MA8U Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f8a93d2171874a978b8c88abb13f7ae2 Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:50.678549 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8a93d2171874a978b8c88abb13f7ae2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8a93d2171874a978b8c88abb13f7ae2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8a93d2171874a978b8c88abb13f7ae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8a93d2171874a978b8c88abb13f7ae2"}]}] Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f8a93d2171874a978b8c88abb13f7ae2 Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3a44901d48934e3f8cbe0d001061a8fa Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project Nov 02 13:41:50.679739 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2022-11-02 13:41:49'} Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:50.680370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 13:41:50.681702 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:50.682596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40a5556a-adf5-4a02-a2c9-65def4685d91 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:50.682596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40a5556a-adf5-4a02-a2c9-65def4685d91 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476 tempest-InstanceUsageAuditLogNegativeTestJSON-1714780476-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 13:41:49" status: 403 len: 128 microversion: 2.1 time: 0.021446 Nov 02 13:41:50.682596 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 102/201] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:41:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2013%3A41%3A49 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:50.688683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b88e3b14-1bb0-4709-aa4d-915317b211dc tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:50.722198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b88e3b14-1bb0-4709-aa4d-915317b211dc tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.040000 Nov 02 13:41:50.723457 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 103/202] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:50 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:50.733988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:50.734946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:50.742072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:50.742839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:50.743589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.744488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:50.745132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:50.745747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.919770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:50.931609 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0481d9f-4c06-47d4-b3ba-bd1e05dd82c8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1476 microversion: 2.1 time: 0.206580 Nov 02 13:41:50.932423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 104/203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:50 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:50.937557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46fc7708-2930-4a7c-93b5-b670fd0af2ed tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:50.967030 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46fc7708-2930-4a7c-93b5-b670fd0af2ed tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.033268 Nov 02 13:41:50.969042 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 105/204] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:41:50 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:50.981620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1cd37ab-5169-4fa7-b990-10cac922db35 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-703421846"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:50.992197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-d1cd37ab-5169-4fa7-b990-10cac922db35 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid 6058241d-a5f7-4485-805a-cd48636dfb69 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:51.038732 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1cd37ab-5169-4fa7-b990-10cac922db35 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068289 Nov 02 13:41:51.040834 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 106/205] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:51.049042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bd4e291-6b9d-46b3-b2f2-2c0d3a2cffa1 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:51.070994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4bd4e291-6b9d-46b3-b2f2-2c0d3a2cffa1 tempest-FlavorsV2TestJSON-1786407797 tempest-FlavorsV2TestJSON-1786407797-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027595 Nov 02 13:41:51.073160 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 107/206] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:41:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:51.082342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:51.083488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:51.084125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:51.084723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:51.085137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:51.089808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1605309e-a627-46e6-aede-e0c060346797 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:51.100674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.101156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.101591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.102314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.102760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.103208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.108071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1605309e-a627-46e6-aede-e0c060346797 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.109426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1605309e-a627-46e6-aede-e0c060346797 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.110284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1605309e-a627-46e6-aede-e0c060346797 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.144361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:51.154830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for user 55e26f05091944cb910f81488056c057 and project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:51.177730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:51.185597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:51.375467 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45f464dd-3f78-4058-9472-908cf90f5a4b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.149050 Nov 02 13:41:51.385643 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 100/207] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:41:51.405817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a433185e-61c7-4d7d-86c4-88be4fe0de40 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:51.406985 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1605309e-a627-46e6-aede-e0c060346797 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.332343 Nov 02 13:41:51.408286 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 108/208] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:51 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:51.409313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a433185e-61c7-4d7d-86c4-88be4fe0de40 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:51.423365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b3ef0a7-3efb-4be4-86be-8e4820aa741c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:51.450801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b3ef0a7-3efb-4be4-86be-8e4820aa741c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.451440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b3ef0a7-3efb-4be4-86be-8e4820aa741c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.451812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b3ef0a7-3efb-4be4-86be-8e4820aa741c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.747658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a433185e-61c7-4d7d-86c4-88be4fe0de40 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:51.765114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a433185e-61c7-4d7d-86c4-88be4fe0de40 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:51.767866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b3ef0a7-3efb-4be4-86be-8e4820aa741c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.351310 Nov 02 13:41:51.768572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 109/209] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:51 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:51.770100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a433185e-61c7-4d7d-86c4-88be4fe0de40 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:51.773453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:51.774048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:51.777449 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a433185e-61c7-4d7d-86c4-88be4fe0de40 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1262 microversion: 2.25 time: 0.383937 Nov 02 13:41:51.781413 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 101/210] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:41:51 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1262 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:51.796885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d2e59156-fd6b-4dfd-b3a0-0b4294c0e96a tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:51.813787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.815868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.816148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.816885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.817349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.817752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.904291 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d2e59156-fd6b-4dfd-b3a0-0b4294c0e96a tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.121528 Nov 02 13:41:51.913458 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 102/211] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:51 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:51.932023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d1b60c6e-2f3e-4209-a3f7-9d0c1a5108f7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-885493240"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:51.968398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-d1b60c6e-2f3e-4209-a3f7-9d0c1a5108f7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid da1d7bf4-571a-4a1a-8405-9adf5c9ba848 for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:52.012680 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d1b60c6e-2f3e-4209-a3f7-9d0c1a5108f7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.094980 Nov 02 13:41:52.013288 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 103/212] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:52.031353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-92dac48c-9130-4e84-8c5b-79a670432b18 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1656303404"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:52.035220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-92dac48c-9130-4e84-8c5b-79a670432b18 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid 07c7187d-a79c-4326-8a9c-4e37d4924d7a for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:52.117018 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-92dac48c-9130-4e84-8c5b-79a670432b18 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101077 Nov 02 13:41:52.119505 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 104/213] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:52.148423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:52.151646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:52.178558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.179060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.186542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.191051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.191685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.192250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.233358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:52.242426 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd5b3ad9-e447-4eee-ba12-57ac14903020 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.472430 Nov 02 13:41:52.250685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 110/214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:51 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:52.260864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b0a6dad6-0329-4588-a17f-8407aec03621 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:52.300505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.301135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.301742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.302296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lazy-loading 'fault' on Instance uuid 1c8d3824-1588-4be6-af45-b90614454f00 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:41:52.336122 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b0a6dad6-0329-4588-a17f-8407aec03621 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.082669 Nov 02 13:41:52.336724 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 111/215] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:52 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:52.344558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e0d781f-4de4-407d-b869-9726d1462b42 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:52.374899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0d781f-4de4-407d-b869-9726d1462b42 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.375442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0d781f-4de4-407d-b869-9726d1462b42 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.375879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0d781f-4de4-407d-b869-9726d1462b42 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.447272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:52.459462 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2e3462e-9f3e-4e89-8d95-2aac7800319e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 200 len: 1310 microversion: 2.1 time: 0.329984 Nov 02 13:41:52.460720 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 105/216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:52 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:52.467133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3abf5ddf-47d8-4e89-8560-e0bd124f64b7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:52.477058 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-3abf5ddf-47d8-4e89-8560-e0bd124f64b7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3abf5ddf-47d8-4e89-8560-e0bd124f64b7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Request method failure captured: Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNsY4yPClXoonzmz6RA6x3A37ITTKOB3Pt5NafIa0ralxMbX7SxBDvFB1yF3rpNW01d8fPsrzI0jxZd-LpVak6ixg1E5WOBpsPLKOHJWS7ZxdKBovX55kxIFCMtwvtWQzG8feV3nhPuPrjXw4ao_a5UnkV01XrFhajPo7u-4TRgBqw Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:52.497932 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15a0996d86754103a702ff6196f5a9ef"}]}] Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 23a7b83bb25c475588b4674c99ccf842 Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: exception: Aggregate 6 could not be found. Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '6'} Nov 02 13:41:52.499442 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.500290 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Nov 02 13:41:52.502251 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.506896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3abf5ddf-47d8-4e89-8560-e0bd124f64b7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:52.508684 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3abf5ddf-47d8-4e89-8560-e0bd124f64b7 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.046303 Nov 02 13:41:52.510450 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 106/217] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:41:52 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:52.678370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e0d781f-4de4-407d-b869-9726d1462b42 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.340564 Nov 02 13:41:52.686655 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 112/218] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:52 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:52.692796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-662ec808-52a9-46fc-b852-e0653f309605 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:52.740833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-662ec808-52a9-46fc-b852-e0653f309605 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-662ec808-52a9-46fc-b852-e0653f309605 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Request method failure captured: Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNsY4yPClXoonzmz6RA6x3A37ITTKOB3Pt5NafIa0ralxMbX7SxBDvFB1yF3rpNW01d8fPsrzI0jxZd-LpVak6ixg1E5WOBpsPLKOHJWS7ZxdKBovX55kxIFCMtwvtWQzG8feV3nhPuPrjXw4ao_a5UnkV01XrFhajPo7u-4TRgBqw Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:52.743120 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15a0996d86754103a702ff6196f5a9ef"}]}] Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23a7b83bb25c475588b4674c99ccf842 Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: exception: Aggregate 6 could not be found. Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6'} Nov 02 13:41:52.744852 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:52.751339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.752979 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-662ec808-52a9-46fc-b852-e0653f309605 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-662ec808-52a9-46fc-b852-e0653f309605 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.056671 Nov 02 13:41:52.755651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 113/219] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:52 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:52.766653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:52.793230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.794104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.798796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.846314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-858238-3. Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 39 Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:52.852866 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: {"add_host": {"host": "n-h2-858238-3"}} Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:52.854301 n-d-858238-3 devstack@n-api.service[137559]: exception: Aggregate 7 already has host n-h2-858238-3. Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-858238-3'}}} Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:41:52.855212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858238-3-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 13:41:52.856511 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 13:41:52.857923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:41:52.859072 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858238-3-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 13, 41, 52, 825934), 'updated_at': None, 'host': 'n-h2-858238-3', 'aggregate_id': 7}] Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.860409 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-858238-3. Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.862931 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-858238-3. Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:52.864607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:52.869062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-858238-3. Nov 02 13:41:52.869062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.869062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-858238-3. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:52.869062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db26d6ae-c05a-43ae-a0f9-a04bd5919a55 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.112503 Nov 02 13:41:52.869910 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 114/220] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:52 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 13:41:52.876417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab41b814-5a8b-42ad-b7ea-f892a8cf872e tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1837011268", "name": "tempest-test_aggregate-83592852"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:52.881257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-ab41b814-5a8b-42ad-b7ea-f892a8cf872e tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid 6224f51e-5219-4ee7-83ae-dc8b2279114c for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:52.950066 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab41b814-5a8b-42ad-b7ea-f892a8cf872e tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.078805 Nov 02 13:41:52.954602 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 115/221] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Nov 2 13:41:52 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:52.955384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-005e7a35-adb6-4fe0-82a5-1b25474af19e req-f1a8d577-be3f-4e00-935b-d07f7d88ae3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8d3824-1588-4be6-af45-b90614454f00", "name": "network-vif-deleted", "tag": "1a7f665b-8989-42ac-b8ef-3ab4e30f6815"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:52.975653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-005e7a35-adb6-4fe0-82a5-1b25474af19e req-f1a8d577-be3f-4e00-935b-d07f7d88ae3f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.978362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:52.978987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:52.979321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-005e7a35-adb6-4fe0-82a5-1b25474af19e req-f1a8d577-be3f-4e00-935b-d07f7d88ae3f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.979866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-005e7a35-adb6-4fe0-82a5-1b25474af19e req-f1a8d577-be3f-4e00-935b-d07f7d88ae3f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.998234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.998910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.999555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.001758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:53.002972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:53.003909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.006042 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-005e7a35-adb6-4fe0-82a5-1b25474af19e req-f1a8d577-be3f-4e00-935b-d07f7d88ae3f service nova] Creating event network-vif-deleted:1a7f665b-8989-42ac-b8ef-3ab4e30f6815 for instance 1c8d3824-1588-4be6-af45-b90614454f00 on n-h2-858238-3 Nov 02 13:41:53.016282 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-005e7a35-adb6-4fe0-82a5-1b25474af19e req-f1a8d577-be3f-4e00-935b-d07f7d88ae3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503621 Nov 02 13:41:53.018240 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 107/222] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:53.041292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2139462c-66b5-4d8a-828e-ba7aa84231a7 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:53.071944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2139462c-66b5-4d8a-828e-ba7aa84231a7 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:53.073872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2139462c-66b5-4d8a-828e-ba7aa84231a7 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:53.074848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2139462c-66b5-4d8a-828e-ba7aa84231a7 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.140472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:53.152923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:53.156396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:53.160466 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe0d7c50-82d7-43dc-8dd1-66ec3b044b5c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1266 microversion: 2.25 time: 0.201409 Nov 02 13:41:53.162129 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 116/223] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:41:52 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:53.176150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a9c9db2-a4da-4484-9292-80c24517dfac tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.256901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a9c9db2-a4da-4484-9292-80c24517dfac tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.073916 Nov 02 13:41:53.257577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 117/224] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:53 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:53.260838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:53.268061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39405232-8f47-4cc7-bec4-101829abfa68 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.277411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-39405232-8f47-4cc7-bec4-101829abfa68 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39405232-8f47-4cc7-bec4-101829abfa68 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Request method failure captured: Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNsY4yPClXoonzmz6RA6x3A37ITTKOB3Pt5NafIa0ralxMbX7SxBDvFB1yF3rpNW01d8fPsrzI0jxZd-LpVak6ixg1E5WOBpsPLKOHJWS7ZxdKBovX55kxIFCMtwvtWQzG8feV3nhPuPrjXw4ao_a5UnkV01XrFhajPo7u-4TRgBqw Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:53.288239 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15a0996d86754103a702ff6196f5a9ef"}]}] Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23a7b83bb25c475588b4674c99ccf842 Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: exception: Aggregate 8 could not be found. Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8'} Nov 02 13:41:53.289762 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.290613 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Nov 02 13:41:53.291766 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.292906 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2139462c-66b5-4d8a-828e-ba7aa84231a7 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.267876 Nov 02 13:41:53.293008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39405232-8f47-4cc7-bec4-101829abfa68 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:53.293098 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 108/225] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:53 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:53.293179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39405232-8f47-4cc7-bec4-101829abfa68 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.027033 Nov 02 13:41:53.293179 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 118/226] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:41:53 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:53.309325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.312108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73c4e8a7-f69c-4e9b-b9d5-d5ae5e2eb460 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.313552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:53.321927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:53.322719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:53.323380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.324279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:53.324938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:53.325612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.337179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-73c4e8a7-f69c-4e9b-b9d5-d5ae5e2eb460 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73c4e8a7-f69c-4e9b-b9d5-d5ae5e2eb460 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Request method failure captured: Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNsY4yPClXoonzmz6RA6x3A37ITTKOB3Pt5NafIa0ralxMbX7SxBDvFB1yF3rpNW01d8fPsrzI0jxZd-LpVak6ixg1E5WOBpsPLKOHJWS7ZxdKBovX55kxIFCMtwvtWQzG8feV3nhPuPrjXw4ao_a5UnkV01XrFhajPo7u-4TRgBqw Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:53.340074 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/15a0996d86754103a702ff6196f5a9ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_15a0996d86754103a702ff6196f5a9ef"}]}] Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 15a0996d86754103a702ff6196f5a9ef Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1098052134 Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23a7b83bb25c475588b4674c99ccf842 Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminTestJSON-1098052134-project-admin Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: exception: Aggregate 8 could not be found. Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8'} Nov 02 13:41:53.342039 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:53.342941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.344580 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73c4e8a7-f69c-4e9b-b9d5-d5ae5e2eb460 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73c4e8a7-f69c-4e9b-b9d5-d5ae5e2eb460 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.040869 Nov 02 13:41:53.348130 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 119/227] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:53 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:53.362187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af48c65a-7d0c-48dc-962e-6a40d5b57ecb tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.379381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:53.436404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af48c65a-7d0c-48dc-962e-6a40d5b57ecb tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.086907 Nov 02 13:41:53.439679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 120/228] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:53 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:53.467244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-701ebde1-a50f-471f-b04f-abaae29de6d5 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1120411835"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:53.476794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-701ebde1-a50f-471f-b04f-abaae29de6d5 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid bb95363e-f115-45a7-beb6-48f576959a96 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:53.512249 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-701ebde1-a50f-471f-b04f-abaae29de6d5 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065138 Nov 02 13:41:53.513991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 121/229] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:53.524153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ade4ea4-0d63-4887-82f2-0f4225bea90f tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1672426920"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:53.529042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-9ade4ea4-0d63-4887-82f2-0f4225bea90f tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid 29e25c88-c3fd-4917-9b92-926622c4dd3e for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:53.597146 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ade4ea4-0d63-4887-82f2-0f4225bea90f tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079432 Nov 02 13:41:53.598708 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 122/230] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:53.613779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.614121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:53.624314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:53.624805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:53.625239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.626449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:53.628570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:53.629030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:53.667050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] HTTP exception thrown: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Request method failure captured: Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 HTTP/1.1 Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNpFWegXLrvnj1OdVDfdhBNrujlR57HMuUc-9hX-_uv1sgUZ66r--2hRgOc50OFO-AIsxTKkqKyFcOxO9kzMBhEqaQ22MFr_YiVuPPoJ-69p6CL-fKTxGb7TelmM2js5CxzC56903VnG1EG8M0gg0veeHPPCkMwZOjbqDf8bOzTG-E Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:53.674069 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b63f9d4f2a534ce6b03bba55cfc49e76"}]}] Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a6caa3a4f63a4f729948679403b2fe21 Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:41:53.675498 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1c8d3824-1588-4be6-af45-b90614454f00'} Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:53.676278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:41:53.677528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:53.678691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Returning 404 to user: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:53.678691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e2482ac-ed00-4570-b9da-0e2041eec515 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 404 len: 111 microversion: 2.1 time: 0.069837 Nov 02 13:41:53.679027 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 123/231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:53 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:53.693002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0db57c30-295a-44b5-ae71-39f9fe9bd13f tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.714787 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0db57c30-295a-44b5-ae71-39f9fe9bd13f tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.032660 Nov 02 13:41:53.723437 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 124/232] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:41:53 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:53.843600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:53.856911 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c667300-fc08-4267-9487-831aede0443a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.562442 Nov 02 13:41:53.872166 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 109/233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:53 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:53.886181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b3904946-dfa3-46f7-86d5-9ccb25058a61 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:53.952563 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b3904946-dfa3-46f7-86d5-9ccb25058a61 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.075197 Nov 02 13:41:53.953442 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 110/234] 10.222.0.18 () {60 vars in 1191 bytes} [Wed Nov 2 13:41:53 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:53.969755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9870a3c9-ba5b-46b3-9c36-ca38041adeeb tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:53.996024 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9870a3c9-ba5b-46b3-9c36-ca38041adeeb tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.031232 Nov 02 13:41:53.998575 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 111/235] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:41:53 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:54.010031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4bdc01a9-5f4e-4660-a1ef-dd754d962f7a tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:54.053105 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4bdc01a9-5f4e-4660-a1ef-dd754d962f7a tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.047074 Nov 02 13:41:54.058959 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 112/236] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:54 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 13:41:54.065920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b490e316-cf2a-4d3d-8231-0f9240e0c181 req-75aca578-d2f3-4da7-be51-c9ef7931de5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1c6755-70f9-4cac-9d48-00f65b4a9507", "name": "network-vif-plugged", "status": "completed", "tag": "076b4d52-c42b-4920-a944-59b40ffa9b3c"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:54.091678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b490e316-cf2a-4d3d-8231-0f9240e0c181 req-75aca578-d2f3-4da7-be51-c9ef7931de5f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:54.092154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b490e316-cf2a-4d3d-8231-0f9240e0c181 req-75aca578-d2f3-4da7-be51-c9ef7931de5f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:54.092616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b490e316-cf2a-4d3d-8231-0f9240e0c181 req-75aca578-d2f3-4da7-be51-c9ef7931de5f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:54.118171 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b490e316-cf2a-4d3d-8231-0f9240e0c181 req-75aca578-d2f3-4da7-be51-c9ef7931de5f service nova] Creating event network-vif-plugged:076b4d52-c42b-4920-a944-59b40ffa9b3c for instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 on n-h2-858238-3 Nov 02 13:41:54.133054 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b490e316-cf2a-4d3d-8231-0f9240e0c181 req-75aca578-d2f3-4da7-be51-c9ef7931de5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071952 Nov 02 13:41:54.134312 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 113/237] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:54.148488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-23a96b5d-c69c-4071-9d1b-039d59ba15fc tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-631482754", "availability_zone": "tempest-test_az-769030584"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:54.207021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-23a96b5d-c69c-4071-9d1b-039d59ba15fc tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid ba7562c9-0a9c-4c22-bf93-3aa7905aab64 for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:54.269558 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-23a96b5d-c69c-4071-9d1b-039d59ba15fc tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.133545 Nov 02 13:41:54.278692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 114/238] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Nov 2 13:41:54 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:54.283847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-94969094", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:54.364863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:54.541016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8e11303-b197-4a6e-89e0-320d48b2f0e7 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:54.545361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b8e11303-b197-4a6e-89e0-320d48b2f0e7 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '60681a6ed05f45cdac69259e3baac493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bcbd1bd69c4cd19dbad395b630a382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8e11303-b197-4a6e-89e0-320d48b2f0e7 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Request method failure captured: Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 39 Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN2TF1L2DSsjR3DM0OIu51JJism8rQfnKK1TxIK45XSQa5BaFdz7DmSnVEdzW3U4W2JDZrEgAo3BdI1F7Po6XlonuA98NN-sbzV0Ylhv6JenWTk3tzb8lK9Qey_WmU1bIQLqJCvVyWJACHa8G8Gafm650kia2CrqJSJCNwhZL6k5gA Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:54.546969 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3bcbd1bd69c4cd19dbad395b630a382"}]}] Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 60681a6ed05f45cdac69259e3baac493 Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: {"add_host": {"host": "n-h2-858238-3"}} Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:54.548420 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-858238-3'}}} Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:54.549303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 13:41:54.550515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:54.574305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8e11303-b197-4a6e-89e0-320d48b2f0e7 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:54.576586 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8e11303-b197-4a6e-89e0-320d48b2f0e7 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.850843 Nov 02 13:41:54.579922 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 125/239] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 13:41:53 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 856 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:54.595463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:54.599771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:54.616178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:54.617052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:54.619085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:54.620106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:54.621146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:54.622856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:54.735599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:54.752584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:54.758003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:54.759215 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5338895-d515-45bd-b203-c0d0a68e38a7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1332 microversion: 2.25 time: 0.177968 Nov 02 13:41:54.763465 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 126/240] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:41:54 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:54.769134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af6f70ec-c6f4-4ea7-8350-9b2ab6b955f4 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-631482754_new", "availability_zone": "tempest-test_az-769030584_new"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:54.974406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:54.975394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:54.976043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:54.976639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:54.977447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:54.988816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:54.989236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:54.989468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6f70ec-c6f4-4ea7-8350-9b2ab6b955f4 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:54.990356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6f70ec-c6f4-4ea7-8350-9b2ab6b955f4 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:54.990708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:54.991248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6f70ec-c6f4-4ea7-8350-9b2ab6b955f4 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:54.992075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:54.992684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:54.993252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.019782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Getting quotas for project b63f9d4f2a534ce6b03bba55cfc49e76. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:55.024633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Getting quotas for user a6caa3a4f63a4f729948679403b2fe21 and project b63f9d4f2a534ce6b03bba55cfc49e76. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:55.039752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:55.042893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:55.053606 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af6f70ec-c6f4-4ea7-8350-9b2ab6b955f4 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 334 microversion: 2.1 time: 0.288976 Nov 02 13:41:55.056715 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 127/241] 10.222.0.18 () {60 vars in 1173 bytes} [Wed Nov 2 13:41:54 2022] PUT /compute/v2.1/os-aggregates/11 => generated 334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:55.068923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28e68977-a4df-4e0b-914b-32012af8ca74 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.104533 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28e68977-a4df-4e0b-914b-32012af8ca74 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.046616 Nov 02 13:41:55.105471 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 128/242] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:55 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:55.111053 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5314b270-34c6-4942-8682-c9ab3652194b tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830891 Nov 02 13:41:55.115441 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 115/243] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:41:55.124691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.125993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:55.127937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c38bf923-5f0a-4415-8968-496c5c92ad57 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.145303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.147041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.148435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.149603 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c38bf923-5f0a-4415-8968-496c5c92ad57 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.032402 Nov 02 13:41:55.150688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.151854 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 116/244] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:41:55 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:55.152007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.152613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.165243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-00384c75-21c0-440c-8e23-7b79c5bd3350 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2077230967"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.170801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-00384c75-21c0-440c-8e23-7b79c5bd3350 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid e2d38aa6-166c-48c5-b5d0-a4fe86cef432 for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:55.202188 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-00384c75-21c0-440c-8e23-7b79c5bd3350 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047504 Nov 02 13:41:55.210226 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 117/245] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:55.214191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-97efff33-f211-4f91-bc7b-4c1b892b3d6f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.214804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-97efff33-f211-4f91-bc7b-4c1b892b3d6f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:55.322670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-97efff33-f211-4f91-bc7b-4c1b892b3d6f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:55.335079 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-97efff33-f211-4f91-bc7b-4c1b892b3d6f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1218 microversion: 2.1 time: 0.124480 Nov 02 13:41:55.337246 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 118/246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:55 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:55.344283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f85a67c6-0dab-4dee-accd-e61025532f22 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.384125 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f85a67c6-0dab-4dee-accd-e61025532f22 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.045535 Nov 02 13:41:55.389262 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 119/247] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:55 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:55.401702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1155624667"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.432836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.437658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.439212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.466128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.467506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.468385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.488713 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1155624667 could not be found. Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 58 Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:55.492434 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: {"add_host": {"host": "tempest-nonexist_host-1155624667"}} Nov 02 13:41:55.493611 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: exception: Compute host tempest-nonexist_host-1155624667 could not be found. Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1155624667'}}} Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1155624667' is not mapped to any cell Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.494318 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 02 13:41:55.495404 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1155624667 could not be found. Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1155624667 could not be found. Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.498134 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1155624667 could not be found. Nov 02 13:41:55.499279 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.502102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1155624667 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.504204 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-696ae33a-785a-4e4a-99be-3bfd355db177 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.117712 Nov 02 13:41:55.505656 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 120/248] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:55.512707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-025d170e-ed26-4835-81a2-30714509633c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1985197292"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.516116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:55.517116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-025d170e-ed26-4835-81a2-30714509633c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Generated uuid 320c12f0-06fd-4702-809d-3f729d11668b for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:55.524575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73e33873-0869-4177-a99c-a7c44c99d58f tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1389 microversion: 2.1 time: 0.416448 Nov 02 13:41:55.535286 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 129/249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:55 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1389 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:55.547434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-afe200f1-f16e-4f3f-a993-10fef66d6be4 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.554150 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-025d170e-ed26-4835-81a2-30714509633c tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047163 Nov 02 13:41:55.555687 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 121/250] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:55.570519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79fbc0f4-b350-484f-81d0-937a9b5ed90a tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.587888 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79fbc0f4-b350-484f-81d0-937a9b5ed90a tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.022983 Nov 02 13:41:55.589600 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-afe200f1-f16e-4f3f-a993-10fef66d6be4 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.057839 Nov 02 13:41:55.590419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 130/251] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:55 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:55.592253 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 122/252] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:41:55 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:55.609831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ccafb75f-b6df-40be-8397-da04aea4b88c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.621534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-512b07ef-10b7-4933-a993-dfeba6f70e51 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ccafb75f-b6df-40be-8397-da04aea4b88c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 283 Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:55.628876 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.630246 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:41:55.630805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.631402 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.633433 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.634326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:41:55.634326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:41:55.634326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:41:55.634326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.634326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ccafb75f-b6df-40be-8397-da04aea4b88c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.636547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ccafb75f-b6df-40be-8397-da04aea4b88c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035811 Nov 02 13:41:55.637200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 131/253] 10.222.0.18 () {60 vars in 1165 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:41:55.652366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-626c219b-231e-4123-a87f-6e733508ef9e tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-626c219b-231e-4123-a87f-6e733508ef9e tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 27 Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:55.660799 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: {"aggregate": {"name": ""}} Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:55.662272 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.663829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:41:55.665973 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.667316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-626c219b-231e-4123-a87f-6e733508ef9e tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.667316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-626c219b-231e-4123-a87f-6e733508ef9e tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.020409 Nov 02 13:41:55.667316 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 132/254] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:41:55.684451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-701787fd-813d-4cb9-89db-06d09982002d tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1127109024"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.690079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-701787fd-813d-4cb9-89db-06d09982002d tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '60681a6ed05f45cdac69259e3baac493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bcbd1bd69c4cd19dbad395b630a382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:55.691327 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-512b07ef-10b7-4933-a993-dfeba6f70e51 tempest-AggregatesAdminTestJSON-1098052134 tempest-AggregatesAdminTestJSON-1098052134-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.070973 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-701787fd-813d-4cb9-89db-06d09982002d tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Request method failure captured: Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 60 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN2TF1L2DSsjR3DM0OIu51JJism8rQfnKK1TxIK45XSQa5BaFdz7DmSnVEdzW3U4W2JDZrEgAo3BdI1F7Po6XlonuA98NN-sbzV0Ylhv6JenWTk3tzb8lK9Qey_WmU1bIQLqJCvVyWJACHa8G8Gafm650kia2CrqJSJCNwhZL6k5gA Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:55.692941 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3bcbd1bd69c4cd19dbad395b630a382"}]}] Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 60681a6ed05f45cdac69259e3baac493 Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: {"aggregate": {"name": "tempest-test_aggregate-1127109024"}} Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:55.694182 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1127109024'}}} Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:55.694875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:55.695881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 13:41:55.697031 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.697031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-701787fd-813d-4cb9-89db-06d09982002d tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.697031 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-701787fd-813d-4cb9-89db-06d09982002d tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.022607 Nov 02 13:41:55.697031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 133/255] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:41:55.698765 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 123/256] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:55.718593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9886b37-87a7-46b5-9185-15ecbed9e46d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2055771975"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.719321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.720152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:55.726846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-d9886b37-87a7-46b5-9185-15ecbed9e46d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid e0d1d006-eb22-4105-9493-635244fad7e8 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:55.745287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.746533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.749763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.750693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.751360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.758470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.775381 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9886b37-87a7-46b5-9185-15ecbed9e46d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070302 Nov 02 13:41:55.776714 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 134/257] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:55.788204 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] HTTP exception thrown: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.788739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1d871d4-9eeb-4389-af04-caa547d5183d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2055771975"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Request method failure captured: Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 HTTP/1.1 Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNqAl5-1H2yVef0ANT704dpAAuKxQB15oHkGtEYkDmZgLpyYFKPabU_ps9JJZJvipNNAq3nHO_NFBz9mXqDD9nfZ_6a_KyBmwFJVO96NETJkKwIUF6NSGoysvg_SlqsRJhPvCzs3lgtfSzY1zgNX2wcP6cTsOBhcGFiqCigWyNT2qE Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 79a2115449bc41f084281dd7f6e060fb Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:55.790561 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79a2115449bc41f084281dd7f6e060fb"}]}] Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 79a2115449bc41f084281dd7f6e060fb Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminTestJSON-710196382-project Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 961cce2a8c2540dd8808c6efce1fe5fd Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminTestJSON-710196382-project Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.791881 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '21d1b403-a5b1-418e-b179-ef4729e45a89'} Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.792524 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.793534 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.798237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Returning 404 to user: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.800852 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9705618-e466-4821-9453-927e0ccfbb50 tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 404 len: 111 microversion: 2.1 time: 0.093627 Nov 02 13:41:55.802875 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 124/258] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:41:55 2022] DELETE /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:55.806487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-b1d871d4-9eeb-4389-af04-caa547d5183d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid d380385d-c1c3-43f5-a0cb-14453de68a2c for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:55.820913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.821544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:55.833005 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b1d871d4-9eeb-4389-af04-caa547d5183d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2055771975 already exists. Nov 02 13:41:55.835617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.836102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.836679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.837319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.837769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.838444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1d871d4-9eeb-4389-af04-caa547d5183d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 60 Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:55.845103 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: {"aggregate": {"name": "tempest-test_aggregate-2055771975"}} Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:55.846348 n-d-858238-3 devstack@n-api.service[137559]: exception: Aggregate tempest-test_aggregate-2055771975 already exists. Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2055771975'}}} Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 13:41:55.847047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2055771975 already exists. Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:55.848386 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2055771975 already exists. Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2055771975 already exists. Nov 02 13:41:55.849416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.855741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1d871d4-9eeb-4389-af04-caa547d5183d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2055771975 already exists. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.859045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1d871d4-9eeb-4389-af04-caa547d5183d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.073825 Nov 02 13:41:55.862924 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 135/259] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:55 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:41:55.883240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:55.884282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] [instance: 21d1b403-a5b1-418e-b179-ef4729e45a89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:55.894608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.900128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.905169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.912792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:55.913559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:55.914074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:55.943908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] HTTP exception thrown: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Request method failure captured: Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 HTTP/1.1 Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNqAl5-1H2yVef0ANT704dpAAuKxQB15oHkGtEYkDmZgLpyYFKPabU_ps9JJZJvipNNAq3nHO_NFBz9mXqDD9nfZ_6a_KyBmwFJVO96NETJkKwIUF6NSGoysvg_SlqsRJhPvCzs3lgtfSzY1zgNX2wcP6cTsOBhcGFiqCigWyNT2qE Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 79a2115449bc41f084281dd7f6e060fb Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:55.945709 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79a2115449bc41f084281dd7f6e060fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79a2115449bc41f084281dd7f6e060fb"}]}] Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 79a2115449bc41f084281dd7f6e060fb Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-710196382 Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminTestJSON-710196382-project Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 961cce2a8c2540dd8808c6efce1fe5fd Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminTestJSON-710196382-project Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.946975 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '21d1b403-a5b1-418e-b179-ef4729e45a89'} Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:55.947644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. Nov 02 13:41:55.948652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:55.951565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] Returning 404 to user: Instance 21d1b403-a5b1-418e-b179-ef4729e45a89 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:55.952628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55895488-0bb5-4ced-98a5-3c1dfa24022d tempest-AggregatesAdminTestJSON-710196382 tempest-AggregatesAdminTestJSON-710196382-project] 10.222.0.18 "GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89" status: 404 len: 111 microversion: 2.1 time: 0.088722 Nov 02 13:41:55.953378 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 136/260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:55 2022] GET /compute/v2.1/servers/21d1b403-a5b1-418e-b179-ef4729e45a89 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:55.960011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5cffc35a-554f-4405-9027-8ecb5a220387 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.002377 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5cffc35a-554f-4405-9027-8ecb5a220387 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.047646 Nov 02 13:41:56.003906 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 137/261] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:55 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:56.013496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9f495ae-f0a8-43d0-ab9e-5816ed962abe tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1694560334"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:56.019885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-a9f495ae-f0a8-43d0-ab9e-5816ed962abe tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid 3dbb51f0-ec0a-41a4-9cec-08df06789d00 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:56.059591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9f495ae-f0a8-43d0-ab9e-5816ed962abe tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049597 Nov 02 13:41:56.060951 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 138/262] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:56.081096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39dd6a17-b74d-4566-a6cc-605475405836 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.082981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39dd6a17-b74d-4566-a6cc-605475405836 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '60681a6ed05f45cdac69259e3baac493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bcbd1bd69c4cd19dbad395b630a382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39dd6a17-b74d-4566-a6cc-605475405836 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Request method failure captured: Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN2TF1L2DSsjR3DM0OIu51JJism8rQfnKK1TxIK45XSQa5BaFdz7DmSnVEdzW3U4W2JDZrEgAo3BdI1F7Po6XlonuA98NN-sbzV0Ylhv6JenWTk3tzb8lK9Qey_WmU1bIQLqJCvVyWJACHa8G8Gafm650kia2CrqJSJCNwhZL6k5gA Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:56.089415 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3bcbd1bd69c4cd19dbad395b630a382"}]}] Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 60681a6ed05f45cdac69259e3baac493 Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 13:41:56.091500 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '15'} Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:56.092297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 13:41:56.093465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.097099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39dd6a17-b74d-4566-a6cc-605475405836 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:56.099037 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39dd6a17-b74d-4566-a6cc-605475405836 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.030394 Nov 02 13:41:56.099809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 139/263] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:41:56.109408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4eff7de1-b54c-4426-b928-38a87f87eca1 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.111641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.121426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.123301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.124533 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c2e6f951-c22e-441b-815b-23d1ef165fc9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.320311 Nov 02 13:41:56.125565 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 125/264] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:41:55 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:56.146746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4eff7de1-b54c-4426-b928-38a87f87eca1 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.042103 Nov 02 13:41:56.147608 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 140/265] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 13:41:56.164729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bcbf4875-701d-4eb8-9e09-889797f01113 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.182757 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-bcbf4875-701d-4eb8-9e09-889797f01113 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bcbf4875-701d-4eb8-9e09-889797f01113 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:41:56.185943 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: exception: Aggregate -1 could not be found. Nov 02 13:41:56.187584 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '-1'} Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:41:56.188247 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.189215 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.190526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.190526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.190526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:56.190526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:56.190526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 13:41:56.190526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.193631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bcbf4875-701d-4eb8-9e09-889797f01113 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:56.195293 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bcbf4875-701d-4eb8-9e09-889797f01113 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040271 Nov 02 13:41:56.197541 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 126/266] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:56 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:56.206608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57122500-b55d-4f78-a27a-f6bb4faffde1 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1424373326"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:56.211186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-57122500-b55d-4f78-a27a-f6bb4faffde1 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid e5558147-121e-40b9-9172-bdaef2b780b2 for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:56.252647 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57122500-b55d-4f78-a27a-f6bb4faffde1 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049649 Nov 02 13:41:56.255648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 141/267] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:56.271364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d8cd7e9-4671-40d0-a6b5-c6d253376eae tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.273363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2d8cd7e9-4671-40d0-a6b5-c6d253376eae tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '60681a6ed05f45cdac69259e3baac493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bcbd1bd69c4cd19dbad395b630a382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d8cd7e9-4671-40d0-a6b5-c6d253376eae tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Request method failure captured: Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN2TF1L2DSsjR3DM0OIu51JJism8rQfnKK1TxIK45XSQa5BaFdz7DmSnVEdzW3U4W2JDZrEgAo3BdI1F7Po6XlonuA98NN-sbzV0Ylhv6JenWTk3tzb8lK9Qey_WmU1bIQLqJCvVyWJACHa8G8Gafm650kia2CrqJSJCNwhZL6k5gA Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:56.275763 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3bcbd1bd69c4cd19dbad395b630a382"}]}] Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 60681a6ed05f45cdac69259e3baac493 Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 13:41:56.277230 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '16'} Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:56.277898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.280893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d8cd7e9-4671-40d0-a6b5-c6d253376eae tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:56.282063 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d8cd7e9-4671-40d0-a6b5-c6d253376eae tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015135 Nov 02 13:41:56.282063 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 127/268] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:56 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:56.294377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4592737-0ee9-4698-946b-4e5cbc72b0bb tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.341673 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a4592737-0ee9-4698-946b-4e5cbc72b0bb tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056916 Nov 02 13:41:56.343482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 142/269] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:56 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:41:56.359360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea08de5f-43a3-4a7c-81ed-43d63c14297c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.369364 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ea08de5f-43a3-4a7c-81ed-43d63c14297c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea08de5f-43a3-4a7c-81ed-43d63c14297c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:56.371200 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: exception: Aggregate -1 could not be found. Nov 02 13:41:56.372952 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '-1'} Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.373572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 13:41:56.374679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.379892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea08de5f-43a3-4a7c-81ed-43d63c14297c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:56.379892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea08de5f-43a3-4a7c-81ed-43d63c14297c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024101 Nov 02 13:41:56.379892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 143/270] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:41:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:56.381848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.382448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:56.390544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:56.391025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:56.391472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:56.392162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:56.392606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:56.393016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:56.525274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.551649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de5805f3-9700-433e-9413-a1ed3c546390 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1214 microversion: 2.1 time: 0.175303 Nov 02 13:41:56.555265 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 144/271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:56 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:56.561337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17e7a0ca-9b73-42b7-98b7-c6cd9bc65090 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.562884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17e7a0ca-9b73-42b7-98b7-c6cd9bc65090 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '60681a6ed05f45cdac69259e3baac493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bcbd1bd69c4cd19dbad395b630a382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17e7a0ca-9b73-42b7-98b7-c6cd9bc65090 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Request method failure captured: Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN2TF1L2DSsjR3DM0OIu51JJism8rQfnKK1TxIK45XSQa5BaFdz7DmSnVEdzW3U4W2JDZrEgAo3BdI1F7Po6XlonuA98NN-sbzV0Ylhv6JenWTk3tzb8lK9Qey_WmU1bIQLqJCvVyWJACHa8G8Gafm650kia2CrqJSJCNwhZL6k5gA Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:56.564494 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3bcbd1bd69c4cd19dbad395b630a382"}]}] Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 60681a6ed05f45cdac69259e3baac493 Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 13:41:56.565652 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:56.566348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:56.567374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17e7a0ca-9b73-42b7-98b7-c6cd9bc65090 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:56.568759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17e7a0ca-9b73-42b7-98b7-c6cd9bc65090 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009569 Nov 02 13:41:56.568759 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 145/272] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:41:56 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:56.571070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:56.572123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:56.587298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:56.587867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:56.588562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:56.589771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:56.590600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:56.591424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:56.876683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f519e7d1-bf68-4fc0-9957-e09d592b39ce tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] 10.222.0.18 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.557583 Nov 02 13:41:56.878241 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 128/273] 10.222.0.18 () {58 vars in 1128 bytes} [Wed Nov 2 13:41:56 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 560 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 13:41:56.888582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-61af4239-ad47-484b-be97-496944423405 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-536591189"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:56.894274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-61af4239-ad47-484b-be97-496944423405 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid e30748bc-5abb-44d4-a5ba-f95b2d107590 for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:56.917092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:56.926204 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03e3505c-2d43-450e-b8b5-a20f031763a8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1588 microversion: 2.1 time: 0.358899 Nov 02 13:41:56.939372 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 146/274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:56 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1588 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:56.944360 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-61af4239-ad47-484b-be97-496944423405 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063044 Nov 02 13:41:56.944360 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 129/275] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:56.977080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9dc0244-1ea0-4b8d-ab25-d7b3f130a284 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Calling method '.version_select at 0x7f6f8253e160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.047699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Action: 'update', calling method: .version_select at 0x7f6f82483dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:57.059242 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f9dc0244-1ea0-4b8d-ab25-d7b3f130a284 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] HTTP exception thrown: Image not found. Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9dc0244-1ea0-4b8d-ab25-d7b3f130a284 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Request method failure captured: Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOkK7pqz_gHp0LD3zm8F9l8Ufo4KfSeAznKYfTpouOImvAyzzQIVDXAIXha5K0S7oAcaSAPXkGlcrn0Xh5u_0f77b7ZWsbV63uSxUlAhH9bYWm83ZciTZ8XYs7JVWXZucvEZfwf0cl5WzL95Q6TsWjRfotOsXp6TT_jxJjCWP9ip-Y Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:57.080096 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e020126f824544a79d87db065cad938f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e020126f824544a79d87db065cad938f"}]}] Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3972dcbdbfd2497bb77c939edd0c36e0 Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: exception: Image not found. Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '-1'} Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:57.081381 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.082214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:57.083240 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9dc0244-1ea0-4b8d-ab25-d7b3f130a284 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Returning 404 to user: Image not found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9dc0244-1ea0-4b8d-ab25-d7b3f130a284 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] 10.222.0.18 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.133339 Nov 02 13:41:57.087227 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 130/276] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Nov 2 13:41:56 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:57.104744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.109800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:57.129955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.130516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.130953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.134316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.135524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.138951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.174781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.175299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.175928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.177125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.177762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.178355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.267914 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-745f7510-46ae-4e9c-bb46-faa2758b4428 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2" status: 200 len: 240 microversion: 2.36 time: 0.331956 Nov 02 13:41:57.269195 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 147/277] 10.222.0.18 () {62 vars in 1303 bytes} [Wed Nov 2 13:41:56 2022] PUT /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2 => generated 240 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:57.273990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c7738b4c-0eb9-4e5c-8d58-380696ffe0e9 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:57.298413 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d1ac2d8-dc27-4bc4-bd19-7eaa7a0c4102 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206394 Nov 02 13:41:57.304637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7738b4c-0eb9-4e5c-8d58-380696ffe0e9 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.305118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7738b4c-0eb9-4e5c-8d58-380696ffe0e9 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.305558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7738b4c-0eb9-4e5c-8d58-380696ffe0e9 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.307603 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 131/278] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:41:57 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:57.312985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70e11a9a-1b4e-4621-9308-a3670d431414 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Calling method '.version_select at 0x7f6f825b9d30>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.356335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-70e11a9a-1b4e-4621-9308-a3670d431414 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] HTTP exception thrown: Image not found. Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70e11a9a-1b4e-4621-9308-a3670d431414 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Request method failure captured: Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/images/74216c7d-4df1-465a-ba63-2f6dbe73ff1j HTTP/1.1 Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOkK7pqz_gHp0LD3zm8F9l8Ufo4KfSeAznKYfTpouOImvAyzzQIVDXAIXha5K0S7oAcaSAPXkGlcrn0Xh5u_0f77b7ZWsbV63uSxUlAhH9bYWm83ZciTZ8XYs7JVWXZucvEZfwf0cl5WzL95Q6TsWjRfotOsXp6TT_jxJjCWP9ip-Y Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:57.359899 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e020126f824544a79d87db065cad938f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e020126f824544a79d87db065cad938f"}]}] Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3972dcbdbfd2497bb77c939edd0c36e0 Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: exception: Image not found. Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '74216c7d-4df1-465a-ba63-2f6dbe73ff1j'} Nov 02 13:41:57.361409 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 74216c7d-4df1-465a-ba63-2f6dbe73ff1j to delete Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.362283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 74216c7d-4df1-465a-ba63-2f6dbe73ff1j could not be found. Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:57.363403 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:41:57.365916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.367086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:57.368735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70e11a9a-1b4e-4621-9308-a3670d431414 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Returning 404 to user: Image not found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:57.369994 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-70e11a9a-1b4e-4621-9308-a3670d431414 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] 10.222.0.18 "DELETE /compute/v2.1/images/74216c7d-4df1-465a-ba63-2f6dbe73ff1j" status: 404 len: 62 microversion: 2.1 time: 0.061348 Nov 02 13:41:57.370774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 132/279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:57 2022] DELETE /compute/v2.1/images/74216c7d-4df1-465a-ba63-2f6dbe73ff1j => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:57.380076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.381069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:57.403681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.404582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.406114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.408072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.409989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.410930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.561063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c7738b4c-0eb9-4e5c-8d58-380696ffe0e9 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.290582 Nov 02 13:41:57.562646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 148/280] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 13:41:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:57.573773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Calling method '.version_select at 0x7f6f82533ee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.782008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:57.797822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:57.799471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:57.806114 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3460d9f-fbb0-403d-b402-1be158831998 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.433174 Nov 02 13:41:57.808135 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 133/281] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:41:57 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:57.848328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-55224e48-a05a-4894-aaaa-adde9c606c25 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Calling method '.version_select at 0x7f6f8253ee50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.873489 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-55224e48-a05a-4894-aaaa-adde9c606c25 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] HTTP exception thrown: Image not found. Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-55224e48-a05a-4894-aaaa-adde9c606c25 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Request method failure captured: Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/images/0b40731f-09b4-4872-bd99-b864db7233a41 HTTP/1.1 Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOkK7pqz_gHp0LD3zm8F9l8Ufo4KfSeAznKYfTpouOImvAyzzQIVDXAIXha5K0S7oAcaSAPXkGlcrn0Xh5u_0f77b7ZWsbV63uSxUlAhH9bYWm83ZciTZ8XYs7JVWXZucvEZfwf0cl5WzL95Q6TsWjRfotOsXp6TT_jxJjCWP9ip-Y Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:57.876623 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e020126f824544a79d87db065cad938f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e020126f824544a79d87db065cad938f"}]}] Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3972dcbdbfd2497bb77c939edd0c36e0 Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: exception: Image not found. Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '0b40731f-09b4-4872-bd99-b864db7233a41'} Nov 02 13:41:57.878329 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0b40731f-09b4-4872-bd99-b864db7233a41 to delete Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.879168 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0b40731f-09b4-4872-bd99-b864db7233a41 could not be found. Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:57.880156 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-55224e48-a05a-4894-aaaa-adde9c606c25 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Returning 404 to user: Image not found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:57.881274 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-55224e48-a05a-4894-aaaa-adde9c606c25 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] 10.222.0.18 "DELETE /compute/v2.1/images/0b40731f-09b4-4872-bd99-b864db7233a41" status: 404 len: 62 microversion: 2.1 time: 0.049603 Nov 02 13:41:57.888452 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 134/282] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:41:57 2022] DELETE /compute/v2.1/images/0b40731f-09b4-4872-bd99-b864db7233a41 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:57.893761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-19508f8f-2711-4658-8593-369ec91da408 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:57.908017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-19508f8f-2711-4658-8593-369ec91da408 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '60681a6ed05f45cdac69259e3baac493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bcbd1bd69c4cd19dbad395b630a382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-19508f8f-2711-4658-8593-369ec91da408 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Request method failure captured: Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 42 Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnN2TF1L2DSsjR3DM0OIu51JJism8rQfnKK1TxIK45XSQa5BaFdz7DmSnVEdzW3U4W2JDZrEgAo3BdI1F7Po6XlonuA98NN-sbzV0Ylhv6JenWTk3tzb8lK9Qey_WmU1bIQLqJCvVyWJACHa8G8Gafm650kia2CrqJSJCNwhZL6k5gA Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:57.915189 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3bcbd1bd69c4cd19dbad395b630a382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3bcbd1bd69c4cd19dbad395b630a382"}]}] Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b3bcbd1bd69c4cd19dbad395b630a382 Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785 Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 60681a6ed05f45cdac69259e3baac493 Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1021658785-project Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: {"remove_host": {"host": "n-h2-858238-3"}} Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:41:57.916501 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-858238-3'}}} Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:57.917223 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 13:41:57.918369 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:57.922515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-19508f8f-2711-4658-8593-369ec91da408 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:57.923828 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-19508f8f-2711-4658-8593-369ec91da408 tempest-AggregatesAdminNegativeTestJSON-1021658785 tempest-AggregatesAdminNegativeTestJSON-1021658785-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.034278 Nov 02 13:41:57.931173 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 135/283] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 13:41:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:57.938452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:57.939348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:57.952558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.955023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.956504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:57.961162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:57.961944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:57.963437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.088655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.089142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.089567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.090288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.090762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.091209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.091718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:58.109038 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b0fa81e-eb14-4af7-b60d-9276a0d91dd4 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1276 microversion: 2.1 time: 0.175988 Nov 02 13:41:58.110467 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 136/284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:57 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:58.130604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a3be3201-608f-41f1-8f7c-b2c32d7b2b47 req-1c10977e-09b9-484d-a6ff-b99372e12b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c91ab6-d7c2-424b-aaaf-2b202a3090d5", "tag": "1150df3c-744e-4d59-8bbb-94d550dfd3ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:58.137208 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-69dce8b9-62af-4f28-a44e-741279421a26 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2/detail" status: 200 len: 672 microversion: 2.36 time: 0.572251 Nov 02 13:41:58.138626 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 149/285] 10.222.0.18 () {60 vars in 1304 bytes} [Wed Nov 2 13:41:57 2022] GET /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2/detail => generated 672 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:58.144875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a3be3201-608f-41f1-8f7c-b2c32d7b2b47 req-1c10977e-09b9-484d-a6ff-b99372e12b8e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.145644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a3be3201-608f-41f1-8f7c-b2c32d7b2b47 req-1c10977e-09b9-484d-a6ff-b99372e12b8e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.147615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a3be3201-608f-41f1-8f7c-b2c32d7b2b47 req-1c10977e-09b9-484d-a6ff-b99372e12b8e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.147765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44b5f855-ac4d-4b0b-8347-15c69c273258 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Calling method '.version_select at 0x7f6f82483940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:58.187240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-44b5f855-ac4d-4b0b-8347-15c69c273258 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] HTTP exception thrown: Image not found. Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44b5f855-ac4d-4b0b-8347-15c69c273258 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Request method failure captured: Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/tempest-invalid-1867838132 HTTP/1.1 Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOkK7pqz_gHp0LD3zm8F9l8Ufo4KfSeAznKYfTpouOImvAyzzQIVDXAIXha5K0S7oAcaSAPXkGlcrn0Xh5u_0f77b7ZWsbV63uSxUlAhH9bYWm83ZciTZ8XYs7JVWXZucvEZfwf0cl5WzL95Q6TsWjRfotOsXp6TT_jxJjCWP9ip-Y Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:41:58.192275 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e020126f824544a79d87db065cad938f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e020126f824544a79d87db065cad938f"}]}] Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3972dcbdbfd2497bb77c939edd0c36e0 Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'tempest-invalid-1867838132'} Nov 02 13:41:58.193661 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1867838132 to delete Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.194745 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1867838132 could not be found. Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:58.196118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44b5f855-ac4d-4b0b-8347-15c69c273258 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:58.198954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44b5f855-ac4d-4b0b-8347-15c69c273258 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] 10.222.0.18 "DELETE /compute/v2.1/images/tempest-invalid-1867838132" status: 404 len: 62 microversion: 2.1 time: 0.053088 Nov 02 13:41:58.200730 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a3be3201-608f-41f1-8f7c-b2c32d7b2b47 req-1c10977e-09b9-484d-a6ff-b99372e12b8e service nova] Creating event network-changed:1150df3c-744e-4d59-8bbb-94d550dfd3ba for instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 on n-h1-858238-3 Nov 02 13:41:58.200984 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 150/286] 10.222.0.18 () {58 vars in 1206 bytes} [Wed Nov 2 13:41:58 2022] DELETE /compute/v2.1/images/tempest-invalid-1867838132 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:58.207888 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a3be3201-608f-41f1-8f7c-b2c32d7b2b47 req-1c10977e-09b9-484d-a6ff-b99372e12b8e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095674 Nov 02 13:41:58.210334 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 137/287] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:58.213373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-827b14d3-22b0-433b-93da-f0c7ee623bd0 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:58.232343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad8c463b-20bd-411a-844b-3b1f38252c56 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Calling method '.version_select at 0x7f6f825b9af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:58.239511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827b14d3-22b0-433b-93da-f0c7ee623bd0 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.240002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827b14d3-22b0-433b-93da-f0c7ee623bd0 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.242328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827b14d3-22b0-433b-93da-f0c7ee623bd0 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.268202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ad8c463b-20bd-411a-844b-3b1f38252c56 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] HTTP exception thrown: Image not found. Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad8c463b-20bd-411a-844b-3b1f38252c56 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Request method failure captured: Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/images/57696081-34b7-474a-8ea1-f2746a50c280 HTTP/1.1 Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOkK7pqz_gHp0LD3zm8F9l8Ufo4KfSeAznKYfTpouOImvAyzzQIVDXAIXha5K0S7oAcaSAPXkGlcrn0Xh5u_0f77b7ZWsbV63uSxUlAhH9bYWm83ZciTZ8XYs7JVWXZucvEZfwf0cl5WzL95Q6TsWjRfotOsXp6TT_jxJjCWP9ip-Y Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:41:58.270602 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e020126f824544a79d87db065cad938f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e020126f824544a79d87db065cad938f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e020126f824544a79d87db065cad938f"}]}] Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e020126f824544a79d87db065cad938f Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607 Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3972dcbdbfd2497bb77c939edd0c36e0 Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1844917607-project Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: exception: Image not found. Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '57696081-34b7-474a-8ea1-f2746a50c280'} Nov 02 13:41:58.271824 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 57696081-34b7-474a-8ea1-f2746a50c280 to delete Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.272591 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 57696081-34b7-474a-8ea1-f2746a50c280 could not be found. Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:58.273935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad8c463b-20bd-411a-844b-3b1f38252c56 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] Returning 404 to user: Image not found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:58.275000 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ad8c463b-20bd-411a-844b-3b1f38252c56 tempest-ImagesDeleteNegativeTestJSON-1844917607 tempest-ImagesDeleteNegativeTestJSON-1844917607-project] 10.222.0.18 "DELETE /compute/v2.1/images/57696081-34b7-474a-8ea1-f2746a50c280" status: 404 len: 62 microversion: 2.1 time: 0.059462 Nov 02 13:41:58.277102 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 138/288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:58 2022] DELETE /compute/v2.1/images/57696081-34b7-474a-8ea1-f2746a50c280 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:41:58.424237 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-827b14d3-22b0-433b-93da-f0c7ee623bd0 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.218404 Nov 02 13:41:58.424893 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 151/289] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 13:41:58 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:58.438569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53f70d2f-b236-4c73-83da-c24913636a04 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:58.487564 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53f70d2f-b236-4c73-83da-c24913636a04 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.053101 Nov 02 13:41:58.488229 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 139/290] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:58 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 13:41:58.497965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b87a118-8b49-400a-a89c-fdfb7a9d100d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-439179329"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:58.502909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.aggregate [None req-8b87a118-8b49-400a-a89c-fdfb7a9d100d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Generated uuid 00dd943e-492c-4ecc-882b-f0ada69c57ca for aggregate {{(pid=137559) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:41:58.518503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Action: 'update', calling method: .version_select at 0x7f6f825fc9d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:58.555831 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b87a118-8b49-400a-a89c-fdfb7a9d100d tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061496 Nov 02 13:41:58.557995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 152/291] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 13:41:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:58.568506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:58.596405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.597326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.598120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.625212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.629147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.629969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.656572 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.compute.aggregates [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 13:41:58.657077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Request method failure captured: Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 42 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnN3ZoVzXos6CWqQ0ZDU--9VyoTiH44x3zowxhPNlF0vx2AOwfCwUm35yCardrM7rAEg0hx4uPR2iVWXggucr72bMneKr2cXZ-cv73KgbNu5fK97poNPvwxLlJdWI8da9rAu-m1pVQiowjTi4Rjq9hb1cXrVE8V1NeYZf7yx9lis2Po Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:41:58.659720 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf107fb126a440fda21e82c31c550540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf107fb126a440fda21e82c31c550540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf107fb126a440fda21e82c31c550540"}]}] Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cf107fb126a440fda21e82c31c550540 Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903 Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 026132cadd51448c80c3100ececbf373 Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: {"remove_host": {"host": "nonexist_host"}} Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:41:58.661421 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 13:41:58.662221 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 13:41:58.663577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.664893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:58.666264 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:58.666264 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:58.666264 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:58.666264 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:58.666264 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:41:58.666264 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:41:58.667949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:58.669626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa89dcb9-4d3e-428c-bb06-ba8921d3d209 tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.104446 Nov 02 13:41:58.677956 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 153/292] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 13:41:58 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:41:58.686904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4dd6fa3-0ae5-4cbf-93f5-32ed7cf10a7c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:58.730298 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4dd6fa3-0ae5-4cbf-93f5-32ed7cf10a7c tempest-AggregatesAdminNegativeTestJSON-1943475903 tempest-AggregatesAdminNegativeTestJSON-1943475903-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.047756 Nov 02 13:41:58.732149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 154/293] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:41:58 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 13:41:58.747865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.748366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.748808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.749534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.750192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.750822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.773261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=9 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:58.811223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.811971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.813078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.814517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.815236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.815871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.829109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:58.837790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:58.838445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:58.867778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.868326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.868762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.874788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:58.875326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:58.875937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:58.925538 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca872d77-9ccc-4d57-b57b-9836849eb25a tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2?user_id=3623edd67bd549cda1c2247d1c1d3354" status: 200 len: 240 microversion: 2.36 time: 0.411610 Nov 02 13:41:58.927510 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 140/294] 10.222.0.18 () {62 vars in 1384 bytes} [Wed Nov 2 13:41:58 2022] PUT /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2?user_id=3623edd67bd549cda1c2247d1c1d3354 => generated 240 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:41:58.954102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79e4ebe3-17c3-49b5-b040-33c0f08f2887 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] Calling method '.version_select at 0x7f6f825b98b0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:59.200770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:59.218018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:59.219781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:59.220999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49e7c3ee-b9a3-4df1-bed1-1315c9180407 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.390332 Nov 02 13:41:59.221562 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 155/295] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:41:58 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:59.229096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:59.229697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:59.236128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:59.236971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:59.237597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:59.238487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:59.239161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:59.239782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:59.432220 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79e4ebe3-17c3-49b5-b040-33c0f08f2887 tempest-QuotasAdminTestV236-940062426 tempest-QuotasAdminTestV236-940062426-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2?user_id=3623edd67bd549cda1c2247d1c1d3354" status: 200 len: 282 microversion: 2.36 time: 0.492682 Nov 02 13:41:59.435780 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 141/296] 10.222.0.18 () {60 vars in 1364 bytes} [Wed Nov 2 13:41:58 2022] GET /compute/v2.1/os-quota-sets/40e5cdc93bd640eaad142e5c03709cf2?user_id=3623edd67bd549cda1c2247d1c1d3354 => generated 282 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:59.494411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:59.507529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08057f15-58be-46a6-97a4-6d6c42f4ae9e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.283708 Nov 02 13:41:59.509944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 156/297] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:59 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:00.251999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:00.254084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:00.269638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:00.270881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:00.272274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:00.276332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:00.278712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:00.280476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:00.535617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:00.536408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:00.547999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:00.548477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:00.551948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:00.553140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:00.553810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:00.554440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:00.559726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:00.721443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:00.731930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:00.733407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:00.742054 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bc99f3dc-688f-418d-ac28-b5d455e51e91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.495607 Nov 02 13:42:00.744080 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 142/298] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:00 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:00.833309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-750f7471-1b37-4bfe-bb22-2a82ce035295 req-6ae31766-de3a-4332-9b25-6a8a1cc03d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afb8e18-b699-459c-b537-9f08c5fa0328", "tag": "fdd3cf83-ba6e-4348-bbc2-24dcb19b2d47"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:00.868828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-750f7471-1b37-4bfe-bb22-2a82ce035295 req-6ae31766-de3a-4332-9b25-6a8a1cc03d61 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:00.872525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-750f7471-1b37-4bfe-bb22-2a82ce035295 req-6ae31766-de3a-4332-9b25-6a8a1cc03d61 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:00.876011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-750f7471-1b37-4bfe-bb22-2a82ce035295 req-6ae31766-de3a-4332-9b25-6a8a1cc03d61 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:00.931437 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-750f7471-1b37-4bfe-bb22-2a82ce035295 req-6ae31766-de3a-4332-9b25-6a8a1cc03d61 service nova] Creating event network-changed:fdd3cf83-ba6e-4348-bbc2-24dcb19b2d47 for instance 6afb8e18-b699-459c-b537-9f08c5fa0328 on n-h2-858238-3 Nov 02 13:42:00.950907 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-750f7471-1b37-4bfe-bb22-2a82ce035295 req-6ae31766-de3a-4332-9b25-6a8a1cc03d61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121667 Nov 02 13:42:00.954913 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 143/299] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:01.022166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:01.032116 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-20afdd24-9732-4cf0-a75d-51e0cc449a36 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.503237 Nov 02 13:42:01.048798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 157/300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:00 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:01.092825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:01.093533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:01.100844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-87dff803-0684-4ab5-b289-5542fe13a307 req-a0de9716-aecf-4845-8e17-a567cf239901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1c6755-70f9-4cac-9d48-00f65b4a9507", "tag": "076b4d52-c42b-4920-a944-59b40ffa9b3c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:01.122579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-87dff803-0684-4ab5-b289-5542fe13a307 req-a0de9716-aecf-4845-8e17-a567cf239901 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:01.122885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:01.123687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:01.124469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:01.125776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-87dff803-0684-4ab5-b289-5542fe13a307 req-a0de9716-aecf-4845-8e17-a567cf239901 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:01.126318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:01.127590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-87dff803-0684-4ab5-b289-5542fe13a307 req-a0de9716-aecf-4845-8e17-a567cf239901 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:01.127858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:01.128465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:01.157818 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-87dff803-0684-4ab5-b289-5542fe13a307 req-a0de9716-aecf-4845-8e17-a567cf239901 service nova] Creating event network-changed:076b4d52-c42b-4920-a944-59b40ffa9b3c for instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 on n-h2-858238-3 Nov 02 13:42:01.170911 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-87dff803-0684-4ab5-b289-5542fe13a307 req-a0de9716-aecf-4845-8e17-a567cf239901 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074607 Nov 02 13:42:01.174718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 158/301] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:01.775800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:01.776608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:01.790507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:01.791060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:01.791623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:01.796473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:01.797467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:01.798047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:02.080447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:02.094525 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05e98cd2-2777-4833-882c-06df8ae90735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 200 len: 1588 microversion: 2.1 time: 1.003727 Nov 02 13:42:02.098888 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 144/302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:01 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 1588 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:02.115199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:02.118503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:02.132619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:02.135572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:02.138274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:02.140362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:02.144273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:02.146984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:02.369871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:02.380130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:02.384774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:02.386000 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.615347 Nov 02 13:42:02.393042 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 159/303] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:01 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:42:02.412325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:02.412325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a32f523-4112-453a-bb66-f9de5bb551ab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001276 Nov 02 13:42:02.421541 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 160/304] 10.222.0.18 () {56 vars in 886 bytes} [Wed Nov 2 13:42:02 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:42:02.567638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:02.578496 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1fb1f3d5-8d4b-4031-aa9d-254b785f7a05 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.478253 Nov 02 13:42:02.583138 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 145/305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:02 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:03.425877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:03.425877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:03.432270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:03.433015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:03.433607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:03.434507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:03.435129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:03.435691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:03.610760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:03.611465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:03.624360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:03.626885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:03.627777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:03.630150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:03.633230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:03.634125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.222719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:04.237342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:04.238788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:04.239972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-217b9516-06ff-401b-a976-9c13bff44dfb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.827961 Nov 02 13:42:04.256652 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 161/306] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:03 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:04.469044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:04.501662 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1144b95d-d62f-4826-b080-7ef9635c8421 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.886378 Nov 02 13:42:04.503309 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 146/307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:03 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:05.276311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:05.279430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:05.325853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:05.328267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:05.329591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.331168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:05.332254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:05.340607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.531662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:05.533282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:05.547699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:05.548195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:05.548631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.549332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:05.549784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:05.550202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.635261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:05.646115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:05.650113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:05.652478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b0dc6b4-45b6-49a4-94f5-7661d40e6a23 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 0.386173 Nov 02 13:42:05.667121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 162/308] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:05 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:06.049201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:06.070022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-acb4bdce-046a-4757-b505-665fe5260cd8 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.543947 Nov 02 13:42:06.072933 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 147/309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:05 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:06.545944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe3a6759-3eb4-4fc4-af93-6a2b013d11a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1188393076", "ram": 512, "vcpus": 1, "disk": 10, "id": 1419360179, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:06.589003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe3a6759-3eb4-4fc4-af93-6a2b013d11a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.538069 Nov 02 13:42:06.600236 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 163/310] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:06 2022] POST /compute/v2.1/flavors => generated 416 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:06.681353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:06.682715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:06.697044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:06.700614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:06.701072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:06.702271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:06.702740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:06.703532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:06.945155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef10630c-b9a2-423a-ae63-c49cd535d60b tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:06.975479 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ef10630c-b9a2-423a-ae63-c49cd535d60b tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] HTTP exception thrown: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef10630c-b9a2-423a-ae63-c49cd535d60b tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Request method failure captured: Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/flavors/1419360179/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOsF3cPaHStW3w3xhFFVXSnfIx5jmrDXZlBR-0S5Kfkk725g2edw3tLAPuSQv6wTlnyUCXTQgcS_4vHA0ZIwWh2fCEXX0LZjnKARtMPnjHZ6me3txbOhnVtgGncgc_r8vb-t7AE2eSkPu-Slnkq4j9yHhPztLTBOrsR95iyCWgcG-M Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:06.982269 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd73249e6bfc4a9c8d0137549e47e778"}]}] Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c0d6de3618fa4adea6022f8ee478561d Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:06.983657 n-d-858238-3 devstack@n-api.service[137558]: exception: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'id': 'hw:cpu_thread_policy'} Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:06.984410 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:06.985864 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:06.987791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef10630c-b9a2-423a-ae63-c49cd535d60b tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Returning 404 to user: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:06.989165 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef10630c-b9a2-423a-ae63-c49cd535d60b tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] 10.222.0.18 "GET /compute/v2.1/flavors/1419360179/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.388511 Nov 02 13:42:06.989944 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 148/311] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 13:42:06 2022] GET /compute/v2.1/flavors/1419360179/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:42:06.995062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7f74fa57-314f-4985-a82c-ccd6b9ae375f req-38b982b2-05c4-4a79-809c-b9579584e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c91ab6-d7c2-424b-aaaf-2b202a3090d5", "name": "network-vif-plugged", "status": "completed", "tag": "1150df3c-744e-4d59-8bbb-94d550dfd3ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.012198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7f74fa57-314f-4985-a82c-ccd6b9ae375f req-38b982b2-05c4-4a79-809c-b9579584e8d9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:07.013334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7f74fa57-314f-4985-a82c-ccd6b9ae375f req-38b982b2-05c4-4a79-809c-b9579584e8d9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:07.013945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7f74fa57-314f-4985-a82c-ccd6b9ae375f req-38b982b2-05c4-4a79-809c-b9579584e8d9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:07.030440 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7f74fa57-314f-4985-a82c-ccd6b9ae375f req-38b982b2-05c4-4a79-809c-b9579584e8d9 service nova] Creating event network-vif-plugged:1150df3c-744e-4d59-8bbb-94d550dfd3ba for instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 on n-h1-858238-3 Nov 02 13:42:07.038330 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7f74fa57-314f-4985-a82c-ccd6b9ae375f req-38b982b2-05c4-4a79-809c-b9579584e8d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046363 Nov 02 13:42:07.039847 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 149/312] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:07.064303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d651eb83-c1e5-4c73-bf0f-6291c735e6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.090163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d651eb83-c1e5-4c73-bf0f-6291c735e6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c0d6de3618fa4adea6022f8ee478561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd73249e6bfc4a9c8d0137549e47e778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d651eb83-c1e5-4c73-bf0f-6291c735e6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Request method failure captured: Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/flavors/1419360179/os-extra_specs HTTP/1.1 Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 66 Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOsF3cPaHStW3w3xhFFVXSnfIx5jmrDXZlBR-0S5Kfkk725g2edw3tLAPuSQv6wTlnyUCXTQgcS_4vHA0ZIwWh2fCEXX0LZjnKARtMPnjHZ6me3txbOhnVtgGncgc_r8vb-t7AE2eSkPu-Slnkq4j9yHhPztLTBOrsR95iyCWgcG-M Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:07.093361 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd73249e6bfc4a9c8d0137549e47e778"}]}] Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c0d6de3618fa4adea6022f8ee478561d Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 13:42:07.094812 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:42:07.095704 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 13:42:07.097056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.102050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d651eb83-c1e5-4c73-bf0f-6291c735e6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:07.103651 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d651eb83-c1e5-4c73-bf0f-6291c735e6d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] 10.222.0.18 "POST /compute/v2.1/flavors/1419360179/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.061800 Nov 02 13:42:07.105533 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 150/313] 10.222.0.18 () {60 vars in 1224 bytes} [Wed Nov 2 13:42:07 2022] POST /compute/v2.1/flavors/1419360179/os-extra_specs => generated 124 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:07.114408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:07.115683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:07.127178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:07.128112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:07.128840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:07.130045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:07.131011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:07.131681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:07.391887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.409251 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-74c81ca4-8913-4fe2-8ec7-73a8e11faaa2 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.302284 Nov 02 13:42:07.415281 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 151/314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:07 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:07.425082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9282a296-3e22-4cd9-a437-022ad6c073d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.489142 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9282a296-3e22-4cd9-a437-022ad6c073d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1419360179/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072249 Nov 02 13:42:07.489978 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 152/315] 10.222.0.18 () {60 vars in 1224 bytes} [Wed Nov 2 13:42:07 2022] POST /compute/v2.1/flavors/1419360179/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:42:07.501779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f2e236a-80c4-47d2-a397-4d7dce3f30e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:07.503774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8f2e236a-80c4-47d2-a397-4d7dce3f30e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c0d6de3618fa4adea6022f8ee478561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd73249e6bfc4a9c8d0137549e47e778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f2e236a-80c4-47d2-a397-4d7dce3f30e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Request method failure captured: Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOsF3cPaHStW3w3xhFFVXSnfIx5jmrDXZlBR-0S5Kfkk725g2edw3tLAPuSQv6wTlnyUCXTQgcS_4vHA0ZIwWh2fCEXX0LZjnKARtMPnjHZ6me3txbOhnVtgGncgc_r8vb-t7AE2eSkPu-Slnkq4j9yHhPztLTBOrsR95iyCWgcG-M Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:07.505880 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd73249e6bfc4a9c8d0137549e47e778"}]}] Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c0d6de3618fa4adea6022f8ee478561d Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:07.507249 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'id': 'hw:numa_nodes'} Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:42:07.507857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 13:42:07.508902 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.511952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f2e236a-80c4-47d2-a397-4d7dce3f30e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:07.513699 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8f2e236a-80c4-47d2-a397-4d7dce3f30e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] 10.222.0.18 "DELETE /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017322 Nov 02 13:42:07.514988 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 153/316] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:42:07 2022] DELETE /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:07.525325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0bfe970c-8255-4fca-b776-1dc63d0a9650 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.565997 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0bfe970c-8255-4fca-b776-1dc63d0a9650 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1419360179/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043924 Nov 02 13:42:07.567047 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 154/317] 10.222.0.18 () {60 vars in 1224 bytes} [Wed Nov 2 13:42:07 2022] POST /compute/v2.1/flavors/1419360179/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:42:07.581749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d93c9260-6919-40db-a5a5-b6f4c63c9249 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.585826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d93c9260-6919-40db-a5a5-b6f4c63c9249 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c0d6de3618fa4adea6022f8ee478561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd73249e6bfc4a9c8d0137549e47e778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d93c9260-6919-40db-a5a5-b6f4c63c9249 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Request method failure captured: Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 22 Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOsF3cPaHStW3w3xhFFVXSnfIx5jmrDXZlBR-0S5Kfkk725g2edw3tLAPuSQv6wTlnyUCXTQgcS_4vHA0ZIwWh2fCEXX0LZjnKARtMPnjHZ6me3txbOhnVtgGncgc_r8vb-t7AE2eSkPu-Slnkq4j9yHhPztLTBOrsR95iyCWgcG-M Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:07.587490 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd73249e6bfc4a9c8d0137549e47e778"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd73249e6bfc4a9c8d0137549e47e778"}]}] Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: dd73249e6bfc4a9c8d0137549e47e778 Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c0d6de3618fa4adea6022f8ee478561d Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: {"hw:numa_nodes": "1"} Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:07.588811 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:42:07.589545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 13:42:07.591719 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.593557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d93c9260-6919-40db-a5a5-b6f4c63c9249 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:07.593557 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d93c9260-6919-40db-a5a5-b6f4c63c9249 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810 tempest-FlavorsExtraSpecsNegativeTestJSON-1929278810-project] 10.222.0.18 "PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013819 Nov 02 13:42:07.593557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 155/318] 10.222.0.18 () {60 vars in 1265 bytes} [Wed Nov 2 13:42:07 2022] PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:07.602957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cadc7fa0-bae8-42f6-8f54-64a504af143e tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:07.618533 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-cadc7fa0-bae8-42f6-8f54-64a504af143e tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] HTTP exception thrown: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cadc7fa0-bae8-42f6-8f54-64a504af143e tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Request method failure captured: Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/flavors/1419360179/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOtHz6ylkZT9o_MbUSi0eWoV0S2_88-TsZLJKSX-uhV8YBMhfbtw744uuRjdNpljaYEqslNXcjeYRar_7plQSHeWqmUYKe1tRRCh5l_CpfuVKGB3VbvXlxPDPaZZaGxBWIjBg3hRKuKQvclUu77pvvOhH7OckehJh3ACj0n2ldfQvg Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c0c4d4442ba94954810493864ba0750b Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:42:07.620908 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c4d4442ba94954810493864ba0750b"}]}] Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c0c4d4442ba94954810493864ba0750b Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bd8e5ed79bee463ba3c6d405e104eb60 Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:07.622969 n-d-858238-3 devstack@n-api.service[137558]: exception: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'id': 'hw:cpu_thread_policy'} Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.623817 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:42:07.625293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.626466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cadc7fa0-bae8-42f6-8f54-64a504af143e tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Returning 404 to user: Flavor 1419360179 has no extra specs with key hw:cpu_thread_policy. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:07.627436 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cadc7fa0-bae8-42f6-8f54-64a504af143e tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1419360179/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.030870 Nov 02 13:42:07.628434 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 156/319] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:42:07 2022] DELETE /compute/v2.1/flavors/1419360179/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:07.639552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bd5e98a1-72ce-4154-bf0c-142d296c4b28 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.644003 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-bd5e98a1-72ce-4154-bf0c-142d296c4b28 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bd5e98a1-72ce-4154-bf0c-142d296c4b28 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Request method failure captured: Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 27 Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOtHz6ylkZT9o_MbUSi0eWoV0S2_88-TsZLJKSX-uhV8YBMhfbtw744uuRjdNpljaYEqslNXcjeYRar_7plQSHeWqmUYKe1tRRCh5l_CpfuVKGB3VbvXlxPDPaZZaGxBWIjBg3hRKuKQvclUu77pvvOhH7OckehJh3ACj0n2ldfQvg Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c0c4d4442ba94954810493864ba0750b Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:42:07.645569 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c4d4442ba94954810493864ba0750b"}]}] Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c0c4d4442ba94954810493864ba0750b Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bd8e5ed79bee463ba3c6d405e104eb60 Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: {"hw:cpu_policy": "shared"} Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:07.646883 n-d-858238-3 devstack@n-api.service[137558]: exception: Request body and URI mismatch Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.647648 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.648761 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:07.648761 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:07.648761 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 13:42:07.648761 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.651940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bd5e98a1-72ce-4154-bf0c-142d296c4b28 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:07.653792 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bd5e98a1-72ce-4154-bf0c-142d296c4b28 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019511 Nov 02 13:42:07.654783 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 157/320] 10.222.0.18 () {60 vars in 1265 bytes} [Wed Nov 2 13:42:07 2022] PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:42:07.665945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3563bf4-2675-4dd9-b2de-6a0d39fbfe46 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3563bf4-2675-4dd9-b2de-6a0d39fbfe46 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Request method failure captured: Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 49 Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOtHz6ylkZT9o_MbUSi0eWoV0S2_88-TsZLJKSX-uhV8YBMhfbtw744uuRjdNpljaYEqslNXcjeYRar_7plQSHeWqmUYKe1tRRCh5l_CpfuVKGB3VbvXlxPDPaZZaGxBWIjBg3hRKuKQvclUu77pvvOhH7OckehJh3ACj0n2ldfQvg Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c0c4d4442ba94954810493864ba0750b Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:42:07.674007 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0c4d4442ba94954810493864ba0750b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0c4d4442ba94954810493864ba0750b"}]}] Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c0c4d4442ba94954810493864ba0750b Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bd8e5ed79bee463ba3c6d405e104eb60 Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 13:42:07.675405 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'flavor_id': '1419360179', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 13:42:07.676051 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.677344 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:07.678401 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:07.678401 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:07.678401 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:42:07.678401 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:42:07.678401 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:42:07.678401 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:07.680342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3563bf4-2675-4dd9-b2de-6a0d39fbfe46 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:07.681398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d3563bf4-2675-4dd9-b2de-6a0d39fbfe46 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019437 Nov 02 13:42:07.682480 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 158/321] 10.222.0.18 () {60 vars in 1265 bytes} [Wed Nov 2 13:42:07 2022] PUT /compute/v2.1/flavors/1419360179/os-extra_specs/hw:numa_nodes => generated 117 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:42:07.695412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-36dda620-4ada-4403-807b-eccd4ebdacc1 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:07.717282 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-36dda620-4ada-4403-807b-eccd4ebdacc1 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1419360179" status: 202 len: 0 microversion: 2.1 time: 0.029133 Nov 02 13:42:07.718456 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 159/322] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:07 2022] DELETE /compute/v2.1/flavors/1419360179 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:07.736314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-09965439-256a-4e29-a506-df93d8d8caf5 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:07.749864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.772911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.774689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:07.776062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8bbb1d47-a974-4557-897b-ed0b531cf0a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1362 microversion: 2.25 time: 1.100159 Nov 02 13:42:07.777337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 164/323] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:06 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1362 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:42:07.830194 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-09965439-256a-4e29-a506-df93d8d8caf5 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885 tempest-FlavorsExtraSpecsNegativeTestJSON-1313514885-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.104060 Nov 02 13:42:07.830973 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 160/324] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:07 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:08.437135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:08.438239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:08.442778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:08.448888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:08.457881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:08.458585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:08.459747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:08.460408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:08.462475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:08.614924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:08.819713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:08.822304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:08.836069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=11 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:08.856841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:08.858857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:08.861134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:08.867395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:08.870033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:08.874572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:08.999489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:09.023960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abb73702-0430-4c37-91af-1ff95df8a735 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.590803 Nov 02 13:42:09.033214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 165/325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:08 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:09.421287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=32 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:09.634506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:09.661224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:09.670122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:09.674517 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29c6b117-1383-4011-a239-51460770133e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1558 microversion: 2.25 time: 0.874229 Nov 02 13:42:09.677908 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 161/326] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:08 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1558 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:10.033391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-210669583", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:10.121669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:10.122540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:10.142870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:10.145701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.146194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.146629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.147372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.147825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.148245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.444146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:10.574875 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-96bffa40-98fc-4fc9-b61c-4e837b8b32b1 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 2051 microversion: 2.25 time: 0.869658 Nov 02 13:42:10.592769 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 162/327] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:09 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 2051 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:10.605100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:10.605689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:10.613083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.613926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.614811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.615867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.616483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.617049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.877822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:10.920809 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3f83b20f-3558-475c-8c92-7492ea6278e1 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.326581 Nov 02 13:42:10.932454 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 163/328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:10 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:11.143019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:11.145965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:11.147988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:11.148883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:11.150351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:11.172350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:11.173119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:11.173710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.174611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:11.175509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:11.177588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.208375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:11.223280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:11.279289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:11.287826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:11.416538 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efcafccf-0fff-4ba9-862f-fdc1d4be6589 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984042 Nov 02 13:42:11.423315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 166/329] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:42:11.430658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:11.431306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:11.458697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:11.460155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:11.460831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.462358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:11.462970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:11.464050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.524729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1151289825", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:11.705496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:12.158805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:12.353896 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15b48e39-595a-43e3-89de-2b13ecc207cb tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 2051 microversion: 2.25 time: 0.929188 Nov 02 13:42:12.356173 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 167/330] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:11 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 2051 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:12.371656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f9e2df1b-e887-4d28-a501-49a1ce115406 req-fc28fdb8-5617-4839-b0cd-f039e47ca761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afb8e18-b699-459c-b537-9f08c5fa0328", "name": "network-vif-plugged", "status": "completed", "tag": "fdd3cf83-ba6e-4348-bbc2-24dcb19b2d47"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:12.415369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9e2df1b-e887-4d28-a501-49a1ce115406 req-fc28fdb8-5617-4839-b0cd-f039e47ca761 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:12.420047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9e2df1b-e887-4d28-a501-49a1ce115406 req-fc28fdb8-5617-4839-b0cd-f039e47ca761 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:12.420491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9e2df1b-e887-4d28-a501-49a1ce115406 req-fc28fdb8-5617-4839-b0cd-f039e47ca761 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:12.488707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f9e2df1b-e887-4d28-a501-49a1ce115406 req-fc28fdb8-5617-4839-b0cd-f039e47ca761 service nova] Creating event network-vif-plugged:fdd3cf83-ba6e-4348-bbc2-24dcb19b2d47 for instance 6afb8e18-b699-459c-b537-9f08c5fa0328 on n-h2-858238-3 Nov 02 13:42:12.514055 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f9e2df1b-e887-4d28-a501-49a1ce115406 req-fc28fdb8-5617-4839-b0cd-f039e47ca761 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156407 Nov 02 13:42:12.516197 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 168/331] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:12.538174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b2921f6-dda1-4818-baa3-51cda378228e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:12.539398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b2921f6-dda1-4818-baa3-51cda378228e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:12.952696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b2921f6-dda1-4818-baa3-51cda378228e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:12.979856 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b2921f6-dda1-4818-baa3-51cda378228e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1216 microversion: 2.1 time: 0.455139 Nov 02 13:42:12.984481 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 169/332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:12 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1216 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:13.001704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:13.002381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:13.030578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.031208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.032055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.033411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.035994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.036950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.406114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:13.418928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b0f47884-20d8-4f4b-8fd9-f7446377103e tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1318 microversion: 2.1 time: 0.431652 Nov 02 13:42:13.419562 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 170/333] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:12 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:13.464807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:13.476980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:13.477545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.477642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:13.477839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:13.479221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:13.479812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:13.480641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.483477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.485119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.488529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.489445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.504173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.505846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.507205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.510729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.511579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.514201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.549048 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c05e26f-db5b-4f04-a255-58285ba48e3d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.107500 Nov 02 13:42:13.553640 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 171/334] 10.222.0.18 () {60 vars in 1217 bytes} [Wed Nov 2 13:42:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:42:13.567266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:13.574152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858238-3", "block_migration": "auto"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:13.578813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for user 832cd460bb5e4148a57d561f762ceb11 and project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:13.596409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:13.628699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.630604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.632380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.633448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.636475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.637152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:13.638332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.642942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:13.816203 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-832f2ec0-270e-4204-a637-6daa5b0e3fd0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.882468 Nov 02 13:42:13.816874 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 164/335] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:42:13.841569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-716cfa9e-30fb-4719-8287-4dbb23d86451 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:13.844522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-716cfa9e-30fb-4719-8287-4dbb23d86451 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:13.862604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:14.034564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'flavor' on Instance uuid 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:14.205617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Going to try to live migrate instance to n-h2-858238-3 {{(pid=137559) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:42:14.514542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-716cfa9e-30fb-4719-8287-4dbb23d86451 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:14.533441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-716cfa9e-30fb-4719-8287-4dbb23d86451 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1213 microversion: 2.1 time: 0.699040 Nov 02 13:42:14.534128 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 165/336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:13 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1213 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:14.550285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:14.556934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:14.591707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.593352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.594788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.595761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.598683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.601432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.955724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:14.968691 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a50274cc-f62d-412b-b933-49e656a408b1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1274 microversion: 2.1 time: 0.433251 Nov 02 13:42:14.991827 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 166/337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:14 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1274 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:14.997747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:15.006464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:15.033401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:15.035195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:15.040738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:15.041924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:15.043081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:15.043969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:15.925064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:15.942610 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-97e0bb8c-095e-4ce5-a31d-03b7c641cd4d tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1467 microversion: 2.1 time: 0.949318 Nov 02 13:42:15.971011 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:14 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1467 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:15.988302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:15.991327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:16.011520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.012340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.017165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.018234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.018748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.019136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.207049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:16.227470 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b7138c0d-c3e6-4cd5-bd80-d85b80b3d917 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1265 microversion: 2.1 time: 0.254941 Nov 02 13:42:16.227984 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 168/339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:15 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:16.605268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f824c6040>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:16.610783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.618602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.620259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.622801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.623495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.625174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.711874 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3450addd-41af-4991-9705-59bc1c864749 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.475186 Nov 02 13:42:16.713985 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 169/340] 10.222.0.18 () {58 vars in 1128 bytes} [Wed Nov 2 13:42:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:16.723947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:16.728899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:16.741938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.742935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.743582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.744721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.745376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.745954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.927265 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca604bb8-8539-489f-984c-895f35a63a9e tempest-DeleteServersAdminTestJSON-1301571670 tempest-DeleteServersAdminTestJSON-1301571670-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328/action" status: 202 len: 0 microversion: 2.1 time: 0.211727 Nov 02 13:42:16.928202 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 170/341] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:42:16 2022] POST /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:16.933446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:16.934319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:16.941940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.942484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.942917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.943677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.944671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.945100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.948327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:17.858420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:17.887683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-efab4886-2a50-41e0-bb26-dd0162e50bef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1316 microversion: 2.1 time: 0.958258 Nov 02 13:42:17.899150 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 171/342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:16 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1316 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:17.899150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f8254bd30>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:17.904862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.904862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.904862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.904862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.905291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.905935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.956705 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-afe727d0-1424-493b-8259-f4bbbe6c8f81 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.061395 Nov 02 13:42:17.965051 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 172/343] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Nov 2 13:42:17 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:17.970798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:17.971788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:17.978623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.979598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.980227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.981126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.982894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.983542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.041215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.041914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.042545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.043258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lazy-loading 'fault' on Instance uuid 6afb8e18-b699-459c-b537-9f08c5fa0328 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:18.674229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:18.688897 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cb5f0987-ac7f-4a76-8ea0-2cd5abaa22fd tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1450 microversion: 2.1 time: 0.721659 Nov 02 13:42:18.695891 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 173/344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:17 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1450 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:18.704889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:18.723611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:18.728134 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f567d34-8289-40b8-9332-44a57c160ee8 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5/action" status: 202 len: 0 microversion: 2.25 time: 5.160061 Nov 02 13:42:18.735711 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 172/345] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:42:13 2022] POST /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5/action => generated 0 bytes in 5172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:18.742829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cbf2a760-51e0-4455-9759-bd848fe65bcf req-f971766e-7301-4970-8336-2ed001a13139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9c1616-fc5e-4255-af98-141b90526fe4", "tag": "af08ebd3-0ef2-4e3d-a5f5-42a0df3c85ae"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:18.743975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.744571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.745103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.746108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.746706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.747202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.764273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cbf2a760-51e0-4455-9759-bd848fe65bcf req-f971766e-7301-4970-8336-2ed001a13139 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.765544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cbf2a760-51e0-4455-9759-bd848fe65bcf req-f971766e-7301-4970-8336-2ed001a13139 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.766173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cbf2a760-51e0-4455-9759-bd848fe65bcf req-f971766e-7301-4970-8336-2ed001a13139 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.781440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cbf2a760-51e0-4455-9759-bd848fe65bcf req-f971766e-7301-4970-8336-2ed001a13139 service nova] Creating event network-changed:af08ebd3-0ef2-4e3d-a5f5-42a0df3c85ae for instance fa9c1616-fc5e-4255-af98-141b90526fe4 on n-h1-858238-3 Nov 02 13:42:18.787505 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cbf2a760-51e0-4455-9759-bd848fe65bcf req-f971766e-7301-4970-8336-2ed001a13139 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049861 Nov 02 13:42:18.792742 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 173/346] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:18.805783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f82254700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:18.812129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.818205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.818958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.820014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.820643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.826902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.856462 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b69bbb92-d0e6-433a-8941-2d2d5bba31a6 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.055150 Nov 02 13:42:18.864209 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 174/347] 10.222.0.18 () {58 vars in 1145 bytes} [Wed Nov 2 13:42:18 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:42:18.864209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:18.864209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:18.871291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.871909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.873155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.873871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.874326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.874749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.900521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:18.917600 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a089e1e6-7f62-43e7-a7ab-311d28efb127 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1271 microversion: 2.1 time: 0.219825 Nov 02 13:42:18.929084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:42:18.936640 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 174/348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:18 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:18.944693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:18.945590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:18.954677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.980196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.983005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.986561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.988956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.989467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.116209 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f3c5c16-492a-4b3e-9875-b5484ea7b95f tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 204 len: 0 microversion: 2.1 time: 0.256820 Nov 02 13:42:19.120650 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 175/349] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:18 2022] DELETE /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:19.131177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f82254c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:19.139230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.140624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.141056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.141990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.142653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.143339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.182511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:19.189972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f87b0110-858c-431c-b415-58d3371a7925 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.064348 Nov 02 13:42:19.198241 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 176/350] 10.222.0.18 () {58 vars in 1128 bytes} [Wed Nov 2 13:42:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:19.206986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:19.208737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:19.217324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.218779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.219509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.220462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.221114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.221876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.251623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:19.586931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:19.618405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:19.633698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:19.639655 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-030b052e-5d8b-48d4-a0b6-062bd2268318 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.700314 Nov 02 13:42:19.642832 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 175/351] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:18 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:19.654606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:19.656268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:19.667689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.669041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.670502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.671950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.673271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.677598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.735677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.736598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.737226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.737928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lazy-loading 'fault' on Instance uuid 6afb8e18-b699-459c-b537-9f08c5fa0328 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:19.826778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:19.845835 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2eaaf1d7-3303-409d-8235-5b0fff2e151f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1316 microversion: 2.1 time: 0.645507 Nov 02 13:42:19.859347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 177/352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:19 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:19.877615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f82257790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:19.891045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.893914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.894373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.895212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.897953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.898413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.946446 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-36fa7e3e-d199-4271-8c55-ebd2e633d484 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.082384 Nov 02 13:42:19.958941 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 178/353] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 13:42:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:19.972943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:19.974335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:19.985216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.986321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.989062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.990716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.991762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.992975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.130365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:20.141755 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7754d80c-db8f-4348-8cc7-2c20c3e86d30 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1456 microversion: 2.1 time: 0.496915 Nov 02 13:42:20.142342 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 176/354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:19 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1456 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:20.166455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f825ed280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:20.170643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.171510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.172187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.177717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.178583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.179317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.223408 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-28e1c0cb-63ee-459a-a416-faa30febe5b2 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.058164 Nov 02 13:42:20.224574 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1128 bytes} [Wed Nov 2 13:42:20 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:20.235814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f82417b80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:20.253574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.254446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.255150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.273455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.274275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.274998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.300733 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3f62a64-7456-40bb-a5db-4b14469b2bc3 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-h2-858238-3" status: 200 len: 729 microversion: 2.1 time: 0.068816 Nov 02 13:42:20.308091 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 178/356] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 13:42:20 2022] GET /compute/v2.1/os-hosts/n-h2-858238-3 => generated 729 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:20.315821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Calling method '.version_select at 0x7f6f8254bca0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:20.326551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.327504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.328674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.356115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.384308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.386797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.453808 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6df7889-f04c-4073-9620-e0bc6440bf71 tempest-HostsAdminTestJSON-1404840868 tempest-HostsAdminTestJSON-1404840868-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-h1-858238-3" status: 200 len: 598 microversion: 2.1 time: 0.142693 Nov 02 13:42:20.468708 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 179/357] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 13:42:20 2022] GET /compute/v2.1/os-hosts/n-h1-858238-3 => generated 598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:20.681487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:20.682107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:20.702386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.706464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.709041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.712446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.712945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.718331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:21.545997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:21.556324 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5644303-8214-4e42-a24b-ec3492943285 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 1.589849 Nov 02 13:42:21.571126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 179/358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:19 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:21.571126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:21.571126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:21.572877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:21.573435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:21.573955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:21.574646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:21.575033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:21.576018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:21.688114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:21.706546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:21.708285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:21.709676 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a6e8b381-2edb-4a56-9da5-5e95acbdcc72 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 1.033017 Nov 02 13:42:21.715268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 180/359] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:20 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:22.213679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1140185485", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "d34ba8c2-d0aa-4641-a845-7e74bb871d7e"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:22.316741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] validate_networks() for [('d34ba8c2-d0aa-4641-a845-7e74bb871d7e', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:22.627125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:22.636679 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bab64fcc-8231-4263-80dc-b168d74f4ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1316 microversion: 2.1 time: 1.076182 Nov 02 13:42:22.652561 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 180/360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:21 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1316 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:22.652561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:22.655627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:22.668327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:22.668665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:22.671523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:22.674844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:22.677867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:22.678495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:22.776248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:22.776702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:22.777149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:22.779445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lazy-loading 'fault' on Instance uuid 6afb8e18-b699-459c-b537-9f08c5fa0328 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:22.961041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:23.190581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:23.207892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e767e2c-a58f-4b1d-911c-183b228b42ce tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1456 microversion: 2.1 time: 0.564919 Nov 02 13:42:23.208806 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 181/361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:22 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1456 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:23.213431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:23.214027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:23.228957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.229829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.231306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.232306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.243990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.244435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.694550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:23.708465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4442c78-2a3a-4bc0-b721-66438505b03d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 0.498436 Nov 02 13:42:23.709699 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 182/362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:23 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:23.722269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:23.723436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:23.733575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.734465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.734909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.736180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.736895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.737898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.906693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:23.907880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:23.908530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:23.909082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:23.909918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:23.947265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.948059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.948724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.953658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.954330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.955151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.010402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Getting quotas for project e0afdc344084470cbef232092429a12a. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:24.022025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Getting quotas for user 1d65a525b6514c33ab806867e8d5d6f9 and project e0afdc344084470cbef232092429a12a. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:24.056744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:24.063888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:24.208288 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fbd8d668-cdb2-40c2-9e78-b4136bf465a9 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.470336 Nov 02 13:42:24.214920 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 181/363] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:42:24.244457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:24.246349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:24.258456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:24.259190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:24.260802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.261952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:24.262705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:24.263328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.835151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:24.842632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:24.850889 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3a65cd14-7e60-4f45-b93a-91b6e04a918b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1316 microversion: 2.1 time: 0.631643 Nov 02 13:42:24.852711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 182/364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:24 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:24.856609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:24.860284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-0f8d7c18-5c65-4c33-9777-d6481285b03e req-ed062f80-df9f-40cd-a2c6-bbcb480db32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9c1616-fc5e-4255-af98-141b90526fe4", "name": "network-vif-plugged", "status": "completed", "tag": "af08ebd3-0ef2-4e3d-a5f5-42a0df3c85ae"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:24.866054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:24.868672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80409646-f47a-4225-9f78-79b29618429b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 1.157631 Nov 02 13:42:24.883646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 183/365] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:23 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:24.896919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-29b5d61d-e938-4a34-8190-94437cd07475 req-fe1849a6-199e-4698-8d17-3e4ecec5553a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afb8e18-b699-459c-b537-9f08c5fa0328", "name": "network-vif-deleted", "tag": "fdd3cf83-ba6e-4348-bbc2-24dcb19b2d47"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:24.926709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0f8d7c18-5c65-4c33-9777-d6481285b03e req-ed062f80-df9f-40cd-a2c6-bbcb480db32f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:24.927323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-29b5d61d-e938-4a34-8190-94437cd07475 req-fe1849a6-199e-4698-8d17-3e4ecec5553a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:24.928567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-29b5d61d-e938-4a34-8190-94437cd07475 req-fe1849a6-199e-4698-8d17-3e4ecec5553a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:24.929011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-29b5d61d-e938-4a34-8190-94437cd07475 req-fe1849a6-199e-4698-8d17-3e4ecec5553a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.930492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0f8d7c18-5c65-4c33-9777-d6481285b03e req-ed062f80-df9f-40cd-a2c6-bbcb480db32f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:24.936460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0f8d7c18-5c65-4c33-9777-d6481285b03e req-ed062f80-df9f-40cd-a2c6-bbcb480db32f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.961349 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-29b5d61d-e938-4a34-8190-94437cd07475 req-fe1849a6-199e-4698-8d17-3e4ecec5553a service nova] Creating event network-vif-deleted:fdd3cf83-ba6e-4348-bbc2-24dcb19b2d47 for instance 6afb8e18-b699-459c-b537-9f08c5fa0328 on n-h2-858238-3 Nov 02 13:42:24.975558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-29b5d61d-e938-4a34-8190-94437cd07475 req-fe1849a6-199e-4698-8d17-3e4ecec5553a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090008 Nov 02 13:42:24.976852 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 184/366] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:24.988051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-658d2481-e01c-4a97-815c-c5ada139e763 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:24.990828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-658d2481-e01c-4a97-815c-c5ada139e763 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.024667 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-0f8d7c18-5c65-4c33-9777-d6481285b03e req-ed062f80-df9f-40cd-a2c6-bbcb480db32f service nova] Creating event network-vif-plugged:af08ebd3-0ef2-4e3d-a5f5-42a0df3c85ae for instance fa9c1616-fc5e-4255-af98-141b90526fe4 on n-h1-858238-3 Nov 02 13:42:25.050909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-0f8d7c18-5c65-4c33-9777-d6481285b03e req-ed062f80-df9f-40cd-a2c6-bbcb480db32f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194129 Nov 02 13:42:25.058552 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 183/367] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:25.074001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:25.074764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.086147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.087334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.088858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.090735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.091755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.109741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.178460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.178938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.191890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.192611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lazy-loading 'fault' on Instance uuid 6afb8e18-b699-459c-b537-9f08c5fa0328 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:25.269115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6caa3a4f63a4f729948679403b2fe21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63f9d4f2a534ce6b03bba55cfc49e76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:25.277634 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41db1af0-1621-4b8e-a0bd-eb225953f079 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 200 len: 1308 microversion: 2.1 time: 0.216266 Nov 02 13:42:25.291526 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 184/368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:25 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:25.297473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:25.298089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.311952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.312551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.312982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.314057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.314611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.315129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.579924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-658d2481-e01c-4a97-815c-c5ada139e763 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:25.595624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-658d2481-e01c-4a97-815c-c5ada139e763 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1216 microversion: 2.1 time: 0.615967 Nov 02 13:42:25.600559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 185/369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:24 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1216 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:25.679218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:25.692048 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-702962cf-0422-4371-a74e-7a7de748f1c6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 0.398928 Nov 02 13:42:25.693020 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 185/370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:25 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:25.881157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:25.882437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.890930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.891882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.892461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.902092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:25.902726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.907038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.907919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.910829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.919193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.920443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.921373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.923550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.925740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.928456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.254547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.307423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.308906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.311162 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b6982f2-97d6-4460-a7b2-d1d9c64cc781 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.414453 Nov 02 13:42:26.315355 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 186/371] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:25 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:26.321234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-35ab9a75-5113-4118-83bb-364eff863f4b req-e8884d17-cd38-4bc3-98f3-dd7e22c9c94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c91ab6-d7c2-424b-aaaf-2b202a3090d5", "name": "network-vif-unplugged", "status": "completed", "tag": "1150df3c-744e-4d59-8bbb-94d550dfd3ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:26.334596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-35ab9a75-5113-4118-83bb-364eff863f4b req-e8884d17-cd38-4bc3-98f3-dd7e22c9c94d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.335081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-35ab9a75-5113-4118-83bb-364eff863f4b req-e8884d17-cd38-4bc3-98f3-dd7e22c9c94d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.342534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-35ab9a75-5113-4118-83bb-364eff863f4b req-e8884d17-cd38-4bc3-98f3-dd7e22c9c94d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.358445 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-35ab9a75-5113-4118-83bb-364eff863f4b req-e8884d17-cd38-4bc3-98f3-dd7e22c9c94d service nova] Creating event network-vif-unplugged:1150df3c-744e-4d59-8bbb-94d550dfd3ba for instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 on n-h1-858238-3 Nov 02 13:42:26.366508 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-35ab9a75-5113-4118-83bb-364eff863f4b req-e8884d17-cd38-4bc3-98f3-dd7e22c9c94d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049808 Nov 02 13:42:26.367516 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 187/372] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:26.373431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.374466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.384333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.385042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.385938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.386806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.387526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.388153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.415421 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] HTTP exception thrown: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Request method failure captured: Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 HTTP/1.1 Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNpFWegXLrvnj1OdVDfdhBNrujlR57HMuUc-9hX-_uv1sgUZ66r--2hRgOc50OFO-AIsxTKkqKyFcOxO9kzMBhEqaQ22MFr_YiVuPPoJ-69p6CL-fKTxGb7TelmM2js5CxzC56903VnG1EG8M0gg0veeHPPCkMwZOjbqDf8bOzTG-E Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:26.422899 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b63f9d4f2a534ce6b03bba55cfc49e76"}]}] Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: a6caa3a4f63a4f729948679403b2fe21 Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.424948 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '6afb8e18-b699-459c-b537-9f08c5fa0328'} Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:26.426292 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.427696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.433666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Returning 404 to user: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:26.435070 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4e352a6-698b-4d5f-941f-8e5ecf4e8a80 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 404 len: 111 microversion: 2.1 time: 0.066141 Nov 02 13:42:26.443485 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 188/373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:26.453622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.454657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.467667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.468504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.469105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.470064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.470793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.471384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.489021 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] HTTP exception thrown: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.506893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Request method failure captured: Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 HTTP/1.1 Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNpFWegXLrvnj1OdVDfdhBNrujlR57HMuUc-9hX-_uv1sgUZ66r--2hRgOc50OFO-AIsxTKkqKyFcOxO9kzMBhEqaQ22MFr_YiVuPPoJ-69p6CL-fKTxGb7TelmM2js5CxzC56903VnG1EG8M0gg0veeHPPCkMwZOjbqDf8bOzTG-E Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:26.518377 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b63f9d4f2a534ce6b03bba55cfc49e76"}]}] Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: a6caa3a4f63a4f729948679403b2fe21 Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.519844 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '6afb8e18-b699-459c-b537-9f08c5fa0328'} Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.521766 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.525033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Returning 404 to user: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:26.525033 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1868b229-ff3f-45e9-a3d2-f6e9d76b3209 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 404 len: 111 microversion: 2.1 time: 0.077261 Nov 02 13:42:26.530542 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 189/374] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:26 2022] DELETE /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:26.536957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fdd02144-eb36-4667-8527-604f248c5ca1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1316 microversion: 2.1 time: 0.659826 Nov 02 13:42:26.537940 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 186/375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:25 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:26.547625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.547625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 6afb8e18-b699-459c-b537-9f08c5fa0328] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.554735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.555260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.558451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.559496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.564113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.564799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.586332 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] HTTP exception thrown: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Request method failure captured: Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 HTTP/1.1 Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNpFWegXLrvnj1OdVDfdhBNrujlR57HMuUc-9hX-_uv1sgUZ66r--2hRgOc50OFO-AIsxTKkqKyFcOxO9kzMBhEqaQ22MFr_YiVuPPoJ-69p6CL-fKTxGb7TelmM2js5CxzC56903VnG1EG8M0gg0veeHPPCkMwZOjbqDf8bOzTG-E Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:26.588546 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b63f9d4f2a534ce6b03bba55cfc49e76"}]}] Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: a6caa3a4f63a4f729948679403b2fe21 Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.589708 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '6afb8e18-b699-459c-b537-9f08c5fa0328'} Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:26.590353 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. Nov 02 13:42:26.592541 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.594800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Returning 404 to user: Instance 6afb8e18-b699-459c-b537-9f08c5fa0328 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:26.595952 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d5d516e6-af22-4093-b406-9407248a0fc5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328" status: 404 len: 111 microversion: 2.1 time: 0.063655 Nov 02 13:42:26.600607 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 190/376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/6afb8e18-b699-459c-b537-9f08c5fa0328 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:26.607156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.608173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.620090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.620686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.623494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.624770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.625008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.625649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.626070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.626717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.640130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.640661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.641105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.641870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.642795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.645550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.647155 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] HTTP exception thrown: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Request method failure captured: Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 HTTP/1.1 Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNpFWegXLrvnj1OdVDfdhBNrujlR57HMuUc-9hX-_uv1sgUZ66r--2hRgOc50OFO-AIsxTKkqKyFcOxO9kzMBhEqaQ22MFr_YiVuPPoJ-69p6CL-fKTxGb7TelmM2js5CxzC56903VnG1EG8M0gg0veeHPPCkMwZOjbqDf8bOzTG-E Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:42:26.650389 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b63f9d4f2a534ce6b03bba55cfc49e76"}]}] Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a6caa3a4f63a4f729948679403b2fe21 Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.652709 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1c8d3824-1588-4be6-af45-b90614454f00'} Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:26.654752 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.656831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.663465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Returning 404 to user: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:26.664644 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0143735f-644a-479b-a10b-cdf4a76429a5 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 404 len: 111 microversion: 2.1 time: 0.063833 Nov 02 13:42:26.665885 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 187/377] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:26 2022] DELETE /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:42:26.682655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.686698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] [instance: 1c8d3824-1588-4be6-af45-b90614454f00] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.704565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.707352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.708079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.709459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.710169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.714023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.733857 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] HTTP exception thrown: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Request method failure captured: Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 HTTP/1.1 Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNpFWegXLrvnj1OdVDfdhBNrujlR57HMuUc-9hX-_uv1sgUZ66r--2hRgOc50OFO-AIsxTKkqKyFcOxO9kzMBhEqaQ22MFr_YiVuPPoJ-69p6CL-fKTxGb7TelmM2js5CxzC56903VnG1EG8M0gg0veeHPPCkMwZOjbqDf8bOzTG-E Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:42:26.737130 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b63f9d4f2a534ce6b03bba55cfc49e76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b63f9d4f2a534ce6b03bba55cfc49e76"}]}] Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b63f9d4f2a534ce6b03bba55cfc49e76 Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-385321202 Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a6caa3a4f63a4f729948679403b2fe21 Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersAdminTestJSON-385321202-project Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.739622 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1c8d3824-1588-4be6-af45-b90614454f00'} Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:26.740917 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. Nov 02 13:42:26.742710 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:26.748964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] Returning 404 to user: Instance 1c8d3824-1588-4be6-af45-b90614454f00 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:26.751501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aff7d252-1a9a-4188-8bea-7ffcf3dd7a88 tempest-DeleteServersAdminTestJSON-385321202 tempest-DeleteServersAdminTestJSON-385321202-project] 10.222.0.18 "GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00" status: 404 len: 111 microversion: 2.1 time: 0.079202 Nov 02 13:42:26.759628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 188/378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/1c8d3824-1588-4be6-af45-b90614454f00 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:26.768227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.769115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.785486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.785982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.786680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.787435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.787895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.788310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.815923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.828152 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae5bcc3c-e11a-4d68-a286-6ca6d80fcadd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1268 microversion: 2.1 time: 0.206893 Nov 02 13:42:26.844091 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 191/379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:27.055669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b31f9fce-6614-489e-991e-09543c40e274 req-4c477bc6-0dfa-4369-8f70-61551c9377ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8169e59-d6a0-4edd-8a16-a69424518ad1", "tag": "cbc2b2f0-a287-4e97-aa3b-58d2e0db3533"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:27.090856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b31f9fce-6614-489e-991e-09543c40e274 req-4c477bc6-0dfa-4369-8f70-61551c9377ab service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.102807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b31f9fce-6614-489e-991e-09543c40e274 req-4c477bc6-0dfa-4369-8f70-61551c9377ab service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.103689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b31f9fce-6614-489e-991e-09543c40e274 req-4c477bc6-0dfa-4369-8f70-61551c9377ab service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.117229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:27.146627 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b31f9fce-6614-489e-991e-09543c40e274 req-4c477bc6-0dfa-4369-8f70-61551c9377ab service nova] Creating event network-changed:cbc2b2f0-a287-4e97-aa3b-58d2e0db3533 for instance c8169e59-d6a0-4edd-8a16-a69424518ad1 on n-h2-858238-3 Nov 02 13:42:27.160761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b31f9fce-6614-489e-991e-09543c40e274 req-4c477bc6-0dfa-4369-8f70-61551c9377ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120096 Nov 02 13:42:27.161666 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 192/380] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:27.171390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:27.184206 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-799e5efd-2f0b-41f6-b4d0-59aa2d56747c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 0.423290 Nov 02 13:42:27.186703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 189/381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:27.348854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:27.349755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:27.383155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.384921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.386130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.392849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.394150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.402673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.565826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:27.567596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:27.590186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.592802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.596000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.598805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.601628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.605809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.979290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:27.990874 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf1aa095-ca6f-492b-9ccb-ce7b2413c28b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1465 microversion: 2.1 time: 0.432092 Nov 02 13:42:28.015864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 190/382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:27 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1465 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:28.027508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:28.028193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:28.037965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.039425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.040850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.041845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.042494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.044109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.171137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:28.188824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3836d8e2-c02d-40c9-8a62-38f57a5c0f6c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1274 microversion: 2.1 time: 0.171165 Nov 02 13:42:28.192954 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 191/383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:28 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:28.316998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:28.337142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:28.345276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:28.353362 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a98aff81-993e-4d1e-837a-77ee5ac44e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 1.008084 Nov 02 13:42:28.357316 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 193/384] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:27 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:28.367693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:28.375881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:28.400454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.427524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.428621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.430127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.433103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.434555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.618246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:28.620708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:28.633521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.634907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.636540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.645489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.646417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.647134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.029869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:29.049705 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfd5a48f-9e79-4671-a612-d73ec2906c27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 0.688428 Nov 02 13:42:29.059673 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 194/385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:28 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:29.072382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-681ea342-edbc-4808-90cb-5f95b6ac7225 req-c2976bc5-d723-4394-989b-4df3a3f3d026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c91ab6-d7c2-424b-aaaf-2b202a3090d5", "tag": "1150df3c-744e-4d59-8bbb-94d550dfd3ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:29.111383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-681ea342-edbc-4808-90cb-5f95b6ac7225 req-c2976bc5-d723-4394-989b-4df3a3f3d026 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.112228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-681ea342-edbc-4808-90cb-5f95b6ac7225 req-c2976bc5-d723-4394-989b-4df3a3f3d026 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.112980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-681ea342-edbc-4808-90cb-5f95b6ac7225 req-c2976bc5-d723-4394-989b-4df3a3f3d026 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.178418 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-681ea342-edbc-4808-90cb-5f95b6ac7225 req-c2976bc5-d723-4394-989b-4df3a3f3d026 service nova] Creating event network-changed:1150df3c-744e-4d59-8bbb-94d550dfd3ba for instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 on n-h1-858238-3 Nov 02 13:42:29.189270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-681ea342-edbc-4808-90cb-5f95b6ac7225 req-c2976bc5-d723-4394-989b-4df3a3f3d026 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126848 Nov 02 13:42:29.191075 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 195/386] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:29.394038 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6e32b33-a62b-4508-9b14-7e611592536e tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1616 microversion: 2.1 time: 1.199149 Nov 02 13:42:29.402109 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 192/387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:28 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1616 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:29.407609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:29.410489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:29.425009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.425849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.426970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.427966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.430928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.431610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.558470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:29.573452 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45eff6f3-9ba0-4542-a3bd-71990b2a3e2f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1274 microversion: 2.1 time: 0.169832 Nov 02 13:42:29.592371 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 193/388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:29 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:29.599112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:29.604000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:29.617559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.621345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.622568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.623690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.624155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.624580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.785411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7d0110cf-38ec-4d14-a06e-618743e53a70 tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] Calling method '.version_select at 0x7f6f8254bee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:29.822627 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7d0110cf-38ec-4d14-a06e-618743e53a70 tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.627221 Nov 02 13:42:29.833452 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 196/389] 10.222.0.18 () {60 vars in 1226 bytes} [Wed Nov 2 13:42:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:42:29.845159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c93a54b3-17cb-47ab-b9d3-a31f9cd6fd3d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: .version_select at 0x7f6f82417b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-511033871", "policies": ["affinity"]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:29.898769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c93a54b3-17cb-47ab-b9d3-a31f9cd6fd3d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:29.903825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:29.912843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:29.916452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c93a54b3-17cb-47ab-b9d3-a31f9cd6fd3d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:30.045395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:30.047450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c93a54b3-17cb-47ab-b9d3-a31f9cd6fd3d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:30.053572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c93a54b3-17cb-47ab-b9d3-a31f9cd6fd3d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:30.060251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:30.061718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:30.062934 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a083f1a-886a-43a7-8612-c990d725a20b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.469224 Nov 02 13:42:30.071731 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 194/390] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:29 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:30.074650 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c93a54b3-17cb-47ab-b9d3-a31f9cd6fd3d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.239720 Nov 02 13:42:30.076171 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 197/391] 10.222.0.18 () {60 vars in 1174 bytes} [Wed Nov 2 13:42:29 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:30.094658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:30.101501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d529abd4-7110-48df-84d4-abf5ec8fac9e tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] Action: 'update', calling method: .version_select at 0x7f6f8224d9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:30.110812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:30.129057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:30.129999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:30.133099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:30.134220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:30.136232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:30.138145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:30.595348 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d529abd4-7110-48df-84d4-abf5ec8fac9e tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.504986 Nov 02 13:42:30.596301 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 195/392] 10.222.0.18 () {62 vars in 1247 bytes} [Wed Nov 2 13:42:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:42:30.605601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1235293082", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4063e594-f7be-4990-b476-bd075488a561"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:30.697945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:30.955846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:30.994925 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3c817d95-b028-4e01-aa0b-69232753465d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 0.916743 Nov 02 13:42:30.995918 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 198/393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:30 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:31.025668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:31.026919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:31.042133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.043695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.044870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.046777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.051013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.052574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.365143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:31.365573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:31.366152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:31.366701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:31.366943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:31.407472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.408405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.409983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.411205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.412189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.412826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.457013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:31.473023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:31.506305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Going to run 2 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:31.515019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:31.551917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:31.567761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0861f931-e5ea-4900-a623-9d9b49c5dc51 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 0.561496 Nov 02 13:42:31.571677 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 199/394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:31 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:31.576626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-27d6eedd-7caa-4eef-9343-04bfae655172 tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] Calling method '.version_select at 0x7f6f82388040>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:31.612168 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-27d6eedd-7caa-4eef-9343-04bfae655172 tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.038857 Nov 02 13:42:31.612688 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 200/395] 10.222.0.18 () {60 vars in 1226 bytes} [Wed Nov 2 13:42:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:42:31.626412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:31.627035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:31.633647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.634138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.634579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.643391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.643989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.644761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.656881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137559) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 13:42:31.669943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=7,nova_api:INSERT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:31.706388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:31.719577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:31.784312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:31.795543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:31.815730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=b15ac095-b966-4223-9357-84ed254f0b5f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:31.886980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:31.899186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:31.955855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:31.968725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:32.032612 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b283afe-690e-47df-b6d3-6d127495bb4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.432734 Nov 02 13:42:32.034830 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 196/396] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 1437 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:42:32.048342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b45ded9-f88f-4293-a19f-e578f347bfbb tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] Action: 'update', calling method: .version_select at 0x7f6f82163670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:32.090553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:32.102267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:32.103861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:32.105036 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-800fcf65-0474-49f0-b618-62c424d12a91 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.491416 Nov 02 13:42:32.117053 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 201/397] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:31 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:32.122173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:32.123050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:32.136858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.137602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.139676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.148255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.148696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.149129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.180779 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b45ded9-f88f-4293-a19f-e578f347bfbb tempest-QuotaClassesAdmin257Test-221208417 tempest-QuotaClassesAdmin257Test-221208417-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.143641 Nov 02 13:42:32.182926 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 197/398] 10.222.0.18 () {62 vars in 1247 bytes} [Wed Nov 2 13:42:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:42:32.191984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:32.213432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:32.221365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Searching by: {'deleted': False, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:42:32.276134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.279152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.286832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.287932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.288515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.288996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.411801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:42:32.552403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fd232ed-7393-4ed8-a978-c4bc1e0e306e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.368533 Nov 02 13:42:32.553327 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 198/399] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:42:32 2022] GET /compute/v2.1/servers => generated 1003 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:32.566334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a29df2e4-d36d-4322-ad5e-5ee8d0da9c00 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:32.566939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a29df2e4-d36d-4322-ad5e-5ee8d0da9c00 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:32.692590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a29df2e4-d36d-4322-ad5e-5ee8d0da9c00 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:32.705045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a29df2e4-d36d-4322-ad5e-5ee8d0da9c00 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1219 microversion: 2.1 time: 0.142605 Nov 02 13:42:32.708573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 199/400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:32 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:32.717244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:32.718142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:32.727346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.728586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.729220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.730604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.733841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.734489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.049858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:33.053809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:33.073372 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12073b6e-1d0d-4b97-b658-c0a1076076dd tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 0.362292 Nov 02 13:42:33.074298 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 200/401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:32 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:33.094032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-eb29185a-98c3-4ab3-86d3-4e20ced179d5 req-6372b0e1-ba45-4f43-b91e-fd3093d62b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8169e59-d6a0-4edd-8a16-a69424518ad1", "name": "network-vif-plugged", "status": "completed", "tag": "cbc2b2f0-a287-4e97-aa3b-58d2e0db3533"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:33.124705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-eb29185a-98c3-4ab3-86d3-4e20ced179d5 req-6372b0e1-ba45-4f43-b91e-fd3093d62b20 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.125805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-eb29185a-98c3-4ab3-86d3-4e20ced179d5 req-6372b0e1-ba45-4f43-b91e-fd3093d62b20 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.126674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-eb29185a-98c3-4ab3-86d3-4e20ced179d5 req-6372b0e1-ba45-4f43-b91e-fd3093d62b20 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.155262 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-eb29185a-98c3-4ab3-86d3-4e20ced179d5 req-6372b0e1-ba45-4f43-b91e-fd3093d62b20 service nova] Creating event network-vif-plugged:cbc2b2f0-a287-4e97-aa3b-58d2e0db3533 for instance c8169e59-d6a0-4edd-8a16-a69424518ad1 on n-h2-858238-3 Nov 02 13:42:33.162444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:33.163922 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-eb29185a-98c3-4ab3-86d3-4e20ced179d5 req-6372b0e1-ba45-4f43-b91e-fd3093d62b20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087086 Nov 02 13:42:33.167226 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 201/402] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:33.179610 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3e5c5c60-7415-4d84-80cf-2f097fa6cdfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 1.060982 Nov 02 13:42:33.181258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:33.183257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:33.183913 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 202/403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:32 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:33.240434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.240948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.245836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.246856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.247728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.248728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.648759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:33.672621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:33.678367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:33.699519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-455fd8b2-1ebc-44f4-ab02-44c829bb8831 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.511221 Nov 02 13:42:33.701171 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 202/404] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:33 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:33.735959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:33.737051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:33.748942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.749666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.750379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.752123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.756195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.757659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.852410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-609df118-f1aa-41e5-877e-ec0b9a5a3399 req-8b9f8ff8-4737-4438-b2ae-19d3e696b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54326ae2-2303-4ac5-a643-a0665406bbfd", "tag": "d00a0d5b-6a6b-407a-96c6-fdcb5fb97e9c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:33.884260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-609df118-f1aa-41e5-877e-ec0b9a5a3399 req-8b9f8ff8-4737-4438-b2ae-19d3e696b5c3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.885028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-609df118-f1aa-41e5-877e-ec0b9a5a3399 req-8b9f8ff8-4737-4438-b2ae-19d3e696b5c3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.886083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-609df118-f1aa-41e5-877e-ec0b9a5a3399 req-8b9f8ff8-4737-4438-b2ae-19d3e696b5c3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.922037 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-609df118-f1aa-41e5-877e-ec0b9a5a3399 req-8b9f8ff8-4737-4438-b2ae-19d3e696b5c3 service nova] Creating event network-changed:d00a0d5b-6a6b-407a-96c6-fdcb5fb97e9c for instance 54326ae2-2303-4ac5-a643-a0665406bbfd on n-h2-858238-3 Nov 02 13:42:33.935941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-609df118-f1aa-41e5-877e-ec0b9a5a3399 req-8b9f8ff8-4737-4438-b2ae-19d3e696b5c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087501 Nov 02 13:42:33.943799 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 203/405] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:33.979844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:34.104878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:34.108636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:34.108874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:34.125585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae0b60a9-5c00-4626-9f05-1ac279446bd0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1223 microversion: 2.1 time: 0.393482 Nov 02 13:42:34.139525 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 203/406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:33 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1223 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:34.151703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.153495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.156567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:34.159729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.160554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.163771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:34.228067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:34.229122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:34.256112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.263459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.264022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:34.265142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.265631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.266221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:34.555714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:34.564819 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1141edfd-6f8e-494d-99d5-82ecab039b06 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1313 microversion: 2.1 time: 0.344532 Nov 02 13:42:34.568621 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 204/407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:34 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:34.660475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:34.681381 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-311a2192-ad87-4090-b988-28e9226348a8 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 0.583942 Nov 02 13:42:34.683009 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 204/408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:34 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:34.737262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:34.738334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:34.766083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.766918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.775146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:34.779651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.780583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.781309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:35.023074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1a51507d-e4b6-4f07-857a-1787c74f17e0 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1689109826", "id": 1633841622, "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:35.093048 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1a51507d-e4b6-4f07-857a-1787c74f17e0 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.395556 Nov 02 13:42:35.094630 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 205/409] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:34 2022] POST /compute/v2.1/flavors => generated 430 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:35.117407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f7dc665-5edd-432e-93c8-3e4011991fbd tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:35.191813 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f7dc665-5edd-432e-93c8-3e4011991fbd tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1633841622" status: 202 len: 0 microversion: 2.1 time: 0.082857 Nov 02 13:42:35.193988 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 206/410] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:35 2022] DELETE /compute/v2.1/flavors/1633841622 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:35.207360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:35.208569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:35.227441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:35.230554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:35.232460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:35.233378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:35.233883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:35.234328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:35.453171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:35.466076 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9fee976b-4cf4-4759-8683-efba282aade5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1271 microversion: 2.1 time: 0.270844 Nov 02 13:42:35.485451 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 207/411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:35 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:35.522833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83cd07f6-7955-41f0-932b-8271f977be2b tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:35.593761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-83cd07f6-7955-41f0-932b-8271f977be2b tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.106805 Nov 02 13:42:35.597786 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 208/412] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:35.618970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:35.621506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:35.647430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:35.648786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:35.649574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:35.650758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:35.652592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:35.653296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:35.866571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:35.896088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:35.899697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:35.901929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc298a7a-aa10-41c6-844a-b0ce96ab956a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 1.173036 Nov 02 13:42:35.903009 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 205/413] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:34 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:35.913674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a16bee77-30bd-4fb2-a021-b24da6695fea tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1013712838", "id": 1438899744, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:35.965752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a16bee77-30bd-4fb2-a021-b24da6695fea tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.060992 Nov 02 13:42:35.973688 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 206/414] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:35 2022] POST /compute/v2.1/flavors => generated 417 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:36.041996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:36.064373 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05182b1d-9e1b-42ec-9d49-45209c06d2e0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1463 microversion: 2.1 time: 0.465108 Nov 02 13:42:36.065079 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 209/415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:35 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1463 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:36.069960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:36.071797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:36.090924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:36.092185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:36.092808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:36.093772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:36.096932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:36.097558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:36.442894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-823872250", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e0293639-a49a-47d1-9a03-7fbc87f19e62"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:36.524088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] validate_networks() for [('e0293639-a49a-47d1-9a03-7fbc87f19e62', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:36.615339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:36.627550 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d1ddf0c-8a5d-494e-ab42-98e2bbeba64c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 0.560399 Nov 02 13:42:36.628751 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 210/416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:36 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:36.642604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-17bff231-4984-473c-896a-a886cb0ef8cc tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:36.692181 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-17bff231-4984-473c-896a-a886cb0ef8cc tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6227 microversion: 2.1 time: 0.061598 Nov 02 13:42:36.696037 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 211/417] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:36 2022] GET /compute/v2.1/flavors/detail => generated 6227 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:37.012612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:37.014028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:37.034483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.036246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.037322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:37.039031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.039806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.042725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:37.774675 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d09a1fb7-5ec3-435e-8cbc-b23a7ce9ccd3 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1614 microversion: 2.1 time: 1.076876 Nov 02 13:42:37.777655 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 212/418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:36 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1614 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:37.792323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:37.794949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:37.818400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.818897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.819408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:37.820467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.821294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.822196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:37.974568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:37.984029 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dcfae9c5-d21f-49b1-bebb-8303d883b21c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1277 microversion: 2.1 time: 0.203584 Nov 02 13:42:37.985225 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 213/419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:37 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:37.990295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe6c6de1-3ec4-48c3-ace3-2c169f8d548e tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:38.020306 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe6c6de1-3ec4-48c3-ace3-2c169f8d548e tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1438899744" status: 202 len: 0 microversion: 2.1 time: 0.033581 Nov 02 13:42:38.021578 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 214/420] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:37 2022] DELETE /compute/v2.1/flavors/1438899744 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:38.042254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:38.043397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:38.053969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.055297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.056785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.058172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.059389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.062901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.356165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:38.396715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:38.401182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:38.404332 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef4807a0-d705-4ccc-acfa-52a030c7b30c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.380947 Nov 02 13:42:38.406305 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 215/421] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:38 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:38.416547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:38.418186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:38.435755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.437463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.438554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.441211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.443519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.445099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.729851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:38.739865 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5198cf86-36d1-4ca1-8f81-73b0fe83ff20 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 0.331633 Nov 02 13:42:38.740788 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 216/422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:38 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:38.746673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:38.747980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:38.756685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.757934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.759370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.760573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.760984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.761421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.887764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4869ec3bba1d40cabf299fcada04d419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31765594e94244dc93f0a9eb464bfc52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:38.888749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] flavor_id is None. Assuming migration. {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 13:42:38.889431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:42:38.916221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:38.916895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:38.920813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:38.923727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:38.924806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:38.945151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.947432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.948245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.949871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.950758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.951613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.986671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:38.991980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:39.001054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for user 23d76f5c29444358864d0bc25c83b4b4 and project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:39.006365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:39.024809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:39.029234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:39.128840 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c81091a9-2d5e-459b-a75e-08eb9efaa24e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.150479 Nov 02 13:42:39.140040 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 207/423] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:42:39.158046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a4f9373-5bd7-4188-be27-0bc5e58bc27d tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:39.242871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a4f9373-5bd7-4188-be27-0bc5e58bc27d tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.103401 Nov 02 13:42:39.247425 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 208/424] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:39 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:39.287267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:39.289534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:39.313008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.315473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.317041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:39.321590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.322087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.324941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:39.337986 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-89110a9c-dc7f-47c3-91c3-cef20192bebc tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.592684 Nov 02 13:42:39.345272 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 217/425] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:42:38 2022] POST /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:39.369768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8b07cbaf-f222-41fa-8b3c-2ba7d9af87fd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:39.370424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8b07cbaf-f222-41fa-8b3c-2ba7d9af87fd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:39.561534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8b07cbaf-f222-41fa-8b3c-2ba7d9af87fd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:39.572336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=27 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:39.580102 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8b07cbaf-f222-41fa-8b3c-2ba7d9af87fd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1210 microversion: 2.1 time: 0.229235 Nov 02 13:42:39.582526 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 218/426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:39 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:39.601314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30edf0dc-a2af-482e-bf5e-8a8f5aa973eb tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1669451060", "id": 847610017, "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:39.649520 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-30edf0dc-a2af-482e-bf5e-8a8f5aa973eb tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.065851 Nov 02 13:42:39.650743 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 219/427] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:39 2022] POST /compute/v2.1/flavors => generated 426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:39.656287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:39.657092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:39.669224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.670051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.687279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:39.688306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.688872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.689315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.048655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:40.060765 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d0c7122f-236b-4712-9786-fac99c476211 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1472 microversion: 2.1 time: 0.408028 Nov 02 13:42:40.061365 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 220/428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:39 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:40.069945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.070544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:40.092627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:40.093403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:40.094024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.095018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:40.095644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:40.096225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.335209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:40.347464 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0254aae-4ca8-4cd3-8d3d-08e4564bc11d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 1.095865 Nov 02 13:42:40.350512 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 209/429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:39 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:40.359222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39edb339-ee7b-4b75-bdcb-645296d3d626 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.430949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:40.438716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39edb339-ee7b-4b75-bdcb-645296d3d626 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/847610017" status: 202 len: 0 microversion: 2.1 time: 0.084205 Nov 02 13:42:40.444255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 210/430] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:42:40 2022] DELETE /compute/v2.1/flavors/847610017 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:40.456099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.457767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:40.458538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:40.461917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:40.466207 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a703a2e-3f6c-4a4f-808a-046310fc8a6d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.402183 Nov 02 13:42:40.479824 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 221/431] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:40 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:40.491632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:40.494383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d4847983-c245-490a-800f-7e5436141b4a tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.497270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:40.498606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.508100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:40.508657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:40.510069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.523531 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d4847983-c245-490a-800f-7e5436141b4a tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041831 Nov 02 13:42:40.534499 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 222/432] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:40 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:40.551569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5a58b0d-0874-4df5-b729-5a1befff434f tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1251947755", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:40.586642 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5a58b0d-0874-4df5-b729-5a1befff434f tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.036006 Nov 02 13:42:40.599183 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 223/433] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:40 2022] POST /compute/v2.1/flavors => generated 507 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:40.608893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ded4d22e-0eaf-465f-affa-787648850ac4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.644671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:40.659575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ded4d22e-0eaf-465f-affa-787648850ac4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/d2b4d421-c541-47b3-9133-b18803ede3dc" status: 202 len: 0 microversion: 2.1 time: 0.057468 Nov 02 13:42:40.662117 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 224/434] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:40 2022] DELETE /compute/v2.1/flavors/d2b4d421-c541-47b3-9133-b18803ede3dc => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:40.679746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.681359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:40.697904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:40.699471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:40.702316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.704067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:40.706226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:40.707219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.906146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:40.938735 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1253e0a-06f7-4000-8b44-25889a49691c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1206 microversion: 2.1 time: 0.267709 Nov 02 13:42:40.938735 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 225/435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:40 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1206 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:40.947374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b96aa04e-9f5c-4a57-a939-5e8d14a6b5b1 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:40.994909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b96aa04e-9f5c-4a57-a939-5e8d14a6b5b1 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.058134 Nov 02 13:42:40.995543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 226/436] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:40 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:41.006892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:41.007422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:41.033013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:41.033716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:41.034473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:41.035838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:41.036485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:41.037490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:41.101839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:42:41.269361 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc53119d-b136-4264-bcec-a85437e962e9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 204 len: 0 microversion: 2.1 time: 0.272267 Nov 02 13:42:41.270634 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 227/437] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:40 2022] DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:41.319978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d0107ab0-b7dc-4fba-87e6-f3df86e4a2d2 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-723152049", "id": "f9da677b-932a-4ec8-9dd0-6c1a9a1664c7", "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:41.407487 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d0107ab0-b7dc-4fba-87e6-f3df86e4a2d2 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.134390 Nov 02 13:42:41.421466 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 228/438] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:41 2022] POST /compute/v2.1/flavors => generated 506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:41.433412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:41.440318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:41.448774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:41.449535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:41.451087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:41.452084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:41.452801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:41.453459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:41.564900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:41.601658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe206faa-8f5b-4fc7-92f3-17ad1c70c355 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 1.155027 Nov 02 13:42:41.615494 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 211/439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:40 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:41.623410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:41.624356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:41.640168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:41.641423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:41.642252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:41.643410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:41.646093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:41.647024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:41.883243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:41.896560 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fb3ccef5-da83-4c1e-92c3-c3e35f93722f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1472 microversion: 2.1 time: 0.473683 Nov 02 13:42:41.914972 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 229/440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:41 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:41.921637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d62c53e3-c67c-41b3-959b-8bb05119aeb4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:41.960951 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d62c53e3-c67c-41b3-959b-8bb05119aeb4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/f9da677b-932a-4ec8-9dd0-6c1a9a1664c7" status: 202 len: 0 microversion: 2.1 time: 0.044116 Nov 02 13:42:41.965366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 230/441] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:41 2022] DELETE /compute/v2.1/flavors/f9da677b-932a-4ec8-9dd0-6c1a9a1664c7 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:41.974195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1356756739", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "1086109857", "adminPass": "***", "networks": [{"uuid": "9a1f410c-4d86-44fe-b1f7-c4d888001bb0"}], "security_groups": [{"name": "tempest-securitygroup--2060794844"}], "key_name": "tempest-keypair-390475980", "user_data": "}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:42.140758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:42.175536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de3e61bd-3b4e-44b2-98ee-0b4e0c2b6b03 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 0.556981 Nov 02 13:42:42.178140 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 212/442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:41 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:42.186217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:42.187607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:42.200953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:42.200953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:42.200953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:42.201502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:42.201835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:42.202077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:42.254689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] validate_networks() for [('9a1f410c-4d86-44fe-b1f7-c4d888001bb0', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:42.732753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:42.754608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:42.762328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:42.765975 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41f381d8-2a3c-413b-9e44-efc4ca3ba9b3 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1568 microversion: 2.25 time: 0.585872 Nov 02 13:42:42.767771 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 213/443] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:42 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1568 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:42.775679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:42.776669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:42.785686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:42.786388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:42.787637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:42.788552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:42.789296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:42.790039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.000713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:43.014322 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6bda1077-5f81-49d9-8756-127a6180d7af tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1270 microversion: 2.1 time: 0.243736 Nov 02 13:42:43.020648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 214/444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:42 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1270 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:43.025514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0fa780f6-4cc5-4c80-8d71-ccedace57171 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:43.056010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0fa780f6-4cc5-4c80-8d71-ccedace57171 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.034002 Nov 02 13:42:43.057380 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 215/445] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:43.057968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:43.058370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:43.058842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:43.059283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:43.060960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:43.063894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ed1f91a1-146f-4d21-9669-c5e7fc3c33ab req-d28f8b5a-3221-46a4-a588-3f26cdc280f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15ac095-b966-4223-9357-84ed254f0b5f", "tag": "48cc2e19-6aff-4054-8c18-cac1c158d3dd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:43.072297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.073056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.073645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.074755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.076097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.076716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.092706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ed1f91a1-146f-4d21-9669-c5e7fc3c33ab req-d28f8b5a-3221-46a4-a588-3f26cdc280f2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.094139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ed1f91a1-146f-4d21-9669-c5e7fc3c33ab req-d28f8b5a-3221-46a4-a588-3f26cdc280f2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.095736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ed1f91a1-146f-4d21-9669-c5e7fc3c33ab req-d28f8b5a-3221-46a4-a588-3f26cdc280f2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.109268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Getting quotas for project ae2d07f95c10416ebb9d30228f5e907e. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:43.117762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Getting quotas for user 351f7415c03346aa81dfbd73a686327f and project ae2d07f95c10416ebb9d30228f5e907e. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:43.135387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ed1f91a1-146f-4d21-9669-c5e7fc3c33ab req-d28f8b5a-3221-46a4-a588-3f26cdc280f2 service nova] Creating event network-changed:48cc2e19-6aff-4054-8c18-cac1c158d3dd for instance b15ac095-b966-4223-9357-84ed254f0b5f on n-h1-858238-3 Nov 02 13:42:43.144043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ed1f91a1-146f-4d21-9669-c5e7fc3c33ab req-d28f8b5a-3221-46a4-a588-3f26cdc280f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084140 Nov 02 13:42:43.145175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:43.145295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 216/446] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:43.149012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:43.154333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:43.155334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:43.165160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.165887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.166684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.168374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.169544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.170355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.237758 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f700898-3045-486a-a293-3147924d0bf3 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.269145 Nov 02 13:42:43.238416 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 231/447] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:42:43.250675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:43.252780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:43.263610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.264786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.265379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.267480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.268133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.268778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.677252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:43.690918 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-06195ed8-228f-44bf-b788-ebe30b1e002f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1472 microversion: 2.1 time: 0.451138 Nov 02 13:42:43.693908 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 232/448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:43 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:43.705525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4fceced9-7cc8-414c-8466-a8d0e7bca845 req-ef742d54-7a6b-4549-bd6a-6f67af6c9818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54326ae2-2303-4ac5-a643-a0665406bbfd", "name": "network-vif-plugged", "status": "completed", "tag": "d00a0d5b-6a6b-407a-96c6-fdcb5fb97e9c"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:43.737601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4fceced9-7cc8-414c-8466-a8d0e7bca845 req-ef742d54-7a6b-4549-bd6a-6f67af6c9818 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.738147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4fceced9-7cc8-414c-8466-a8d0e7bca845 req-ef742d54-7a6b-4549-bd6a-6f67af6c9818 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.739623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4fceced9-7cc8-414c-8466-a8d0e7bca845 req-ef742d54-7a6b-4549-bd6a-6f67af6c9818 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.756003 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4fceced9-7cc8-414c-8466-a8d0e7bca845 req-ef742d54-7a6b-4549-bd6a-6f67af6c9818 service nova] Creating event network-vif-plugged:d00a0d5b-6a6b-407a-96c6-fdcb5fb97e9c for instance 54326ae2-2303-4ac5-a643-a0665406bbfd on n-h2-858238-3 Nov 02 13:42:43.762324 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4fceced9-7cc8-414c-8466-a8d0e7bca845 req-ef742d54-7a6b-4549-bd6a-6f67af6c9818 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067067 Nov 02 13:42:43.763808 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 233/449] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:43.771553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c653d7fa-dc25-4b8c-9c60-f009140f5d68 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1846571137", "id": 2074193618, "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:43.829757 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c653d7fa-dc25-4b8c-9c60-f009140f5d68 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.064228 Nov 02 13:42:43.846362 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 234/450] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:43 2022] POST /compute/v2.1/flavors => generated 414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:43.858992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:43.862953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:43.878280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.879514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.880648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:43.882309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:43.883448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:43.884398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.126528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.159060 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a90ed0b8-ecbc-4f81-be59-b76a9af2fb1c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 1.011957 Nov 02 13:42:44.183639 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 217/451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:43 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:44.204775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.206189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:44.223979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.224660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.225312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.226514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.227349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.228072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.425650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.458906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7e82a47-3397-4731-ad71-1915483a2f04 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1268 microversion: 2.1 time: 0.269579 Nov 02 13:42:44.464158 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 218/452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1268 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:44.476274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.484944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:44.501782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.506924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.508977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.515991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.518168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.518866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.764776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.795458 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a22457b8-5777-49fb-b899-54db5cdd2ac3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 0.943790 Nov 02 13:42:44.799711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 235/453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:43 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:44.811393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e91f3d73-dfd9-43ab-868b-b1910a86a5be tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.820950 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e91f3d73-dfd9-43ab-868b-b1910a86a5be tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/2074193618" status: 200 len: 414 microversion: 2.1 time: 0.018991 Nov 02 13:42:44.830678 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 236/454] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/flavors/2074193618 => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:44.836841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.837662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:44.847513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.848146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.848746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.849642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.850231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.850955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.920774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.941292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.942753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.943962 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2a678f1-4794-4b50-9cf2-21b9b85afa8c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1558 microversion: 2.25 time: 0.476686 Nov 02 13:42:44.944770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 219/455] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1558 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:44.959412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:44.972343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.975187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:44.977270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc424774-8cd4-4d66-9215-bd89f6bfd5b6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1268 microversion: 2.1 time: 0.144812 Nov 02 13:42:44.977899 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 237/456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:45.008715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.009832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.010883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.013138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.014197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.015187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.432682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:45.445245 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15a14a07-e52d-43de-9370-eea5d8332abb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1472 microversion: 2.1 time: 0.484226 Nov 02 13:42:45.445852 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 220/457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:45.473173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-47e0ccce-8d40-47cc-ab49-389fe5503a22 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '.version_select at 0x7f6f820cb8b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:45.479010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47e0ccce-8d40-47cc-ab49-389fe5503a22 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.491172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47e0ccce-8d40-47cc-ab49-389fe5503a22 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.491664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47e0ccce-8d40-47cc-ab49-389fe5503a22 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.520692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-47e0ccce-8d40-47cc-ab49-389fe5503a22 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.058066 Nov 02 13:42:45.521314 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 221/458] 10.222.0.18 () {60 vars in 1184 bytes} [Wed Nov 2 13:42:45 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:45.546020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3fa9f2e8-0613-44f0-aed8-21d66fb2f2c8 req-22c1d50e-6512-40b9-8452-e6578f00ae1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb31b3b-b447-47cc-8482-dd92d3c3ee54", "tag": "9b705e00-2c57-491e-9f90-916ea143a563"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:45.570871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3fa9f2e8-0613-44f0-aed8-21d66fb2f2c8 req-22c1d50e-6512-40b9-8452-e6578f00ae1a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.571396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3fa9f2e8-0613-44f0-aed8-21d66fb2f2c8 req-22c1d50e-6512-40b9-8452-e6578f00ae1a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.571829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3fa9f2e8-0613-44f0-aed8-21d66fb2f2c8 req-22c1d50e-6512-40b9-8452-e6578f00ae1a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.591839 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3fa9f2e8-0613-44f0-aed8-21d66fb2f2c8 req-22c1d50e-6512-40b9-8452-e6578f00ae1a service nova] Creating event network-changed:9b705e00-2c57-491e-9f90-916ea143a563 for instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 on n-h1-858238-3 Nov 02 13:42:45.597685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb3ad49a-fe26-4ba0-90f4-6e012ff9aae6 tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:45.599536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3fa9f2e8-0613-44f0-aed8-21d66fb2f2c8 req-22c1d50e-6512-40b9-8452-e6578f00ae1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068550 Nov 02 13:42:45.600628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 222/459] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:45.606782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:45.607603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:45.615750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.616504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.617730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.617730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.618435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.618924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.668624 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb3ad49a-fe26-4ba0-90f4-6e012ff9aae6 tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.689378 Nov 02 13:42:45.682555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 238/460] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:45.706589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:45.707781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:45.723951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.724810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.725470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.726460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.729709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.730436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.894086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:45.923021 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4dc76e93-99c3-49a3-9929-caa360a56488 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1316 microversion: 2.1 time: 0.224343 Nov 02 13:42:45.932679 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 239/461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:45 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:45.947484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:45.951695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:45.958857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:45.974396 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91b4e089-719d-4be0-93ec-555ba199f046 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1316 microversion: 2.1 time: 0.372028 Nov 02 13:42:45.975452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 223/462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:45 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:45.984129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a25c895-669f-4fb2-ac1f-3321179c6cea tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:45.987863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.990084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.990897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.992127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:45.992639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:45.993133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:46.022318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a25c895-669f-4fb2-ac1f-3321179c6cea tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2074193618" status: 202 len: 0 microversion: 2.1 time: 0.044891 Nov 02 13:42:46.023695 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 224/463] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:45 2022] DELETE /compute/v2.1/flavors/2074193618 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:46.031424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:46.032314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:46.041107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:46.042594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:46.043268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:46.044472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:46.045146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:46.046518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:46.559502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:46.579533 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86dbd122-9265-4a92-bcd2-281e2c8e63d5 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 0.551055 Nov 02 13:42:46.581641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 225/464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:46 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:46.598363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:46.599281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:46.616116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:46.616840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:46.618856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:46.622434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:46.625175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:46.626695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:46.672793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:47.433206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:47.471613 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1f63497-dde4-4b51-9505-24f921a588b9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 2051 microversion: 2.25 time: 1.536917 Nov 02 13:42:47.472490 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 240/465] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:45 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 2051 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:47.482905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7a3fd56e-1308-49d2-8ad7-98465e6e8ef8 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:47.521222 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7a3fd56e-1308-49d2-8ad7-98465e6e8ef8 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.047121 Nov 02 13:42:47.532494 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 241/466] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:47 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:47.539694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:47.545253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:47.566214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.567076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.575869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:47.577256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.577960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.578574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:47.921444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:47.936453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b0047e6-d280-4541-961f-562eaf1c0871 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 1.351176 Nov 02 13:42:47.949459 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 226/467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:46 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:47.964871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:47.968277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:47.989813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.992513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.992993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.000595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.001485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.005009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.426912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:48.449391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd480643-9b01-4534-9490-f7840941d735 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1322 microversion: 2.1 time: 0.498414 Nov 02 13:42:48.449996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 227/468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:47 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:48.462612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:48.463618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:48.482003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.482808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.483442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.484342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.488902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.490248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.554866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:48.569914 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d48ebd02-ef6a-4be4-adc3-065ae81c198a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1472 microversion: 2.1 time: 1.035425 Nov 02 13:42:48.596818 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 242/469] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:47 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1472 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:48.606301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a9513d40-d856-499e-b12a-cc3f1ae64d2e tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1839478540", "id": 850839211, "os-flavor-access:is_public": "False"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:48.670859 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a9513d40-d856-499e-b12a-cc3f1ae64d2e tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.071697 Nov 02 13:42:48.673158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 243/470] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:48 2022] POST /compute/v2.1/flavors => generated 427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:48.685686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:48.686877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:48.699508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.701520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.703824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.706162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.707674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.708694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.976469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:49.015569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=57,nova_cell0:UPDATE=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:49.273242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:49.289132 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ebf2fd15-83be-49c4-95a2-5679d7432de1 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 0.613636 Nov 02 13:42:49.305010 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 244/471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:48 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:49.328225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1864271612", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e66fe5e6-396f-407f-9138-ece1c71d4efa"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:49.366466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:49.393515 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-085baa4a-513a-482f-af2d-f9dfd6c4341c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1504 microversion: 2.1 time: 0.927677 Nov 02 13:42:49.395570 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 228/472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:48 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1504 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:49.463891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] validate_networks() for [('e66fe5e6-396f-407f-9138-ece1c71d4efa', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:49.711056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Action: 'update', calling method: .version_select at 0x7f6f820cfa60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:49.719613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:49.721749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:49.723572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.766369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:49.770653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:49.775307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.826611 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] HTTP exception thrown: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Request method failure captured: Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8 HTTP/1.1 Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 56 Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnPYtCdp-vY4oJ2cf6c-CO9_lAIHG0esc8HB1BmZLdQeN9l-BGDL1zO0YZiGx02qrCoWhwLrv6qY_6eJFSjqHE7jTCydJHtm4ebDLnUGeSW3j7LjXQJN5Xe8oC1TyyCSQ_SUBYFBNiZdflkDnpsAsVRK0_bsFsQf1zQspOSVYgGlrYw Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ca021f256714834ae392a335c55266a Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:42:49.839060 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ca021f256714834ae392a335c55266a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ca021f256714834ae392a335c55266a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ca021f256714834ae392a335c55266a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ca021f256714834ae392a335c55266a"}]}] Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ca021f256714834ae392a335c55266a Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 11632002f3ab4eb4b5cd012fdf745f2c Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:42:49.842518 n-d-858238-3 devstack@n-api.service[137559]: exception: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a58c8663-e45c-49db-bd2d-de330ca38af8', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.843977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:49.846452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:49.849044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:49.849044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:49.849044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.857477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Returning 404 to user: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:49.859404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98f8ffc6-04c8-4e4f-9327-b1e231c6587a tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8" status: 404 len: 110 microversion: 2.53 time: 0.461994 Nov 02 13:42:49.863611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 229/473] 10.222.0.18 () {62 vars in 1309 bytes} [Wed Nov 2 13:42:49 2022] PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8 => generated 110 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:42:49.875484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8361932e-ded5-47c3-9ee5-8cf2dfbafe81 req-d38f2796-c580-4691-a66e-7649636caaca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1c6755-70f9-4cac-9d48-00f65b4a9507", "name": "network-vif-deleted", "tag": "076b4d52-c42b-4920-a944-59b40ffa9b3c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:49.889497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8361932e-ded5-47c3-9ee5-8cf2dfbafe81 req-d38f2796-c580-4691-a66e-7649636caaca service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:49.891017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8361932e-ded5-47c3-9ee5-8cf2dfbafe81 req-d38f2796-c580-4691-a66e-7649636caaca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:49.892233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8361932e-ded5-47c3-9ee5-8cf2dfbafe81 req-d38f2796-c580-4691-a66e-7649636caaca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.920513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8361932e-ded5-47c3-9ee5-8cf2dfbafe81 req-d38f2796-c580-4691-a66e-7649636caaca service nova] Creating event network-vif-deleted:076b4d52-c42b-4920-a944-59b40ffa9b3c for instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 on n-h2-858238-3 Nov 02 13:42:49.931908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8361932e-ded5-47c3-9ee5-8cf2dfbafe81 req-d38f2796-c580-4691-a66e-7649636caaca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065255 Nov 02 13:42:49.935860 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 230/474] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:49.944358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba71faac-d886-46f8-b7f6-0663c1b60ccb tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "850839211"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:49.965026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ba71faac-d886-46f8-b7f6-0663c1b60ccb tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] HTTP exception thrown: Flavor 850839211 could not be found. Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba71faac-d886-46f8-b7f6-0663c1b60ccb tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] Request method failure captured: Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 106 Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnPJ6rEJh5RLuULJzI3kBuOPicJvVefeV6ct66uzLhhibtx9q2vkdmBtr_DrWJ2VLaJrb26jYyp4u_mU6eTWniVg8ojQNc758HN-KMpWfC0_4G3aY0QMuFdoHYQ23R0KqLmZThAUvFrIlsKHcnNNdvsExQKhY5hAMLtpnOTonYUAzws Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b459c2024ed44ad98a2330c59eb496ce Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FlavorsAdminTestJSON-646119343 Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:42:49.978401 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b459c2024ed44ad98a2330c59eb496ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b459c2024ed44ad98a2330c59eb496ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b459c2024ed44ad98a2330c59eb496ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b459c2024ed44ad98a2330c59eb496ce"}]}] Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FlavorsAdminTestJSON-646119343 Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b459c2024ed44ad98a2330c59eb496ce Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-646119343 Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FlavorsAdminTestJSON-646119343-project Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 9e3a9b3cc72e4d29b0fbc7f10f202512 Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FlavorsAdminTestJSON-646119343-project Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "test", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "850839211"}} Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:42:49.981394 n-d-858238-3 devstack@n-api.service[137559]: exception: Flavor 850839211 could not be found. Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '850839211'}}} Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 850839211 could not be found. Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.985175 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 850839211 could not be found. Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:49.987522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:49.990388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:49.990388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:49.990388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:49.990388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 850839211 could not be found. Nov 02 13:42:49.990388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:49.992709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba71faac-d886-46f8-b7f6-0663c1b60ccb tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] Returning 400 to user: Flavor 850839211 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:49.993906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba71faac-d886-46f8-b7f6-0663c1b60ccb tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.056360 Nov 02 13:42:49.995137 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 231/475] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:49 2022] POST /compute/v2.1/servers => generated 80 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:42:50.002732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:50.005322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:50.020688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.021629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.022320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.024802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.026166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.026906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.269523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:50.270352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:50.270640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:50.271049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:50.271466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:50.286748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.287762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.288369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.290189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.293287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.293947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.326947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:50.336925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for user 55e26f05091944cb910f81488056c057 and project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:50.385223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:50.388495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:50.493720 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05b26b19-86db-401b-a95e-61e273a2f066 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.187064 Nov 02 13:42:50.496071 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 245/476] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:42:50.510778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:50.511574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:50.535550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.536092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.536618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.538237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.540714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.541670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.547796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:50.604658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:42:50.669773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:50.682119 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84e0da0b-1ba5-4415-9633-0bce3a545cc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.684399 Nov 02 13:42:50.701060 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 232/477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:49 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:50.710855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:50.712092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:50.721674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.722215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.722645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.723719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.724181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.724594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.804446 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-88337897-734f-4688-95ad-d47c1a8d10ee tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 204 len: 0 microversion: 2.1 time: 0.303984 Nov 02 13:42:50.811510 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 246/478] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:50 2022] DELETE /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:50.829128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:50.833004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:50.862013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.862868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.863852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:50.865844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:50.866946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:50.867672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.064068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.075392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c08f1492-290c-4fbe-bc46-22330d470ac1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.372568 Nov 02 13:42:51.094821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 233/479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:50 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.102282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Action: 'update', calling method: .version_select at 0x7f6f81f9d430>, body: {"status": "disabled"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:51.108467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.109114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.109839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.116862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.117348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.117845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.124817 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] HTTP exception thrown: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Request method failure captured: Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8 HTTP/1.1 Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 22 Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnPYtCdp-vY4oJ2cf6c-CO9_lAIHG0esc8HB1BmZLdQeN9l-BGDL1zO0YZiGx02qrCoWhwLrv6qY_6eJFSjqHE7jTCydJHtm4ebDLnUGeSW3j7LjXQJN5Xe8oC1TyyCSQ_SUBYFBNiZdflkDnpsAsVRK0_bsFsQf1zQspOSVYgGlrYw Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ca021f256714834ae392a335c55266a Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:42:51.126872 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ca021f256714834ae392a335c55266a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ca021f256714834ae392a335c55266a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ca021f256714834ae392a335c55266a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ca021f256714834ae392a335c55266a"}]}] Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ca021f256714834ae392a335c55266a Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 11632002f3ab4eb4b5cd012fdf745f2c Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: {"status": "disabled"} Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: exception: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.128326 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a58c8663-e45c-49db-bd2d-de330ca38af8', 'body': {'status': 'disabled'}} Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.129122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:51.130260 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:51.132843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.132843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.134018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Returning 404 to user: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:51.136593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b286ab13-61ce-44d0-ae38-5315053dbc3c tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8" status: 404 len: 110 microversion: 2.53 time: 0.040016 Nov 02 13:42:51.137843 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 234/480] 10.222.0.18 () {62 vars in 1309 bytes} [Wed Nov 2 13:42:51 2022] PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:42:51.146648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2f438063-7409-4ba5-9b02-ba28738ca4a7 req-550cffa1-5b35-46a4-9af8-53d9fe734890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a944552c-b24f-4bf8-bffa-b24a0816b48b", "tag": "81c1e916-e331-4ec8-bd6d-bb2cc1c715ad"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:51.169495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2f438063-7409-4ba5-9b02-ba28738ca4a7 req-550cffa1-5b35-46a4-9af8-53d9fe734890 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.170605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2f438063-7409-4ba5-9b02-ba28738ca4a7 req-550cffa1-5b35-46a4-9af8-53d9fe734890 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.171339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2f438063-7409-4ba5-9b02-ba28738ca4a7 req-550cffa1-5b35-46a4-9af8-53d9fe734890 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.186711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2f438063-7409-4ba5-9b02-ba28738ca4a7 req-550cffa1-5b35-46a4-9af8-53d9fe734890 service nova] Creating event network-changed:81c1e916-e331-4ec8-bd6d-bb2cc1c715ad for instance a944552c-b24f-4bf8-bffa-b24a0816b48b on n-h2-858238-3 Nov 02 13:42:51.195327 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2f438063-7409-4ba5-9b02-ba28738ca4a7 req-550cffa1-5b35-46a4-9af8-53d9fe734890 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055551 Nov 02 13:42:51.196795 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 235/481] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:51.203789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5cc0ef0-5064-4ba6-83e8-bb7de64af5af tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.218784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.225776 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f5cc0ef0-5064-4ba6-83e8-bb7de64af5af tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/850839211" status: 202 len: 0 microversion: 2.1 time: 0.026874 Nov 02 13:42:51.228496 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 236/482] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:42:51 2022] DELETE /compute/v2.1/flavors/850839211 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:51.232906 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-118107a9-a9ed-4ff3-986d-326c09d21abf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.419145 Nov 02 13:42:51.233901 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 247/483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:50 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.247459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.247459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:51.248009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b47bb4b2-5ca7-42c6-a7bc-520c231c6cab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.248009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b47bb4b2-5ca7-42c6-a7bc-520c231c6cab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:51.252297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:51.258862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.259905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.260558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.261642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.262627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.263329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.352077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b47bb4b2-5ca7-42c6-a7bc-520c231c6cab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.361582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b47bb4b2-5ca7-42c6-a7bc-520c231c6cab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.363642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b47bb4b2-5ca7-42c6-a7bc-520c231c6cab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.365010 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b47bb4b2-5ca7-42c6-a7bc-520c231c6cab tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1262 microversion: 2.25 time: 0.130106 Nov 02 13:42:51.365756 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 248/484] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1262 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:51.371052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.372020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:51.378556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.379353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.380003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.380912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.381569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.382255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.561482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.574057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f47b0e34-8df9-4e54-bb62-fbf6e86e1c06 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 0.342707 Nov 02 13:42:51.591646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 237/485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.592633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Action: 'update', calling method: .version_select at 0x7f6f81fdbe50>, body: {"status": "enabled"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:51.599472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.600430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.601105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.608659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.610140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.611288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.620352 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] HTTP exception thrown: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Request method failure captured: Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8 HTTP/1.1 Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 21 Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnPYtCdp-vY4oJ2cf6c-CO9_lAIHG0esc8HB1BmZLdQeN9l-BGDL1zO0YZiGx02qrCoWhwLrv6qY_6eJFSjqHE7jTCydJHtm4ebDLnUGeSW3j7LjXQJN5Xe8oC1TyyCSQ_SUBYFBNiZdflkDnpsAsVRK0_bsFsQf1zQspOSVYgGlrYw Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ca021f256714834ae392a335c55266a Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:42:51.623662 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ca021f256714834ae392a335c55266a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ca021f256714834ae392a335c55266a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ca021f256714834ae392a335c55266a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ca021f256714834ae392a335c55266a"}]}] Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ca021f256714834ae392a335c55266a Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290 Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 11632002f3ab4eb4b5cd012fdf745f2c Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: {"status": "enabled"} Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: exception: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.625031 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a58c8663-e45c-49db-bd2d-de330ca38af8', 'body': {'status': 'enabled'}} Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.625824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:51.627036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:51.628791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. Nov 02 13:42:51.628791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:51.628791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Returning 404 to user: Service a58c8663-e45c-49db-bd2d-de330ca38af8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:51.628791 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02631436-9ad6-4f7e-9e1f-13cd1bb28056 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8" status: 404 len: 110 microversion: 2.53 time: 0.042106 Nov 02 13:42:51.628791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 238/486] 10.222.0.18 () {62 vars in 1309 bytes} [Wed Nov 2 13:42:51 2022] PUT /compute/v2.1/os-services/a58c8663-e45c-49db-bd2d-de330ca38af8 => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:42:51.636225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4541a451-bf72-4cff-bfcc-d302495a07b4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.638370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.646670 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41428029-e6df-4d5d-9435-03ae509d8c02 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1510 microversion: 2.1 time: 0.279648 Nov 02 13:42:51.651137 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 249/487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.652468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.663681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.664190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.664627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.665405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.674224 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4541a451-bf72-4cff-bfcc-d302495a07b4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.046432 Nov 02 13:42:51.674831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.675399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.680279 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 239/488] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.704073 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7bf3aa46-e6c9-4d84-a227-64181f5b5988 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.055049 Nov 02 13:42:51.704682 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 250/489] 10.222.0.18 () {60 vars in 1178 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:51.711189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37e653bd-d6ea-4486-b2d9-f493b35b139d tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-269440444", "id": 1233685915, "os-flavor-access:is_public": "False"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:51.714048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.715025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:51.722710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.723772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.724219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.725413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.726231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.726667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.745826 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37e653bd-d6ea-4486-b2d9-f493b35b139d tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.043572 Nov 02 13:42:51.747040 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 240/490] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:51 2022] POST /compute/v2.1/flavors => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:51.752020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.756937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.757767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.758310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.759213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.759736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.761354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.810687 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e987330-7bc6-430f-8d3e-6cde842e6b17 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062589 Nov 02 13:42:51.812064 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 241/491] 10.222.0.18 () {60 vars in 1211 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:51.833416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac1a84f2-7a85-4836-b9c4-634d6a427742 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1744324167", "id": 1013933949, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:51.860888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac1a84f2-7a85-4836-b9c4-634d6a427742 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047436 Nov 02 13:42:51.867740 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 242/492] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:51 2022] POST /compute/v2.1/flavors => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:51.875762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.886249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.886743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.887214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.888530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.889100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.889674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.924233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b138fb15-a525-48b8-8c78-f710df1442db tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054368 Nov 02 13:42:51.925223 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 243/493] 10.222.0.18 () {60 vars in 1178 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:51.929979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a7dc5db-8dff-49ff-b8eb-b4a787864a15 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.947881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.951286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a7dc5db-8dff-49ff-b8eb-b4a787864a15 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.024213 Nov 02 13:42:51.959240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 244/494] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:51.962269 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9d71d039-fe9e-4a9c-bc3a-7f4a3994764a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.251288 Nov 02 13:42:51.970416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.971584 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 251/495] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.974432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.983648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.985146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.987192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.988557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.989907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.001045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9be5c3d7-5de9-4990-ad3d-59aa6b406ecd tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.035110 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87c019bf-0764-459c-b8b5-9ed97d6e2784 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-858238-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.074439 Nov 02 13:42:52.036166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 245/496] 10.222.0.18 () {60 vars in 1235 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/os-services?host=n-d-858238-3&binary=xxx => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:52.041903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cd2d74fb-0ad3-4345-8d36-7e4cfd4513f1 req-ad2c5aab-818e-482b-aff8-a129ab3711ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187acb18-1b79-484c-abce-d04e4f964c1e", "tag": "7580a147-c698-4d66-991e-fba7f3a2050b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:52.049208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:52.055665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cd2d74fb-0ad3-4345-8d36-7e4cfd4513f1 req-ad2c5aab-818e-482b-aff8-a129ab3711ac service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.056096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cd2d74fb-0ad3-4345-8d36-7e4cfd4513f1 req-ad2c5aab-818e-482b-aff8-a129ab3711ac service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.056547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cd2d74fb-0ad3-4345-8d36-7e4cfd4513f1 req-ad2c5aab-818e-482b-aff8-a129ab3711ac service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.068846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9be5c3d7-5de9-4990-ad3d-59aa6b406ecd tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.095385 Nov 02 13:42:52.069873 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 252/497] 10.222.0.18 () {58 vars in 1177 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.080833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cd2d74fb-0ad3-4345-8d36-7e4cfd4513f1 req-ad2c5aab-818e-482b-aff8-a129ab3711ac service nova] Creating event network-changed:7580a147-c698-4d66-991e-fba7f3a2050b for instance 187acb18-1b79-484c-abce-d04e4f964c1e on n-h2-858238-3 Nov 02 13:42:52.086183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cd2d74fb-0ad3-4345-8d36-7e4cfd4513f1 req-ad2c5aab-818e-482b-aff8-a129ab3711ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048277 Nov 02 13:42:52.087135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 246/498] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.090302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.093549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79b5624f-8082-4092-adfb-e14fe8aeaed3 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.101095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.101955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.103880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.105179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.105592 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79b5624f-8082-4092-adfb-e14fe8aeaed3 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.017079 Nov 02 13:42:52.106338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.106582 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 247/499] 10.222.0.18 () {58 vars in 1171 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.107271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.120108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.121161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:52.128429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.129225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.129872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.130762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.131392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.131963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.146141 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e6da3f30-7817-4b2c-9e08-b5ad29d5eba7 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.074812 Nov 02 13:42:52.147729 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 253/500] 10.222.0.18 () {60 vars in 1178 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:52.152725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9ba5af8e-04e4-40ff-90d4-6f554582a466 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.172962 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9ba5af8e-04e4-40ff-90d4-6f554582a466 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.023626 Nov 02 13:42:52.173872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 254/501] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.180331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.186928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.188239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.188875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.189885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.190348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.190999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.220549 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2158c580-5dca-485e-82a4-2c1688247232 tempest-ServicesAdminNegativeV253TestJSON-1170361290 tempest-ServicesAdminNegativeV253TestJSON-1170361290-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.044447 Nov 02 13:42:52.229113 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 255/502] 10.222.0.18 () {60 vars in 1239 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:52.230950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8e6e91f9-1bdb-46d3-9b24-12720f44fd58 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.258948 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8e6e91f9-1bdb-46d3-9b24-12720f44fd58 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6224 microversion: 2.1 time: 0.035502 Nov 02 13:42:52.272295 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 256/503] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6224 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:52.369387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:52.389518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93133875-c8d7-4a2f-bc8b-14291995bd1a tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.269760 Nov 02 13:42:52.394997 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 248/504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:52.407742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.409345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:52.442895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.444070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.445694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.447413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.448567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.452936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.468405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c477cb4-8afa-493d-92c4-2ee040ee4378 tempest-ServicesAdminNegativeV253TestJSON-781335186 tempest-ServicesAdminNegativeV253TestJSON-781335186-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.475868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7c477cb4-8afa-493d-92c4-2ee040ee4378 tempest-ServicesAdminNegativeV253TestJSON-781335186 tempest-ServicesAdminNegativeV253TestJSON-781335186-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c9e37498a5254ac8b9d6ffb8231193ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b930a040214987963a054e4da1d7d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c477cb4-8afa-493d-92c4-2ee040ee4378 tempest-ServicesAdminNegativeV253TestJSON-781335186 tempest-ServicesAdminNegativeV253TestJSON-781335186-project] Request method failure captured: Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnPWufeyNWekkNeHd7WOmutk2YSK5yOXxuJoB5GL0vyouI1dJhPVl9nBfTZFMXkMJXWDj4F-_bYWDrqdkaYTppVzeV97-CI5OQfFebCuRNJH7ipoJ9GTrUniBtB4ikXGCggKhQDHh43ZIrgY1xLFfJBX_URLMYqXPvVrhDBaajT78Ac Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0b930a040214987963a054e4da1d7d3 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-781335186 Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:52.479194 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0b930a040214987963a054e4da1d7d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0b930a040214987963a054e4da1d7d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0b930a040214987963a054e4da1d7d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0b930a040214987963a054e4da1d7d3"}]}] Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-781335186 Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0b930a040214987963a054e4da1d7d3 Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-781335186 Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServicesAdminNegativeV253TestJSON-781335186-project Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c9e37498a5254ac8b9d6ffb8231193ad Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-781335186-project Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:42:52.482705 n-d-858238-3 devstack@n-api.service[137558]: action_args: {} Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:42:52.484910 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:42:52.487284 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:52.491482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c477cb4-8afa-493d-92c4-2ee040ee4378 tempest-ServicesAdminNegativeV253TestJSON-781335186 tempest-ServicesAdminNegativeV253TestJSON-781335186-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:52.493525 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c477cb4-8afa-493d-92c4-2ee040ee4378 tempest-ServicesAdminNegativeV253TestJSON-781335186 tempest-ServicesAdminNegativeV253TestJSON-781335186-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.218730 Nov 02 13:42:52.503971 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 257/505] 10.222.0.18 () {60 vars in 1178 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/os-services => generated 112 bytes in 228 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:42:52.523343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dce23cae-4d57-4ffb-b4ec-748756a3f811 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.583802 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dce23cae-4d57-4ffb-b4ec-748756a3f811 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6224 microversion: 2.1 time: 0.077826 Nov 02 13:42:52.585230 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 258/506] 10.222.0.18 () {58 vars in 1175 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:52.599682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-62fddf0d-2c2f-456e-b4bd-7f2f0ef272eb req-4d5f0720-d6eb-4b14-800d-0b76986144c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb31b3b-b447-47cc-8482-dd92d3c3ee54", "name": "network-vif-plugged", "status": "completed", "tag": "9b705e00-2c57-491e-9f90-916ea143a563"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:52.613235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-62fddf0d-2c2f-456e-b4bd-7f2f0ef272eb req-4d5f0720-d6eb-4b14-800d-0b76986144c6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.614792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-62fddf0d-2c2f-456e-b4bd-7f2f0ef272eb req-4d5f0720-d6eb-4b14-800d-0b76986144c6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.615458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-62fddf0d-2c2f-456e-b4bd-7f2f0ef272eb req-4d5f0720-d6eb-4b14-800d-0b76986144c6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.631612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-62fddf0d-2c2f-456e-b4bd-7f2f0ef272eb req-4d5f0720-d6eb-4b14-800d-0b76986144c6 service nova] Creating event network-vif-plugged:9b705e00-2c57-491e-9f90-916ea143a563 for instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 on n-h1-858238-3 Nov 02 13:42:52.638047 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-62fddf0d-2c2f-456e-b4bd-7f2f0ef272eb req-4d5f0720-d6eb-4b14-800d-0b76986144c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050369 Nov 02 13:42:52.639469 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 259/507] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.645502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.662321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:52.678029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.680065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.681002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.683712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.692575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.694479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.876456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:52.892380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:52.894907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:52.899921 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d8201cb2-a49c-49b2-9cd5-cb62f785fdf8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1332 microversion: 2.25 time: 0.258511 Nov 02 13:42:52.901566 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 260/508] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:52.932139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.934233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:52.953920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.955858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.958148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.959209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.959990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.960642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.975181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:53.004727 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea92ad3b-bbbf-41eb-baa7-b7f7f823abb5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.607501 Nov 02 13:42:53.040048 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 249/509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.049781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48a33c3b-fa27-4ea9-9dd9-7379f8483f69 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.090908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48a33c3b-fa27-4ea9-9dd9-7379f8483f69 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6224 microversion: 2.1 time: 0.049938 Nov 02 13:42:53.092333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 250/510] 10.222.0.18 () {58 vars in 1173 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6224 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.111499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.114963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:53.127697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.128191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.128630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.129327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.130175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.133268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.382375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:53.386873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:53.394639 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e11010b8-0749-49a1-bd0c-ac4589acc69f tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1510 microversion: 2.1 time: 0.301321 Nov 02 13:42:53.396681 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 251/511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.410958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.411919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:53.426915 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-991c952e-26de-461d-9a76-848385b0acaa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1319 microversion: 2.1 time: 0.505918 Nov 02 13:42:53.427698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.427904 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 261/512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.428795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.429451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.430769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.432116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.433025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.436037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d20f9c7a-2202-4f90-aac4-bc2b797a9bd5 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.467965 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d20f9c7a-2202-4f90-aac4-bc2b797a9bd5 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6224 microversion: 2.1 time: 0.035379 Nov 02 13:42:53.469189 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 262/513] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6224 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.479432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.480592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:53.488625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.489490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.490329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.491835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.492984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.494413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.712080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:53.722649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-00e0a791-0e97-4e42-88b7-8164fd509199 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.324220 Nov 02 13:42:53.739842 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 252/514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.745233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88106764-5940-4a72-a84f-0430a861b2f4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.767935 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88106764-5940-4a72-a84f-0430a861b2f4 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1013933949" status: 202 len: 0 microversion: 2.1 time: 0.026758 Nov 02 13:42:53.768929 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 253/515] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:53 2022] DELETE /compute/v2.1/flavors/1013933949 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:53.785571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b23996d5-03ea-4fbe-bde6-0072de10dffa tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.814895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b23996d5-03ea-4fbe-bde6-0072de10dffa tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.036295 Nov 02 13:42:53.816161 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 254/516] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:53.836156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf461e5f-4d47-4145-b825-0ac1a94101b9 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.874910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf461e5f-4d47-4145-b825-0ac1a94101b9 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1233685915" status: 202 len: 0 microversion: 2.1 time: 0.042527 Nov 02 13:42:53.877553 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 255/517] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:53 2022] DELETE /compute/v2.1/flavors/1233685915 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:53.888797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-978fefdc-e841-4538-8f48-4ac036a36386 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.911854 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-978fefdc-e841-4538-8f48-4ac036a36386 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029830 Nov 02 13:42:53.913127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 256/518] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:53.936785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:53.937402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:53.943977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.944461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.944887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.945586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:53.946035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:53.946447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.028245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.039898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.041147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.042318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c7d8645-cfd7-40ec-a152-c4e3c8b4c767 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1320 microversion: 2.25 time: 0.115140 Nov 02 13:42:54.043182 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 257/519] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1320 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:54.048319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b71517aa-68fb-439d-979e-7426104c24b8 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1639096775", "id": 1895540149, "os-flavor-access:is_public": "False"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:54.080766 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b71517aa-68fb-439d-979e-7426104c24b8 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.036601 Nov 02 13:42:54.082005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 258/520] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:54 2022] POST /compute/v2.1/flavors => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:54.088307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.089328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:54.103696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.104422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.104859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.106276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.107719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.108226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.154126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.174920 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce1167ea-8664-4c26-b806-bc16a798d0cc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.703093 Nov 02 13:42:54.175657 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 263/521] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:53 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.186304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4392c55e-e81e-42cf-8a7b-8d89603454a8 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.254623 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4392c55e-e81e-42cf-8a7b-8d89603454a8 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.074234 Nov 02 13:42:54.264933 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 264/522] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.284858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f1e5575-502b-4b36-bffe-611b609908ea tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.370411 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f1e5575-502b-4b36-bffe-611b609908ea tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.089710 Nov 02 13:42:54.383539 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 265/523] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.406109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-35049982-d104-4ef5-891d-92b36d72a028 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.459583 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-35049982-d104-4ef5-891d-92b36d72a028 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1895540149" status: 202 len: 0 microversion: 2.1 time: 0.059783 Nov 02 13:42:54.461429 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 266/524] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:54 2022] DELETE /compute/v2.1/flavors/1895540149 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:42:54.468461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.469551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:54.483549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.485673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.498499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.502397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.503767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.504500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.601237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.601606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.616801 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0c4533cf-6453-403f-9f50-fb0d3fa7a189 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1468 microversion: 2.1 time: 0.150187 Nov 02 13:42:54.634719 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 267/525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1468 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.645418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.647717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:54.650345 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a264fc4c-e4ce-4b4d-a922-f80cfebd11d1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.566967 Nov 02 13:42:54.651948 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 259/526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.657473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce180b33-e887-4b06-b841-60657967e592 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.688906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.690403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.692063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.693208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.693949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.694639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.720892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce180b33-e887-4b06-b841-60657967e592 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.055736 Nov 02 13:42:54.721944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 260/527] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.744251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ca35ee04-ed93-48ba-9091-019072a98cbe req-2ef4a7f4-eab8-4362-a247-8143b6ee5b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54326ae2-2303-4ac5-a643-a0665406bbfd", "name": "network-vif-deleted", "tag": "d00a0d5b-6a6b-407a-96c6-fdcb5fb97e9c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:54.770799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ca35ee04-ed93-48ba-9091-019072a98cbe req-2ef4a7f4-eab8-4362-a247-8143b6ee5b82 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.777733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ca35ee04-ed93-48ba-9091-019072a98cbe req-2ef4a7f4-eab8-4362-a247-8143b6ee5b82 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.779350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ca35ee04-ed93-48ba-9091-019072a98cbe req-2ef4a7f4-eab8-4362-a247-8143b6ee5b82 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.818327 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ca35ee04-ed93-48ba-9091-019072a98cbe req-2ef4a7f4-eab8-4362-a247-8143b6ee5b82 service nova] Creating event network-vif-deleted:d00a0d5b-6a6b-407a-96c6-fdcb5fb97e9c for instance 54326ae2-2303-4ac5-a643-a0665406bbfd on n-h2-858238-3 Nov 02 13:42:54.826745 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ca35ee04-ed93-48ba-9091-019072a98cbe req-2ef4a7f4-eab8-4362-a247-8143b6ee5b82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101938 Nov 02 13:42:54.828559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 261/528] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:54.835775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f50f164-e27b-4ba1-a3af-b45e7f6c9fd1 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-202722032", "id": 1757248139, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:54.869994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f50f164-e27b-4ba1-a3af-b45e7f6c9fd1 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.039420 Nov 02 13:42:54.878464 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 262/529] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:54 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:54.880241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2f1e8e50-e209-46e7-824d-e6e1eff0cf44 req-a48c28ef-7833-43d5-8d4a-bf22cde54dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15ac095-b966-4223-9357-84ed254f0b5f", "name": "network-vif-plugged", "status": "completed", "tag": "48cc2e19-6aff-4054-8c18-cac1c158d3dd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:54.894934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2f1e8e50-e209-46e7-824d-e6e1eff0cf44 req-a48c28ef-7833-43d5-8d4a-bf22cde54dc4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.895569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2f1e8e50-e209-46e7-824d-e6e1eff0cf44 req-a48c28ef-7833-43d5-8d4a-bf22cde54dc4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.896021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2f1e8e50-e209-46e7-824d-e6e1eff0cf44 req-a48c28ef-7833-43d5-8d4a-bf22cde54dc4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.961577 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2f1e8e50-e209-46e7-824d-e6e1eff0cf44 req-a48c28ef-7833-43d5-8d4a-bf22cde54dc4 service nova] Creating event network-vif-plugged:48cc2e19-6aff-4054-8c18-cac1c158d3dd for instance b15ac095-b966-4223-9357-84ed254f0b5f on n-h1-858238-3 Nov 02 13:42:54.969671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2f1e8e50-e209-46e7-824d-e6e1eff0cf44 req-a48c28ef-7833-43d5-8d4a-bf22cde54dc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097011 Nov 02 13:42:54.975214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 263/530] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:54.987041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.988070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.006700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.007362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.007837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.008772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.009549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.010157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.191396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.206978 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-563482e2-cd4d-48b7-b474-64a2cb57bf9e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1468 microversion: 2.1 time: 0.567061 Nov 02 13:42:55.210222 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 268/531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1468 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:55.217515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-43933510-76e5-46cb-8e0f-9f4b6c10caff tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.258284 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-43933510-76e5-46cb-8e0f-9f4b6c10caff tempest-FlavorsAdminTestJSON-646119343 tempest-FlavorsAdminTestJSON-646119343-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.045774 Nov 02 13:42:55.259961 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 269/532] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:55.266013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.267237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.276213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.278217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.279197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.280673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.281571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.282290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.570301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.579852 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0f84d68-17a4-4193-b4a3-c9291126b5f9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.602201 Nov 02 13:42:55.580971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 264/533] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:55.599079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.600246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.608453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.608796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.609780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.610454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.611407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.612086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.613280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.627896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.630446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.633939 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-615ca485-2e66-42fd-a023-455ae5408425 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.371807 Nov 02 13:42:55.635039 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 270/534] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:55.640865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.643058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.656934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.657658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.658243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.659137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.659908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.660476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.662957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:55.859074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.870981 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-008d7850-b718-4069-839f-c8d2d5db30d5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.288768 Nov 02 13:42:55.872365 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 265/535] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:55.877345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0203edf6-732b-4a12-a05d-af3930cb704b tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.904559 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0203edf6-732b-4a12-a05d-af3930cb704b tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1757248139" status: 202 len: 0 microversion: 2.1 time: 0.030473 Nov 02 13:42:55.905890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 266/536] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:42:55 2022] DELETE /compute/v2.1/flavors/1757248139 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:55.924143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.924990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.934015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.935408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.935553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.936557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.937155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.937961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.957208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.965587 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b9dd68c-c4db-4d39-ba36-83646030c85d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1319 microversion: 2.1 time: 0.329112 Nov 02 13:42:55.975246 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 271/537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:55.975246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.975246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.977389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.978328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.978887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.979682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lazy-loading 'fault' on Instance uuid 54326ae2-2303-4ac5-a643-a0665406bbfd {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:55.980379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.981070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.981718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.982601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.983285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.983916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.080638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d65a525b6514c33ab806867e8d5d6f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0afdc344084470cbef232092429a12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:56.094255 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7838eb9-a2cb-44e8-a967-3a26011ee16b tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 200 len: 1306 microversion: 2.1 time: 0.186993 Nov 02 13:42:56.095668 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 267/538] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 1306 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:56.111356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51e2e84c-0019-4bc6-8a94-89c7b944ce12 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.186402 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-51e2e84c-0019-4bc6-8a94-89c7b944ce12 tempest-FlavorsAdminTestJSON-700477978 tempest-FlavorsAdminTestJSON-700477978-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.086912 Nov 02 13:42:56.187622 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 268/539] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:42:56 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:56.192515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e077c3bc-84a4-4e97-924f-6d7667241a92 req-f1940254-6707-4742-98e5-bd5834ad227a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1", "tag": "f76f283a-7454-4b94-a823-c32b31a249d0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:56.209514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e077c3bc-84a4-4e97-924f-6d7667241a92 req-f1940254-6707-4742-98e5-bd5834ad227a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.210124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e077c3bc-84a4-4e97-924f-6d7667241a92 req-f1940254-6707-4742-98e5-bd5834ad227a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.210652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e077c3bc-84a4-4e97-924f-6d7667241a92 req-f1940254-6707-4742-98e5-bd5834ad227a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.237824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e077c3bc-84a4-4e97-924f-6d7667241a92 req-f1940254-6707-4742-98e5-bd5834ad227a service nova] Creating event network-changed:f76f283a-7454-4b94-a823-c32b31a249d0 for instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 on n-h1-858238-3 Nov 02 13:42:56.243787 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e077c3bc-84a4-4e97-924f-6d7667241a92 req-f1940254-6707-4742-98e5-bd5834ad227a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054505 Nov 02 13:42:56.244828 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 269/540] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:56.351508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:56.360059 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4c2c0fa9-71d5-49aa-bd29-2a1f6fdf8a34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.391780 Nov 02 13:42:56.362605 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 272/541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:56.611018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.612803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:56.621488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.622089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.623061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.624088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.624537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.625139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.663022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.663698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:56.670783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.671380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.672083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.672841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.673417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.673909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.900083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:56.912477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:56.914533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:56.916000 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-875e25f0-1c71-4a22-8062-8f9db0bc9314 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.257536 Nov 02 13:42:56.931131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 273/542] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:56 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:56.931131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.931521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:56.952368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.952946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.953380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.954087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.954533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.954947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.041413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.054364 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d55ea498-d3ec-455e-b07e-36314cf7bd7f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.450350 Nov 02 13:42:57.056629 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 270/543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:56 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:57.078956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.079411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.088231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.088694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.089070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.092268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.092268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.092268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.159037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.161386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:57.173849 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0960074b-74f5-4a99-9846-a6b419d47269 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.250662 Nov 02 13:42:57.174477 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 274/544] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:56 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:57.185438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.188387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.195832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.196975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.198379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.199886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.200949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.201588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.219680 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd HTTP/1.1 Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:57.222448 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.223755 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '54326ae2-2303-4ac5-a643-a0665406bbfd'} Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.224507 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.225640 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.228814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.230766 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a972560a-1dc3-4197-beae-0c89a08192f3 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 404 len: 111 microversion: 2.1 time: 0.053953 Nov 02 13:42:57.233553 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 275/545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:57 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:57.244235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1381499199", "metadata": {"image_type": "test"}}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:57.247571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.256056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.257401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.258628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.259833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.260551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.260987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.280233 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd/action HTTP/1.1 Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 112 Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:57.282032 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1381499199", "metadata": {"image_type": "test"}}} Nov 02 13:42:57.283309 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '54326ae2-2303-4ac5-a643-a0665406bbfd', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1381499199', 'metadata': {'image_type': 'test'}}}} Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.283997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.285169 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e6093eaa-8328-43b3-afd1-5027fa0a32f7 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "POST /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd/action" status: 404 len: 111 microversion: 2.1 time: 0.043677 Nov 02 13:42:57.286283 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 276/546] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Nov 2 13:42:57 2022] POST /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:57.299398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c8b9d6a-5f37-4a7b-9db3-d3577b7bca72 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1677571747", "metadata": {"image_type": "test"}}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:57.302069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c8b9d6a-5f37-4a7b-9db3-d3577b7bca72 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Failed to fetch instance by id tempest-invalid-920014122 {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:42:57.303284 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-1c8b9d6a-5f37-4a7b-9db3-d3577b7bca72 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance tempest-invalid-920014122 could not be found. Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c8b9d6a-5f37-4a7b-9db3-d3577b7bca72 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/tempest-invalid-920014122/action HTTP/1.1 Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 112 Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:57.305003 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1677571747", "metadata": {"image_type": "test"}}} Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:57.306628 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance tempest-invalid-920014122 could not be found. Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'tempest-invalid-920014122', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1677571747', 'metadata': {'image_type': 'test'}}}} Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-920014122 could not be found. Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.307801 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-920014122 could not be found. Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-920014122 could not be found. Nov 02 13:42:57.309315 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.310656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c8b9d6a-5f37-4a7b-9db3-d3577b7bca72 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance tempest-invalid-920014122 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.310656 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c8b9d6a-5f37-4a7b-9db3-d3577b7bca72 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "POST /compute/v2.1/servers/tempest-invalid-920014122/action" status: 404 len: 100 microversion: 2.1 time: 0.015398 Nov 02 13:42:57.311779 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 277/547] 10.222.0.18 () {60 vars in 1246 bytes} [Wed Nov 2 13:42:57 2022] POST /compute/v2.1/servers/tempest-invalid-920014122/action => generated 100 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:57.321357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a615150a-daa5-4eac-8f47-3c089f3b7bde tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-500995378"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:57.324301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a615150a-daa5-4eac-8f47-3c089f3b7bde tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:42:57.324811 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a615150a-daa5-4eac-8f47-3c089f3b7bde tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a615150a-daa5-4eac-8f47-3c089f3b7bde tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 56 Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:57.327289 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: {"createImage": {"name": "tempest-test-snap-500995378"}} Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:57.328515 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-500995378'}}} Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.334469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.335758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.337171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a615150a-daa5-4eac-8f47-3c089f3b7bde tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.337171 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a615150a-daa5-4eac-8f47-3c089f3b7bde tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011980 Nov 02 13:42:57.337171 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 278/548] 10.222.0.18 () {60 vars in 1275 bytes} [Wed Nov 2 13:42:57 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:42:57.341838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9cc02e4-4389-450d-aa15-96c1e20b3b0c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-638433147"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:57.344360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c9cc02e4-4389-450d-aa15-96c1e20b3b0c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:42:57.344804 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-c9cc02e4-4389-450d-aa15-96c1e20b3b0c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9cc02e4-4389-450d-aa15-96c1e20b3b0c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 56 Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:57.346397 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: {"createImage": {"name": "tempest-test-snap-638433147"}} Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:57.347834 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-638433147'}}} Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.348695 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:42:57.350010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.351072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9cc02e4-4389-450d-aa15-96c1e20b3b0c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.351072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c9cc02e4-4389-450d-aa15-96c1e20b3b0c tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013288 Nov 02 13:42:57.351072 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 279/549] 10.222.0.18 () {60 vars in 1281 bytes} [Wed Nov 2 13:42:57 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:57.360259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.361462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.370378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.370811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.372051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.373122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.373673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.375148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.394423 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd HTTP/1.1 Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:42:57.396565 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.398032 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '54326ae2-2303-4ac5-a643-a0665406bbfd'} Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.398990 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.400426 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.401844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.401844 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b7e86556-8324-472d-8fc8-36184c92b310 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 404 len: 111 microversion: 2.1 time: 0.044353 Nov 02 13:42:57.401844 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 280/550] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:42:57 2022] DELETE /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:57.409289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.410377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.418422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.419239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.419751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.421413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.421949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.422578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.443927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.456063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-09933957-dde9-44f1-8ee3-8aaa11c8b1ef tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1469 microversion: 2.1 time: 0.383375 Nov 02 13:42:57.468558 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 271/551] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:57 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:57.483161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.483768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] [instance: 54326ae2-2303-4ac5-a643-a0665406bbfd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.505191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.505687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.506486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.506816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.507295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.507713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.536708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] HTTP exception thrown: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Request method failure captured: Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd HTTP/1.1 Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnO83rkNyi5FdMmeAEsOuFMVHLxzWEwNe4Cp8xn7s06q9tFMBpekfYtdKqDm5gZiyhH_9SYvMguLRrO9g-Z34bTjCcRwe8vP9IINUcqX9Vl04uRGHbqUOZvXUWt-pF3jyOsePyneUBTbEKwJLLaJ_FIz9L_WvmuPKUP3dqKKzrRM6qs Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:42:57.538680 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e0afdc344084470cbef232092429a12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e0afdc344084470cbef232092429a12a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e0afdc344084470cbef232092429a12a"}]}] Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e0afdc344084470cbef232092429a12a Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-192352191 Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1d65a525b6514c33ab806867e8d5d6f9 Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesNegativeTestJSON-192352191-project Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.540164 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '54326ae2-2303-4ac5-a643-a0665406bbfd'} Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:57.540868 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. Nov 02 13:42:57.542050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:42:57.543054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] Returning 404 to user: Instance 54326ae2-2303-4ac5-a643-a0665406bbfd could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:57.543054 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d487b63f-bc4c-45b8-a3ab-68cbcd5d2246 tempest-ImagesNegativeTestJSON-192352191 tempest-ImagesNegativeTestJSON-192352191-project] 10.222.0.18 "GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd" status: 404 len: 111 microversion: 2.1 time: 0.070431 Nov 02 13:42:57.543054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 272/552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:57 2022] GET /compute/v2.1/servers/54326ae2-2303-4ac5-a643-a0665406bbfd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:57.546496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.553024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.554680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Searching by: {'reservation_id': 'r-3a105pex', 'deleted': False, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:42:57.562760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.563274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.563704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.565061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.565518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.565938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.696931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.707073 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-426f85c4-879d-403d-9cd9-c72ca700324d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.303937 Nov 02 13:42:57.722988 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 281/553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:57 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:57.754407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:42:57.860282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.869339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.869824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.870259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.942954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:57.943870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:57.950164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.950919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.951529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.952396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:57.952852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:57.953259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.139929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:58.155468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:58.158427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:58.162685 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6ffdb16-dab5-45d5-8b83-4f252fa4dd0c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.220976 Nov 02 13:42:58.168125 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 282/554] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:57 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:42:58.188278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:58.189188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:58.195466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.195966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.196405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.197117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.197570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.205039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.258311 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6058d6e-aa7f-466b-9cfe-8fbe79e9abcf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-3a105pex" status: 200 len: 2930 microversion: 2.1 time: 0.715994 Nov 02 13:42:58.271124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 273/555] 10.222.0.18 () {58 vars in 1197 bytes} [Wed Nov 2 13:42:57 2022] GET /compute/v2.1/servers/detail?reservation_id=r-3a105pex => generated 2930 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:58.271124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:58.271124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:58.294557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.295566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.296014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.297249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.298331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.299051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.546989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:58.557818 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-25923af1-737f-4f45-adf1-46a5e22dce69 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.388563 Nov 02 13:42:58.559404 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 283/556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:58 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:58.573690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d06009e0-7911-4bd7-a3b1-12f55faaefbf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:58.633026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.server_groups [None req-d06009e0-7911-4bd7-a3b1-12f55faaefbf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Querying cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) for 2 instances {{(pid=137558) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:42:58.635887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d06009e0-7911-4bd7-a3b1-12f55faaefbf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.637779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d06009e0-7911-4bd7-a3b1-12f55faaefbf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.639223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d06009e0-7911-4bd7-a3b1-12f55faaefbf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.702207 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d06009e0-7911-4bd7-a3b1-12f55faaefbf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/4063e594-f7be-4990-b476-bd075488a561" status: 200 len: 265 microversion: 2.1 time: 0.136381 Nov 02 13:42:58.705732 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 284/557] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:42:58 2022] GET /compute/v2.1/os-server-groups/4063e594-f7be-4990-b476-bd075488a561 => generated 265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:58.720896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:58.722347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:58.732086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.733133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.734214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.735506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.736171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.736783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.029996 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1228e6e3-7dde-4c26-a559-d3f87336de21 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1620 microversion: 2.1 time: 0.312114 Nov 02 13:42:59.031016 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 285/558] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:58 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1620 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:59.038587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:59.039687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:59.052651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.054283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.054988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.057270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.060121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.060975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.137147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:59.158542 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd91b501-7ec4-422c-95e6-80ae975e42ca tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.897952 Nov 02 13:42:59.173910 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 274/559] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:58 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:59.441110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:59.453678 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c9de10f3-575b-4cd0-9aef-bbd21b7bb1d6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.421096 Nov 02 13:42:59.456229 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 286/560] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:59 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:59.473427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:59.473640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:59.480551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.480813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.481247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.481995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.482446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.482867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.568217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1331338752", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:59.630973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:59.788142 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8a9eb50f-2373-49fb-996f-53ed4a053daf tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1619 microversion: 2.1 time: 0.328711 Nov 02 13:42:59.791634 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 287/561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:42:59 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1619 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:59.807942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:59.809564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:59.823840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.824950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.825906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.827242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.828189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.829026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.011252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.021768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.023250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.024732 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b36cbd4b-1cce-4d93-b323-7b2c78006569 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.228730 Nov 02 13:43:00.025312 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 288/562] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:42:59 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:00.047918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-15f5e0c9-5c62-4347-8d89-63a1b9d2323e req-54c34a78-7647-4718-887d-9d88ea6b0770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a944552c-b24f-4bf8-bffa-b24a0816b48b", "name": "network-vif-plugged", "status": "completed", "tag": "81c1e916-e331-4ec8-bd6d-bb2cc1c715ad"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:00.059419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-15f5e0c9-5c62-4347-8d89-63a1b9d2323e req-54c34a78-7647-4718-887d-9d88ea6b0770 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.060732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-15f5e0c9-5c62-4347-8d89-63a1b9d2323e req-54c34a78-7647-4718-887d-9d88ea6b0770 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.061760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-15f5e0c9-5c62-4347-8d89-63a1b9d2323e req-54c34a78-7647-4718-887d-9d88ea6b0770 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.077880 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-15f5e0c9-5c62-4347-8d89-63a1b9d2323e req-54c34a78-7647-4718-887d-9d88ea6b0770 service nova] Creating event network-vif-plugged:81c1e916-e331-4ec8-bd6d-bb2cc1c715ad for instance a944552c-b24f-4bf8-bffa-b24a0816b48b on n-h2-858238-3 Nov 02 13:43:00.087051 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-15f5e0c9-5c62-4347-8d89-63a1b9d2323e req-54c34a78-7647-4718-887d-9d88ea6b0770 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045147 Nov 02 13:43:00.088907 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 289/563] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:00.099789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:00.100695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:00.108966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.109897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.110528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.111741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.112355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.113420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.375571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:00.376269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:00.376943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:00.377571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:00.378131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:00.390361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.391167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.391792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.395268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.401593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.406537 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0fe80f54-cc92-4dcb-bc09-c0ce1f6f7805 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.314049 Nov 02 13:43:00.408733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.409196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.410590 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 290/564] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:00 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:00.433142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdfa8222-b8b0-44e1-8a21-9a1e89e2a741 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: .version_select at 0x7f6f823884c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1079967334", "policies": ["anti-affinity"]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:00.456452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Getting quotas for project 2f103e51a58e4d68881209163bd0f4ea. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:00.457572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fdfa8222-b8b0-44e1-8a21-9a1e89e2a741 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:00.463867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fdfa8222-b8b0-44e1-8a21-9a1e89e2a741 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:00.469214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:00.473974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Getting quotas for user c34c673cd0054881b58a1b848dfc81c0 and project 2f103e51a58e4d68881209163bd0f4ea. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:00.499283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:00.507022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:00.526022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fdfa8222-b8b0-44e1-8a21-9a1e89e2a741 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:00.532242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fdfa8222-b8b0-44e1-8a21-9a1e89e2a741 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:00.558209 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fdfa8222-b8b0-44e1-8a21-9a1e89e2a741 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.145063 Nov 02 13:43:00.571871 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 291/565] 10.222.0.18 () {60 vars in 1174 bytes} [Wed Nov 2 13:43:00 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:00.572793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:00.574389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:00.584125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.584850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.585622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.586523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.586981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.587505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.643386 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5a798c7-ed90-4651-98f1-ee9f6d93c40e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467231 Nov 02 13:43:00.649701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 275/566] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:42:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:00.668628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:00.670306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:00.714572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.717714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.721304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.722416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.726963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.727598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.799297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.815887 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-39b94626-b90d-4bc8-bfec-3211f276aab1 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.247387 Nov 02 13:43:00.816710 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 292/567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:00 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:00.823329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-094b3727-0325-4693-847d-2d03de6c25e4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:00.824918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-094b3727-0325-4693-847d-2d03de6c25e4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:00.915124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-094b3727-0325-4693-847d-2d03de6c25e4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.925160 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-094b3727-0325-4693-847d-2d03de6c25e4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1214 microversion: 2.1 time: 0.105455 Nov 02 13:43:00.926327 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 293/568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:00 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:00.932534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1726282451", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fe8a389b-e4c2-4eae-bec6-23014482bb74"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:01.030210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:01.090170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:01.098950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-612499dc-ef18-4b3d-88c7-e53fdb7f7805 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.447392 Nov 02 13:43:01.116177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 276/569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:00 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:01.130280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:01.137949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:01.141511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:01.148885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.151050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.154639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.155608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.156242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.165991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.608049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:01.617967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:01.619453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:01.620592 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-deb75358-4389-4089-995d-5fc720c7ab11 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.503685 Nov 02 13:43:01.621166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 277/570] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:01 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:01.634755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:01.639415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:01.660407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:01.660820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:01.661289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:01.661692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:01.662097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:01.666978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.667766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.668216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.672995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.673487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.680939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.720870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.721833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.723069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.724798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.726426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.727180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.781473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:01.791825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:01.809076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Going to run 2 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:01.812988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:01.866500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137558) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 13:43:01.926412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:01.940591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:01.997961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:02.020820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a474e5cf-3868-4d76-a8d3-28b6343e58d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1310 microversion: 2.1 time: 0.387148 Nov 02 13:43:02.022156 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 278/571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:01 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1310 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:02.040022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.040900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.043758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:02.050279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:02.050815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.051878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.052480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.053358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.053938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.054361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.098290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=f0c46a30-9bc6-4310-871c-c58756321660,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:02.228160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:02.242461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:02.259587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:02.270174 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a0da15fb-1451-416d-ae49-4be03279bddb tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.246549 Nov 02 13:43:02.281911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 279/572] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:02.290920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.294738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.314393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.314901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.318000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.320235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.323285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.323946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.358141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:02.365363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'server_group_members'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:02.437962 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b1a6f04-9b30-4d69-ace6-6399e85a683d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.510394 Nov 02 13:43:02.439087 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 294/573] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 1512 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:43:02.445063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.445946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.452881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.453599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.454872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.455802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.456418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.457042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.472758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:02.486452 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48a16a36-6549-4c12-aae7-bedd68336f2a tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1266 microversion: 2.1 time: 0.203066 Nov 02 13:43:02.487049 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 280/574] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:02.506694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-253c66cb-65ad-4848-93b2-129c6f383d27 req-f7c3e5c3-d2fd-40d8-99fe-911d9687880c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187acb18-1b79-484c-abce-d04e4f964c1e", "name": "network-vif-plugged", "status": "completed", "tag": "7580a147-c698-4d66-991e-fba7f3a2050b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:02.517473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-253c66cb-65ad-4848-93b2-129c6f383d27 req-f7c3e5c3-d2fd-40d8-99fe-911d9687880c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.518130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-253c66cb-65ad-4848-93b2-129c6f383d27 req-f7c3e5c3-d2fd-40d8-99fe-911d9687880c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.518861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-253c66cb-65ad-4848-93b2-129c6f383d27 req-f7c3e5c3-d2fd-40d8-99fe-911d9687880c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.539872 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-253c66cb-65ad-4848-93b2-129c6f383d27 req-f7c3e5c3-d2fd-40d8-99fe-911d9687880c service nova] Creating event network-vif-plugged:7580a147-c698-4d66-991e-fba7f3a2050b for instance 187acb18-1b79-484c-abce-d04e4f964c1e on n-h2-858238-3 Nov 02 13:43:02.548712 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-253c66cb-65ad-4848-93b2-129c6f383d27 req-f7c3e5c3-d2fd-40d8-99fe-911d9687880c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045518 Nov 02 13:43:02.549806 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 281/575] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:02.779663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Calling method '.version_select at 0x7f6f82182280>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.784478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.785727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.786165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.823254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.824223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.824843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.855623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.856685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.857634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.869394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:02.879147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b21c199d-009f-4624-95bf-fca141ce5420 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327951 Nov 02 13:43:02.882304 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 282/576] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:02.896459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.898232 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7cecbda4-4d82-42a1-85ce-754975b1f449 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.453065 Nov 02 13:43:02.905818 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 295/577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:02.914662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.915481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.921886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:02.926407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:02.928166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Searching by: {'deleted': False, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:43:02.932607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.933102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.933537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.938528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.939161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.939550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.955136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.955899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.956467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.957525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.958477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.959423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.012788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:43:03.070240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50089c8f-208a-4442-9d3a-8853c0593e8e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.185955 Nov 02 13:43:03.078350 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 283/578] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers => generated 1665 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:03.272723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9414cc0b-1102-4343-8efa-94408d031b0e tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Calling method '.version_select at 0x7f6f81ff08b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.276979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9414cc0b-1102-4343-8efa-94408d031b0e tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '8a2ae8618ded48d88695fc7cc962ffd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c102c0d3c946a184e0c059dec4c974', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9414cc0b-1102-4343-8efa-94408d031b0e tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Request method failure captured: Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/n-h1-858238-3/search HTTP/1.1 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnPlrvLwjdFO0yyz3PeieM4oK413bGnYAnKWz9xwjAkDpfkmeHOs9cvJTp2nvhKgS80zVkGyQD4jUce4gVgCv8WZW63QkJi6ODgjvFcRpqUkxI7p4xZ__BeeUYIiDN_c39TJ3bHBjAiv6Hf5ZANhYWSmZnj9d5IYUUaFcxyKdUHhM34 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d6c102c0d3c946a184e0c059dec4c974 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1176974336 Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:43:03.279728 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6c102c0d3c946a184e0c059dec4c974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d6c102c0d3c946a184e0c059dec4c974"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6c102c0d3c946a184e0c059dec4c974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d6c102c0d3c946a184e0c059dec4c974"}]}] Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1176974336 Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d6c102c0d3c946a184e0c059dec4c974 Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1176974336 Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8a2ae8618ded48d88695fc7cc962ffd7 Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 13:43:03.281251 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'n-h1-858238-3'} Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:43:03.282181 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 13:43:03.283631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.285235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9414cc0b-1102-4343-8efa-94408d031b0e tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:03.285373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9414cc0b-1102-4343-8efa-94408d031b0e tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h1-858238-3/search" status: 403 len: 117 microversion: 2.1 time: 0.203464 Nov 02 13:43:03.286485 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 284/579] 10.222.0.18 () {58 vars in 1209 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/os-hypervisors/n-h1-858238-3/search => generated 117 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:03.292864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.293666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.314198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.314714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.319349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.320181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.320665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.321106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.568962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.581649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-696b0e2b-30ad-4071-a4a9-18c3a0045f1f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1490 microversion: 2.1 time: 0.292583 Nov 02 13:43:03.582284 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 285/580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1490 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:03.587952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3e64c86-1a60-48fa-819d-2a9762371e26 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.588790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3e64c86-1a60-48fa-819d-2a9762371e26 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.641959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.651108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.653361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.654949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c43f768-27a8-46d8-8a43-033e0c6c6226 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.748565 Nov 02 13:43:03.664348 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 296/581] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:03.664348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.664348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.679852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.681833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.682351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.683081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.685588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.685588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.705330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3e64c86-1a60-48fa-819d-2a9762371e26 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.714684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3e64c86-1a60-48fa-819d-2a9762371e26 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1219 microversion: 2.1 time: 0.130734 Nov 02 13:43:03.737775 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 286/582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:03.751370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Calling method '.version_select at 0x7f6f820cbdc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.753444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.753876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.754406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.782431 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Request method failure captured: Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnPm2jJ8RyvYqiA0zo19kO9vjiF1UevRxAwzEhAOPowXMV4chZXQIhiilnEHkz3ufQrjYTk0gyNfc1kGsNHu_QRoblvAgnDgrzKe7_58JPaWkziZDjMVPqFheBMgfruHkwAu-1MnjZWbndIcgcIzXYP-juvoFbkOEu6huEvun3XEAR0 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0148b4d21a8d4c77a50c5a379fe2acb7 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1224778350 Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:43:03.784334 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0148b4d21a8d4c77a50c5a379fe2acb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0148b4d21a8d4c77a50c5a379fe2acb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0148b4d21a8d4c77a50c5a379fe2acb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0148b4d21a8d4c77a50c5a379fe2acb7"}]}] Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1224778350 Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0148b4d21a8d4c77a50c5a379fe2acb7 Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1224778350 Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3273b8a2bde64ad4bb60f1553296626a Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:43:03.785866 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:03.786722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7c2ad1ca-427b-4132-80d9-d9f065c2b440 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.046923 Nov 02 13:43:03.788267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 287/583] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:03.793623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.795007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.803675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.804360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.804950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.805940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.806554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.807144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.812086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:03.945251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.957473 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a52af53-1b1c-4463-b142-d198741a93f8 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1272 microversion: 2.1 time: 0.169734 Nov 02 13:43:03.959870 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 288/584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:04.008713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:04.020357 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf24224b-a6c2-48f3-a386-dc1e699e4725 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.362931 Nov 02 13:43:04.021884 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 297/585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:04.027547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Calling method '.version_select at 0x7f6f82148e50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.029846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.030324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.030873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.054664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.055133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.055589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.067448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.067930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.068363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.077477 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0eb67704-e47a-45bc-90c5-33245ae68066 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054010 Nov 02 13:43:04.078435 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 298/586] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:04.084281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.085106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:04.098860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.099901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.100548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.101706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.102480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.103572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.249526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.252013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:04.259495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.259979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.268310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.268310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.268310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.268310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.524113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:04.546560 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bd9572c7-f364-43f7-8c93-bc36d81083c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.467006 Nov 02 13:43:04.568475 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 299/587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:04.586579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee218a0b-4692-4d68-8851-e9da42c8b8c0 tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Calling method '.version_select at 0x7f6f823884c0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.589760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ee218a0b-4692-4d68-8851-e9da42c8b8c0 tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '8a2ae8618ded48d88695fc7cc962ffd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c102c0d3c946a184e0c059dec4c974', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee218a0b-4692-4d68-8851-e9da42c8b8c0 tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Request method failure captured: Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnPlrvLwjdFO0yyz3PeieM4oK413bGnYAnKWz9xwjAkDpfkmeHOs9cvJTp2nvhKgS80zVkGyQD4jUce4gVgCv8WZW63QkJi6ODgjvFcRpqUkxI7p4xZ__BeeUYIiDN_c39TJ3bHBjAiv6Hf5ZANhYWSmZnj9d5IYUUaFcxyKdUHhM34 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d6c102c0d3c946a184e0c059dec4c974 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1176974336 Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:43:04.597640 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6c102c0d3c946a184e0c059dec4c974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d6c102c0d3c946a184e0c059dec4c974"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d6c102c0d3c946a184e0c059dec4c974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d6c102c0d3c946a184e0c059dec4c974"}]}] Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1176974336 Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d6c102c0d3c946a184e0c059dec4c974 Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1176974336 Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8a2ae8618ded48d88695fc7cc962ffd7 Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 13:43:04.599270 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '1'} Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:43:04.600211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 13:43:04.601355 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:04.602459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee218a0b-4692-4d68-8851-e9da42c8b8c0 tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:04.602459 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ee218a0b-4692-4d68-8851-e9da42c8b8c0 tempest-HypervisorAdminNegativeUnderV252Test-1176974336 tempest-HypervisorAdminNegativeUnderV252Test-1176974336-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029388 Nov 02 13:43:04.603286 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 300/588] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:04.619544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Calling method '.version_select at 0x7f6f822633a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.621318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.621809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.622248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.664408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:04.665728 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] HTTP exception thrown: No hypervisor matching '2e4430d7-4593-48bb-a204-377b7ec07345' could be found. Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Request method failure captured: Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-hypervisors/2e4430d7-4593-48bb-a204-377b7ec07345/servers HTTP/1.1 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnPm2jJ8RyvYqiA0zo19kO9vjiF1UevRxAwzEhAOPowXMV4chZXQIhiilnEHkz3ufQrjYTk0gyNfc1kGsNHu_QRoblvAgnDgrzKe7_58JPaWkziZDjMVPqFheBMgfruHkwAu-1MnjZWbndIcgcIzXYP-juvoFbkOEu6huEvun3XEAR0 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 0148b4d21a8d4c77a50c5a379fe2acb7 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1224778350 Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:43:04.667470 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0148b4d21a8d4c77a50c5a379fe2acb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0148b4d21a8d4c77a50c5a379fe2acb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0148b4d21a8d4c77a50c5a379fe2acb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0148b4d21a8d4c77a50c5a379fe2acb7"}]}] Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1224778350 Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 0148b4d21a8d4c77a50c5a379fe2acb7 Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1224778350 Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3273b8a2bde64ad4bb60f1553296626a Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: exception: No hypervisor matching '2e4430d7-4593-48bb-a204-377b7ec07345' could be found. Nov 02 13:43:04.668770 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2e4430d7-4593-48bb-a204-377b7ec07345'} Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2e4430d7-4593-48bb-a204-377b7ec07345' could be found. Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:04.669490 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2e4430d7-4593-48bb-a204-377b7ec07345' could be found. Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] Returning 404 to user: No hypervisor matching '2e4430d7-4593-48bb-a204-377b7ec07345' could be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9f92f95e-4f78-44f2-8e6a-39873931ae83 tempest-HypervisorAdminNegativeUnderV252Test-1224778350 tempest-HypervisorAdminNegativeUnderV252Test-1224778350-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2e4430d7-4593-48bb-a204-377b7ec07345/servers" status: 404 len: 123 microversion: 2.1 time: 0.061700 Nov 02 13:43:04.670545 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 301/589] 10.222.0.18 () {58 vars in 1281 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/os-hypervisors/2e4430d7-4593-48bb-a204-377b7ec07345/servers => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:43:04.686681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.687339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:04.707210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.707719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.709469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.711735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.715891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.717684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.769034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d7b2397-8293-4dd1-8436-a12b85f61b90 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1641 microversion: 2.1 time: 0.805146 Nov 02 13:43:04.783638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 289/590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1641 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:04.803480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6f1c3405-7fe3-414d-8f1b-366fd99f98e2 req-c9dd198c-8651-4475-a00d-90d4d73e2533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1", "name": "network-vif-plugged", "status": "completed", "tag": "f76f283a-7454-4b94-a823-c32b31a249d0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:04.825263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6f1c3405-7fe3-414d-8f1b-366fd99f98e2 req-c9dd198c-8651-4475-a00d-90d4d73e2533 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.834118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6f1c3405-7fe3-414d-8f1b-366fd99f98e2 req-c9dd198c-8651-4475-a00d-90d4d73e2533 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.835370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6f1c3405-7fe3-414d-8f1b-366fd99f98e2 req-c9dd198c-8651-4475-a00d-90d4d73e2533 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.857519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6f1c3405-7fe3-414d-8f1b-366fd99f98e2 req-c9dd198c-8651-4475-a00d-90d4d73e2533 service nova] Creating event network-vif-plugged:f76f283a-7454-4b94-a823-c32b31a249d0 for instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 on n-h1-858238-3 Nov 02 13:43:04.863638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6f1c3405-7fe3-414d-8f1b-366fd99f98e2 req-c9dd198c-8651-4475-a00d-90d4d73e2533 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078533 Nov 02 13:43:04.865310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 290/591] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:04.876012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.877002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:04.884485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.885232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.886047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.886926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.887581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.888847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.985375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:04.994720 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9696785-6bd3-449d-be6e-17dfa59d6147 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1271 microversion: 2.1 time: 0.124145 Nov 02 13:43:04.999325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 291/592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:05.004245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:05.007746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:05.037126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.038495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.039957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.043215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.043881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.045497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.161470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:05.173449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:05.180069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:05.182953 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4b0e4ea0-bc0a-42e0-b621-9205e37f1820 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.502025 Nov 02 13:43:05.184918 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 302/593] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:43:05.193616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:05.194413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:05.215127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.215637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.216149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.216870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.217323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.219732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.439445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:05.453721 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-195a7a34-f164-4897-9258-5f06ad65e0b7 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1272 microversion: 2.1 time: 0.266994 Nov 02 13:43:05.457182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 303/594] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:05 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:05.474975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:05.477522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:05.505016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.505855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.506464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.508188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.510258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.514321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.542788 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-389382e1-4c3a-43cc-a610-a9824fa5a194 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1641 microversion: 2.1 time: 0.541932 Nov 02 13:43:05.563648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 292/595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1641 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:05.571413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:05.575793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.576631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.577224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.578559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.579214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.579818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.617099 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03a0adb6-d2df-4858-8b85-37e3118d8c45 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050851 Nov 02 13:43:05.625554 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 293/596] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:43:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:05.626000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:05.627392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:05.635457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.635973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.636512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.637885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.638544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.639061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.921117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:05.932285 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-815c5b7d-56ee-4a1d-9cef-3cc174142f3f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1477 microversion: 2.1 time: 0.311918 Nov 02 13:43:05.934538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 294/597] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:05 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:05.943944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858238-3", "block_migration": true, "disk_over_commit": false}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:05.949978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:05.969499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.970452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.971181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.972096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.972892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.973472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:06.008036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lazy-loading 'flavor' on Instance uuid a944552c-b24f-4bf8-bffa-b24a0816b48b {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:06.029544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:06.030962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Going to try to live migrate instance to n-h1-858238-3 {{(pid=137559) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:43:06.050755 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1740ebf7-d8ac-4c4f-8a3a-d91a47990af8 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1390 microversion: 2.1 time: 0.590035 Nov 02 13:43:06.053218 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 304/598] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:05 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1390 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:06.059349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:06.060322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:06.086581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:06.088521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:06.090180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:06.094107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:06.097235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:06.098959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:06.305915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:06.354025 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5611931c-74da-438c-af19-5688c6548314 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1271 microversion: 2.1 time: 0.293525 Nov 02 13:43:06.354731 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 305/599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:06 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:06.370570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:06.370570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:06.405439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:06.405948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:06.406387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:06.407320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:06.409569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:06.409993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.183551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:07.201508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:07.203075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:07.204580 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-03691a39-e214-4054-a7c8-5ac5a7c710f5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1362 microversion: 2.25 time: 0.840804 Nov 02 13:43:07.205614 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 306/600] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:06 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1362 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:07.211171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:07.217192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:07.223729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.224406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.224995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.225849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.226465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.227033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.697856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:07.751271 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b29c7316-3449-43de-a7d0-d73683f9648c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1314 microversion: 2.1 time: 0.540169 Nov 02 13:43:07.758492 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 307/601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:07 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:07.778715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:07.780665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:07.817817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.820601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.822779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.826265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.833832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.834956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.474794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:08.489281 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5198fca5-bdee-46e6-9794-1b2d65f2c5db tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1476 microversion: 2.1 time: 0.729061 Nov 02 13:43:08.496353 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 308/602] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:07 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1476 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:08.525281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:08.527503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:08.542260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.542753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.545648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.546411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.546870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.547334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.102353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.110883 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eda124bf-dd34-40c6-bebb-e43eb257f278 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1589 microversion: 2.1 time: 0.601875 Nov 02 13:43:09.127362 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 309/603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:08 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1589 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:09.133245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:09.134043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:09.147457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.148236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.148844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.149718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.150179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.150600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.258264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.271235 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56879c65-13b1-46c7-b0aa-2004bd722c63 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1277 microversion: 2.1 time: 0.142629 Nov 02 13:43:09.284238 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 310/604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:09 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:09.297150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:09.298171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:09.334687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.335421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.335857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.336556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.337545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.338371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.670841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.680576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.685919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.689192 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-992e109b-a881-49ae-984b-0e8ec42b6d29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1557 microversion: 2.25 time: 0.408000 Nov 02 13:43:09.702800 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 311/605] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:09 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1557 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:09.719222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:09.724365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:09.740382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.742085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.743202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.744661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.746109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.747161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.120982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94611e38-42ed-40fe-bedb-a5f35430c420 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b/action" status: 202 len: 0 microversion: 2.1 time: 4.183973 Nov 02 13:43:10.122350 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 295/606] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:05 2022] POST /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b/action => generated 0 bytes in 4187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:10.125665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:10.152055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:10.157151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:10.167238 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75c655d7-133e-4706-ab7a-70ead92c1356 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1314 microversion: 2.1 time: 0.462063 Nov 02 13:43:10.177631 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 312/607] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:09 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:10.190953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.191591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d3c6881f-7486-40c0-92ee-f95e81c2f2b9 req-e596c939-1f5d-4351-984a-0c640cdd051e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01e1ba0-4d30-4622-a442-dae576c272f9", "tag": "ac2e8ead-f207-4418-996a-c2e3359f9b2f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:10.201202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.218568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.219530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.219949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.220380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.226440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d3c6881f-7486-40c0-92ee-f95e81c2f2b9 req-e596c939-1f5d-4351-984a-0c640cdd051e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.227858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d3c6881f-7486-40c0-92ee-f95e81c2f2b9 req-e596c939-1f5d-4351-984a-0c640cdd051e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.228444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d3c6881f-7486-40c0-92ee-f95e81c2f2b9 req-e596c939-1f5d-4351-984a-0c640cdd051e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.255867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d3c6881f-7486-40c0-92ee-f95e81c2f2b9 req-e596c939-1f5d-4351-984a-0c640cdd051e service nova] Creating event network-changed:ac2e8ead-f207-4418-996a-c2e3359f9b2f for instance a01e1ba0-4d30-4622-a442-dae576c272f9 on n-h2-858238-3 Nov 02 13:43:10.279390 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d3c6881f-7486-40c0-92ee-f95e81c2f2b9 req-e596c939-1f5d-4351-984a-0c640cdd051e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095702 Nov 02 13:43:10.282799 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 313/608] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:10.311544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:10.312261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:10.326874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.328043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.329118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.330023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.330784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.331404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.502796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a811ac7-4dfb-4d09-a168-cab69977e793 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.377383 Nov 02 13:43:10.503594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 296/609] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:43:10 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:10.508652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8169e59-d6a0-4edd-8a16-a69424518ad1", "name": "network-vif-unplugged", "status": "completed", "tag": "cbc2b2f0-a287-4e97-aa3b-58d2e0db3533"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:10.534044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.534532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.534960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.564206 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] Creating event network-vif-unplugged:cbc2b2f0-a287-4e97-aa3b-58d2e0db3533 for instance c8169e59-d6a0-4edd-8a16-a69424518ad1 on n-h1-858238-3 Nov 02 13:43:10.589496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:43:10.620879 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-28652232-d9c0-4f42-a1ac-a468e902f5d7 req-2a2e3d1e-9320-45fe-a4fd-187ea7b81198 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115700 Nov 02 13:43:10.623484 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 297/610] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:10.635699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:10.640669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:10.657384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.657903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.658375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.660576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.661942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.663588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.156957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:11.166489 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-95ed0910-a474-4089-9a41-07b22837f12e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1476 microversion: 2.1 time: 0.881355 Nov 02 13:43:11.188435 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 314/611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:10 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1476 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:11.198655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.199648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.207186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.207991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.208795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.209816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.210479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.211150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.399016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:11.421783 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-32fc5bff-3eff-40aa-ab22-b641370d899e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 2050 microversion: 2.25 time: 0.795481 Nov 02 13:43:11.423404 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 298/612] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:10 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 2050 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:11.437702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.439652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.447589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.448498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.449187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.450171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.450668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.451128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.635901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:11.649611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-677d71d1-f7ae-40f8-a446-63ad744024d8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.459419 Nov 02 13:43:11.663352 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 315/613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:11 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:11.663352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.663352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.667385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.668110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.668728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.669749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.670217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.670644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.754400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=12 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:12.085930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:12.115872 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-27c451c7-776a-4a55-a1e2-6f16fa0cb453 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1314 microversion: 2.1 time: 0.463344 Nov 02 13:43:12.121811 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 316/614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:11 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:12.298682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:12.309004 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53bdb72f-06cc-487b-845d-f2ab512d4a0a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 0.882250 Nov 02 13:43:12.311683 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 299/615] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:11 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:12.311797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2efc6e98-e377-4db6-919e-c57c8a521bb3 tempest-NetworksTest-804495231 tempest-NetworksTest-804495231-project-admin] Calling method '.version_select at 0x7f6f824cd670>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:12.316916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:12.317804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:12.325232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:12.326501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:12.327173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:12.328058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:12.328721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:12.329141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:12.375115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=47 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:13.122673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:13.136683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2efc6e98-e377-4db6-919e-c57c8a521bb3 tempest-NetworksTest-804495231 tempest-NetworksTest-804495231-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 6750 microversion: 2.1 time: 1.011900 Nov 02 13:43:13.140011 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 317/616] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:43:12 2022] GET /compute/v2.1/os-networks => generated 6750 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:13.142608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:13.143539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:13.164328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.165191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.165839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.166759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.167335 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd03b755-55f2-4236-842b-7a4d6ca0ff0e tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 2050 microversion: 2.25 time: 0.853617 Nov 02 13:43:13.167733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.167934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 300/617] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:12 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 2050 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:13.168559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.174764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c2c515c0-2422-48e9-b124-2ef45afead23 req-d245ada7-3d1a-4324-be36-21d19b597ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c46a30-9bc6-4310-871c-c58756321660", "tag": "27d86d4f-e22e-4025-9595-7c25c6c7372f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:13.192859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2c515c0-2422-48e9-b124-2ef45afead23 req-d245ada7-3d1a-4324-be36-21d19b597ec5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.194346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2c515c0-2422-48e9-b124-2ef45afead23 req-d245ada7-3d1a-4324-be36-21d19b597ec5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.195159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2c515c0-2422-48e9-b124-2ef45afead23 req-d245ada7-3d1a-4324-be36-21d19b597ec5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.220447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c2c515c0-2422-48e9-b124-2ef45afead23 req-d245ada7-3d1a-4324-be36-21d19b597ec5 service nova] Creating event network-changed:27d86d4f-e22e-4025-9595-7c25c6c7372f for instance f0c46a30-9bc6-4310-871c-c58756321660 on n-h1-858238-3 Nov 02 13:43:13.246517 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c2c515c0-2422-48e9-b124-2ef45afead23 req-d245ada7-3d1a-4324-be36-21d19b597ec5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076818 Nov 02 13:43:13.247395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 301/618] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:13.255679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:13.257953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:13.280836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.283373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.284447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.285973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.287055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.290044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.724077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:13.827231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:13.838382 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-645135a4-fe76-4456-8ed4-180d284f4953 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.588807 Nov 02 13:43:13.852630 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 302/619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:13 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:13.862587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8169e59-d6a0-4edd-8a16-a69424518ad1", "tag": "cbc2b2f0-a287-4e97-aa3b-58d2e0db3533"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:13.881200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.882180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.882948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.903704 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] Creating event network-changed:cbc2b2f0-a287-4e97-aa3b-58d2e0db3533 for instance c8169e59-d6a0-4edd-8a16-a69424518ad1 on n-h1-858238-3 Nov 02 13:43:13.911549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:43:13.932161 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-be56f007-2930-459e-8b7f-e35da50a266b req-1cb678f4-c6a8-44cb-8fd0-66e8dd72252a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077694 Nov 02 13:43:13.932789 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 303/620] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:13.940773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e0b2828-17fe-4768-88f0-9696e25a8f8a tempest-NetworksTest-804495231 tempest-NetworksTest-804495231-project-admin] Calling method '.version_select at 0x7f6f823b9310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.068710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:14.090585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f0125d3-f0c9-4106-b801-fe3c9787a387 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1476 microversion: 2.1 time: 0.949944 Nov 02 13:43:14.094182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 318/621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:13 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1476 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:14.101099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.102662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:14.110850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.111683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.112761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.113858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.114831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.115483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.388766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:14.398023 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c6a4eab5-235b-465f-88f6-d47586a717e5 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1314 microversion: 2.1 time: 0.301892 Nov 02 13:43:14.449062 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 319/622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:14 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:14.474285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.480918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.481541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.482926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.484105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.484794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.485400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.510012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:14.538504 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a84b7279-35eb-4e90-b4d7-a89c73844db0 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076278 Nov 02 13:43:14.541555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 320/623] 10.222.0.18 () {60 vars in 1217 bytes} [Wed Nov 2 13:43:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:43:14.563664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.565065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:14.576765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.577784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.579290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.581186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.582493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.583435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.815658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e0b2828-17fe-4768-88f0-9696e25a8f8a tempest-NetworksTest-804495231 tempest-NetworksTest-804495231-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks/b97a9e12-2fb3-456c-8ab0-aa34fb4c040d" status: 200 len: 652 microversion: 2.1 time: 0.880807 Nov 02 13:43:14.817594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 304/624] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:43:13 2022] GET /compute/v2.1/os-networks/b97a9e12-2fb3-456c-8ab0-aa34fb4c040d => generated 652 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:14.825979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:14.827148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:14.838608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.840526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.842679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.843891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.844597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.845455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.896421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:14.906148 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ebb861c8-6c0f-44ac-b0c6-eddabe438b94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 0.362843 Nov 02 13:43:14.910900 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 321/625] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:14 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:14.916612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:14.918803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c075eba8-5895-47f6-baad-dbb5b9f9b601 tempest-NetworksTest-804495231 tempest-NetworksTest-804495231-project-admin] Calling method '.version_select at 0x7f6f822411f0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.944080 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f192b72-c0e3-4cec-ab10-1a1c546e4fd2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1/action" status: 202 len: 0 microversion: 2.25 time: 0.123494 Nov 02 13:43:14.944816 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 305/626] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:43:14 2022] POST /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:14.954748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.955564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:14.962731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.963350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.963863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.964705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.965230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.965751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.455077 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c075eba8-5895-47f6-baad-dbb5b9f9b601 tempest-NetworksTest-804495231 tempest-NetworksTest-804495231-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 6750 microversion: 2.1 time: 0.540870 Nov 02 13:43:15.462938 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 322/627] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:43:14 2022] GET /compute/v2.1/os-networks => generated 6750 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:15.467842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:15.468450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:15.479986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.480479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.480911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.481616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.490014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.490519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.589699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=20 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:15.822329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:15.856327 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fa0f6106-35b4-4f9c-9a8b-8d605cc42faa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 2035 microversion: 2.25 time: 0.392027 Nov 02 13:43:15.858346 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 323/628] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:15 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 2035 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:15.872521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:15.873609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:15.881636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.882332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.882964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.885216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.886124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.886847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.057061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:16.070988 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a05822d7-943d-4874-91a5-661266689e89 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 1.121508 Nov 02 13:43:16.071909 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 306/629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:14 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:16.076750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-14a85fc4-756c-44a6-b8f0-c73f41cd25cf req-2f879f9b-0620-4128-85b6-43e141073c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d157f09d-638c-42c0-b885-8795ad3c5837", "tag": "7a3afd1d-b54c-48be-9590-7efdb54b80eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:16.089951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-14a85fc4-756c-44a6-b8f0-c73f41cd25cf req-2f879f9b-0620-4128-85b6-43e141073c32 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.091732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-14a85fc4-756c-44a6-b8f0-c73f41cd25cf req-2f879f9b-0620-4128-85b6-43e141073c32 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.092532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-14a85fc4-756c-44a6-b8f0-c73f41cd25cf req-2f879f9b-0620-4128-85b6-43e141073c32 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.105634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-14a85fc4-756c-44a6-b8f0-c73f41cd25cf req-2f879f9b-0620-4128-85b6-43e141073c32 service nova] Creating event network-changed:7a3afd1d-b54c-48be-9590-7efdb54b80eb for instance d157f09d-638c-42c0-b885-8795ad3c5837 on n-h2-858238-3 Nov 02 13:43:16.110696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:16.112706 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-14a85fc4-756c-44a6-b8f0-c73f41cd25cf req-2f879f9b-0620-4128-85b6-43e141073c32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039150 Nov 02 13:43:16.113328 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 307/630] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:16.122404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d89063c8-dfc3-4a65-ad27-2a17d91b6bb3 req-c6c65831-81fc-4514-b91c-1e09a5511905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01e1ba0-4d30-4622-a442-dae576c272f9", "name": "network-vif-plugged", "status": "completed", "tag": "ac2e8ead-f207-4418-996a-c2e3359f9b2f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:16.130004 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-066bdb6a-b16e-487e-a2b9-6eb9851a0bdb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1474 microversion: 2.1 time: 0.268526 Nov 02 13:43:16.131461 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 324/631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:15 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:16.138139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d89063c8-dfc3-4a65-ad27-2a17d91b6bb3 req-c6c65831-81fc-4514-b91c-1e09a5511905 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.139277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d89063c8-dfc3-4a65-ad27-2a17d91b6bb3 req-c6c65831-81fc-4514-b91c-1e09a5511905 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.139868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d89063c8-dfc3-4a65-ad27-2a17d91b6bb3 req-c6c65831-81fc-4514-b91c-1e09a5511905 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.149073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:16.150309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:16.158545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d89063c8-dfc3-4a65-ad27-2a17d91b6bb3 req-c6c65831-81fc-4514-b91c-1e09a5511905 service nova] Creating event network-vif-plugged:ac2e8ead-f207-4418-996a-c2e3359f9b2f for instance a01e1ba0-4d30-4622-a442-dae576c272f9 on n-h2-858238-3 Nov 02 13:43:16.161848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.166122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.166861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.168922 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d89063c8-dfc3-4a65-ad27-2a17d91b6bb3 req-c6c65831-81fc-4514-b91c-1e09a5511905 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054049 Nov 02 13:43:16.171050 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 308/632] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:16.171391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.172382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.173302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.178386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:16.179469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:16.187159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.188009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.188677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.189981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.190853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.191530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.480042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:16.490981 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6580826e-5a3c-4e3c-826a-5072a46d8f08 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1314 microversion: 2.1 time: 0.358239 Nov 02 13:43:16.492008 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 325/633] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:16 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:16.496888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858238-3", "block_migration": "auto"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:16.500796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:16.507399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.509678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.510734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.511711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.512362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.513644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.694092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'flavor' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:16.800078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:16.809428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Going to try to live migrate instance to n-h2-858238-3 {{(pid=137558) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:43:16.813869 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d203cf05-ce80-4b2f-bc20-aebbfda9ad84 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1589 microversion: 2.1 time: 0.636065 Nov 02 13:43:16.827776 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 309/634] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:16 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1589 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:16.848273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:16.849095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:16.870980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.872302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.873573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.874924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.875645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.886203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.263056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:18.275953 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa393dcb-b069-4ec5-8d51-9aad672ae689 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 1.446500 Nov 02 13:43:18.276705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 310/635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:16 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:18.284838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a944552c-b24f-4bf8-bffa-b24a0816b48b", "name": "network-vif-unplugged", "status": "completed", "tag": "81c1e916-e331-4ec8-bd6d-bb2cc1c715ad"}, {"name": "network-changed", "server_uuid": "187acb18-1b79-484c-abce-d04e4f964c1e", "tag": "7580a147-c698-4d66-991e-fba7f3a2050b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:18.319020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.319794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.320404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.337047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] Creating event network-vif-unplugged:81c1e916-e331-4ec8-bd6d-bb2cc1c715ad for instance a944552c-b24f-4bf8-bffa-b24a0816b48b on n-h2-858238-3 Nov 02 13:43:18.337907 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] Creating event network-changed:7580a147-c698-4d66-991e-fba7f3a2050b for instance 187acb18-1b79-484c-abce-d04e4f964c1e on n-h2-858238-3 Nov 02 13:43:18.347409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6e9c0052-f918-4274-96bb-dec4e0559bdd req-620bf4ce-e6ad-42d1-9c91-8a0d2fc2dd74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.069096 Nov 02 13:43:18.348190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 311/636] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:18.354459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:18.357022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:18.371419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.373681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.374237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.375224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.375792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.376494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.016158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:19.024913 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-350c37dd-3a7b-48ab-b46c-94dad5ade812 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.675376 Nov 02 13:43:19.039834 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 312/637] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:18 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:19.048501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:19.049386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:19.055896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.056611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.057192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.058074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.058666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.059273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.020416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:20.111314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d11d91b-b962-4ec2-8c09-1cfea70b2512 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1471 microversion: 2.1 time: 1.064898 Nov 02 13:43:20.139492 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 313/638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:19 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1471 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:20.167736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:20.170579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.208536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.210748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.211676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.213508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.221423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.222175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.278680 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-51016051-abf3-4221-9755-a0df4a61276d tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1/action" status: 202 len: 0 microversion: 2.25 time: 3.785502 Nov 02 13:43:20.279655 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 326/639] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:43:16 2022] POST /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1/action => generated 0 bytes in 3787 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:20.289233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:20.289844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.315979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.316755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.317346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.318227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.318827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.331837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.553075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:20.564015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-527ac906-3725-407b-94d7-f3d163e86ff3 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1464 microversion: 2.1 time: 0.418625 Nov 02 13:43:20.565233 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 314/640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:20 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1464 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:20.570587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:20.571530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.578817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.579619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.580213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.581225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.581892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.582467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.892631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:20.907421 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-864c9335-b9d2-4034-b198-2e4d9f40da97 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.340715 Nov 02 13:43:20.908077 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 315/641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:20 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:20.921596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:20.923267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.937484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.940485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.942577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.945063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.946418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.947612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.103623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd953779-db7f-4552-a42f-ae97f1bbd96f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1/action" status: 204 len: 0 microversion: 2.1 time: 0.193101 Nov 02 13:43:21.111701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:21.132620 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 316/642] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:20 2022] POST /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1/action => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:21.135607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-81a1a6aa-e0cb-49ef-8e7e-7f5ee11390c0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 0.853247 Nov 02 13:43:21.135607 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 327/643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:20 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:21.152144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:21.154601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:21.171132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a2d0750d-9937-4d82-b616-fd3ce4b8d5fc req-58b14ce2-962d-41d7-aee2-50f74e8229f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a944552c-b24f-4bf8-bffa-b24a0816b48b", "tag": "81c1e916-e331-4ec8-bd6d-bb2cc1c715ad"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:21.175907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.178877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.179363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.186754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.187296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.191415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.213691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a2d0750d-9937-4d82-b616-fd3ce4b8d5fc req-58b14ce2-962d-41d7-aee2-50f74e8229f3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.214573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a2d0750d-9937-4d82-b616-fd3ce4b8d5fc req-58b14ce2-962d-41d7-aee2-50f74e8229f3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.215303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a2d0750d-9937-4d82-b616-fd3ce4b8d5fc req-58b14ce2-962d-41d7-aee2-50f74e8229f3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.251492 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a2d0750d-9937-4d82-b616-fd3ce4b8d5fc req-58b14ce2-962d-41d7-aee2-50f74e8229f3 service nova] Creating event network-changed:81c1e916-e331-4ec8-bd6d-bb2cc1c715ad for instance a944552c-b24f-4bf8-bffa-b24a0816b48b on n-h2-858238-3 Nov 02 13:43:21.290238 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a2d0750d-9937-4d82-b616-fd3ce4b8d5fc req-58b14ce2-962d-41d7-aee2-50f74e8229f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150696 Nov 02 13:43:21.297084 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 328/644] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:21.702039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Calling method '.version_select at 0x7f6f823e7790>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:21.736542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.738980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.756876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.774171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:21.804204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:21.812961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:21.826620 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e7a10b3-96ee-41e0-9a3a-86c2b19d94a5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.698850 Nov 02 13:43:21.830643 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 317/645] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:21 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:21.840414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:21.841105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:21.880381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.881099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.881746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.882978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.890671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.893463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.927842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.928999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.930225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.030063 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7a329e2c-7d2d-4ce0-9011-6562fe35124a tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/2f103e51a58e4d68881209163bd0f4ea?start=2022-11-01T13%3A43%3A20.586486&end=2022-11-03T13%3A43%3A20.586486" status: 200 len: 695 microversion: 2.1 time: 0.721692 Nov 02 13:43:22.040556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 329/646] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Nov 2 13:43:21 2022] GET /compute/v2.1/os-simple-tenant-usage/2f103e51a58e4d68881209163bd0f4ea?start=2022-11-01T13%3A43%3A20.586486&end=2022-11-03T13%3A43%3A20.586486 => generated 695 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:22.050613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:22.052363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:22.082403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.087854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.095172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.097029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.100951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.104218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.532945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:22.571484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8bcd994-70bd-490b-a26e-f851e0456ba3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1471 microversion: 2.1 time: 0.739532 Nov 02 13:43:22.575555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 318/647] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:21 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1471 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:22.592663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '.version_select at 0x7f6f820cfe50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:22.616554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.619198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.622624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.708548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.714026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.717074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.816429 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6e7ec00-38be-4ed5-9c83-343876736a48 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/2f103e51a58e4d68881209163bd0f4ea?start=2022-11-01T13%3A43%3A20.586486&end=2022-11-03T13%3A43%3A20.586486" status: 200 len: 695 microversion: 2.1 time: 0.239112 Nov 02 13:43:22.829124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 319/648] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Nov 2 13:43:22 2022] GET /compute/v2.1/os-simple-tenant-usage/2f103e51a58e4d68881209163bd0f4ea?start=2022-11-01T13%3A43%3A20.586486&end=2022-11-03T13%3A43%3A20.586486 => generated 695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:22.866430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:22.869096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:22.900454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.901064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.918113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.920353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.921156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.929367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.395329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:23.408006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e426c18f-0a3a-4bb9-acc2-c24e89390baf tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 0.577070 Nov 02 13:43:23.414746 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 320/649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:22 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:23.423876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-311c1c45-8c5a-4674-9282-faa4fbff77d7 req-fbbbb780-6ef6-4639-96b3-e35035eaea3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d157f09d-638c-42c0-b885-8795ad3c5837", "name": "network-vif-plugged", "status": "completed", "tag": "7a3afd1d-b54c-48be-9590-7efdb54b80eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:23.463285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-311c1c45-8c5a-4674-9282-faa4fbff77d7 req-fbbbb780-6ef6-4639-96b3-e35035eaea3f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.474030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-311c1c45-8c5a-4674-9282-faa4fbff77d7 req-fbbbb780-6ef6-4639-96b3-e35035eaea3f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.482139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-311c1c45-8c5a-4674-9282-faa4fbff77d7 req-fbbbb780-6ef6-4639-96b3-e35035eaea3f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.512844 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-311c1c45-8c5a-4674-9282-faa4fbff77d7 req-fbbbb780-6ef6-4639-96b3-e35035eaea3f service nova] Creating event network-vif-plugged:7a3afd1d-b54c-48be-9590-7efdb54b80eb for instance d157f09d-638c-42c0-b885-8795ad3c5837 on n-h2-858238-3 Nov 02 13:43:23.524045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-311c1c45-8c5a-4674-9282-faa4fbff77d7 req-fbbbb780-6ef6-4639-96b3-e35035eaea3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107466 Nov 02 13:43:23.527446 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 321/650] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:23.540464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Calling method '.version_select at 0x7f6f8241b790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:23.567830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.568731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.569545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.649585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.654631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.656701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.764313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6963d83-f17c-4e9a-9135-404b9931018c tempest-TenantUsagesTestJSON-924128348 tempest-TenantUsagesTestJSON-924128348-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A43%3A20.586486&end=2022-11-03T13%3A43%3A20.586486&detailed=1" status: 200 len: 8170 microversion: 2.1 time: 0.234145 Nov 02 13:43:23.765535 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 322/651] 10.222.0.18 () {58 vars in 1335 bytes} [Wed Nov 2 13:43:23 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A43%3A20.586486&end=2022-11-03T13%3A43%3A20.586486&detailed=1 => generated 8170 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:23.775590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:23.784123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:23.799693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.805656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.807184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.814507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.815388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.816058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.844343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:23.865896 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0e31dc74-d5a1-4308-ab18-fc7f8d893e1e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 1.823190 Nov 02 13:43:23.870991 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 330/652] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:22 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:23.880628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:23.884810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:23.904775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.905766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.906463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.907538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.908230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.911176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.144160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.155039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.156543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.157736 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f70a77a-3dd2-4673-a217-c859e5c5784b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.389460 Nov 02 13:43:24.158291 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 323/653] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:23 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:24.181090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f3d28653-2a6c-427e-9a14-03e783217eb8 req-1ac02371-9121-45e3-97e0-b4f60e883bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1", "name": "network-vif-unplugged", "status": "completed", "tag": "f76f283a-7454-4b94-a823-c32b31a249d0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:24.206555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d28653-2a6c-427e-9a14-03e783217eb8 req-1ac02371-9121-45e3-97e0-b4f60e883bdf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.207919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d28653-2a6c-427e-9a14-03e783217eb8 req-1ac02371-9121-45e3-97e0-b4f60e883bdf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.209261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d28653-2a6c-427e-9a14-03e783217eb8 req-1ac02371-9121-45e3-97e0-b4f60e883bdf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.244647 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f3d28653-2a6c-427e-9a14-03e783217eb8 req-1ac02371-9121-45e3-97e0-b4f60e883bdf service nova] Creating event network-vif-unplugged:f76f283a-7454-4b94-a823-c32b31a249d0 for instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 on n-h1-858238-3 Nov 02 13:43:24.253029 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f3d28653-2a6c-427e-9a14-03e783217eb8 req-1ac02371-9121-45e3-97e0-b4f60e883bdf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093511 Nov 02 13:43:24.253645 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 324/654] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:24.274098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:24.274958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:24.311724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.315375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.316028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.316952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.317563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.319453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.357884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:24.427085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:24.514393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.519036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:24.534268 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b14428fd-c2d4-44de-a0fe-5c20b077bc5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1471 microversion: 2.1 time: 0.660201 Nov 02 13:43:24.536191 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 331/655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:23 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1471 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:24.556519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d5332df-82ae-4f12-99e7-38b964318dad tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 204 len: 0 microversion: 2.1 time: 0.297925 Nov 02 13:43:24.562440 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 325/656] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:43:24 2022] DELETE /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:24.585820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:24.603667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:24.623471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.624278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.625342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.628362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.629290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.631518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.878171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1351486116", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:24.963484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.988179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6ad891e-c32d-4878-a778-355d177429bd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 0.423552 Nov 02 13:43:24.989098 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 326/657] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:24 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:24.999360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:25.015282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:25.016445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:25.028637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.030546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.031327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.032615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.033426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.034418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.288463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:25.301301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7df0a86-71aa-407a-8b74-e78f5c720b4c tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1470 microversion: 2.1 time: 0.297406 Nov 02 13:43:25.304311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 327/658] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:25 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:25.308634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:25.309410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:25.317818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.318266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.318916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.319776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.320343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.320872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.539267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:25.555761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6d24351-3d1d-45e5-b560-91b422e10f8f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.251258 Nov 02 13:43:25.556993 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 328/659] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:25 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:25.567890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:25.569095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:25.578094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.578945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.579485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.580257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.580718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.581141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.864588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:25.865159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:25.865735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:25.866246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:25.866788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:25.878150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.878785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.879447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.880365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.880974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.881504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.908437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Getting quotas for project 79f7aaa6112b46a7bf98f60b687df626. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:25.916850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Getting quotas for user 1bdb941a8c874faca7f7a85763d242e1 and project 79f7aaa6112b46a7bf98f60b687df626. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:25.936367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:25.939074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:26.004433 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-13d56ee6-9a8a-4df2-92c3-2ea94f1db27d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466461 Nov 02 13:43:26.005297 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 332/660] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:26.009972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c46a30-9bc6-4310-871c-c58756321660", "name": "network-vif-plugged", "status": "completed", "tag": "27d86d4f-e22e-4025-9595-7c25c6c7372f"}, {"server_uuid": "c8169e59-d6a0-4edd-8a16-a69424518ad1", "name": "network-vif-plugged", "status": "completed", "tag": "cbc2b2f0-a287-4e97-aa3b-58d2e0db3533"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:26.022782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.023656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.024331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.047849 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Creating event network-vif-plugged:27d86d4f-e22e-4025-9595-7c25c6c7372f for instance f0c46a30-9bc6-4310-871c-c58756321660 on n-h1-858238-3 Nov 02 13:43:26.048763 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Creating event network-vif-plugged:cbc2b2f0-a287-4e97-aa3b-58d2e0db3533 for instance c8169e59-d6a0-4edd-8a16-a69424518ad1 on n-h1-858238-3 Nov 02 13:43:26.054160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.063938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.065722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.066964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5ea14a7a-07da-4176-a1d6-b4762adecb03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.507590 Nov 02 13:43:26.070417 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 329/661] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:25 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:26.086102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.087239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:26.089115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:43:26.101635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.103023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.103929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.105161 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b2a39f32-3351-4d78-9072-dc40ea2a0425 req-0add426f-cfa0-454e-abb0-d8851dd63faf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098559 Nov 02 13:43:26.105769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.106843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.109540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.110514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 333/662] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:26.117920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f201f16c-e609-40a0-b60b-e48afb048018 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.118914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f201f16c-e609-40a0-b60b-e48afb048018 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:26.320833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f201f16c-e609-40a0-b60b-e48afb048018 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.340543 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f201f16c-e609-40a0-b60b-e48afb048018 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1223 microversion: 2.1 time: 0.225824 Nov 02 13:43:26.343378 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 334/663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1223 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:26.359555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.362203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:26.383316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.385431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.387302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.390400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.391184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.392177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.528553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.548600 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe100a34-29e9-469b-9d5f-a65315517109 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1471 microversion: 2.1 time: 0.474131 Nov 02 13:43:26.550076 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 330/664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:26.559855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ec11afb6-53d6-4961-8a2f-8ac1eac2d2c0 req-a871ce15-9dca-4769-ac40-bd5db1959a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1", "tag": "f76f283a-7454-4b94-a823-c32b31a249d0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:26.581846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ec11afb6-53d6-4961-8a2f-8ac1eac2d2c0 req-a871ce15-9dca-4769-ac40-bd5db1959a00 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.583047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ec11afb6-53d6-4961-8a2f-8ac1eac2d2c0 req-a871ce15-9dca-4769-ac40-bd5db1959a00 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.584975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ec11afb6-53d6-4961-8a2f-8ac1eac2d2c0 req-a871ce15-9dca-4769-ac40-bd5db1959a00 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.656756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ec11afb6-53d6-4961-8a2f-8ac1eac2d2c0 req-a871ce15-9dca-4769-ac40-bd5db1959a00 service nova] Creating event network-changed:f76f283a-7454-4b94-a823-c32b31a249d0 for instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 on n-h1-858238-3 Nov 02 13:43:26.682171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ec11afb6-53d6-4961-8a2f-8ac1eac2d2c0 req-a871ce15-9dca-4769-ac40-bd5db1959a00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129912 Nov 02 13:43:26.689702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 331/665] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:26.707217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.724437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:26.751777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.752657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.753408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.754693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.759207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.762269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.063025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.071994 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf4874b5-1433-4eb3-aca1-06a4f63ce3ac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1319 microversion: 2.1 time: 0.726605 Nov 02 13:43:27.087586 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 335/666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:27.095464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.096540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.106119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.106883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.107536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.108255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.108868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.109456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.192247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.205589 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41a4848a-47d7-40f3-9b99-c0040e231c7d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1470 microversion: 2.1 time: 0.510304 Nov 02 13:43:27.206351 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 332/667] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1470 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:27.213200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.214816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.226627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.227535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.228224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.230558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.232213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.232610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.492569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.505635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.525186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.532599 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd9a489c-23fe-4d49-a644-2056a1350319 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.321743 Nov 02 13:43:27.535546 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 333/668] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:27.565063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.570825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.591817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.597055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.598661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.600255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.601092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.602084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.916809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.917397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.930223 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ed3c3b4-5000-4356-8ced-f119106bba3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.840987 Nov 02 13:43:27.935224 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87057fe3-ad37-4d8a-93fe-4dafc08f0cb5 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1219 microversion: 2.1 time: 0.397561 Nov 02 13:43:27.948304 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 336/669] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:27.951984 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 334/670] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1219 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:27.956994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.959073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.972797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.973442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.974957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.977286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.977789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.978268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.122166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:28.130201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:28.189765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.191717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.192403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.195428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.196200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.197987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.570646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:28.595041 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2897b11e-f424-40e3-a551-ac67ebd93a5c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1471 microversion: 2.1 time: 0.643591 Nov 02 13:43:28.603592 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 337/671] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:28.626146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:28.628202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:28.637174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.638188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.639701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.640651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.641311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.641967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.828738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:28.847386 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ad3ddea-7838-4f83-851f-60150249b7f7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1469 microversion: 2.1 time: 0.750044 Nov 02 13:43:28.848659 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 335/672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:28 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1469 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:28.918842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6da6cea1-6b91-47d8-be07-12a8cf23e21f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Action: 'create', calling method: .version_select at 0x7f6f8241b670>, body: {"keypair": {"name": "tempest-keypair-751331790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJnSsF8uZdSOIgVhpsllgce5M8+YCKenrd7JPlFXLTXnup9fFpcAXmqlzGPvmhlK3vxkesLcTuxOx8a9I5xvuGhDI/mkdwCTaCOcCgS6ni+17YxGytcmiW2O3s1RwtW6A=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:28.978296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6da6cea1-6b91-47d8-be07-12a8cf23e21f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Getting quotas for project 3f456c505e374d62a0185db1764f0911. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:28.986656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6da6cea1-6b91-47d8-be07-12a8cf23e21f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Getting quotas for user 17b9d516e828485a931fb97ba2d3c43c and project 3f456c505e374d62a0185db1764f0911. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:29.033515 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6da6cea1-6b91-47d8-be07-12a8cf23e21f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182754 Nov 02 13:43:29.037924 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 336/673] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:43:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:29.048227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:29.049246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:29.062971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.067005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.067677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.069129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.069596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.070028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.110032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.117905 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0004ff94-1abf-45b6-bac8-a5bbaa86d01d tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1470 microversion: 2.1 time: 0.512370 Nov 02 13:43:29.135497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 338/674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:28 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:29.145856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:29.154795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:29.163280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:29.165251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.166332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.166786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.167565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.168111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.168450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.216586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:29.566870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.579527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.581271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.582514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6eef2f4-f528-4a38-853a-9e9b79753359 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.543032 Nov 02 13:43:29.583082 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 337/675] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:29 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:29.618768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.644082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-89bf8c1e-a89c-4a97-a61c-628021c50152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 200 len: 1468 microversion: 2.1 time: 0.506730 Nov 02 13:43:29.645028 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 339/676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:29 2022] GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:29.652921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:29.655022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:29.679663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.680515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.682436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.682929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:29.683655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.684542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.685163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.685283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:29.705304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.705802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.706240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.706952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:29.709562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:29.710028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.954275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.965519 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ced45a6a-26c8-4fb7-8c29-0ce871afe562 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1281 microversion: 2.1 time: 0.317213 Nov 02 13:43:29.973662 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 340/677] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:29 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:29.979019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:29.987493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:30.009632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.010131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.010569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.011321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.011776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.012202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.070286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.100016 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f9efde4-6ef3-4406-81eb-6cb3f5971c5f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1500 microversion: 2.1 time: 0.495440 Nov 02 13:43:30.120782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 338/678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:29 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1500 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:30.139076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3c2900e3-c683-4ac6-80c7-f17ae0ad1cc1 req-9a804b3a-c52b-464c-b232-bb6599ac3743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01e1ba0-4d30-4622-a442-dae576c272f9", "name": "network-vif-deleted", "tag": "ac2e8ead-f207-4418-996a-c2e3359f9b2f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:30.153626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c2900e3-c683-4ac6-80c7-f17ae0ad1cc1 req-9a804b3a-c52b-464c-b232-bb6599ac3743 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.154737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c2900e3-c683-4ac6-80c7-f17ae0ad1cc1 req-9a804b3a-c52b-464c-b232-bb6599ac3743 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.155407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c2900e3-c683-4ac6-80c7-f17ae0ad1cc1 req-9a804b3a-c52b-464c-b232-bb6599ac3743 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.168794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c2900e3-c683-4ac6-80c7-f17ae0ad1cc1 req-9a804b3a-c52b-464c-b232-bb6599ac3743 service nova] Creating event network-vif-deleted:ac2e8ead-f207-4418-996a-c2e3359f9b2f for instance a01e1ba0-4d30-4622-a442-dae576c272f9 on n-h2-858238-3 Nov 02 13:43:30.175571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3c2900e3-c683-4ac6-80c7-f17ae0ad1cc1 req-9a804b3a-c52b-464c-b232-bb6599ac3743 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052515 Nov 02 13:43:30.177514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 339/679] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:30.183409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:30.191025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.192138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Searching by: {'reservation_id': 'r-s610yl1a', 'deleted': False, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:43:30.199028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.199650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.201508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.202548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.203073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.203667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.320011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:43:30.394954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.407624 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ab96947e-61a5-4728-9254-bcb918461c70 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1463 microversion: 2.1 time: 0.429893 Nov 02 13:43:30.411133 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 341/680] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:29 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1463 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:30.421750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:30.425750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:30.439972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.442729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.443666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.446455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.447201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.447792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.460424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.481589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.486140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.487069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.531324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.531755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.532230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.532691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lazy-loading 'fault' on Instance uuid a01e1ba0-4d30-4622-a442-dae576c272f9 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:30.645254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34c673cd0054881b58a1b848dfc81c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f103e51a58e4d68881209163bd0f4ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.653463 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-97d98f3a-a6a4-42cc-8e0e-9de18a3daec4 tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 200 len: 1304 microversion: 2.1 time: 0.240942 Nov 02 13:43:30.661989 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 342/681] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:30 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:30.668654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:30.670476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:30.680777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.681423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.682184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.689909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.690657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.691350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.812726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f3630dc-05cc-436a-9501-554b25986c4b tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-s610yl1a" status: 200 len: 2930 microversion: 2.1 time: 0.633751 Nov 02 13:43:30.814816 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 340/682] 10.222.0.18 () {58 vars in 1197 bytes} [Wed Nov 2 13:43:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-s610yl1a => generated 2930 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:30.820929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:30.821931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:30.837695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.838402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.839886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.840825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.842344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.842934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.067627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:31.071941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:31.084511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:31.086400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:31.087906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f06f244c-6272-428a-b72a-07c7e212fa10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.271846 Nov 02 13:43:31.089289 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 341/683] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:30 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:31.095943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6ac4f7b-b44d-4ed0-8473-592ffd97c381 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.121601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.server_groups [None req-c6ac4f7b-b44d-4ed0-8473-592ffd97c381 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Querying cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) for 2 instances {{(pid=137559) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:43:31.122324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ac4f7b-b44d-4ed0-8473-592ffd97c381 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.122894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ac4f7b-b44d-4ed0-8473-592ffd97c381 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.123663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6ac4f7b-b44d-4ed0-8473-592ffd97c381 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.162199 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6ac4f7b-b44d-4ed0-8473-592ffd97c381 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/fe8a389b-e4c2-4eae-bec6-23014482bb74" status: 200 len: 271 microversion: 2.1 time: 0.071405 Nov 02 13:43:31.163697 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 342/684] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/os-server-groups/fe8a389b-e4c2-4eae-bec6-23014482bb74 => generated 271 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:31.171490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.172501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.189418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.190340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.191513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.195077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.196255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.197156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.289028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:31.298624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28337b6e-2876-43d7-b30c-1e24945134ff tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1281 microversion: 2.1 time: 0.133104 Nov 02 13:43:31.303273 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 343/685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.310612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.311673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.319859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.320501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.321035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.321904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.322402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.322975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.590014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:31.612831 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0e46706-7d87-460e-9936-98e55255abcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1490 microversion: 2.1 time: 0.307672 Nov 02 13:43:31.619163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 344/686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1490 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.624330 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e2520e9b-4158-43a4-bef9-19fab62ea315 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1614 microversion: 2.1 time: 0.965883 Nov 02 13:43:31.624944 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 343/687] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:30 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1614 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.636988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.637839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.642306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e3e14838-31b7-45a8-a780-cdf522bc7b82 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '.version_select at 0x7f6f824cd4c0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.649960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e14838-31b7-45a8-a780-cdf522bc7b82 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.650992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e14838-31b7-45a8-a780-cdf522bc7b82 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.652168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e14838-31b7-45a8-a780-cdf522bc7b82 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.660286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.661035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.661627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.662543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.663183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.664485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.684527 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e3e14838-31b7-45a8-a780-cdf522bc7b82 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1557 microversion: 2.1 time: 0.050785 Nov 02 13:43:31.686928 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 344/688] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/os-migrations => generated 1557 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:31.700185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dfebfd5c-f09f-4110-beab-bc13ac88215b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '.version_select at 0x7f6f8269b310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.707236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfebfd5c-f09f-4110-beab-bc13ac88215b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.708638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfebfd5c-f09f-4110-beab-bc13ac88215b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.709802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfebfd5c-f09f-4110-beab-bc13ac88215b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.728022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dfebfd5c-f09f-4110-beab-bc13ac88215b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1557 microversion: 2.1 time: 0.038176 Nov 02 13:43:31.734087 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 345/689] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/os-migrations => generated 1557 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.743558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.745353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] [instance: a01e1ba0-4d30-4622-a442-dae576c272f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.758260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.760146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.760932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.762452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.763056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.764595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.796058 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] HTTP exception thrown: Instance a01e1ba0-4d30-4622-a442-dae576c272f9 could not be found. Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Request method failure captured: Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 HTTP/1.1 Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnPhuJmjEjt19H3eZfIwUfWuTA5cjAuuiNc96-Rre6wNy0jN9ccP-oH_0s29lh4AJyJ_TA9MPZymPUGSbsI-F1tIey9T3Kbo6-h3GvGDmcV1wufL_5OnBCUlVcwTQVpK6AOC3ur3Kw6QFSjAiAXhD_zdWctR_LBT_kUzQVqcMVa9qdo Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2f103e51a58e4d68881209163bd0f4ea Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TenantUsagesTestJSON-1185773190 Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:43:31.798473 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f103e51a58e4d68881209163bd0f4ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f103e51a58e4d68881209163bd0f4ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f103e51a58e4d68881209163bd0f4ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f103e51a58e4d68881209163bd0f4ea"}]}] Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TenantUsagesTestJSON-1185773190 Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2f103e51a58e4d68881209163bd0f4ea Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1185773190 Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TenantUsagesTestJSON-1185773190-project Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c34c673cd0054881b58a1b848dfc81c0 Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TenantUsagesTestJSON-1185773190-project Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance a01e1ba0-4d30-4622-a442-dae576c272f9 could not be found. Nov 02 13:43:31.800550 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'a01e1ba0-4d30-4622-a442-dae576c272f9'} Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01e1ba0-4d30-4622-a442-dae576c272f9 could not be found. Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:31.802295 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01e1ba0-4d30-4622-a442-dae576c272f9 could not be found. Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01e1ba0-4d30-4622-a442-dae576c272f9 could not be found. Nov 02 13:43:31.805238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:31.807572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] Returning 404 to user: Instance a01e1ba0-4d30-4622-a442-dae576c272f9 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:31.807572 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e05a6ecb-8dd5-4c03-8c19-0561e7ff502e tempest-TenantUsagesTestJSON-1185773190 tempest-TenantUsagesTestJSON-1185773190-project] 10.222.0.18 "GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9" status: 404 len: 111 microversion: 2.1 time: 0.064304 Nov 02 13:43:31.807572 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 346/690] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/a01e1ba0-4d30-4622-a442-dae576c272f9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:31.807572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.807572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.815340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.815931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.816443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.817510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.818289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.819195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.916003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9eff6e3a-4b51-4a62-b6b6-16fd3b5df5ab tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1620 microversion: 2.1 time: 0.299894 Nov 02 13:43:31.917990 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 345/691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1620 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.941885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.943120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.950429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.951836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.952427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.953323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.953974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.955033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:32.324454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-341b64b6-66ad-4f83-882a-0522aef1b689 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 200 len: 1619 microversion: 2.1 time: 0.386430 Nov 02 13:43:32.325056 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 346/692] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 1619 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:32.329892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-97096802", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:32.437682 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-885a6a97-89e9-48f2-bbb6-f77f00efc70c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1641 microversion: 2.1 time: 0.631380 Nov 02 13:43:32.439454 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 347/693] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1641 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:32.458635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:32.459284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:32.479842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:32.512076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:32.512578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:32.513022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:32.513777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:32.525238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:32.526090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.000899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:33.019336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:33.022127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:33.024297 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-885cfb65-2d65-4b77-b24d-2868d807f329 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1567 microversion: 2.25 time: 0.580713 Nov 02 13:43:33.026104 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 348/694] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:32 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1567 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:33.032634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:33.033348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:33.040003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:33.040740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:33.041426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.042328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:33.042854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:33.043385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.158741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:33.159185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:33.160190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:33.161206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:33.161896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:33.172357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:33.173055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:33.173310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.175230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:33.175230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:33.175230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.212123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:33.219717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for user 832cd460bb5e4148a57d561f762ceb11 and project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:33.253665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:33.256770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:33.365835 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83950fea-8cb8-4c80-9c1a-148c2dfacb34 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039583 Nov 02 13:43:33.370451 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 347/695] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:33.380987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1451176950", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "fa9c1616-fc5e-4255-af98-141b90526fe4"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:33.449533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:33.707125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:33.716596 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-146ca688-6a94-410d-b273-9b560a30391f tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.688643 Nov 02 13:43:33.719126 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 349/696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:33 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:33.728004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1428952900", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e0293639-a49a-47d1-9a03-7fbc87f19e62"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:33.865711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] validate_networks() for [('e0293639-a49a-47d1-9a03-7fbc87f19e62', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:34.273086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:34.273661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:34.274968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:34.275884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:34.276520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:34.320814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.323530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.324274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.330972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.333307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.336437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.368598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:34.377943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:34.429499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:34.433881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:34.534286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23bb940d-f791-4c7a-a02f-fa78b313ddfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161642 Nov 02 13:43:34.536250 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 348/697] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:34.549040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:34.550652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:34.561208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.562163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.563007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.563909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.564514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.565375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.965259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:34.966399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:34.967061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:34.967651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:34.968230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:34.986744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.987265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.993397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.994435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.995190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.995782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:35.054777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:35.069965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for user 23d76f5c29444358864d0bc25c83b4b4 and project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:35.094361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:35.098682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:35.210077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.223830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3fad73fc-7155-419f-8e73-cf3b2f709029 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1263 microversion: 2.1 time: 0.682732 Nov 02 13:43:35.225019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 349/698] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:34 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1263 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:35.241189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:35.242883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:35.258360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:35.261200 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e7bc4873-b61f-424d-8abb-16da86eeab8b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537919 Nov 02 13:43:35.261377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:35.261874 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 350/699] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:35.269819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:35.269819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:35.269819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:35.269819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:35.297915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70f9c554-2170-4974-ae45-5f2c7cd467d6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:35.298563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-70f9c554-2170-4974-ae45-5f2c7cd467d6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:35.453415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-70f9c554-2170-4974-ae45-5f2c7cd467d6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.465514 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-70f9c554-2170-4974-ae45-5f2c7cd467d6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1217 microversion: 2.1 time: 0.201948 Nov 02 13:43:35.467230 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 351/700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:35 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:35.473259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:35.474333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:35.507712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:35.508682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:35.509908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:35.511067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:35.515940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:35.517707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:35.678219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.690574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.693157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.695782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83b42c5f-ea7e-47ae-b279-184eca03ec26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1542 microversion: 2.25 time: 0.468739 Nov 02 13:43:35.698003 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 350/701] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:35 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1542 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:35.718891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8f1176ad-b26a-4a06-bffd-e38bfeac5a52 req-e88fe560-a95e-4173-bfa6-5f6629d68a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df283811-c76f-4bdb-b45e-9a5b57d350a3", "tag": "e17a6801-7c83-45b8-8676-3854be9cb7ff"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:35.736258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8f1176ad-b26a-4a06-bffd-e38bfeac5a52 req-e88fe560-a95e-4173-bfa6-5f6629d68a92 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:35.737550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8f1176ad-b26a-4a06-bffd-e38bfeac5a52 req-e88fe560-a95e-4173-bfa6-5f6629d68a92 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:35.738600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8f1176ad-b26a-4a06-bffd-e38bfeac5a52 req-e88fe560-a95e-4173-bfa6-5f6629d68a92 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:35.764634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8f1176ad-b26a-4a06-bffd-e38bfeac5a52 req-e88fe560-a95e-4173-bfa6-5f6629d68a92 service nova] Creating event network-changed:e17a6801-7c83-45b8-8676-3854be9cb7ff for instance df283811-c76f-4bdb-b45e-9a5b57d350a3 on n-h1-858238-3 Nov 02 13:43:35.772454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8f1176ad-b26a-4a06-bffd-e38bfeac5a52 req-e88fe560-a95e-4173-bfa6-5f6629d68a92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072543 Nov 02 13:43:35.773665 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 351/702] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:35.795442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b30c2e42-4b58-450b-9fe2-61eb4ca83c85 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:35.797240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b30c2e42-4b58-450b-9fe2-61eb4ca83c85 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:35.806881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:35.936735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b30c2e42-4b58-450b-9fe2-61eb4ca83c85 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.947920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b30c2e42-4b58-450b-9fe2-61eb4ca83c85 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1211 microversion: 2.1 time: 0.172488 Nov 02 13:43:35.950073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 352/703] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:35 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:35.972319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-69ff8cda-86fb-47c9-aff7-dbc0d77763b6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '.version_select at 0x7f6f8211d820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:35.990143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69ff8cda-86fb-47c9-aff7-dbc0d77763b6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:35.991970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69ff8cda-86fb-47c9-aff7-dbc0d77763b6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:35.993275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69ff8cda-86fb-47c9-aff7-dbc0d77763b6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.055048 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-69ff8cda-86fb-47c9-aff7-dbc0d77763b6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.103609 Nov 02 13:43:36.057890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 353/704] 10.222.0.18 () {60 vars in 1184 bytes} [Wed Nov 2 13:43:35 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:36.073478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:36.074243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:36.094319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.095349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.096801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.099268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.100509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.103003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.469566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:36.490448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-677f5b88-be53-48da-8ead-9571471f1bb5 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 2035 microversion: 2.25 time: 0.422140 Nov 02 13:43:36.492626 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 354/705] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:36 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 2035 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:36.512013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:36.526116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:36.550782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.557516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.558986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.560170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.560711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.561204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.718051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:36.732686 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ac5493c-7f56-4f23-8b4e-f00f25462f61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1269 microversion: 2.1 time: 0.237003 Nov 02 13:43:36.734268 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 355/706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:36 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:36.751216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:36.752232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:36.762636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.764559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.765677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.767799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.769019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.770093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.844688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:36.856779 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c8ec2368-2212-46da-a319-263d68828e63 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 1.387923 Nov 02 13:43:36.858179 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 352/707] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:35 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:36.866118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfab4757-f6d6-4de7-9ec2-b53b2e66c696 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Action: 'create', calling method: .version_select at 0x7f6f827110d0>, body: {"keypair": {"name": "tempest-keypair-1701718549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlqmtMiaRj19KPg+g1bbQ5mJrAgZr+s57jE3WCYVC9pkKWaeatrqb7Pz5DOklpbo3NiI4rjUGTFAtR6b/VavHbuCyOv82uolfx29qdOWfTdo4l2FBijHrc8MAVZezMbbg=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:36.899297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-cfab4757-f6d6-4de7-9ec2-b53b2e66c696 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for project 21ac2eda404042c0871fc312f0b9f705. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:36.912998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-cfab4757-f6d6-4de7-9ec2-b53b2e66c696 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for user 55e26f05091944cb910f81488056c057 and project 21ac2eda404042c0871fc312f0b9f705. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:36.931732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:36.944726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-959977e6-4393-4928-90a3-a496ab72e6dc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1269 microversion: 2.1 time: 0.207588 Nov 02 13:43:36.947520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 356/708] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:36 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1269 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:36.985107 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfab4757-f6d6-4de7-9ec2-b53b2e66c696 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.124805 Nov 02 13:43:36.986587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 353/709] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 13:43:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:43:36.988055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:36.988682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:37.018855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.019426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.021622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.022447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.022917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.023421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.245819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:37.259973 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5c4d61a-4e69-4c10-b38d-cc53e204bb4f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1207 microversion: 2.1 time: 0.281516 Nov 02 13:43:37.262876 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 357/710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:36 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1207 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:37.762729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:37.763871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:37.780723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.784775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.785536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.789807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.790231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.791305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.902773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:37.905202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:37.917072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.917928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.918687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.923977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.925887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.927776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.932741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:37.945019 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b389b7c-70d7-4972-8ac6-8b18dcaa3276 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1269 microversion: 2.1 time: 0.187705 Nov 02 13:43:37.947538 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 354/711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:37 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:37.970736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:37.971549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:37.978998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.979839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.980215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.981095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.982011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.982889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.186286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:38.234215 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e386e172-e91c-4f07-8578-ff74b387c785 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1275 microversion: 2.1 time: 0.266571 Nov 02 13:43:38.235336 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 355/712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:37 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:38.305254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:38.314142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:38.321522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:38.328824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-31081bf6-895e-4770-a105-650650f76a45 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.434642 Nov 02 13:43:38.334486 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 358/713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:37 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:38.350381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.354376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.355658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.358707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.362606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.365981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.781233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:38.797595 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e730aab-09e8-4f5a-892d-6fc46c0a7918 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1271 microversion: 2.1 time: 0.497850 Nov 02 13:43:38.798697 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 356/714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:38 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1271 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:38.972463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:38.975564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:38.996300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.998662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.999750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.003847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.005218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.006219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.261094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:39.261930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:39.271135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.271756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.272477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.273958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.274839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.276263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.461213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:39.476476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-615238a3-f300-4f36-8861-0d118f2a4969 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.510823 Nov 02 13:43:39.477527 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 359/715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:38 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:39.485303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:39.487140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:39.504566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.506293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.514934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.517572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.519892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.520631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:39.523791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.532475 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f16eb78-01f0-48c7-b0a8-8a2e24034cfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1275 microversion: 2.1 time: 0.275456 Nov 02 13:43:39.539403 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 357/716] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:39 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:39.836495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:39.837593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:39.847292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.848380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.849008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.850698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.851374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.852152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.086184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:40.100274 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb021ba4-ff96-49c6-a632-acdfe10cb198 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.620536 Nov 02 13:43:40.102318 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 360/717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:39 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:40.311173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:40.338331 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4b62764c-3f81-4d02-85b8-b63e2ce9e5d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1269 microversion: 2.1 time: 0.507062 Nov 02 13:43:40.338925 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 358/718] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:39 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1269 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:40.504471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:40.505209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:40.523995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.525782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.527659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.528487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.529567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.535700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.567959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:40.568844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:40.579280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.581295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.584417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.585376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.588313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.590106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.910384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:40.928995 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6b6cf5d-a608-491f-970b-660cf7d4fff6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1275 microversion: 2.1 time: 0.363384 Nov 02 13:43:40.931930 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 359/719] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:40 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:40.942892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2077041286", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e66fe5e6-396f-407f-9138-ece1c71d4efa"}], "security_groups": [{"name": "tempest-securitygroup--337154930"}], "key_name": "tempest-keypair-1701718549", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:41.000823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:41.014526 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b6ca163-a2e9-4285-81d3-a4c5f509561f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.513970 Nov 02 13:43:41.028507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 361/720] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:40 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:41.133468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:41.134884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:41.146276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.152836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.155667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.159657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.163589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.166427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.176070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:41.405031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] validate_networks() for [('e66fe5e6-396f-407f-9138-ece1c71d4efa', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:41.515826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:41.526707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ef90b39-6557-4c82-b47d-3011fa5ea135 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.405123 Nov 02 13:43:41.530455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 362/721] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:41 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:41.535824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:41.539494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:41.557976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.558809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.559145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.560685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.561035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.561460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.695339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:41.717944 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b36a4f0-9aaf-4c16-9bd7-c09498d525cc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1269 microversion: 2.1 time: 0.183759 Nov 02 13:43:41.720716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 363/722] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:41 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:41.960713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:41.961624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:41.985233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.987505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.989841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.992572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.994638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.995704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.406161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:42.415427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8eb1ae86-5f0b-4c59-b913-f10e1be9cc55 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.460617 Nov 02 13:43:42.421808 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 364/723] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:41 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:42.436664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:42.436664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:42.446929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.447586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.448119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.460143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.460810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.461348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.830445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:42.852941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1dcbddd7-3c46-44d6-bfc7-ab970065cb37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.429729 Nov 02 13:43:42.861707 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 365/724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:42 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:42.869112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3551c102-fd8a-4538-9451-bfd88286142f req-16c64067-54a3-45fd-b09a-4266ddef323f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51abafa0-0a60-40be-a3fb-e3a2432312a3", "tag": "170b76f2-e7e1-4778-9b1d-ddb44c16387a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:42.881426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3551c102-fd8a-4538-9451-bfd88286142f req-16c64067-54a3-45fd-b09a-4266ddef323f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.882464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3551c102-fd8a-4538-9451-bfd88286142f req-16c64067-54a3-45fd-b09a-4266ddef323f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.883332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3551c102-fd8a-4538-9451-bfd88286142f req-16c64067-54a3-45fd-b09a-4266ddef323f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.903006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3551c102-fd8a-4538-9451-bfd88286142f req-16c64067-54a3-45fd-b09a-4266ddef323f service nova] Creating event network-changed:170b76f2-e7e1-4778-9b1d-ddb44c16387a for instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 on n-h2-858238-3 Nov 02 13:43:42.909462 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3551c102-fd8a-4538-9451-bfd88286142f req-16c64067-54a3-45fd-b09a-4266ddef323f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044729 Nov 02 13:43:42.910989 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 366/725] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:42.918191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:42.919278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:42.927254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.927879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.928392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.929339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.930035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.930748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.327386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:43.328014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:43.328770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:43.329377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:43.329970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:43.360430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.360741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.361206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.361930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.362417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.362973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.390566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=9 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:43.454888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:43.483185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for user 55e26f05091944cb910f81488056c057 and project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:43.516932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:43.529716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:43.645546 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-894caa23-e5c3-411d-bf2d-5e2bfde7dda4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.706987 Nov 02 13:43:43.649005 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 360/726] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:43:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:43:43.660284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:43.663556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:43.681276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.682162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.682839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.683887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.686640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.687414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.698139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:43.742034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:43.759042 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4c383be-b0d7-44fc-a80b-8d150c76fa97 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.842991 Nov 02 13:43:43.762002 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 367/727] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:42 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:43.770140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:43.771566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:43.792906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.802778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.803898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.805214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.806093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.806758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.187231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:44.207711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abcd1ce1-deb4-483c-8872-10e5c0332848 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.443258 Nov 02 13:43:44.212987 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 368/728] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:43 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:44.222752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d83120da-7eee-42a7-b335-9cc52f8ec29d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:44.223495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d83120da-7eee-42a7-b335-9cc52f8ec29d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:44.356963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:44.649842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d83120da-7eee-42a7-b335-9cc52f8ec29d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:44.659148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d83120da-7eee-42a7-b335-9cc52f8ec29d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:44.665143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d83120da-7eee-42a7-b335-9cc52f8ec29d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:44.668370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d83120da-7eee-42a7-b335-9cc52f8ec29d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1286 microversion: 2.25 time: 0.454246 Nov 02 13:43:44.672025 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 369/729] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:44 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1286 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:44.694477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ee492752-1ccc-4db3-9e91-b2c60d4544da req-86eca8cf-7126-4ca1-b1a2-f23eeedaf96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df283811-c76f-4bdb-b45e-9a5b57d350a3", "name": "network-vif-plugged", "status": "completed", "tag": "e17a6801-7c83-45b8-8676-3854be9cb7ff"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:44.706639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ee492752-1ccc-4db3-9e91-b2c60d4544da req-86eca8cf-7126-4ca1-b1a2-f23eeedaf96b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.707417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ee492752-1ccc-4db3-9e91-b2c60d4544da req-86eca8cf-7126-4ca1-b1a2-f23eeedaf96b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.708134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ee492752-1ccc-4db3-9e91-b2c60d4544da req-86eca8cf-7126-4ca1-b1a2-f23eeedaf96b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.724184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ee492752-1ccc-4db3-9e91-b2c60d4544da req-86eca8cf-7126-4ca1-b1a2-f23eeedaf96b service nova] Creating event network-vif-plugged:e17a6801-7c83-45b8-8676-3854be9cb7ff for instance df283811-c76f-4bdb-b45e-9a5b57d350a3 on n-h1-858238-3 Nov 02 13:43:44.730240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ee492752-1ccc-4db3-9e91-b2c60d4544da req-86eca8cf-7126-4ca1-b1a2-f23eeedaf96b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041267 Nov 02 13:43:44.731414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 370/730] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:44.739510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:44.740437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:44.747799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.749208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.749806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.750719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.751353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.751941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.202397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:45.217369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-109f24e4-dcf9-41e3-ae91-e16e5f688192 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.480799 Nov 02 13:43:45.220382 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 371/731] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:44 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:45.227955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:45.250736 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b8da3e6f-ab84-46b4-97e5-d73af3281751 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 1.600253 Nov 02 13:43:45.275371 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 361/732] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:43 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:45.278381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:45.281127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:45.291846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:45.292859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:45.299802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.302048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.304020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.305797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.306428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.307791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.316533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.317056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.326766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.327663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.328150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.328576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.811002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:45.822609 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d3e486b-b055-4384-91bf-7ed8db9494d3 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.601116 Nov 02 13:43:45.830058 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 372/733] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:45 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:45.838978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:45.845647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:45.855681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:45.869951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.873373 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd99d5cb-e4ce-48da-a1bb-fd6c88415d94 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.588260 Nov 02 13:43:45.874017 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 362/734] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:45 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:45.875686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.876919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.879590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.880706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.881394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.075518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:46.100993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:46.103427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:46.109852 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8d81137-ed5c-4077-92cb-a9f02bec614f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1338 microversion: 2.25 time: 0.277771 Nov 02 13:43:46.121252 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 373/735] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:45 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1338 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:46.253132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:46.254430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:46.254637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7b7e10e9-e835-4527-a259-b59889dac9aa req-263d4fa1-d7d4-4806-9ca3-1c4d65f82b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d405ec8-6f09-419d-9e99-df4cf38c9144", "tag": "6e0b8572-13b4-4aa8-aea4-63b21f83a3ea"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:46.283581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.291902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.298926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.303377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.305356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.306901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.312166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7b7e10e9-e835-4527-a259-b59889dac9aa req-263d4fa1-d7d4-4806-9ca3-1c4d65f82b17 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.326270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7b7e10e9-e835-4527-a259-b59889dac9aa req-263d4fa1-d7d4-4806-9ca3-1c4d65f82b17 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.329749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7b7e10e9-e835-4527-a259-b59889dac9aa req-263d4fa1-d7d4-4806-9ca3-1c4d65f82b17 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.373378 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7b7e10e9-e835-4527-a259-b59889dac9aa req-263d4fa1-d7d4-4806-9ca3-1c4d65f82b17 service nova] Creating event network-changed:6e0b8572-13b4-4aa8-aea4-63b21f83a3ea for instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 on n-h2-858238-3 Nov 02 13:43:46.382992 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7b7e10e9-e835-4527-a259-b59889dac9aa req-263d4fa1-d7d4-4806-9ca3-1c4d65f82b17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137287 Nov 02 13:43:46.384596 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 374/736] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:46.394735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:46.395979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:46.409197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.410639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.411690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.413465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.414845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.415887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.675834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:46.685752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b56b84c-5b8f-4cd7-bf14-2932b2008943 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.299293 Nov 02 13:43:46.687806 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 375/737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:46 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:46.867983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:46.867983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:46.895249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.904435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.904885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.912803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.913298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.916525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:47.572023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:47.583336 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80cc3c85-e067-420e-bf0a-6394c66f0fa2 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1323 microversion: 2.1 time: 0.727167 Nov 02 13:43:47.592641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 376/738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:46 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1323 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:47.614331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:47.625585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:47.641211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:47.648349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:47.650299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:47.651315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:47.652204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:47.652782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:47.894137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:47.905074 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d94b7a9-9155-4e09-9535-c8578a0e9068 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 1.663415 Nov 02 13:43:47.910842 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 363/739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:46 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:47.927541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:47.930637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:47.952288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:47.952782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:47.957534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:47.958443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:47.958936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:47.959432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.128118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:48.147201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b5cbfef-94ea-4e84-b1bc-913dc440c428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.552246 Nov 02 13:43:48.148072 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 377/740] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:47 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:48.194957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:48.201583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:48.214398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.214888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.215360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.216083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.217058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.225579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.442482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:48.469500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:48.471947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:48.473322 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0de5f8d0-8e6d-414b-aa45-31bc48a1b79f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1344 microversion: 2.25 time: 0.560677 Nov 02 13:43:48.474171 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 364/741] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:47 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1344 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:48.612182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:48.612964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:48.636343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.636914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.637359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.643461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.644000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.645819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.932396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:48.956335 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f538e5e-ac31-427e-b62c-40fbc321a7de tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.806649 Nov 02 13:43:48.963899 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 378/742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:48 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:48.987423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d3346ab9-a968-47ec-9165-9383aa5fae4d req-c2270db8-8ec5-47b6-95a6-7c04c916703a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe77b17-d974-49f8-9b09-3aa8866fc56e", "tag": "3b0d7cb7-22f9-48b0-9f29-0906adc65935"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:49.034756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d3346ab9-a968-47ec-9165-9383aa5fae4d req-c2270db8-8ec5-47b6-95a6-7c04c916703a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.042473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d3346ab9-a968-47ec-9165-9383aa5fae4d req-c2270db8-8ec5-47b6-95a6-7c04c916703a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.043953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d3346ab9-a968-47ec-9165-9383aa5fae4d req-c2270db8-8ec5-47b6-95a6-7c04c916703a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.074451 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d3346ab9-a968-47ec-9165-9383aa5fae4d req-c2270db8-8ec5-47b6-95a6-7c04c916703a service nova] Creating event network-changed:3b0d7cb7-22f9-48b0-9f29-0906adc65935 for instance ebe77b17-d974-49f8-9b09-3aa8866fc56e on n-h2-858238-3 Nov 02 13:43:49.089421 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d3346ab9-a968-47ec-9165-9383aa5fae4d req-c2270db8-8ec5-47b6-95a6-7c04c916703a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122521 Nov 02 13:43:49.090661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 379/743] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:49.097122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:49.098204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:49.108594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.109716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.110465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.111783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.112740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.113332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.629810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:49.639686 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac8b852f-b922-4b18-99c6-e6e3604f279b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.547555 Nov 02 13:43:49.667497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 380/744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:49 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:49.678709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:49.679292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:49.712885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.717440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.718178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.721331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.722041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.722662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.054625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.072937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f935c72-e53c-43ac-ac46-d2a810b4b7b4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.404182 Nov 02 13:43:50.073846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 381/745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:49 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:50.087646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:50.088656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:50.098343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.099238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.100293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.101502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.102237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.102877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.134143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:50.224476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.235047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.236986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.238667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cdd5591-0144-4ae5-8f7e-8e5125b33a68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1344 microversion: 2.25 time: 0.163753 Nov 02 13:43:50.247130 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 382/746] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:50 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:50.254892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e3c0ece6-d77c-4cf6-96d6-e19280014c1f req-3ade9c89-b4c3-45ef-bdc8-a3a05f9a3997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51abafa0-0a60-40be-a3fb-e3a2432312a3", "name": "network-vif-plugged", "status": "completed", "tag": "170b76f2-e7e1-4778-9b1d-ddb44c16387a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:50.266706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3c0ece6-d77c-4cf6-96d6-e19280014c1f req-3ade9c89-b4c3-45ef-bdc8-a3a05f9a3997 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.267247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3c0ece6-d77c-4cf6-96d6-e19280014c1f req-3ade9c89-b4c3-45ef-bdc8-a3a05f9a3997 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.267681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3c0ece6-d77c-4cf6-96d6-e19280014c1f req-3ade9c89-b4c3-45ef-bdc8-a3a05f9a3997 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.281843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e3c0ece6-d77c-4cf6-96d6-e19280014c1f req-3ade9c89-b4c3-45ef-bdc8-a3a05f9a3997 service nova] Creating event network-vif-plugged:170b76f2-e7e1-4778-9b1d-ddb44c16387a for instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 on n-h2-858238-3 Nov 02 13:43:50.289563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e3c0ece6-d77c-4cf6-96d6-e19280014c1f req-3ade9c89-b4c3-45ef-bdc8-a3a05f9a3997 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039211 Nov 02 13:43:50.299265 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 383/747] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:50.310937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:50.312656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:50.322117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.322609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.323287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.324221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.324871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.325496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.579373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.588562 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e26df3cc-96a1-40a5-bfa5-a134a205b0e7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.283960 Nov 02 13:43:50.589155 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 384/748] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:50 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:50.733835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.764322 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d97e123f-4ed5-4e85-af1f-0abdbfe8a9af tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1473 microversion: 2.1 time: 2.158805 Nov 02 13:43:50.786491 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 365/749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:48 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1473 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:50.819163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:50.820445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:50.837447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.843214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.844481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.848950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.850100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.850934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.940120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1738413780", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "78207ca2-c72f-4aba-a624-6c41b5c5faf0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:51.052779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] validate_networks() for [('78207ca2-c72f-4aba-a624-6c41b5c5faf0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:51.324914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:51.345989 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f765c28e-60ff-4846-885e-f2368bf4d5ca tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.531031 Nov 02 13:43:51.347702 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 366/750] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:50 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:51.355532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:51.356548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:51.388398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.388919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.396379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.399491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.401850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.402402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.480622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Request method failure captured: Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3/diagnostics HTTP/1.1 Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnP6323RZqp6smoCMhzsH2OuyPkPnadKZXz5fzshglhCM9a8lv8-8r1serOeXakmiOPFCQjrcxHHeP9BryT29wYjxlMxho03adiS1kKwvi2O7737zb_UgDVM5PSCye9N0tcqpPjhNnLcaTtpnugUjGBXsY2l58jXJBJZY1eK4GlQcwU Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 79f7aaa6112b46a7bf98f60b687df626 Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-79293669 Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:43:51.501242 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79f7aaa6112b46a7bf98f60b687df626"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79f7aaa6112b46a7bf98f60b687df626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79f7aaa6112b46a7bf98f60b687df626"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79f7aaa6112b46a7bf98f60b687df626"}]}] Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-79293669 Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 79f7aaa6112b46a7bf98f60b687df626 Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-79293669 Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerDiagnosticsNegativeTest-79293669-project Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1bdb941a8c874faca7f7a85763d242e1 Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-79293669-project Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:43:51.503768 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': 'df283811-c76f-4bdb-b45e-9a5b57d350a3'} Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:43:51.505446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:43:51.508773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:51.511407 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99523556-7392-4e4c-9a7f-7a66ce95fbc8 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.155910 Nov 02 13:43:51.523317 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 367/751] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:43:51 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3/diagnostics => generated 117 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:51.538411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:51.541334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:51.557052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.560663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.561359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.564626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.566364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.567735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.744074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:51.744751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:51.745360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:51.745898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:51.746617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:51.763200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.764933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.765867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.766817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.767761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.768680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.792356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Getting quotas for project c7d8d8d2ae5749748ab4fcd40d1bd747. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:51.799534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Getting quotas for user f5d532dce5f14db7a5b029734d672aba and project c7d8d8d2ae5749748ab4fcd40d1bd747. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:51.818127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:51.822226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:51.934339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38cde350-92ba-43e4-9272-368777c49c73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343742 Nov 02 13:43:51.936282 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 385/752] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:51.941778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:51.943292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:51.954850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.955818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.956507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.957704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:51.958394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:51.959051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.128464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.155776 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8e7a30bb-cf1b-466d-b7a9-0ce7f7e57405 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.629745 Nov 02 13:43:52.181862 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 368/753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:51 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:52.207878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:52.208707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:52.224944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:52.229346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.235264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.238125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.242298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.246601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.247053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.249172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.258176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.259977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.261356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-586f232f-944a-4bec-a197-8c1bc0363c03 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.323646 Nov 02 13:43:52.268103 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 386/754] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:51 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:52.286916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:52.287888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:52.298982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.301238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.301989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.304659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.305693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.307236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.326143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:52.539836 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-937e208c-dd2f-4efc-a59a-01c03eadfd09 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "DELETE /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 204 len: 0 microversion: 2.1 time: 0.354706 Nov 02 13:43:52.542939 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 369/755] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:43:52 2022] DELETE /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:52.556953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d7381bd9-b1f7-477d-9c2f-6e97c54a5522 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:52.558156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7381bd9-b1f7-477d-9c2f-6e97c54a5522 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:52.731383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.732947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d7381bd9-b1f7-477d-9c2f-6e97c54a5522 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.740582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=27 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:52.767951 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d7381bd9-b1f7-477d-9c2f-6e97c54a5522 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1224 microversion: 2.1 time: 0.221531 Nov 02 13:43:52.772453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d7a2da3-eaa7-4b56-909a-c87a5cc9227e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.502795 Nov 02 13:43:52.772747 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 370/756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:52 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1224 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:52.777420 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 387/757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:52 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:52.804948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:52.806217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:52.806438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:52.813481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:52.821660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.822521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.823398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.824648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.825468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.826246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.845178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.854246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.855059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.856368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.857986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.860044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.089965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.100227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f677f49-0b2f-458b-aa97-0fe1f80b4d5a tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1479 microversion: 2.1 time: 0.320976 Nov 02 13:43:53.102367 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 388/758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:52 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1479 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:53.191205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:53.191927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:53.199372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.200267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.201599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.202476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.203077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.203686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.333971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.369499 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8f83f1f8-8b13-48f7-80f8-a7574abdcbd9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1311 microversion: 2.1 time: 0.591927 Nov 02 13:43:53.374711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 371/759] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:52 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:53.399401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:53.403510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:53.409238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.423037 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-edae4492-4c1c-4367-8e2f-17a27994c891 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.237892 Nov 02 13:43:53.424094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 389/760] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:53 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:53.451942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:53.458574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.459708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.460700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.462230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.463821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.464611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.769783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0a243b2f-e001-4268-8cd8-523d3741a42f req-fdf877ff-7085-4d43-bf9b-c520b453995c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3426fa2d-9b02-4df3-8af1-6fb412017b0e", "tag": "63dfc207-aeb4-4650-96b1-e22bd52c850e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:53.821984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0a243b2f-e001-4268-8cd8-523d3741a42f req-fdf877ff-7085-4d43-bf9b-c520b453995c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.823777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0a243b2f-e001-4268-8cd8-523d3741a42f req-fdf877ff-7085-4d43-bf9b-c520b453995c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.824391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0a243b2f-e001-4268-8cd8-523d3741a42f req-fdf877ff-7085-4d43-bf9b-c520b453995c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.858410 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0a243b2f-e001-4268-8cd8-523d3741a42f req-fdf877ff-7085-4d43-bf9b-c520b453995c service nova] Creating event network-changed:63dfc207-aeb4-4650-96b1-e22bd52c850e for instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e on n-h1-858238-3 Nov 02 13:43:53.877921 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0a243b2f-e001-4268-8cd8-523d3741a42f req-fdf877ff-7085-4d43-bf9b-c520b453995c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114665 Nov 02 13:43:53.882686 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 390/761] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:53.892587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.904113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:53.909003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:53.910175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.911716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.912857 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9cb0178-3774-4d4f-a155-fa0ceb43dc29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.534227 Nov 02 13:43:53.936209 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 372/762] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:53 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:53.942139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:53.947424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:53.956933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.965487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.966418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.967314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.968376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.969028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.969640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.969801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.971965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.983347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.985157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.988386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:54.408036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:54.433548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b56d3eb9-f762-4a41-aece-a6b83bc32f5d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1228 microversion: 2.1 time: 0.548672 Nov 02 13:43:54.434154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 391/763] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:53 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1228 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:54.460880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:54.461925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:54.489994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:54.494554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:54.495484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:54.500308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:54.501386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:54.502392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:54.747087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:54.794448 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e52061a5-ec09-4676-927c-b7f096e3ffcd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.853542 Nov 02 13:43:54.806846 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 373/764] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:53 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:54.834435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:54.845279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:54.876300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:54.876812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:54.877251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:54.881260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:54.883734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:54.889537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:55.173572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:55.196244 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-738ba707-967c-4805-86b1-71f5ff88c332 tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1479 microversion: 2.1 time: 0.755057 Nov 02 13:43:55.197449 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 392/765] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:54 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1479 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:55.245959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:55.250539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:55.264433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:55.265539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:55.266211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:55.267352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:55.268001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:55.268608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:55.523038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:55.544412 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d025951f-9b77-4f90-807b-83dc735266e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1461 microversion: 2.1 time: 0.732942 Nov 02 13:43:55.545730 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 374/766] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:54 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1461 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:55.550843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:55.552137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:55.559933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:55.561399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:55.562326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:55.563351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:55.564528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:55.565206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.033815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.047965 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95444e3d-9955-4f77-b374-c3abe9255d9c tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.823491 Nov 02 13:43:56.048565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 393/767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:55 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:56.058290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:56.061368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:56.071870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:56.076797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.078459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.079172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.080929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.082508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.086332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.188421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.197486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.211607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5403102-a41f-4698-847d-9e0a624e683d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1276 microversion: 2.1 time: 0.161676 Nov 02 13:43:56.212212 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 394/768] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:56 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:56.222892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:56.230843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:56.252363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.256664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.260349 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ba3c65b4-8ad0-4cea-bce2-9b841a0d0b4e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.713360 Nov 02 13:43:56.264281 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 375/769] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:55 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:56.274757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:56.276620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:56.287191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.289167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.290456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.292071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.292795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.293928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.294484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.295029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.297466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.299020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.301692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.301692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.478795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.485707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Old instance type m1.heat2, new instance type m1.heat {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:43:56.512668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:56.513153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:56.514083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:56.518540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:56.518971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:56.790058 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37af076c-6144-4d0f-8201-bffcd9025b08 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3/action" status: 202 len: 0 microversion: 2.1 time: 0.568827 Nov 02 13:43:56.791157 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 395/770] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:56 2022] POST /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:56.805836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:56.806462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:56.818926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.819477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.820769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.820769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.821054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.821483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.876000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:56.958522 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-378fb218-bf7c-42af-9b8b-04a762b0d172 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.675941 Nov 02 13:43:56.976342 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 376/771] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:56 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:57.057203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:57.070641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:57.141844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.142864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.144216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.145527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.148544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.150644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.212151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:57.233393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:57.255574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0f1f3c2-6a53-4ebc-a6f8-f4d98cabef3d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1437 microversion: 2.1 time: 0.462574 Nov 02 13:43:57.267713 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 396/772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:56 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1437 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:57.282034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:57.283164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:57.289959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.290682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.291310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.292817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.293466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.294049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.758607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:57.771584 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd6568f6-d133-4335-abd8-c33237ad18ab tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.784532 Nov 02 13:43:57.772553 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 377/773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:56 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:57.786061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b9c29b02-da7b-426c-ae0f-e35097fd719f req-65055268-b178-428a-b654-86e9a1730a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe77b17-d974-49f8-9b09-3aa8866fc56e", "name": "network-vif-plugged", "status": "completed", "tag": "3b0d7cb7-22f9-48b0-9f29-0906adc65935"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:57.818023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b9c29b02-da7b-426c-ae0f-e35097fd719f req-65055268-b178-428a-b654-86e9a1730a1f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.820230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b9c29b02-da7b-426c-ae0f-e35097fd719f req-65055268-b178-428a-b654-86e9a1730a1f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.827146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b9c29b02-da7b-426c-ae0f-e35097fd719f req-65055268-b178-428a-b654-86e9a1730a1f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.861405 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b9c29b02-da7b-426c-ae0f-e35097fd719f req-65055268-b178-428a-b654-86e9a1730a1f service nova] Creating event network-vif-plugged:3b0d7cb7-22f9-48b0-9f29-0906adc65935 for instance ebe77b17-d974-49f8-9b09-3aa8866fc56e on n-h2-858238-3 Nov 02 13:43:57.883686 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b9c29b02-da7b-426c-ae0f-e35097fd719f req-65055268-b178-428a-b654-86e9a1730a1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109597 Nov 02 13:43:57.887065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 378/774] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:57.894914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:57.901213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:57.919903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.921030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.921702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.922682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:57.923412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:57.924059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.996144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:58.012732 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-029c077f-32de-4e15-9bec-d63de8719dfd tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.735551 Nov 02 13:43:58.015192 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 397/775] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:57 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:58.027069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:58.029417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:58.049414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.050163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.050695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.051563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.052119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.052645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.311646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:58.326437 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-383d7797-869f-48a3-9bbb-833cb76abcbc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1282 microversion: 2.1 time: 0.437683 Nov 02 13:43:58.349916 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 379/776] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:57 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1282 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:58.364921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-50380634-d051-44c4-b497-f1f87a9a55e6 req-1dcbbe64-32da-476d-94fc-5f368521e1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df283811-c76f-4bdb-b45e-9a5b57d350a3", "name": "network-vif-deleted", "tag": "e17a6801-7c83-45b8-8676-3854be9cb7ff"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:58.384130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-50380634-d051-44c4-b497-f1f87a9a55e6 req-1dcbbe64-32da-476d-94fc-5f368521e1f0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.388398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-50380634-d051-44c4-b497-f1f87a9a55e6 req-1dcbbe64-32da-476d-94fc-5f368521e1f0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.389173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-50380634-d051-44c4-b497-f1f87a9a55e6 req-1dcbbe64-32da-476d-94fc-5f368521e1f0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.405389 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-50380634-d051-44c4-b497-f1f87a9a55e6 req-1dcbbe64-32da-476d-94fc-5f368521e1f0 service nova] Creating event network-vif-deleted:e17a6801-7c83-45b8-8676-3854be9cb7ff for instance df283811-c76f-4bdb-b45e-9a5b57d350a3 on n-h1-858238-3 Nov 02 13:43:58.413535 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-50380634-d051-44c4-b497-f1f87a9a55e6 req-1dcbbe64-32da-476d-94fc-5f368521e1f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061890 Nov 02 13:43:58.415025 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 380/777] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:58.425318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:58.426586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:58.438751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.440860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.441697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.443647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.444752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.448039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.714357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:58.747504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:58.754141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:58.759232 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-066ac062-43ec-4f4c-9e90-9e0616a0fe25 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.740983 Nov 02 13:43:58.764696 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 398/778] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:43:58 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:43:58.776051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:58.776818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:58.793040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.799550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.801392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.802288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.803730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.804441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.890768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.892123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.893005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.894078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lazy-loading 'fault' on Instance uuid df283811-c76f-4bdb-b45e-9a5b57d350a3 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:58.900978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:59.322951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bdb941a8c874faca7f7a85763d242e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f7aaa6112b46a7bf98f60b687df626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:59.357972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42f0d585-ba48-4ba4-9471-6ef99f3ff45e tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 200 len: 1313 microversion: 2.1 time: 0.590746 Nov 02 13:43:59.363923 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 399/779] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:58 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:59.375195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:59.377781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:59.429494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.430151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.430839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.432316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.433012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.433715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.559138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:59.574539 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5e8dda9-32a0-463c-9f69-5a030902775e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 1.157171 Nov 02 13:43:59.577291 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 381/780] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:58 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:59.591581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:59.592642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:59.616570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.616570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.616570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.617883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.618341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.618779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.657397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:59.813085 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af9d7f97-9025-49d0-aa2d-225a631d0fe9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "DELETE /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 204 len: 0 microversion: 2.1 time: 0.233536 Nov 02 13:43:59.814317 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 382/781] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:43:59 2022] DELETE /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:59.820270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:59.821260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:59.835784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.837025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.838104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.839536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.840285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.840928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.973409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.021298 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3d1a2a37-bb2c-4f13-aef7-e46f3622d787 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.654448 Nov 02 13:44:00.031905 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 400/782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:59 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:00.042799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:00.048742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.071632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.074889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.075752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.081501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.084006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.085276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.110624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.133995 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5ef69230-3575-4311-bd7d-23b14a33ceb3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.317650 Nov 02 13:44:00.147136 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 383/783] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:59 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:00.163740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:00.164370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.172829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.173327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.173755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.174471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.175110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.175363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.474451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.492946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.505657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.510441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea3573b4-4a42-4785-a4a3-dd0d63eff0a2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1324 microversion: 2.1 time: 0.476145 Nov 02 13:44:00.514765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.515999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 401/784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:00 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:00.523486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:00.526139 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0c8914d2-d294-4b52-b562-c62cbe41fdc0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.388176 Nov 02 13:44:00.527984 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 384/785] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:44:00 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:00.532694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.536492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:00.541889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] [instance: df283811-c76f-4bdb-b45e-9a5b57d350a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.547438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.553355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.554400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.555738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.556765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.558370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.559030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.564121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.565179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.566090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.566711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.567341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.602278 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] HTTP exception thrown: Instance df283811-c76f-4bdb-b45e-9a5b57d350a3 could not be found. Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Request method failure captured: Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 HTTP/1.1 Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnP6323RZqp6smoCMhzsH2OuyPkPnadKZXz5fzshglhCM9a8lv8-8r1serOeXakmiOPFCQjrcxHHeP9BryT29wYjxlMxho03adiS1kKwvi2O7737zb_UgDVM5PSCye9N0tcqpPjhNnLcaTtpnugUjGBXsY2l58jXJBJZY1eK4GlQcwU Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 79f7aaa6112b46a7bf98f60b687df626 Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-79293669 Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:44:00.606791 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79f7aaa6112b46a7bf98f60b687df626"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/79f7aaa6112b46a7bf98f60b687df626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/79f7aaa6112b46a7bf98f60b687df626"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_79f7aaa6112b46a7bf98f60b687df626"}]}] Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-79293669 Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 79f7aaa6112b46a7bf98f60b687df626 Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-79293669 Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerDiagnosticsNegativeTest-79293669-project Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 1bdb941a8c874faca7f7a85763d242e1 Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-79293669-project Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance df283811-c76f-4bdb-b45e-9a5b57d350a3 could not be found. Nov 02 13:44:00.608312 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'df283811-c76f-4bdb-b45e-9a5b57d350a3'} Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df283811-c76f-4bdb-b45e-9a5b57d350a3 could not be found. Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:00.609225 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df283811-c76f-4bdb-b45e-9a5b57d350a3 could not be found. Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df283811-c76f-4bdb-b45e-9a5b57d350a3 could not be found. Nov 02 13:44:00.610671 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:00.614481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] Returning 404 to user: Instance df283811-c76f-4bdb-b45e-9a5b57d350a3 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:00.618183 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c09a1f7-d506-454e-b06d-29313b3d4b9d tempest-ServerDiagnosticsNegativeTest-79293669 tempest-ServerDiagnosticsNegativeTest-79293669-project] 10.222.0.18 "GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3" status: 404 len: 111 microversion: 2.1 time: 0.087694 Nov 02 13:44:00.622383 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 385/786] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:00 2022] GET /compute/v2.1/servers/df283811-c76f-4bdb-b45e-9a5b57d350a3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:00.634292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:00.644602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.659504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.660369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.660979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.661862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.663392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.664067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.872137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:00.888134 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-89939c68-ba16-4723-8a3b-40e29473305e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.263883 Nov 02 13:44:00.890247 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 386/787] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:00 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:01.032260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:01.062555 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-793d61cf-b067-4020-a40e-78802b4e3de9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1714 microversion: 2.1 time: 0.544459 Nov 02 13:44:01.065638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:01.079140 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 402/788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:00 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1714 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:01.079434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:01.088083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.088083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.088083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.088083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.089136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.089313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.172526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:01.173538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:01.196028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.196525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.196962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.197678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.198126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.198568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.337690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:01.351678 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-14e236c6-5964-45e0-b220-60822e5c4b37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.290623 Nov 02 13:44:01.352945 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 387/789] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:01 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:01.359530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-0f07b23d-f433-458d-aa09-6c9cd300a1c9 req-2d7c4b64-c835-4934-ab95-15c81d54a42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d405ec8-6f09-419d-9e99-df4cf38c9144", "name": "network-vif-plugged", "status": "completed", "tag": "6e0b8572-13b4-4aa8-aea4-63b21f83a3ea"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:01.374663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0f07b23d-f433-458d-aa09-6c9cd300a1c9 req-2d7c4b64-c835-4934-ab95-15c81d54a42d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.375385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0f07b23d-f433-458d-aa09-6c9cd300a1c9 req-2d7c4b64-c835-4934-ab95-15c81d54a42d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.375934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0f07b23d-f433-458d-aa09-6c9cd300a1c9 req-2d7c4b64-c835-4934-ab95-15c81d54a42d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.390936 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-0f07b23d-f433-458d-aa09-6c9cd300a1c9 req-2d7c4b64-c835-4934-ab95-15c81d54a42d service nova] Creating event network-vif-plugged:6e0b8572-13b4-4aa8-aea4-63b21f83a3ea for instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 on n-h2-858238-3 Nov 02 13:44:01.397842 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-0f07b23d-f433-458d-aa09-6c9cd300a1c9 req-2d7c4b64-c835-4934-ab95-15c81d54a42d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042946 Nov 02 13:44:01.399278 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 388/790] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:01.551363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:01.552130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:01.567722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.568771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.570874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.571928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.575207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.575681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.736679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:01.754502 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0941eda5-8c29-4638-93f0-073baef20758 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.588087 Nov 02 13:44:01.755770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 403/791] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:01 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:01.775730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:01.776676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:01.787258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:01.789173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.790687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.791335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.792617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.793640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.794490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.812279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=28 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:01.854644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:01.865498 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2dda4ba6-024d-4738-a29a-fc2e05fe2a48 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1324 microversion: 2.1 time: 0.318619 Nov 02 13:44:01.866216 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 389/792] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:01 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:01.922834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:01.923695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:01.930564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.931237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.931726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.932734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:01.933199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:01.933740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.085586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.100702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.103508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.105525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cafc079-b132-4655-a2ee-8fab74a710fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.348548 Nov 02 13:44:02.106861 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 404/793] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:44:01 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:02.116274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:02.116897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:02.128003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.128860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.129569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.130768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.131651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.132532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.235430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.253194 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-140a5c4e-9115-43a0-aff4-e3a6d17c38fb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1311 microversion: 2.1 time: 0.335467 Nov 02 13:44:02.254572 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 390/794] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:01 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1311 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:02.356608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e014a19c-be65-4398-bf14-d0267f1040f3 req-45fc304e-750a-45ba-9e3b-a97e9e0600f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:02.381928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e014a19c-be65-4398-bf14-d0267f1040f3 req-45fc304e-750a-45ba-9e3b-a97e9e0600f0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.383048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e014a19c-be65-4398-bf14-d0267f1040f3 req-45fc304e-750a-45ba-9e3b-a97e9e0600f0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.384281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e014a19c-be65-4398-bf14-d0267f1040f3 req-45fc304e-750a-45ba-9e3b-a97e9e0600f0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.412044 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e014a19c-be65-4398-bf14-d0267f1040f3 req-45fc304e-750a-45ba-9e3b-a97e9e0600f0 service nova] Creating event network-changed:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:44:02.424480 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e014a19c-be65-4398-bf14-d0267f1040f3 req-45fc304e-750a-45ba-9e3b-a97e9e0600f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075333 Nov 02 13:44:02.426143 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 391/795] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:02.436437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:02.437894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:02.452177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.453333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.454277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.455770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.456901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.457867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.597312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.630238 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5ee508f-04bf-48b4-a669-be0dbd092142 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1714 microversion: 2.1 time: 0.521285 Nov 02 13:44:02.631300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 405/796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:02 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1714 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:02.762382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:02.782245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:02.783570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:02.807899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.812109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.813354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.815298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.816945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.821996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.901288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.909984 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c81823a-b54f-4a99-bc25-ac201efb0daa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.481951 Nov 02 13:44:02.911270 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 392/797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:02 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:02.923999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:02.925863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:02.938493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.939363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.939799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.940516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.941002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.941393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.159967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:03.172937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58726e1f-81c8-4267-9114-beb9175527ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.398411 Nov 02 13:44:03.174844 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 406/798] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:02 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:03.191364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:03.192165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:03.199401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.203672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.204101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.204834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.209514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.210302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.308404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:03.336283 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-85992ee1-6329-47c2-b7df-a8891bf924a6 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1324 microversion: 2.1 time: 0.422651 Nov 02 13:44:03.337779 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 393/799] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:02 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:03.363679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:03.365735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:03.378499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.379653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.380727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.382232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.383300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.384262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.566788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:03.589869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:03.595573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:03.598491 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b1e228f-fb2f-4265-b3ce-13dae11581fa tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.421800 Nov 02 13:44:03.599452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 407/800] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:44:03 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:03.626335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b13f43fd-f849-4860-b4e5-d69a882f9b35 req-12265c83-f479-4ce4-beea-3275765a6eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3426fa2d-9b02-4df3-8af1-6fb412017b0e", "name": "network-vif-plugged", "status": "completed", "tag": "63dfc207-aeb4-4650-96b1-e22bd52c850e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:03.638181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b13f43fd-f849-4860-b4e5-d69a882f9b35 req-12265c83-f479-4ce4-beea-3275765a6eef service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.640087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b13f43fd-f849-4860-b4e5-d69a882f9b35 req-12265c83-f479-4ce4-beea-3275765a6eef service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.640839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b13f43fd-f849-4860-b4e5-d69a882f9b35 req-12265c83-f479-4ce4-beea-3275765a6eef service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.658235 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b13f43fd-f849-4860-b4e5-d69a882f9b35 req-12265c83-f479-4ce4-beea-3275765a6eef service nova] Creating event network-vif-plugged:63dfc207-aeb4-4650-96b1-e22bd52c850e for instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e on n-h1-858238-3 Nov 02 13:44:03.665803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b13f43fd-f849-4860-b4e5-d69a882f9b35 req-12265c83-f479-4ce4-beea-3275765a6eef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064703 Nov 02 13:44:03.666734 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 408/801] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:03.672202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:03.673206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:03.680536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.681126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.681681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.682959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.683601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.684175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.778141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:03.803916 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b4d245b1-0f7c-4116-8aa9-27cbc1853fb6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1490 microversion: 2.1 time: 0.447836 Nov 02 13:44:03.820244 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 394/802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:03 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1490 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:03.860421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:03.861347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:03.893256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.895532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.898226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.901193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.901714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.906312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.988661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:04.007761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa01eb68-2a22-45ba-8aec-5aaf6bb7a6ae tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1714 microversion: 2.1 time: 0.339539 Nov 02 13:44:04.009497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 409/803] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:03 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1714 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:04.016544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:04.017413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:04.026464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.027687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.029077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.030739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.031857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.033110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.242412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:04.259517 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-552b2d38-a52c-4294-ae96-460dcf66afb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.247353 Nov 02 13:44:04.260468 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 410/804] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:04 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:04.293631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:04.296109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:04.327788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.328914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.330211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.332445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:04.334371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.338240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.339995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.353557 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2db34dfa-2eec-4728-afd1-c8b31958d3d3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1641 microversion: 2.1 time: 0.520240 Nov 02 13:44:04.355360 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 395/805] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:03 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1641 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:04.371011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:04.375597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:04.387796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.389170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.389945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.391202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.392058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.393138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.687958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:04.720242 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-999a8d9a-f459-436d-9c86-f775d2436873 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1324 microversion: 2.1 time: 0.353158 Nov 02 13:44:04.732795 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 396/806] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:04 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:04.752730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:04.753354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:04.761221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.761678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.762465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.762941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:04.763513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:04.763895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:04.963701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:04.974999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad8be780-1069-4f59-b0fc-feb9b892c9b8 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1317 microversion: 2.1 time: 0.693585 Nov 02 13:44:04.989110 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 411/807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:04 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:05.000873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:05.001769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:05.014104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.015174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.015943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.017508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.018265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.019476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.343231 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d66e4986-5b63-4a79-be54-09b0df5a882b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1641 microversion: 2.1 time: 0.604852 Nov 02 13:44:05.359126 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 397/808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:04 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1641 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:05.373270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:05.384293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:05.398714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.399590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.403774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.404895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.405578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.406240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.608675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:05.619125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:05.621246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:05.622661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ae0cc79-5893-4ffc-9d86-463feb4e0ef1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1411 microversion: 2.25 time: 0.627057 Nov 02 13:44:05.641272 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 412/809] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:44:04 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1411 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:05.654691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:05.657427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:05.659387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:05.672323 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7574a04f-2c40-4f09-a30c-3ffac07e8caf tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1646 microversion: 2.1 time: 0.310997 Nov 02 13:44:05.676131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.678109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.678885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.680430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.681344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.682408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.688597 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 398/810] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:05 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1646 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:05.695935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:05.702333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.704936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.705681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.706599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.708764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.709380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.770026 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dbfb1a3b-d14b-4a4c-94b0-6510c1517214 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.079350 Nov 02 13:44:05.771113 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 399/811] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:44:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:05.783688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:05.784300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:05.795715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.796119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.796548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.797253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.797757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.798184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.066902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:06.097777 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-81cfdb1c-6c70-46b4-a318-e1b91e8144c2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.454288 Nov 02 13:44:06.099072 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 413/812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:05 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:06.115654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:06.118978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:06.134145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:06.145392 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b5c8748c-698c-4f12-b2e7-8cf06add99a8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1324 microversion: 2.1 time: 0.366420 Nov 02 13:44:06.152463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.154876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.155890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.157362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.158458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.160025 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 400/813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:05 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:06.171739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.176540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:06.178773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:06.192496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.193755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.195199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.198476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.199111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.200637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.427323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7f1fc6b-5fd9-4aa8-a8b8-31ed9bebc25c tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e/action" status: 202 len: 0 microversion: 2.1 time: 0.322829 Nov 02 13:44:06.431365 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 414/814] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:06 2022] POST /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:06.446612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:06.447551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:06.477181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.478043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.487346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.488940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.489779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.493345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.975279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:06.986714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37bc077a-6ea3-4c3e-a34d-11a2c0b5f47f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1646 microversion: 2.1 time: 0.547272 Nov 02 13:44:06.997308 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 415/815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:06 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1646 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:07.051756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:07.052869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:07.063717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.064463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.065165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.066522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.067699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.068332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.180378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.195562 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e75b022-7aec-43d1-80a5-c5600dc85225 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1467 microversion: 2.1 time: 1.033382 Nov 02 13:44:07.196673 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 401/816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:06 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1467 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:07.207044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:07.208188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:07.227337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.228108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.228766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.229700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.230363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.235659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.371293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '351f7415c03346aa81dfbd73a686327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2d07f95c10416ebb9d30228f5e907e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.396854 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-873ae9c3-576d-4573-afd0-7b0b1d42c5e5 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 200 len: 1349 microversion: 2.1 time: 0.195991 Nov 02 13:44:07.399647 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 402/817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:07 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 1349 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:07.403358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.423594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.424820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.431197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2404c96e-b9a8-46d6-b619-7bc7290f2aaf req-292ef590-2f17-4718-914f-dc12b5d99734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187acb18-1b79-484c-abce-d04e4f964c1e", "name": "network-vif-deleted", "tag": "7580a147-c698-4d66-991e-fba7f3a2050b"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:07.440794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3770541f-5ad2-4f85-a34d-a6fe76c93d1a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1607 microversion: 2.25 time: 0.441154 Nov 02 13:44:07.441648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 416/818] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:44:06 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1607 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:07.458019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:07.460099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:07.471796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.484663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.485743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.487217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.489111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2404c96e-b9a8-46d6-b619-7bc7290f2aaf req-292ef590-2f17-4718-914f-dc12b5d99734 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.489450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.489658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2404c96e-b9a8-46d6-b619-7bc7290f2aaf req-292ef590-2f17-4718-914f-dc12b5d99734 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.490002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2404c96e-b9a8-46d6-b619-7bc7290f2aaf req-292ef590-2f17-4718-914f-dc12b5d99734 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.490976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.521483 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2404c96e-b9a8-46d6-b619-7bc7290f2aaf req-292ef590-2f17-4718-914f-dc12b5d99734 service nova] Creating event network-vif-deleted:7580a147-c698-4d66-991e-fba7f3a2050b for instance 187acb18-1b79-484c-abce-d04e4f964c1e on n-h2-858238-3 Nov 02 13:44:07.530296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2404c96e-b9a8-46d6-b619-7bc7290f2aaf req-292ef590-2f17-4718-914f-dc12b5d99734 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108787 Nov 02 13:44:07.530895 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 403/819] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:07.544062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:07.545854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:07.585750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.587637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.588787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.591382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.592868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.594491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.754543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.794554 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9184241-d6bf-4fa7-bd42-70d2ac6370dd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1470 microversion: 2.1 time: 0.351218 Nov 02 13:44:07.795799 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 417/820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:07 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:07.806309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:07.807550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:07.822062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.823017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.823791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.825053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:07.827992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:07.828672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.911664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.932949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1dc74117-b339-428c-b8f7-20d880620b28 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1324 microversion: 2.1 time: 0.400088 Nov 02 13:44:07.979542 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 404/821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:07 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:08.114077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fcc33fe6-e145-48a6-afef-bd06a18b29c5 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1618 microversion: 2.1 time: 0.314157 Nov 02 13:44:08.115483 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 418/822] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:07 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1618 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:08.124702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.125648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:08.136529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.137524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.138952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.139902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.140525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.141334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.257896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.262338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.272337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.275688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.276656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.277150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.277616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.318247 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-edb32f9d-4f9c-491b-87c1-6a629c4c2189 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.336791 Nov 02 13:44:08.327346 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 405/823] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:44:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:08.334516 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7170788d-bf86-4a3e-a9a0-2d14705362fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.217721 Nov 02 13:44:08.335709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 419/824] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 13:44:08 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:08.338658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7a8747b6-1151-4871-bf84-5b966dc22684 req-41dd4656-4b2a-4dae-a782-57a96eb7f74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "name": "network-vif-plugged", "status": "completed", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:08.346930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.347675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:08.354436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7a8747b6-1151-4871-bf84-5b966dc22684 req-41dd4656-4b2a-4dae-a782-57a96eb7f74f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.355559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7a8747b6-1151-4871-bf84-5b966dc22684 req-41dd4656-4b2a-4dae-a782-57a96eb7f74f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.356910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7a8747b6-1151-4871-bf84-5b966dc22684 req-41dd4656-4b2a-4dae-a782-57a96eb7f74f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.360767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.361227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.361659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.362378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.362870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.363325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.380987 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7a8747b6-1151-4871-bf84-5b966dc22684 req-41dd4656-4b2a-4dae-a782-57a96eb7f74f service nova] Creating event network-vif-plugged:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:44:08.391019 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7a8747b6-1151-4871-bf84-5b966dc22684 req-41dd4656-4b2a-4dae-a782-57a96eb7f74f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058540 Nov 02 13:44:08.391966 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 406/825] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:08.398169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.403410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.404869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.405609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.406525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.407169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.407748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.440189 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4994cd6a-a5fa-414c-8f07-0bcd1876009d tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.046648 Nov 02 13:44:08.440763 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 407/826] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 13:44:08 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:08.445599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-880543552", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["fa9c1616-fc5e-4255-af98-141b90526fe4"]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:08.507618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:08.699786 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf57b581-afab-458e-9062-936aaf26fd2b tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1626 microversion: 2.1 time: 0.362584 Nov 02 13:44:08.701632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 420/827] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:08 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1626 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:08.707343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.713797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:08.729346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.729987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.730421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.732469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.733049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.735682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.751376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e HTTP/1.1 Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:44:08.753356 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:08.756011 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '187acb18-1b79-484c-abce-d04e4f964c1e'} Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:08.757299 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:08.758490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:08.760658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:08.760658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eba6d461-9176-40af-9caa-6e3f9dd7fefc tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 404 len: 111 microversion: 2.1 time: 0.052167 Nov 02 13:44:08.760658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 421/828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:08 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:08.768076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.775901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.776944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.777796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.780117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.781081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.781844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.823663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41a33282-63ab-486e-a9c4-de56f48bfecf tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.065694 Nov 02 13:44:08.823875 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 422/829] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:44:08 2022] GET /compute/v2.1/os-services => generated 944 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:08.834022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858238-3", "block_migration": true, "disk_over_commit": false}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:08.834022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:08.849210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.850085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.850730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.851995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.852770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.853514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.904922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lazy-loading 'flavor' on Instance uuid ebe77b17-d974-49f8-9b09-3aa8866fc56e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:08.925668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Going to try to live migrate instance to n-h1-858238-3 {{(pid=137559) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:44:09.329929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:09.330468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:09.330728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:09.331794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:09.331794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:09.333622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:09.348113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.349369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.350134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.351903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.353000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.353954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.382083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:09.391220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:09.411661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:09.417274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:09.496116 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1da68f32-4426-4cd3-b398-9715dc149d1d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051340 Nov 02 13:44:09.497197 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 408/830] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:44:09.513720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:09.515059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:09.523488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.524509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.525182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.526856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.527740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.528354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.550836 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 HTTP/1.1 Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:44:09.552630 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:09.553959 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3e1c6755-70f9-4cac-9d48-00f65b4a9507'} Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:09.554762 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:09.559804 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:09.561841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:09.561841 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a95ab0f0-c482-4d40-9c4e-7276812d5ea4 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 404 len: 111 microversion: 2.1 time: 0.055950 Nov 02 13:44:09.561841 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 409/831] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:44:09 2022] DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:09.561841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:09.561841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:09.568629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.569124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.569550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.570545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.572184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.572676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.024266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:10.038006 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-def4a885-29e1-4e3d-9116-7b676ece1576 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.481545 Nov 02 13:44:10.057194 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 410/832] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:09 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:10.064045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:10.068392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.069293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.069931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.071202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.072066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.072737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.125959 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2dbe742c-6cc4-47c5-8c60-c7bbfcbbd05b tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-858238-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.064624 Nov 02 13:44:10.139027 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 411/833] 10.222.0.18 () {58 vars in 1194 bytes} [Wed Nov 2 13:44:10 2022] GET /compute/v2.1/os-services?host=n-d-858238-3&binary=xxx => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:44:10.143790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:10.144423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:10.168283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.168790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.169229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.170561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.171018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.171475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.496314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:10.508889 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e28f8fee-f189-427b-be49-567a841fe266 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1519 microversion: 2.1 time: 0.368689 Nov 02 13:44:10.519800 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 412/834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:10 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1519 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:10.543412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:10.545000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:10.554950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.556150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.557035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.558332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.559374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.560252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.760144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:10.780423 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-09dfe248-1882-442e-b0a6-77920893baa9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1220 microversion: 2.1 time: 0.258368 Nov 02 13:44:10.782435 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 413/835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:10 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1220 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:10.788943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:10.790578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:10.799420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.800611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.801409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.802350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.802998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.803623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.825195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 HTTP/1.1 Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:44:10.827787 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:10.829393 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3e1c6755-70f9-4cac-9d48-00f65b4a9507'} Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:10.830263 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:10.831790 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:10.835550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:10.838042 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ac263a84-e636-458e-9dad-15ac1a1cd4db tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 404 len: 111 microversion: 2.1 time: 0.054116 Nov 02 13:44:10.839174 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 414/836] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:10 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:10.851798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:10.858340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.860244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.860849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.861995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:10.862690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:10.863948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:10.929798 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2e89a3f1-2384-4db2-9c87-e0f54e18dcb7 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.089319 Nov 02 13:44:10.948605 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 415/837] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:44:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:10.960608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f15328b7-ce67-4868-ab9f-53232011b038 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'create', calling method: .version_select at 0x7f6f820e5dc0>, body: {"pool": null} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:11.258974 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-019a227b-5d95-431c-8c3d-5dba4d773982 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e/action" status: 202 len: 0 microversion: 2.1 time: 2.432777 Nov 02 13:44:11.259433 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 423/838] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:08 2022] POST /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e/action => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:11.300139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44cd5d60-3596-487d-865f-07a9fed37ad7 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '.version_select at 0x7f6f81c29550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:11.398972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44cd5d60-3596-487d-865f-07a9fed37ad7 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390475980" status: 202 len: 0 microversion: 2.1 time: 0.130293 Nov 02 13:44:11.406465 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 424/839] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390475980 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:11.424362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:11.438689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.439738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.441538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.448964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.449869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.450538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.541687 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-321de309-7e44-4ff6-8e8a-d4fa41bc4cd6 tempest-ServicesAdminNegativeTestJSON-1521081312 tempest-ServicesAdminNegativeTestJSON-1521081312-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.127255 Nov 02 13:44:11.546921 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 425/840] 10.222.0.18 () {58 vars in 1198 bytes} [Wed Nov 2 13:44:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:44:11.559351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:11.562973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:11.581828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.586562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.587397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.588384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.590114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.593875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.986546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.009870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9e06cf3-929e-412e-88cc-c3e006430627 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.461516 Nov 02 13:44:12.011728 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 426/841] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:11 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:12.047438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:12.048385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:12.060946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.066828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.067620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.069029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.069029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.069727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.592173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.600868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-040b15b9-9076-41c0-ad2c-d9e7b9102907 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.586116 Nov 02 13:44:12.615868 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 427/842] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:12 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:12.624938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a3509805-4881-48ed-b8da-b7f61d5206d9 req-c02525b4-9d6a-4fd8-b6ae-78d20c33471c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3426fa2d-9b02-4df3-8af1-6fb412017b0e", "tag": "63dfc207-aeb4-4650-96b1-e22bd52c850e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:12.635015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a3509805-4881-48ed-b8da-b7f61d5206d9 req-c02525b4-9d6a-4fd8-b6ae-78d20c33471c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.635812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a3509805-4881-48ed-b8da-b7f61d5206d9 req-c02525b4-9d6a-4fd8-b6ae-78d20c33471c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.636416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a3509805-4881-48ed-b8da-b7f61d5206d9 req-c02525b4-9d6a-4fd8-b6ae-78d20c33471c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.658008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a3509805-4881-48ed-b8da-b7f61d5206d9 req-c02525b4-9d6a-4fd8-b6ae-78d20c33471c service nova] Creating event network-changed:63dfc207-aeb4-4650-96b1-e22bd52c850e for instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e on n-h1-858238-3 Nov 02 13:44:12.664310 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a3509805-4881-48ed-b8da-b7f61d5206d9 req-c02525b4-9d6a-4fd8-b6ae-78d20c33471c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046494 Nov 02 13:44:12.666227 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 428/843] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:12.890499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e8a48c7-1328-47e8-98d4-10ec6e808a33 tempest-ServicesAdminNegativeTestJSON-1542314007 tempest-ServicesAdminNegativeTestJSON-1542314007-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:12.899137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e8a48c7-1328-47e8-98d4-10ec6e808a33 tempest-ServicesAdminNegativeTestJSON-1542314007 tempest-ServicesAdminNegativeTestJSON-1542314007-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'abca9c48e5ea416fa352e3d7509ebe76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc89e8734fbd4f20a9ceb74048b6b3d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e8a48c7-1328-47e8-98d4-10ec6e808a33 tempest-ServicesAdminNegativeTestJSON-1542314007 tempest-ServicesAdminNegativeTestJSON-1542314007-project] Request method failure captured: Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQlvSYdfjpdTE8TBnkCZhsYk-ymz3_UEsif6Ni0ns_l1oqOeDglbPVXkFu0z19GTc6NxJq_OgsEOJjSiZCke-6TrXxsuNnAXMMYCh8WDYgrBwgwqTgpEUKU5CF9pGFo6jYH_ipuOINw4Pqef2lBnBuTl675q13K-OdGg23OixCVM40 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cc89e8734fbd4f20a9ceb74048b6b3d3 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1542314007 Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:44:12.903078 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cc89e8734fbd4f20a9ceb74048b6b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cc89e8734fbd4f20a9ceb74048b6b3d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cc89e8734fbd4f20a9ceb74048b6b3d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cc89e8734fbd4f20a9ceb74048b6b3d3"}]}] Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1542314007 Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cc89e8734fbd4f20a9ceb74048b6b3d3 Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1542314007 Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServicesAdminNegativeTestJSON-1542314007-project Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: abca9c48e5ea416fa352e3d7509ebe76 Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1542314007-project Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:44:12.905116 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:44:12.905912 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:44:12.907028 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:12.908353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e8a48c7-1328-47e8-98d4-10ec6e808a33 tempest-ServicesAdminNegativeTestJSON-1542314007 tempest-ServicesAdminNegativeTestJSON-1542314007-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:12.908353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e8a48c7-1328-47e8-98d4-10ec6e808a33 tempest-ServicesAdminNegativeTestJSON-1542314007 tempest-ServicesAdminNegativeTestJSON-1542314007-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.238963 Nov 02 13:44:12.909423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 429/844] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:44:12 2022] GET /compute/v2.1/os-services => generated 112 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:12.920446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:12.921066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:12.937028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.937525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.939302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.940777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.941671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.942248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:13.195224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:13.204674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5d6e8f5-41c6-4dd8-976d-847e4071e213 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1274 microversion: 2.1 time: 0.293494 Nov 02 13:44:13.205102 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 430/845] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:12 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1274 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:13.216658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:13.221522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:13.238654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:13.239180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:13.240587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:13.243542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:13.245891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:13.247360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:13.761956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:13.772920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-991e778a-82d2-4e02-8ea5-f20ffef838cd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.566733 Nov 02 13:44:13.775527 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 431/846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:13 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:13.783416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-153407704", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "53e37d35-cbdd-473f-81fc-0fd3fdb0ed6a"}], "security_groups": [{"name": "tempest-securitygroup--1409012920"}], "key_name": "tempest-keypair-751331790", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5bb28a72-5e55-495b-847a-6bf86f9052ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:14.045254 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f15328b7-ce67-4868-ab9f-53232011b038 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.092289 Nov 02 13:44:14.046817 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 416/847] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:44:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:14.052012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:14.053334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:14.062840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:14.065067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:14.065950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:14.067038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:14.068211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:14.069265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:14.146096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] validate_networks() for [('53e37d35-cbdd-473f-81fc-0fd3fdb0ed6a', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:14.457078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:14.478298 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c4e4b925-bfa9-4560-8f0d-4b7c4cb8ed92 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.429465 Nov 02 13:44:14.479233 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 417/848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:14 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:14.520933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d1889f8-914f-4b91-b92b-b45b0640f7d1 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:14.562093 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d1889f8-914f-4b91-b92b-b45b0640f7d1 tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1960985029" status: 202 len: 0 microversion: 2.1 time: 0.055424 Nov 02 13:44:14.567553 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 418/849] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:44:14 2022] DELETE /compute/v2.1/flavors/1960985029 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:14.597593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-44f3a93c-3fa4-48c1-ab78-103d8aa26cf0 req-532b13ed-0c51-4904-ad30-2d17697ddbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe77b17-d974-49f8-9b09-3aa8866fc56e", "name": "network-vif-unplugged", "status": "completed", "tag": "3b0d7cb7-22f9-48b0-9f29-0906adc65935"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:14.641330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-44f3a93c-3fa4-48c1-ab78-103d8aa26cf0 req-532b13ed-0c51-4904-ad30-2d17697ddbe5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:14.642185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-44f3a93c-3fa4-48c1-ab78-103d8aa26cf0 req-532b13ed-0c51-4904-ad30-2d17697ddbe5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:14.642810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-44f3a93c-3fa4-48c1-ab78-103d8aa26cf0 req-532b13ed-0c51-4904-ad30-2d17697ddbe5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:14.680574 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-44f3a93c-3fa4-48c1-ab78-103d8aa26cf0 req-532b13ed-0c51-4904-ad30-2d17697ddbe5 service nova] Creating event network-vif-unplugged:3b0d7cb7-22f9-48b0-9f29-0906adc65935 for instance ebe77b17-d974-49f8-9b09-3aa8866fc56e on n-h2-858238-3 Nov 02 13:44:14.696373 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-44f3a93c-3fa4-48c1-ab78-103d8aa26cf0 req-532b13ed-0c51-4904-ad30-2d17697ddbe5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114736 Nov 02 13:44:14.698252 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 419/850] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:14.713983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1802788196", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "78207ca2-c72f-4aba-a624-6c41b5c5faf0"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:14.882577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] validate_networks() for [('78207ca2-c72f-4aba-a624-6c41b5c5faf0', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:15.371455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Getting quotas for project 3f456c505e374d62a0185db1764f0911. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:15.379906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Getting quotas for user 17b9d516e828485a931fb97ba2d3c43c and project 3f456c505e374d62a0185db1764f0911. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:15.406664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:15.407897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:15.409253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:15.410313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:15.411582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:15.426714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:15.437430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.438300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.438995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.440207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.441048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.442227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.474098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Getting quotas for project 3f456c505e374d62a0185db1764f0911. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:15.481392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Getting quotas for user 17b9d516e828485a931fb97ba2d3c43c and project 3f456c505e374d62a0185db1764f0911. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:15.570134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:15.572233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bb28a72-5e55-495b-847a-6bf86f9052ef',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:15.772190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:15.773917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:15.775435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:15.776211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:15.776980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:15.813686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.814261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.814839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.816336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.817215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.818287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.859617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Getting quotas for project c7d8d8d2ae5749748ab4fcd40d1bd747. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:15.868358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Getting quotas for user f5d532dce5f14db7a5b029734d672aba and project c7d8d8d2ae5749748ab4fcd40d1bd747. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:15.871086 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bac360b1-1d8b-45b0-a652-eebdabf83fd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.094324 Nov 02 13:44:15.884809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 432/851] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 2101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:44:15.890686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:15.892083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:15.901755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.903135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.904705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.905575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.906173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.907086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.911386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:15.929388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:16.028630 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d4ef48df-c135-48d8-bf1d-1aaf61b69760 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328567 Nov 02 13:44:16.030665 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 420/852] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:44:16.037172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-349ebff0-f199-4432-b1a2-8b3d63a9218a tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.067571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-349ebff0-f199-4432-b1a2-8b3d63a9218a tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.035040 Nov 02 13:44:16.068755 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 421/853] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.076151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.077054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.095461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.098726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.100123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.101125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.103183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.105000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.162898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:16.180917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2167f56-d93a-48cb-a7fd-2c72bde49486 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 0.293724 Nov 02 13:44:16.182918 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 433/854] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:15 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.206906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.209399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.231041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.231581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.232018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.233054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.233623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.234221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.528679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:16.541448 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2c809941-3923-4467-98f4-7f1c2356ea2b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.471361 Nov 02 13:44:16.556851 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 422/855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.564010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-bf7d73f2-c4ec-4daf-8d92-1ad023c25be3 req-e96e9fdd-b9cd-4084-8a69-382a8e8b889a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3428c3e-a122-4f8d-a660-b46c92ff1c59", "tag": "ca95a7f1-7a9d-4aa8-94b1-70f7a6b766bc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:16.572209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:16.577689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bf7d73f2-c4ec-4daf-8d92-1ad023c25be3 req-e96e9fdd-b9cd-4084-8a69-382a8e8b889a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.579171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bf7d73f2-c4ec-4daf-8d92-1ad023c25be3 req-e96e9fdd-b9cd-4084-8a69-382a8e8b889a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.580250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bf7d73f2-c4ec-4daf-8d92-1ad023c25be3 req-e96e9fdd-b9cd-4084-8a69-382a8e8b889a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.590489 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6dd4d9b-950b-41c5-956d-7827e101918b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.405855 Nov 02 13:44:16.602463 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 434/856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.625577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d74ded0-6139-4061-8e85-bd67042a3005 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.634098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d74ded0-6139-4061-8e85-bd67042a3005 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.634614 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-bf7d73f2-c4ec-4daf-8d92-1ad023c25be3 req-e96e9fdd-b9cd-4084-8a69-382a8e8b889a service nova] Creating event network-changed:ca95a7f1-7a9d-4aa8-94b1-70f7a6b766bc for instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 on n-h2-858238-3 Nov 02 13:44:16.644819 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-bf7d73f2-c4ec-4daf-8d92-1ad023c25be3 req-e96e9fdd-b9cd-4084-8a69-382a8e8b889a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086334 Nov 02 13:44:16.645546 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 423/857] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:16.655440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-87a9a203-da0c-4b21-9a5b-2ee5dd2fe075 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.661139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-87a9a203-da0c-4b21-9a5b-2ee5dd2fe075 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.760919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-87a9a203-da0c-4b21-9a5b-2ee5dd2fe075 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:16.768629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d74ded0-6139-4061-8e85-bd67042a3005 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:16.807734 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-87a9a203-da0c-4b21-9a5b-2ee5dd2fe075 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1224 microversion: 2.1 time: 0.157584 Nov 02 13:44:16.809882 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 424/858] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.818323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c339d0ad-721e-436d-bd15-a0c8be9f56ba tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.819862 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d74ded0-6139-4061-8e85-bd67042a3005 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1120 microversion: 2.1 time: 0.211792 Nov 02 13:44:16.821858 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 435/859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1120 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.853333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ceac3cf7-132b-4508-ab0e-baf64a1f8663 req-5c488920-eda9-4588-8b41-0c9ad1e62916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe77b17-d974-49f8-9b09-3aa8866fc56e", "tag": "3b0d7cb7-22f9-48b0-9f29-0906adc65935"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:16.868280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ceac3cf7-132b-4508-ab0e-baf64a1f8663 req-5c488920-eda9-4588-8b41-0c9ad1e62916 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.868791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ceac3cf7-132b-4508-ab0e-baf64a1f8663 req-5c488920-eda9-4588-8b41-0c9ad1e62916 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.869434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ceac3cf7-132b-4508-ab0e-baf64a1f8663 req-5c488920-eda9-4588-8b41-0c9ad1e62916 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.880679 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c339d0ad-721e-436d-bd15-a0c8be9f56ba tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1086109857" status: 202 len: 0 microversion: 2.1 time: 0.066206 Nov 02 13:44:16.883267 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 425/860] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 13:44:16 2022] DELETE /compute/v2.1/flavors/1086109857 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:16.889582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ceac3cf7-132b-4508-ab0e-baf64a1f8663 req-5c488920-eda9-4588-8b41-0c9ad1e62916 service nova] Creating event network-changed:3b0d7cb7-22f9-48b0-9f29-0906adc65935 for instance ebe77b17-d974-49f8-9b09-3aa8866fc56e on n-h2-858238-3 Nov 02 13:44:16.895067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f6ba145-7454-49db-ae14-d4ee3261c33b tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.897198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ceac3cf7-132b-4508-ab0e-baf64a1f8663 req-5c488920-eda9-4588-8b41-0c9ad1e62916 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064017 Nov 02 13:44:16.905900 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 436/861] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:16.939849 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f6ba145-7454-49db-ae14-d4ee3261c33b tempest-ServersWithSpecificFlavorTestJSON-1479943445 tempest-ServersWithSpecificFlavorTestJSON-1479943445-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051075 Nov 02 13:44:16.957519 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 426/862] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.978751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.981889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.001572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.004112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.005120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.006191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.011587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.012476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.054125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e HTTP/1.1 Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:44:17.056748 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.058461 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '187acb18-1b79-484c-abce-d04e4f964c1e'} Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:17.059824 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.062826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.065204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:17.065204 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a5b8857-f810-46f0-948b-6723c89c8bd9 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "DELETE /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 404 len: 111 microversion: 2.1 time: 0.087937 Nov 02 13:44:17.065204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 437/863] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:44:16 2022] DELETE /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:17.074100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.074985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 187acb18-1b79-484c-abce-d04e4f964c1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.092421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.093179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.093927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.104345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.105217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.105930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.111837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:17.151146 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e HTTP/1.1 Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:44:17.152965 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.155346 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '187acb18-1b79-484c-abce-d04e4f964c1e'} Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:17.156197 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. Nov 02 13:44:17.157621 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.160131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 187acb18-1b79-484c-abce-d04e4f964c1e could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:17.161356 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9c7018be-c2ac-420d-8a4a-1160551aba11 tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e" status: 404 len: 111 microversion: 2.1 time: 0.092989 Nov 02 13:44:17.165670 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 427/864] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/187acb18-1b79-484c-abce-d04e4f964c1e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:17.172947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.173448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.182369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.183077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.183563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.184635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.185568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.186521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.208050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.208978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.219769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.223625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.224162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.225117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.227963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.228423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.230925 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 HTTP/1.1 Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:44:17.237211 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.238614 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3e1c6755-70f9-4cac-9d48-00f65b4a9507'} Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:17.239376 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.240763 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.242231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:17.242231 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23d5afa6-cec0-49d1-912d-b962fb3e283d tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 404 len: 111 microversion: 2.1 time: 0.073855 Nov 02 13:44:17.243446 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 438/865] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:44:17 2022] DELETE /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:17.257496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.258877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] [instance: 3e1c6755-70f9-4cac-9d48-00f65b4a9507] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.272803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.274013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.276316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.278041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.279077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.280345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.299134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:17.322743 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] HTTP exception thrown: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Request method failure captured: Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 HTTP/1.1 Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnNydxazyMAMvp1FWxUQ4lgQuixHmDM55zkV3BhSHy07dxxnS3CTRSOuOfd8NMhzPGN7GA72gfEhyl65bEoRdQA1fVYYSIr5EtjVIeqeLC0AsBigOHbKPI3f8Vux5FLcyACoPl5UNLCDFcwCi_nNjyH13_4qoU8C6xd5V3rJYvEx98E Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:44:17.325730 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ae2d07f95c10416ebb9d30228f5e907e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ae2d07f95c10416ebb9d30228f5e907e"}]}] Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ae2d07f95c10416ebb9d30228f5e907e Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148 Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 351f7415c03346aa81dfbd73a686327f Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1219018148-project Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.328975 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3e1c6755-70f9-4cac-9d48-00f65b4a9507'} Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:17.330690 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. Nov 02 13:44:17.334169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:17.335768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] Returning 404 to user: Instance 3e1c6755-70f9-4cac-9d48-00f65b4a9507 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:17.338057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c78421d5-3bf0-41bd-875b-52fe70def7ba tempest-ServersWithSpecificFlavorTestJSON-1219018148 tempest-ServersWithSpecificFlavorTestJSON-1219018148-project] 10.222.0.18 "GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507" status: 404 len: 111 microversion: 2.1 time: 0.089746 Nov 02 13:44:17.344574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 439/866] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/3e1c6755-70f9-4cac-9d48-00f65b4a9507 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:17.491731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.509807 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d04cf3cc-8259-4c45-be42-1c1b1886ed5e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 0.298993 Nov 02 13:44:17.515160 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 428/867] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:17.574809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.578005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.593148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.594047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.594683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.596116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.597206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.599528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.624353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.625458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.638740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.643396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.644005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.645631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.646104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.646610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.882112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.892457 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5d033ec-e567-4c3d-924c-38ca658606ca tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.272580 Nov 02 13:44:17.893281 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 429/868] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:17.935030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.951794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-033109d5-1a1f-4b55-ac13-ae3c3625694f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.382962 Nov 02 13:44:17.967808 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 440/869] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:17.976904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.977887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.984556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.985578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.986478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.987915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.988824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.989621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.086766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1882422378", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:18.093054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:18.104311 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c55215f2-06b8-4203-b2c2-8a9dbbf77d25 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1220 microversion: 2.1 time: 0.135256 Nov 02 13:44:18.123397 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 441/870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:18.123397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.123397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.129113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.130665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.131391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.132379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.133014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.134250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.150859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:18.444375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:18.444849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:18.445956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:18.446587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:18.447128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:18.461355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.462586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.463425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.465053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.466142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.467286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.476197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:18.493376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b9182f6-841b-4e6a-bb69-85be270cd0b3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1218 microversion: 2.1 time: 0.386042 Nov 02 13:44:18.508681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Getting quotas for project 9e05ee5eb5cd4988b46b9f26dd465546. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:18.514881 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 442/871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1218 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:18.521826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Getting quotas for user d9d13699486d4f8d90b656623f88e267 and project 9e05ee5eb5cd4988b46b9f26dd465546. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:18.544642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.546650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:18.547705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.551510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:18.557673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.558497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.559018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.560028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.561347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.561949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.636624 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a5bd494-35e6-492e-8ddd-a6678a0526ab tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740544 Nov 02 13:44:18.640513 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 430/872] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:44:18.658337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1838fcba-f86e-4be9-81e7-9b706233bd7e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.660575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1838fcba-f86e-4be9-81e7-9b706233bd7e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.665790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:18.764459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1838fcba-f86e-4be9-81e7-9b706233bd7e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:18.785702 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1838fcba-f86e-4be9-81e7-9b706233bd7e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1217 microversion: 2.1 time: 0.133583 Nov 02 13:44:18.786690 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 431/873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:18.930329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.936417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.973674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.975976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.977556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.981003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.984223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.984985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.239977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:19.249492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d1243ff-4a74-4a42-aec7-c980c392832f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 0.716156 Nov 02 13:44:19.271181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 443/874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:19.290892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:19.291702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:19.301662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.302566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.309920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.312515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.313842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.315360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.824129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:19.843294 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-482bd7c0-8f9c-41ba-beaa-7916804368ff tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.920239 Nov 02 13:44:19.845134 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 432/875] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:19.858845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:19.859957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:19.867570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.868439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.869411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.870650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.871695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.872587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.046904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:20.067153 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9412b45a-c0e3-4629-90b5-6242503f798e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.799583 Nov 02 13:44:20.071980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 444/876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:19 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:20.083847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:20.084811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:20.119744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.122790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.127452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.129895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.130739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.132420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.318810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:20.327501 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6975365-55a2-416e-b698-aca782b445cc tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1276 microversion: 2.1 time: 0.477731 Nov 02 13:44:20.332635 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 433/877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:19 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1276 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:20.353426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:20.354291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:20.361901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.362391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.363286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.364152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.364909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.367905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.476021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:20.494351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06a43778-9962-4ede-9178-8e3e69c10215 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1236 microversion: 2.1 time: 0.420247 Nov 02 13:44:20.497238 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 445/878] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:20 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1236 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:20.497526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:20.505241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:20.506736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:20.510268 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-476f4900-5a95-4519-8941-232329574836 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1269 microversion: 2.1 time: 0.173033 Nov 02 13:44:20.510991 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 434/879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:20 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:20.530061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.535448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.537368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.541517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.542920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.543650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.872362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:20.873018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:20.882740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.883169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.883611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.887627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.888093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.889806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.310205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.321132 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4bef54e0-99ca-4cdb-bdee-29df522a7467 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 0.822489 Nov 02 13:44:21.331503 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 446/880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:20 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:21.349441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:21.350867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:21.365406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.366246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.366863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.367774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.368389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.368958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.698652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.708418 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1282626a-cf88-4d65-a47b-d6ef73b38662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.375430 Nov 02 13:44:21.711617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.713199 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 447/881] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:21 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:21.720498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:21.723494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:21.737658 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2797d9e3-df09-44f7-a7d5-9c8bf3c97c2b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.871087 Nov 02 13:44:21.738964 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 435/882] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:20 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:21.740715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.743585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.744507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.746750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.748864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.750940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.756172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:21.756843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:21.788152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.788632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.789414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.790853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.791920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.804009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.952628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.966112 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37641a82-7e7b-4704-bad6-b2568f3a9671 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1282 microversion: 2.1 time: 0.251534 Nov 02 13:44:21.967735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 448/883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:21 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:21.976586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:21.979914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:21.999402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.014276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.014871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.019260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.023845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.024831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.153661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:22.174678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:22.177654 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5fa73923-64c5-4598-866c-4271805dfe14 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1236 microversion: 2.1 time: 0.436412 Nov 02 13:44:22.186139 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8c6490d-ddc4-4434-b578-ecea4dffd75c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1275 microversion: 2.1 time: 0.215639 Nov 02 13:44:22.190736 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 449/884] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:21 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:22.191771 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 436/885] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:21 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1236 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:22.354846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:22.354846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:22.367057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.367678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.368184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.368978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.372397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.372397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.745424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:22.747253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:22.762714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.764506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.765207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.772289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.773246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.775044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.428987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:23.443359 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c2e0b7a-3f73-4249-9b6e-08aff0b7f06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.709396 Nov 02 13:44:23.449670 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 437/886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:22 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:23.461725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:23.462362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:23.476015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.476505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.477158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.477964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.484755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.485219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.807205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:23.829897 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78b44059-9f01-4990-a427-66ca4b467c46 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 1.479708 Nov 02 13:44:23.867346 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 450/887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:22 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:23.879484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:23.880415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:23.896515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.904021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.904800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.906037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.906968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.908158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.044746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.063272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2dd20b3a-12cb-43d7-b29b-8a26702198a0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1282 microversion: 2.1 time: 0.191890 Nov 02 13:44:24.064455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 451/888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:23 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:24.073518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.075128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.087177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.088933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.089603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.091047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.094044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.095434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.119192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.137326 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bc664666-53df-427d-91f4-98903372cfdd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.681223 Nov 02 13:44:24.143253 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 438/889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:23 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:24.174747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.176218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.194292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.195693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.196691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.197929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.198648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.199344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.424305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.456616 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-91a75379-a877-4f4a-b7e2-2e14c90a6b7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1275 microversion: 2.1 time: 0.307552 Nov 02 13:44:24.458152 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 439/890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:24.492120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.496939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.543906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.547237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.550191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.557586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.576808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.577446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.578389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.589887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-858de45b-6a26-4e7e-bfcd-a43801ab5590 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1304 microversion: 2.1 time: 0.523802 Nov 02 13:44:24.591075 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 452/891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1304 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:24.870180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.870967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.892080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.892601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.893069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.893815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.894467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.899245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.066589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:25.081547 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2561407c-45c6-4f49-881c-88aec498038d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.597554 Nov 02 13:44:25.095728 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 440/892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:25.095728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.095728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.124626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.128160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.128807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.132418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.132974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.135252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.456817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:25.725418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:25.740900 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-430c41eb-5e36-41db-841a-41abc7b9fa85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 0.874508 Nov 02 13:44:25.741583 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 453/893] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:25.746866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.747522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.773452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.773960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.774401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.775471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.776119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.776764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.822269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:25.841571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-013bb5cc-5e09-4023-81f2-d6a7d8b81bfa tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.752837 Nov 02 13:44:25.842733 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 441/894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:25 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:25.874553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f0f6e967-db8c-4647-bfbc-9ca3ae3ac74a req-19eedec9-54bd-4def-b953-2993d00a3f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3428c3e-a122-4f8d-a660-b46c92ff1c59", "name": "network-vif-plugged", "status": "completed", "tag": "ca95a7f1-7a9d-4aa8-94b1-70f7a6b766bc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:25.892347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f0f6e967-db8c-4647-bfbc-9ca3ae3ac74a req-19eedec9-54bd-4def-b953-2993d00a3f2d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.893236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f0f6e967-db8c-4647-bfbc-9ca3ae3ac74a req-19eedec9-54bd-4def-b953-2993d00a3f2d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.894939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f0f6e967-db8c-4647-bfbc-9ca3ae3ac74a req-19eedec9-54bd-4def-b953-2993d00a3f2d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.912867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f0f6e967-db8c-4647-bfbc-9ca3ae3ac74a req-19eedec9-54bd-4def-b953-2993d00a3f2d service nova] Creating event network-vif-plugged:ca95a7f1-7a9d-4aa8-94b1-70f7a6b766bc for instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 on n-h2-858238-3 Nov 02 13:44:25.920961 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f0f6e967-db8c-4647-bfbc-9ca3ae3ac74a req-19eedec9-54bd-4def-b953-2993d00a3f2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049244 Nov 02 13:44:25.925240 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 442/895] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:25.939503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.940388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.950183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.950680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.951667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.952514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.952976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.953784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.346605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.363711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec303440-5e17-4e84-bd12-e9d7622fc1bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1500 microversion: 2.1 time: 0.620931 Nov 02 13:44:26.364825 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 454/896] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:25 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1500 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:26.370145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:26.371609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:26.382021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.382963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.383783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.385080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.387069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.390802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.727868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.741699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-393e310c-454a-45d5-bd46-c0ea9f4dac08 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1304 microversion: 2.1 time: 0.375638 Nov 02 13:44:26.752446 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 455/897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:26 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1304 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:26.757972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:26.758818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:26.765582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.766306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.766922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.767841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.768473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.769094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.831345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:26.846002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:27.022839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.032161 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c6a09c7-db10-4482-84ff-3e339d5ede19 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 1.104407 Nov 02 13:44:27.033158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 443/898] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:25 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:27.039975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.041127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.049543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.050256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.050878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.051768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.052815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.053407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.131715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.147290 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abb37eab-a49d-4251-b7b0-02003f1c2c51 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.393017 Nov 02 13:44:27.149886 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 456/899] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:26 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:27.158489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.160000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.172949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.173831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.174758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.175692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.176599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.177051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.711926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.726815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d386baf0-a0fb-4bbd-9535-984139bb7e1c tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.575302 Nov 02 13:44:27.727471 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 457/900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:27.740201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-465713a7-bce8-49db-8570-1dcbceb0d2ab req-7376b617-3f32-44f1-ba7c-7c4996176966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7", "tag": "3964e435-be7d-448a-819a-3ae95e8e9617"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:27.765521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-465713a7-bce8-49db-8570-1dcbceb0d2ab req-7376b617-3f32-44f1-ba7c-7c4996176966 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.766396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-465713a7-bce8-49db-8570-1dcbceb0d2ab req-7376b617-3f32-44f1-ba7c-7c4996176966 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.766985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-465713a7-bce8-49db-8570-1dcbceb0d2ab req-7376b617-3f32-44f1-ba7c-7c4996176966 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.812602 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-465713a7-bce8-49db-8570-1dcbceb0d2ab req-7376b617-3f32-44f1-ba7c-7c4996176966 service nova] Creating event network-changed:3964e435-be7d-448a-819a-3ae95e8e9617 for instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 on n-h1-858238-3 Nov 02 13:44:27.824124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-465713a7-bce8-49db-8570-1dcbceb0d2ab req-7376b617-3f32-44f1-ba7c-7c4996176966 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095371 Nov 02 13:44:27.824752 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 458/901] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:27.838875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.841345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.842615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.862286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.863044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.863714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.864594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.875881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.876569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.887369 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3922eb16-173c-4bd1-bc48-aad5c9ce69f3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1316 microversion: 2.1 time: 0.852360 Nov 02 13:44:27.891072 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 444/902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:27.905395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.910682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.931549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.935560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.936756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.937694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.938287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.939411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.177928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:28.208382 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b8ee449-f420-41ec-920f-051d75720c6b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1475 microversion: 2.1 time: 0.381877 Nov 02 13:44:28.209449 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 459/903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:28.250581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:28.252147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:28.263279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.265015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.265964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.267742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.268843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.269807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.483150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=16 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:28.601149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:28.634632 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d8b78312-9979-4852-99b5-bb597fb2f7c0 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1304 microversion: 2.1 time: 0.741358 Nov 02 13:44:28.636959 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 445/904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1304 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:28.668085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:28.669374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:28.695870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.695870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.695870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.696845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.697696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.698479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.772043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=22 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:28.802442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:28.822256 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-726b6856-fd90-4fae-8ac1-7e51b5c8551a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.600846 Nov 02 13:44:28.853324 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 460/905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:28 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:28.870150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71506186-b0b8-4940-9f6a-83f13ae8a29e tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '.version_select at 0x7f6f81bbb040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:28.880943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71506186-b0b8-4940-9f6a-83f13ae8a29e tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.883742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71506186-b0b8-4940-9f6a-83f13ae8a29e tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.884987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71506186-b0b8-4940-9f6a-83f13ae8a29e tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.918084 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71506186-b0b8-4940-9f6a-83f13ae8a29e tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.062098 Nov 02 13:44:28.932720 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 461/906] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:44:28 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:28.939365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-79499812-3823-49af-842a-42b5fd5f709e req-a7992ec6-e9d6-4377-b9cf-b4111e15e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52930fa0-4be4-4360-92c9-e26f818900c5", "tag": "e2323723-2a70-402a-b8fe-89d625a68490"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:28.981714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79499812-3823-49af-842a-42b5fd5f709e req-a7992ec6-e9d6-4377-b9cf-b4111e15e4ba service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.982999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79499812-3823-49af-842a-42b5fd5f709e req-a7992ec6-e9d6-4377-b9cf-b4111e15e4ba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.983780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79499812-3823-49af-842a-42b5fd5f709e req-a7992ec6-e9d6-4377-b9cf-b4111e15e4ba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.004767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-79499812-3823-49af-842a-42b5fd5f709e req-a7992ec6-e9d6-4377-b9cf-b4111e15e4ba service nova] Creating event network-changed:e2323723-2a70-402a-b8fe-89d625a68490 for instance 52930fa0-4be4-4360-92c9-e26f818900c5 on n-h1-858238-3 Nov 02 13:44:29.037171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-79499812-3823-49af-842a-42b5fd5f709e req-a7992ec6-e9d6-4377-b9cf-b4111e15e4ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102833 Nov 02 13:44:29.038605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 462/907] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:29.046665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:29.047680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:29.057868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.057868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.057868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.057868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.058535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.058535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.254752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.257603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:29.268460 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-24a10289-de73-4fb2-98ed-5e9cff6b542c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.608240 Nov 02 13:44:29.297617 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 446/908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:28 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:29.305047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:29.306545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:29.314143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.314900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.315563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.316452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.317105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.317698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.627996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.639329 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9f85b261-b63b-422a-b772-e20993c351c2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1465 microversion: 2.1 time: 0.338897 Nov 02 13:44:29.640705 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 447/909] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:29 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1465 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:29.645608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:29.646819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:29.654185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.655031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.655644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.657113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.657862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.658456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.787125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.801586 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-467c093c-fbd2-4ad7-b677-2c07680e55e5 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.761233 Nov 02 13:44:29.802587 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 463/910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:29 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:29.811796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:29.812502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:29.820738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.821641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.822261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.823164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.823824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.824466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.127574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.135686 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64dd8364-27cf-4c9c-be45-c48070c840b2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.330796 Nov 02 13:44:30.136377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 464/911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:29 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:30.143472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:30.143472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:30.152210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.153208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.154061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.155565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.156490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.157332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.235327 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9c1d607a-ce2f-4cb9-86b2-b62eb30a7cfb tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 200 len: 1626 microversion: 2.1 time: 0.593109 Nov 02 13:44:30.239501 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 448/912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:29 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 1626 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:30.263024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:30.266555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:30.280397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.281273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.281930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.283070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.283812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.284536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.382711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5aadfca-6733-4760-bd7a-f436385c40c8 tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1616 microversion: 2.1 time: 0.245026 Nov 02 13:44:30.383484 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 465/913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:30 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1616 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:30.389919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-580b93e7-13b6-41fb-b495-73f9ecfdd289 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Action: 'create', calling method: .version_select at 0x7f6f81ba7af0>, body: {"keypair": {"name": "tempest-keypair-733637231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQIT7lrQnXyKq30AXZ7mlzousBNyRivjPsndTFFzAEqMXp9LDGitJ85C+fm9KLOZRBe6F2W8sZEUfqBAwTjgLiWSBFL5P9oT2oYrB6vyB80pUJyRJ2kD9Nms4krcF4Bsw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:30.415313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-580b93e7-13b6-41fb-b495-73f9ecfdd289 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for project 89354db644694189ac3ae9ec09e7e786. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:30.437579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-580b93e7-13b6-41fb-b495-73f9ecfdd289 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for user 23d76f5c29444358864d0bc25c83b4b4 and project 89354db644694189ac3ae9ec09e7e786. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:30.472360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-580b93e7-13b6-41fb-b495-73f9ecfdd289 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087483 Nov 02 13:44:30.473404 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 466/914] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:44:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:30.479140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:30.480146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:30.489303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.490218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.490880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.492165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.492896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.495670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.691431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.704288 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-73367287-3e2b-4464-b314-a18c7c8f213e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.461582 Nov 02 13:44:30.705279 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 449/915] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:30 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:30.710646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-332466586", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "fa9c1616-fc5e-4255-af98-141b90526fe4"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:30.770182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.780219 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba75873e-63a9-4216-a1ee-aced75012db9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.305213 Nov 02 13:44:30.780825 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 467/916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:30 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:30.785551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:30.832791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:30.832791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:30.842405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.843506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.843956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.844825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.845587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.846461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.048149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:31.057082 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0867b41d-dd22-4fb6-82f8-719b26a7697d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.230719 Nov 02 13:44:31.057793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 468/917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:30 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:31.164827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:31.165551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:31.172909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.173504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.174001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.174768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.175319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.175803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.366921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:31.379895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71604682-3400-4709-8b69-c4240e6fd460 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.218710 Nov 02 13:44:31.380938 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 469/918] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:31 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:31.387736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1fc6db81-b643-4deb-a2d4-b37a7546e6bb req-cc9551eb-581f-4664-b97e-cfbe2b5d5126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:31.415334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1fc6db81-b643-4deb-a2d4-b37a7546e6bb req-cc9551eb-581f-4664-b97e-cfbe2b5d5126 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.416380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1fc6db81-b643-4deb-a2d4-b37a7546e6bb req-cc9551eb-581f-4664-b97e-cfbe2b5d5126 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.417062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1fc6db81-b643-4deb-a2d4-b37a7546e6bb req-cc9551eb-581f-4664-b97e-cfbe2b5d5126 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.437816 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1fc6db81-b643-4deb-a2d4-b37a7546e6bb req-cc9551eb-581f-4664-b97e-cfbe2b5d5126 service nova] Creating event network-changed:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:44:31.443635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1fc6db81-b643-4deb-a2d4-b37a7546e6bb req-cc9551eb-581f-4664-b97e-cfbe2b5d5126 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061067 Nov 02 13:44:31.445211 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 470/919] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:31.657523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:31.658094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:31.658930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:31.659601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:31.660117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:31.671792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.672593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.673127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.674653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.675288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.675922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.695335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:31.703247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Getting quotas for user 6d7a7e25d4ef4a6fbb82b806a555ed87 and project 56eb3627bd244c4dbac386bfcecd21ef. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:31.719399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:31.722080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:31.740134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:31.741787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:31.751544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:31.755484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.756636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.758049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.759289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.759957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.760824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.791071 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2cbe0d9b-ae26-426c-929a-fc25074160b7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084044 Nov 02 13:44:31.796550 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 450/920] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:44:31.810788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4ec7cfc1-13a6-4a8e-843c-d6c5e538cea4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:31.811390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4ec7cfc1-13a6-4a8e-843c-d6c5e538cea4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:31.931186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4ec7cfc1-13a6-4a8e-843c-d6c5e538cea4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:31.948163 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4ec7cfc1-13a6-4a8e-843c-d6c5e538cea4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1216 microversion: 2.1 time: 0.143837 Nov 02 13:44:31.964115 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 451/921] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:31 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:31.974909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:31.977683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:31.989773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.990757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.991635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.994267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.995324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.996164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.099427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.116526 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48d2c08a-4db6-41ae-aeab-c313a80bba11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.384895 Nov 02 13:44:32.134338 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 471/922] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:31 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:32.136956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:32.146025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:32.159797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.160760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.161907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.164319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.166171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.167461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.420622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.430903 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3afaef4e-1ecc-4775-87e2-8ff87315b4d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.305513 Nov 02 13:44:32.431565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 472/923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:32 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:32.448333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:32.448952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:32.459822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.460610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.461286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.462165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.462764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.463569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.545973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.561740 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c71c6c9-57a3-44c3-bb86-f5c8e58a250e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.594187 Nov 02 13:44:32.563848 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 452/924] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:31 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:32.721685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.731200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0f542a09-0dbd-43f6-baf1-9fc13e9a06d6 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.298377 Nov 02 13:44:32.748730 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 473/925] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:32 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:32.975603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:32.977669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:32.990519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.992288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.999416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.001105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.002021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.002864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.160267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.161347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.181513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.181513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.181513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.181513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.182141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.182141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.202667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.213235 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ab40f66-4f3a-400e-afb3-39f5bcd3da7f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1268 microversion: 2.1 time: 0.244054 Nov 02 13:44:33.218296 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 453/926] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:32 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1268 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:33.361714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1446492408", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e0293639-a49a-47d1-9a03-7fbc87f19e62"}], "security_groups": [{"name": "tempest-securitygroup--743005213"}], "key_name": "tempest-keypair-733637231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:33.428039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.447724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2b8b74a-4e6f-4e69-bccc-004a8c53c9b0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.291906 Nov 02 13:44:33.463821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 474/927] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:33.472650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.473302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.479922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.480399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.481051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.481759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.482213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.482665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.695173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] validate_networks() for [('e0293639-a49a-47d1-9a03-7fbc87f19e62', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:33.712478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.740251 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0445b1d4-413a-4e13-bd2c-6eb7ca15a49f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.273744 Nov 02 13:44:33.741627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 475/928] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:33.751592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.753149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.767061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.767825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.769159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.770045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.770708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.771311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.974023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.978071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:33.986550 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e06d066-8ca4-4e47-8a0a-c4c8c762c970 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.243674 Nov 02 13:44:33.987482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 476/929] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:33.992909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.993857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:34.011548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.012204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.012970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.014384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.015002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.015720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.191044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.211659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6f1b808-54cd-4bbc-850b-158370c3d368 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.222753 Nov 02 13:44:34.212248 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 477/930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:34.248086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:34.250184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:34.259229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.260013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.261246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.262139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.262887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.263496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.349267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.359432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bde293a5-76ce-4108-aafe-393599d5fcce tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1274 microversion: 2.1 time: 0.119604 Nov 02 13:44:34.360022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 478/931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:34 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:34.472724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:34.473512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:34.483565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.484398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.485261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.486287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.486904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.487508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.777990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.798456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23983b95-f49a-4625-889b-d2444863825c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.330144 Nov 02 13:44:34.799560 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 479/932] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:34 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:34.804879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:34.805705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:34.823914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.824618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.825327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.826368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.827005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.827810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.976536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:34.977320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:34.977508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:34.977787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:34.978565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:35.012438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.012929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.013360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.014636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.015083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.015553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.059047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:35.069149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for user 23d76f5c29444358864d0bc25c83b4b4 and project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:35.085955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:35.089320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:35.145755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.153901 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2c6c05d0-1f35-476f-85d2-275fb397ad0f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.797063 Nov 02 13:44:35.156870 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 454/933] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:44:35.166473 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dec41a2d-a9c7-4c74-b96e-bb605474b26b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.365487 Nov 02 13:44:35.168979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.170626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.183606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 480/934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:34 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:35.189688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1a29abf-41b1-4d7e-ad80-475ef8586cfe tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.190307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1a29abf-41b1-4d7e-ad80-475ef8586cfe tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.194543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.195591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.195591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.196207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.196766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.197066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.291722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f1a29abf-41b1-4d7e-ad80-475ef8586cfe tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.303948 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1a29abf-41b1-4d7e-ad80-475ef8586cfe tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1234 microversion: 2.1 time: 0.119055 Nov 02 13:44:35.321540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 481/935] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1234 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:35.346836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.348925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.362515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.375524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.376707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.381406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.384304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.385113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.626765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.649407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71e61a45-4a7f-4ad9-967e-42d6f1187eb3 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.321363 Nov 02 13:44:35.654504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 482/936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:35.678405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.682268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.714267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.716615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.717119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.720759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.721390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.724244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.822426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.832184 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ad884082-f18d-47f1-b0de-4b66725f4c0f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.673421 Nov 02 13:44:35.834015 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 455/937] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:35.841368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.842487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.855433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.856127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.856995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.859602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.860252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.860855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.034867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.047544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7bc4ba2d-afd4-496f-a37e-1da504af24a0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.387970 Nov 02 13:44:36.048802 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 483/938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:36.116829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.125326 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-81f8deb3-0346-421c-8527-23bfcfd9cc8a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.289845 Nov 02 13:44:36.139711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 456/939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:36.198432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:36.199353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:36.208450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.209448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.210172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.211290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.213657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.214323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.349242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:36.350362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:36.364688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.365959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.367075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.369607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.370626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.371632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.493452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.509974 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05a408f0-f83b-4f38-abb0-55ec8aee097d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1286 microversion: 2.1 time: 0.167817 Nov 02 13:44:36.511629 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 457/940] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:36 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:36.628379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.643387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-605aa2a5-5c0c-41bc-b6b1-5f8c9a4030ea tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.449944 Nov 02 13:44:36.644296 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 484/941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:36 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:36.677762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:36.678809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:36.687902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.688593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.689277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.690987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.691754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.692581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.859391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:36.860520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:36.873748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.874520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.900137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.906231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.906878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.910495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.114759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:37.131984 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3fefad40-0c3d-46a9-ab94-db36680dde48 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.457609 Nov 02 13:44:37.135872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 458/942] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:36 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:37.146284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1cf26830-8df8-4054-bdf8-3757c096732d req-8fb583df-6a48-4296-a76f-7b8681988665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52930fa0-4be4-4360-92c9-e26f818900c5", "name": "network-vif-plugged", "status": "completed", "tag": "e2323723-2a70-402a-b8fe-89d625a68490"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:37.161869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1cf26830-8df8-4054-bdf8-3757c096732d req-8fb583df-6a48-4296-a76f-7b8681988665 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.162777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1cf26830-8df8-4054-bdf8-3757c096732d req-8fb583df-6a48-4296-a76f-7b8681988665 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.163502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1cf26830-8df8-4054-bdf8-3757c096732d req-8fb583df-6a48-4296-a76f-7b8681988665 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.178839 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1cf26830-8df8-4054-bdf8-3757c096732d req-8fb583df-6a48-4296-a76f-7b8681988665 service nova] Creating event network-vif-plugged:e2323723-2a70-402a-b8fe-89d625a68490 for instance 52930fa0-4be4-4360-92c9-e26f818900c5 on n-h1-858238-3 Nov 02 13:44:37.187566 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1cf26830-8df8-4054-bdf8-3757c096732d req-8fb583df-6a48-4296-a76f-7b8681988665 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049591 Nov 02 13:44:37.188940 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 459/943] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:37.197288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:37.198196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:37.213029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.214957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.215713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.217320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.219046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.219669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.289823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:37.306401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0192f40c-83b1-4193-b0d4-547189db7bb7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.452091 Nov 02 13:44:37.327928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 485/944] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:36 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:37.350410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:37.351836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:37.369406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.370208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.370856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.372193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.375570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.376514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.795897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:37.811982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95f26841-2e39-4406-a5db-2a89fcc0ad89 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.482364 Nov 02 13:44:37.812580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 486/945] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:37 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:37.842769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:37.843409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:37.856459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.856948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.857371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.858690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.859163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.859599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.883479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:37.894974 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a320c465-d866-416e-b403-ebf7daaf6ee6 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.703389 Nov 02 13:44:37.897250 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 460/946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:37 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:37.918949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:37.918949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:37.918949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.918949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.920774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.920774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.920774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.920774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.960044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:37.970627 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3219429d-7965-4a09-9098-0dacaac038d6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1292 microversion: 2.1 time: 0.144444 Nov 02 13:44:37.972504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 487/947] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:37 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:38.169412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:38.171703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:38.186778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.187543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.187979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.188695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.189149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.189566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.356173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:38.365870 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d7ea028-d4c8-45dc-b0d6-f34a23e28833 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1324 microversion: 2.1 time: 0.467481 Nov 02 13:44:38.366797 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 461/948] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:37 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:38.372766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:38.374279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:38.381645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.382378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.383048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.384024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.384718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.385483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.464759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:38.477182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f2d6c55-9a19-4ca2-bddf-7b797f36c58a tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.314981 Nov 02 13:44:38.477896 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 488/949] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:38 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:38.704538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-57c0e65f-721e-4467-bfad-e6ec24d28911 req-e16727aa-26bf-423d-b93d-e144417868c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add86abd-d651-4ffc-a079-b6c2e0ebbdab", "tag": "dd8c28cf-09cc-4c2c-9a19-70b896c67b51"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:38.727536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-57c0e65f-721e-4467-bfad-e6ec24d28911 req-e16727aa-26bf-423d-b93d-e144417868c6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.728871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-57c0e65f-721e-4467-bfad-e6ec24d28911 req-e16727aa-26bf-423d-b93d-e144417868c6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.729844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-57c0e65f-721e-4467-bfad-e6ec24d28911 req-e16727aa-26bf-423d-b93d-e144417868c6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.754865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-57c0e65f-721e-4467-bfad-e6ec24d28911 req-e16727aa-26bf-423d-b93d-e144417868c6 service nova] Creating event network-changed:dd8c28cf-09cc-4c2c-9a19-70b896c67b51 for instance add86abd-d651-4ffc-a079-b6c2e0ebbdab on n-h1-858238-3 Nov 02 13:44:38.764101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-57c0e65f-721e-4467-bfad-e6ec24d28911 req-e16727aa-26bf-423d-b93d-e144417868c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081420 Nov 02 13:44:38.765534 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 489/950] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:44:38.841202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:38.843082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:38.850008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.850557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.851202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.852668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.853370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.854641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.878003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:38.886016 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3236b17e-5ef2-44dd-a068-16f55db1fba0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.517929 Nov 02 13:44:38.903414 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 462/951] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:38 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:38.932216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:38.933232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:38.940939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.941617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.942183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:38.943010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:38.943595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:38.944148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.077534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.086837 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-826ae324-affa-4271-a1ca-b38d17539444 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.252085 Nov 02 13:44:39.087632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 490/952] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:38 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:39.095005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:39.096085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.106364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.107219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.107945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.109355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.110238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.110776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.215116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.227648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3eb718e4-795d-400c-b038-498864b1ebd6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1292 microversion: 2.1 time: 0.138382 Nov 02 13:44:39.228729 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 491/953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:39 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1292 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:39.395993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:39.396599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.419907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.420588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.421924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.422302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.423127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.423810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.613476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.618684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.630109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4adbd969-0753-42df-a481-0e0503ab18d8 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 200 len: 1518 microversion: 2.1 time: 0.237453 Nov 02 13:44:39.631075 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 492/954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:39 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:39.632096 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99a228c0-e4a3-4939-baa2-aeec2ce730c7 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.708983 Nov 02 13:44:39.637830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:39.638734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.642555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 463/955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:38 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:39.646591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.647113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.647767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.648749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.649893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.650727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.664937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'action', calling method: .version_select at 0x7f6f842c4e50>, body: {"addFloatingIp": {"address": "172.25.9.31"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:39.669200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.681726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:39.685327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.686801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.687478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.688359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.688975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.689569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.809603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:44:39.810302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquired lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:44:39.842835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.852346 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-587ca998-2253-4ce5-9b7d-ad3c03231e24 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.219034 Nov 02 13:44:39.870939 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 493/956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:39 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:39.882740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8db39a53-31a2-4c73-8a16-9045f23f0a66 req-33f8042c-0337-42be-81f4-8c3537b4c09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "name": "network-vif-plugged", "status": "completed", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:39.894328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8db39a53-31a2-4c73-8a16-9045f23f0a66 req-33f8042c-0337-42be-81f4-8c3537b4c09f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.894810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8db39a53-31a2-4c73-8a16-9045f23f0a66 req-33f8042c-0337-42be-81f4-8c3537b4c09f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.895270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8db39a53-31a2-4c73-8a16-9045f23f0a66 req-33f8042c-0337-42be-81f4-8c3537b4c09f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.909539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8db39a53-31a2-4c73-8a16-9045f23f0a66 req-33f8042c-0337-42be-81f4-8c3537b4c09f service nova] Creating event network-vif-plugged:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:44:39.916606 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8db39a53-31a2-4c73-8a16-9045f23f0a66 req-33f8042c-0337-42be-81f4-8c3537b4c09f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043586 Nov 02 13:44:39.917591 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 494/957] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:39.924878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:39.926025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.933665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.934679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.935378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.936473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.937209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.938791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.126854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.133806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:40.141067 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94034205-1007-46cb-bdfb-a8a1637fae58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.221591 Nov 02 13:44:40.159525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 495/958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:39 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:40.172003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:40.172618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:40.179119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.179666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.180092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.181201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.181651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.182075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.345465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.354355 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-403f4aed-6548-4136-b3eb-9d1716708770 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.191578 Nov 02 13:44:40.354941 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 496/959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:40 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:40.359618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:40.360600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:40.366912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.367425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.367851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.368555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.369029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.369445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.446256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.455185 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc4f3394-c8ae-4c4a-8aa9-5b7099f0f771 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1292 microversion: 2.1 time: 0.099119 Nov 02 13:44:40.455902 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 497/960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:40 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:40.674767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:40.676043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:40.686693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.687286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.687839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.689034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.690083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.690756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.930428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.952454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ec29c5f-b73f-4ade-ae77-d30d6a365cac tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.283112 Nov 02 13:44:40.969675 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 498/961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:40 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:40.977776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:40.978747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:40.992611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.993831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.994937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.996196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.997257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.997616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.209573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.224997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cdf48f97-48ee-4569-965d-0023fb162cff tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.257278 Nov 02 13:44:41.231166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 499/962] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:40 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:41.237282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:41.238074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:41.249751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.250330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.251294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.251856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.252846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.252970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.446942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.457743 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c1b71d5-96ca-4908-b2aa-befb00238ec7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1475 microversion: 2.1 time: 0.228011 Nov 02 13:44:41.458342 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 500/963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:41 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:41.465741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:41.466587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:41.475958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.476786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.477238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.477953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.478415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.478828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.654923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.673305 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15a7fd95-53e7-452c-86ac-51c8adc46b37 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.212466 Nov 02 13:44:41.683058 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 501/964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:41 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:41.691263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:41.692216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:41.699893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.700637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.701711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.702617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.703591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.704356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.935433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.947985 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54712592-cf02-4400-a1fb-8874b282f0c1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.261961 Nov 02 13:44:41.975364 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 502/965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:41 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:41.994375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:41.997356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:42.021500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.022315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.023156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.024850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.025577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.027440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.341121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:42.362031 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-916b352d-f577-40c6-a533-e95c6d495ff4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.376627 Nov 02 13:44:42.368685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 503/966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:41 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:42.381805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-815d1fe3-1bd1-4264-b723-d5eff85e4126 req-35294b94-bfab-4c8c-9346-3bd67162d5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7", "name": "network-vif-plugged", "status": "completed", "tag": "3964e435-be7d-448a-819a-3ae95e8e9617"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:42.397011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-815d1fe3-1bd1-4264-b723-d5eff85e4126 req-35294b94-bfab-4c8c-9346-3bd67162d5c3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.397011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-815d1fe3-1bd1-4264-b723-d5eff85e4126 req-35294b94-bfab-4c8c-9346-3bd67162d5c3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.398386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-815d1fe3-1bd1-4264-b723-d5eff85e4126 req-35294b94-bfab-4c8c-9346-3bd67162d5c3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.421795 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-815d1fe3-1bd1-4264-b723-d5eff85e4126 req-35294b94-bfab-4c8c-9346-3bd67162d5c3 service nova] Creating event network-vif-plugged:3964e435-be7d-448a-819a-3ae95e8e9617 for instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 on n-h1-858238-3 Nov 02 13:44:42.433133 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-815d1fe3-1bd1-4264-b723-d5eff85e4126 req-35294b94-bfab-4c8c-9346-3bd67162d5c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062893 Nov 02 13:44:42.437868 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 504/967] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:42.452918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:42.453785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:42.468277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.468891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.469811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.470638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.471157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.471653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.720590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:42.731952 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dff1c023-9d05-4c8b-881e-7c7de438af1b tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1292 microversion: 2.1 time: 0.291203 Nov 02 13:44:42.733721 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 505/968] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:42 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:42.753383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:42.754505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:42.764150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.764752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.765287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.766058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.766629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.767275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.991771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:43.002620 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96c7b045-1026-4523-9523-185a6f9a0da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1474 microversion: 2.1 time: 0.267617 Nov 02 13:44:43.003900 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 506/969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:42 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:43.009086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:43.009966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:43.017225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.018254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.019516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.020515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.021131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.021700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.063958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Building network info cache for instance {{(pid=137558) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:44:43.221315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:43.250539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60d0bef0-9523-4ec0-b763-6de555079453 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1317 microversion: 2.1 time: 0.244058 Nov 02 13:44:43.252934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 507/970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:43 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:43.259813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:43.260536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:43.271823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.272769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.274046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.275356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.276694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.277396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.525300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:43.540511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7c69e95-fb2c-4a08-8955-cc879ea59e5e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.286024 Nov 02 13:44:43.555126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 508/971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:43 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:43.555126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-34e283b2-5140-4dce-863c-90fcac22f024 req-e323d8a2-c302-4c5b-b701-2b29ecc967bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:43.572732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-34e283b2-5140-4dce-863c-90fcac22f024 req-e323d8a2-c302-4c5b-b701-2b29ecc967bf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.573225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-34e283b2-5140-4dce-863c-90fcac22f024 req-e323d8a2-c302-4c5b-b701-2b29ecc967bf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.574285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-34e283b2-5140-4dce-863c-90fcac22f024 req-e323d8a2-c302-4c5b-b701-2b29ecc967bf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.603848 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-34e283b2-5140-4dce-863c-90fcac22f024 req-e323d8a2-c302-4c5b-b701-2b29ecc967bf service nova] Creating event network-changed:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:44:43.614632 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-34e283b2-5140-4dce-863c-90fcac22f024 req-e323d8a2-c302-4c5b-b701-2b29ecc967bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070872 Nov 02 13:44:43.616001 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 509/972] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:43.627641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:43.629588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:43.645174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.646610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.647778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.649017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.649832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.651420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.487491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:44.502253 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37580517-818e-4b47-b968-5bf073d67730 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.883755 Nov 02 13:44:44.503361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 510/973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:43 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:44.519990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:44.520720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:44.528748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.529276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.532453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.534382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.535734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.536676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.999220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:45.011193 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5d9de9f-25db-482a-bdfe-a970d9cc4c1f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1483 microversion: 2.1 time: 0.505831 Nov 02 13:44:45.027121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 511/974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:44 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1483 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:45.027121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.027121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.027503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:45.033678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.034257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.034689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.037076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.037825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.038313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.052072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Updating instance_info_cache with network_info: [{"id": "3488126b-3c4f-42cd-8246-62f7a79facb5", "address": "fa:16:3e:c7:25:7a", "network": {"id": "78207ca2-c72f-4aba-a624-6c41b5c5faf0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-31735822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7d8d8d2ae5749748ab4fcd40d1bd747", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3488126b-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:44:45.081602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:45.085362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Releasing lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:44:45.086312 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2bbaf155-3c6f-4f02-a5ee-02fb7c406a73 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action" status: 202 len: 0 microversion: 2.1 time: 5.435039 Nov 02 13:44:45.089520 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 464/975] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:39 2022] POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action => generated 0 bytes in 5439 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:44:45.101538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.102158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.124462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.134328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.135248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.136775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.137607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.138374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.183943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:45.302822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:45.394202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:45.411085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9608918-b402-44b2-9f30-d1d6ef820b35 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1474 microversion: 2.1 time: 0.396811 Nov 02 13:44:45.413401 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 512/976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:45.443542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.444507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.454420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.455231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.456429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.457515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.458305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.459194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.530165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:45.555034 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a54044a-7ace-464d-8904-ea699855e474 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1467 microversion: 2.1 time: 0.464023 Nov 02 13:44:45.566859 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 465/977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1467 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:45.698203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:45.704481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:45.719584 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-281fcaa1-f23f-4e07-8c7e-f4b0dbd28d3a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.304452 Nov 02 13:44:45.721663 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 513/978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:45.745898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.746956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.754480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-954bf212-29e0-4adc-802d-068f72539308 tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-680710917", "id": 123675684, "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:45.758052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.759491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.760192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.761491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.762055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.762591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.785633 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-954bf212-29e0-4adc-802d-068f72539308 tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.224423 Nov 02 13:44:45.787261 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 466/979] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:44:45 2022] POST /compute/v2.1/flavors => generated 467 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:45.794061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.31"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:45.798957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.807561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.808277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.808722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.809652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.810112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.810567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.855281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "refresh_cache-52930fa0-4be4-4360-92c9-e26f818900c5" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:44:45.855961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquired lock "refresh_cache-52930fa0-4be4-4360-92c9-e26f818900c5" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:44:45.860231 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8d03e66-eadb-4fe2-ae31-6ec432432e45 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136521 Nov 02 13:44:45.860971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 514/980] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:45.873650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.874793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.889075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.890125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.890926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.892025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.892907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.893439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:46.225291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:46.233843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5294bc9-b9d0-4b97-a1a8-79b9edac2428 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.370887 Nov 02 13:44:46.234770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 515/981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:46.244996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-602890945", "metadata": {"image_type": "test"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:46.248078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:46.259055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:46.260012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:46.260849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:46.261741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:46.262284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:46.262999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:46.315766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Getting quotas for project 9e05ee5eb5cd4988b46b9f26dd465546. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:46.323419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Getting quotas for user d9d13699486d4f8d90b656623f88e267 and project 9e05ee5eb5cd4988b46b9f26dd465546. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:46.340400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:46.632366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1fe41f00-e123-4585-9013-042078aabf69 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "POST /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365/action" status: 202 len: 0 microversion: 2.1 time: 0.395841 Nov 02 13:44:46.633706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 516/982] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:46 2022] POST /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:44:46.649757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7cfcca86-8d4f-4fad-9016-f9a1364a73df req-71253188-f68f-42b2-b94a-7715fb36bdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380fd169-b6bb-4da9-bac7-37950d8f2428", "tag": "223fc1ee-7c85-4aa3-8257-614ae0ade6e5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:46.672463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7cfcca86-8d4f-4fad-9016-f9a1364a73df req-71253188-f68f-42b2-b94a-7715fb36bdfd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:46.673322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7cfcca86-8d4f-4fad-9016-f9a1364a73df req-71253188-f68f-42b2-b94a-7715fb36bdfd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:46.674080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7cfcca86-8d4f-4fad-9016-f9a1364a73df req-71253188-f68f-42b2-b94a-7715fb36bdfd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:46.692561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7cfcca86-8d4f-4fad-9016-f9a1364a73df req-71253188-f68f-42b2-b94a-7715fb36bdfd service nova] Creating event network-changed:223fc1ee-7c85-4aa3-8257-614ae0ade6e5 for instance 380fd169-b6bb-4da9-bac7-37950d8f2428 on n-h2-858238-3 Nov 02 13:44:46.702513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7cfcca86-8d4f-4fad-9016-f9a1364a73df req-71253188-f68f-42b2-b94a-7715fb36bdfd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064041 Nov 02 13:44:46.703841 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 517/983] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:46.716034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51abafa0-0a60-40be-a3fb-e3a2432312a3", "name": "network-vif-unplugged", "status": "completed", "tag": "170b76f2-e7e1-4778-9b1d-ddb44c16387a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:46.737169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:46.738137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:46.738824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:46.760122 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] Creating event network-vif-unplugged:170b76f2-e7e1-4778-9b1d-ddb44c16387a for instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 on n-h2-858238-3 Nov 02 13:44:46.767984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:44:46.776699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3dae5e87-69d6-4608-93b1-bf3b5a81cd2e req-e5b325fb-f84b-47fd-ad87-4f6c8de32e70 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071062 Nov 02 13:44:46.777907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 518/984] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:46.785555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e98219c0-e8c5-4feb-abe9-e4847076f3be tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:47.078830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e98219c0-e8c5-4feb-abe9-e4847076f3be tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/123675684/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.299165 Nov 02 13:44:47.080432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 519/985] 10.222.0.18 () {62 vars in 1262 bytes} [Wed Nov 2 13:44:46 2022] POST /compute/v2.1/flavors/123675684/os-extra_specs => generated 62 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:47.096672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:47.099057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:47.121927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.122789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.124288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.125680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.126449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.127257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.459401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:47.477826 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-483f1e56-dbad-4ed7-ad05-4e171cd3d9f9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1472 microversion: 2.1 time: 0.393640 Nov 02 13:44:47.484530 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 520/986] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:47 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:47.486476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:47.487240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:47.497743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.498357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.498852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.499659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.500219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.500715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.694225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 3426fa2d-9b02-4df3-8af1-6fb412017b0e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:47.711964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2a00330-3759-4328-964d-b4774e657911 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 2345 microversion: 2.25 time: 0.231269 Nov 02 13:44:47.713000 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 521/987] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:44:47 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 2345 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:47.725655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9db23163-798f-4347-9939-d5e4db89afec tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81b413a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:47.792737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9db23163-798f-4347-9939-d5e4db89afec tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.078187 Nov 02 13:44:47.810440 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 522/988] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:44:47 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:47.819497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:47.820779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:47.831814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.832252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.832738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.833460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.834330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.834462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.023722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.041747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d56e98d-45bd-4d2c-9b9a-60315b2cb337 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.229042 Nov 02 13:44:48.042801 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 523/989] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:47 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:48.053072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4ab7174-e7e4-4b93-be92-bbce9153405a tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.084210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4ab7174-e7e4-4b93-be92-bbce9153405a tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/123675684" status: 202 len: 0 microversion: 2.86 time: 0.039706 Nov 02 13:44:48.085120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 524/990] 10.222.0.18 () {60 vars in 1199 bytes} [Wed Nov 2 13:44:48 2022] DELETE /compute/v2.1/flavors/123675684 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:48.090514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.092854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.102346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.103726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.104645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.105995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.107939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.108924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.329330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.348509 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4c8743b-0cd4-4105-a473-841bdfa78f50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.261573 Nov 02 13:44:48.363864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 525/991] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:48.378421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.379196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.380158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.network.neutron [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] re-assign floating IP 172.25.9.31 from instance d13b6558-179e-4fc0-9441-a6ee07235187 Nov 02 13:44:48.392211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.393289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.393934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.394859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.395608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.396424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.463992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Building network info cache for instance {{(pid=137558) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:44:48.592826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.605922 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a65bedc0-e333-4953-8088-f605bb762ff4 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1483 microversion: 2.1 time: 0.239315 Nov 02 13:44:48.608593 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 526/992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1483 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:48.619718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0d46be4d-5a83-47db-8b7d-7f6c2599a2d7 req-742d0a61-f062-4516-9972-54e4024185b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7", "tag": "3964e435-be7d-448a-819a-3ae95e8e9617"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:48.632658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d46be4d-5a83-47db-8b7d-7f6c2599a2d7 req-742d0a61-f062-4516-9972-54e4024185b8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.633450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d46be4d-5a83-47db-8b7d-7f6c2599a2d7 req-742d0a61-f062-4516-9972-54e4024185b8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.633769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d46be4d-5a83-47db-8b7d-7f6c2599a2d7 req-742d0a61-f062-4516-9972-54e4024185b8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.656898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0d46be4d-5a83-47db-8b7d-7f6c2599a2d7 req-742d0a61-f062-4516-9972-54e4024185b8 service nova] Creating event network-changed:3964e435-be7d-448a-819a-3ae95e8e9617 for instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 on n-h1-858238-3 Nov 02 13:44:48.664369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0d46be4d-5a83-47db-8b7d-7f6c2599a2d7 req-742d0a61-f062-4516-9972-54e4024185b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054106 Nov 02 13:44:48.665229 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 527/993] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:48.715022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.726016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.726758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.727488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.729072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.730670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.732284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.793600 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2931d2e3-98e5-483e-a64b-613e0215dbbc tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.095081 Nov 02 13:44:48.799332 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 528/994] 10.222.0.18 () {60 vars in 1217 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:48.806930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14c1aab1-ab25-4a8c-8e79-b62c586eb97b tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.901292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14c1aab1-ab25-4a8c-8e79-b62c586eb97b tempest-FlavorMetadataValidation-1956752468 tempest-FlavorMetadataValidation-1956752468-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.100210 Nov 02 13:44:48.902620 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 529/995] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:48.929901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.929901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.943270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.943944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.944467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.945291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.946298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.946298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.394316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:49.394601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Updating instance_info_cache with network_info: [{"id": "3488126b-3c4f-42cd-8246-62f7a79facb5", "address": "fa:16:3e:c7:25:7a", "network": {"id": "78207ca2-c72f-4aba-a624-6c41b5c5faf0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-31735822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7d8d8d2ae5749748ab4fcd40d1bd747", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3488126b-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:44:49.418726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db162c06-ff91-4ca8-a27c-4209f9d1b7de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1472 microversion: 2.1 time: 0.508695 Nov 02 13:44:49.419046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Building network info cache for instance {{(pid=137558) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:44:49.431333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 530/996] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:49.441920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-dd023cc8-b343-4f19-9430-bf6d6165358f req-7e8d88d1-8e7b-4fbd-b21d-c17f22def109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add86abd-d651-4ffc-a079-b6c2e0ebbdab", "name": "network-vif-plugged", "status": "completed", "tag": "dd8c28cf-09cc-4c2c-9a19-70b896c67b51"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:49.461025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dd023cc8-b343-4f19-9430-bf6d6165358f req-7e8d88d1-8e7b-4fbd-b21d-c17f22def109 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.462562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dd023cc8-b343-4f19-9430-bf6d6165358f req-7e8d88d1-8e7b-4fbd-b21d-c17f22def109 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.463660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dd023cc8-b343-4f19-9430-bf6d6165358f req-7e8d88d1-8e7b-4fbd-b21d-c17f22def109 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.494338 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-dd023cc8-b343-4f19-9430-bf6d6165358f req-7e8d88d1-8e7b-4fbd-b21d-c17f22def109 service nova] Creating event network-vif-plugged:dd8c28cf-09cc-4c2c-9a19-70b896c67b51 for instance add86abd-d651-4ffc-a079-b6c2e0ebbdab on n-h1-858238-3 Nov 02 13:44:49.500549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-dd023cc8-b343-4f19-9430-bf6d6165358f req-7e8d88d1-8e7b-4fbd-b21d-c17f22def109 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066324 Nov 02 13:44:49.501544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 531/997] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:49.512287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dbb4dd14-2c18-4112-bd67-cdfc7187f91f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81d10e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:49.625129 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dbb4dd14-2c18-4112-bd67-cdfc7187f91f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.121978 Nov 02 13:44:49.626146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 532/998] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:44:49 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:49.632097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}, {"name": "network-changed", "server_uuid": "52930fa0-4be4-4360-92c9-e26f818900c5", "tag": "e2323723-2a70-402a-b8fe-89d625a68490"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:49.648020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.648606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.649105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.692068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] Creating event network-changed:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:44:49.693182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] Creating event network-changed:e2323723-2a70-402a-b8fe-89d625a68490 for instance 52930fa0-4be4-4360-92c9-e26f818900c5 on n-h1-858238-3 Nov 02 13:44:49.711784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8e09e998-2332-4cdf-b14e-8e0844bcf0d7 req-1b1e4100-79ee-42eb-ae23-b4745d896703 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083508 Nov 02 13:44:49.715944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 533/999] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:49.725136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:49.726334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:49.736831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.737670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.738262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.739159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.739782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.740355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.598635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:50.617068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d820244-e204-4b05-829b-a335910e14f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.895189 Nov 02 13:44:50.618185 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 534/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:49 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:50.636011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:50.637667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:50.652791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.653251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.655737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.657003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.661172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.664518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.385218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Updating instance_info_cache with network_info: [{"id": "e2323723-2a70-402a-b8fe-89d625a68490", "address": "fa:16:3e:8e:08:b8", "network": {"id": "78207ca2-c72f-4aba-a624-6c41b5c5faf0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-31735822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7d8d8d2ae5749748ab4fcd40d1bd747", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape2323723-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:44:51.402012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Releasing lock "refresh_cache-52930fa0-4be4-4360-92c9-e26f818900c5" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:44:51.404006 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e38273da-4651-4135-bdef-69b4ee6a7d9f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5/action" status: 202 len: 0 microversion: 2.1 time: 5.615727 Nov 02 13:44:51.407311 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 467/1001] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:45 2022] POST /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5/action => generated 0 bytes in 5620 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:44:51.428118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:51.429354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:51.446816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.450604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.452785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.455189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.456577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.457370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.469833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:51.491796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d947f0f-75ab-420a-a587-e6a8cea5994a tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.866890 Nov 02 13:44:51.493169 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 535/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:50 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:51.508429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-016a31ac-c0be-473c-beaa-972d14857bd0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81b72d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:51.603558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-016a31ac-c0be-473c-beaa-972d14857bd0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.109042 Nov 02 13:44:51.609239 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 536/1003] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:44:51 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:51.621104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'action', calling method: .version_select at 0x7f6f83b63310>, body: {"removeFloatingIp": {"address": "172.25.9.31"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:51.960937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:51.971830 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b15d69f2-2931-4d9e-b617-27deb48bdbc5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1469 microversion: 2.1 time: 0.560865 Nov 02 13:44:51.972446 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 468/1004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:51 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1469 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:51.986821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:51.993731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.015001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.015906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.016683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.018030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.018871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.020594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.257908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:52.269258 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cb635322-caa8-439e-8f87-097c3d302a1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.290542 Nov 02 13:44:52.270948 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 469/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:51 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:52.282124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:52.291493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.301576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.302326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.302923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.303721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.304397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.306225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.438768 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9a2cbd7f-c9f7-48fd-ae7f-dd6d36fe6fd3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3/action" status: 204 len: 0 microversion: 2.1 time: 0.166181 Nov 02 13:44:52.439941 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 470/1006] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:52 2022] POST /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3/action => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:52.447416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13d03b71-bc03-4bf6-951a-38790950c9cb", "device": "/dev/xvdb"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:52.452064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.460324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.461118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.461807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.463060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.463922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.464952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.560628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.575182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.578255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.579432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.581127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.582209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.582976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.033949 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] HTTP exception thrown: Floating IP 172.25.9.31 is not associated with instance d13b6558-179e-4fc0-9441-a6ee07235187. Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Request method failure captured: Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action HTTP/1.1 Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 48 Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQVscrSsN4IZioUQVw3ZApx5fWPAZemWSMmxUMOYASkVanv4i-_1q2BgUp-yME-f6DKjIma0bCC091cE674JEs5qlKZZ5CFd93NowZLgLW0t4jGhyVrcKefk6QU9SM0hFmczuefIA-_AjRLhmKLqs2NsPYIzKGAaoTNyIHXnFnbB6Q Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:44:53.037552 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7d8d8d2ae5749748ab4fcd40d1bd747"}]}] Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f5d532dce5f14db7a5b029734d672aba Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: {"removeFloatingIp": {"address": "172.25.9.31"}} Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:44:53.040011 n-d-858238-3 devstack@n-api.service[137559]: exception: Floating IP 172.25.9.31 is not associated with instance d13b6558-179e-4fc0-9441-a6ee07235187. Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd13b6558-179e-4fc0-9441-a6ee07235187', 'body': {'removeFloatingIp': {'address': '172.25.9.31'}}} Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.31 is not associated with instance d13b6558-179e-4fc0-9441-a6ee07235187. Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:53.042525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:53.046416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:53.046416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:53.046416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:53.046416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:53.046416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.31 is not associated with instance d13b6558-179e-4fc0-9441-a6ee07235187. Nov 02 13:44:53.046416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:44:53.049142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Returning 409 to user: Floating IP 172.25.9.31 is not associated with instance d13b6558-179e-4fc0-9441-a6ee07235187. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:53.050825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b764759-eae5-4caa-961a-2ba0e1038663 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action" status: 409 len: 145 microversion: 2.1 time: 1.440090 Nov 02 13:44:53.052048 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 537/1007] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:51 2022] POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action => generated 145 bytes in 1442 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:44:53.060828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:53.062875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:53.074790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.076699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.078625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.080097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.081407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.082137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.112578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:53.400630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:53.431731 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44e7fd8c-7788-4aeb-be70-34f8bcece340 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1469 microversion: 2.1 time: 0.377224 Nov 02 13:44:53.448785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 538/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:53 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:53.453910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:53.454556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:53.461999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.462485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.462910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.463650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.464100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.464512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.699053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:53.714409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-47a8fee5-1908-44c6-bde9-b2c7e934db51 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.264277 Nov 02 13:44:53.715738 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 539/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:53 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:53.752700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-69afc403-1395-4c59-a417-f0d406a53052 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81af1430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:53.867273 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-69afc403-1395-4c59-a417-f0d406a53052 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.149985 Nov 02 13:44:53.867933 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 540/1010] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:44:53 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:53.882403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.31"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:54.114096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:54.124618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:54.125122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:54.125819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:54.127046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:54.127687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:54.128606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:54.589700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "refresh_cache-52930fa0-4be4-4360-92c9-e26f818900c5" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:44:54.590356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquired lock "refresh_cache-52930fa0-4be4-4360-92c9-e26f818900c5" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:44:55.773634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Building network info cache for instance {{(pid=137559) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:44:56.931777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Updating instance_info_cache with network_info: [{"id": "e2323723-2a70-402a-b8fe-89d625a68490", "address": "fa:16:3e:8e:08:b8", "network": {"id": "78207ca2-c72f-4aba-a624-6c41b5c5faf0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-31735822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7d8d8d2ae5749748ab4fcd40d1bd747", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape2323723-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137559) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:44:56.957675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Releasing lock "refresh_cache-52930fa0-4be4-4360-92c9-e26f818900c5" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:44:56.959886 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae6313a7-2ef1-450b-b7b9-75b034e08bb2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5/action" status: 202 len: 0 microversion: 2.1 time: 3.082264 Nov 02 13:44:56.961374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 541/1011] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:53 2022] POST /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5/action => generated 0 bytes in 3093 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:44:56.967767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:56.969258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:56.978106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.979719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.981101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.982225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.983321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.984229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.225636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:57.248034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f54cfbe-0b8e-401b-9543-d4212f95d9a0 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.285124 Nov 02 13:44:57.259414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 542/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:56 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:57.281000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:57.282299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:57.292892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.293783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.294423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.295534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.296196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.296820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.544262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:57.561432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a57e5e1-fd40-4b00-88e4-9a0a4dce76b4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1461 microversion: 2.1 time: 0.286153 Nov 02 13:44:57.577793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 543/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:57 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1461 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:57.586651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:57.587288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:57.598481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.598986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.599446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.600138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.600615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.601030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.814348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:57.825341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f0a9528-568a-4be8-9f40-210f95bd5120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.247156 Nov 02 13:44:57.828991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 544/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:57 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:57.840360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d55f1b4e-3fcb-42dc-8c8d-ddd442738de4 req-873d04d1-f6cf-414f-9e12-760c792a9381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380fd169-b6bb-4da9-bac7-37950d8f2428", "name": "network-vif-plugged", "status": "completed", "tag": "223fc1ee-7c85-4aa3-8257-614ae0ade6e5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:57.860760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d55f1b4e-3fcb-42dc-8c8d-ddd442738de4 req-873d04d1-f6cf-414f-9e12-760c792a9381 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.861922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d55f1b4e-3fcb-42dc-8c8d-ddd442738de4 req-873d04d1-f6cf-414f-9e12-760c792a9381 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.862847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d55f1b4e-3fcb-42dc-8c8d-ddd442738de4 req-873d04d1-f6cf-414f-9e12-760c792a9381 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.885655 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d55f1b4e-3fcb-42dc-8c8d-ddd442738de4 req-873d04d1-f6cf-414f-9e12-760c792a9381 service nova] Creating event network-vif-plugged:223fc1ee-7c85-4aa3-8257-614ae0ade6e5 for instance 380fd169-b6bb-4da9-bac7-37950d8f2428 on n-h2-858238-3 Nov 02 13:44:57.897766 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d55f1b4e-3fcb-42dc-8c8d-ddd442738de4 req-873d04d1-f6cf-414f-9e12-760c792a9381 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066990 Nov 02 13:44:57.898672 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 545/1015] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:57.913992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4a6d7fb-a226-48cc-8837-21a2804d01fa tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f17ee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:58.044730 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4a6d7fb-a226-48cc-8837-21a2804d01fa tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.141269 Nov 02 13:44:58.055968 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 546/1016] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:44:57 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:58.077764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0c7524dd-d16e-4950-958b-96794edaed8c req-b64c90bc-7c87-4e8a-9a53-c467471b8f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52930fa0-4be4-4360-92c9-e26f818900c5", "tag": "e2323723-2a70-402a-b8fe-89d625a68490"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:58.114720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0c7524dd-d16e-4950-958b-96794edaed8c req-b64c90bc-7c87-4e8a-9a53-c467471b8f63 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.115595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0c7524dd-d16e-4950-958b-96794edaed8c req-b64c90bc-7c87-4e8a-9a53-c467471b8f63 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.116363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0c7524dd-d16e-4950-958b-96794edaed8c req-b64c90bc-7c87-4e8a-9a53-c467471b8f63 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.181028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0c7524dd-d16e-4950-958b-96794edaed8c req-b64c90bc-7c87-4e8a-9a53-c467471b8f63 service nova] Creating event network-changed:e2323723-2a70-402a-b8fe-89d625a68490 for instance 52930fa0-4be4-4360-92c9-e26f818900c5 on n-h1-858238-3 Nov 02 13:44:58.197467 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0c7524dd-d16e-4950-958b-96794edaed8c req-b64c90bc-7c87-4e8a-9a53-c467471b8f63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139031 Nov 02 13:44:58.198727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 547/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:58.554684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70f37e1e-734e-43b3-a063-4ae1d283e476 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2108436306", "ram": 512, "vcpus": 1, "disk": 10, "id": 767481337, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:58.745748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70f37e1e-734e-43b3-a063-4ae1d283e476 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.543364 Nov 02 13:44:58.747792 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 548/1018] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:44:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:58.766726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:58.770586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:58.777315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:58.786269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.787224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.788203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.790244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.791628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.791628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.884204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:44:59.090147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3464c66d-439d-4025-b165-b0af63eb8460 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "POST /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 6.647429 Nov 02 13:44:59.104158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 471/1019] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Nov 2 13:44:52 2022] POST /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 194 bytes in 6651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:44:59.117431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:59.119759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:59.136792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.141715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.142628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.145570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.148164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.148921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.154637 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0958caf3-956d-43e3-9ac4-0e6b0840153b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 204 len: 0 microversion: 2.1 time: 0.403216 Nov 02 13:44:59.162173 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 549/1020] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:44:58 2022] DELETE /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:59.176684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:59.177949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:59.194697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.200028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.201117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.205064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.205064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.205064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.655472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:59.666339 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ee738473-d0ab-4616-84c1-8280ec4b496f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1461 microversion: 2.1 time: 0.560292 Nov 02 13:44:59.679875 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 472/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:59 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1461 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:59.693942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:59.694173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a5a4e72-9431-4db2-9b66-3bbca0019a70 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:59.704465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f96c76af-dc4e-40de-891e-64a78d4096cd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.531958 Nov 02 13:44:59.705858 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 550/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:59 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:59.725986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:59.726612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:59.746125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.747158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.748230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.749735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.750633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.751414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.755938 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a5a4e72-9431-4db2-9b66-3bbca0019a70 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.073909 Nov 02 13:44:59.762710 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 473/1023] 10.222.0.18 () {60 vars in 1221 bytes} [Wed Nov 2 13:44:59 2022] POST /compute/v2.1/flavors/767481337/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:44:59.790108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7128a41d-94e8-41a5-be2a-1ec4b63c6ed0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ec13a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:59.860878 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7128a41d-94e8-41a5-be2a-1ec4b63c6ed0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.094906 Nov 02 13:44:59.862834 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 474/1024] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:44:59 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:59.870898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.31"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:59.874134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:59.882351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.883156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.883706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.884872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.885687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.886221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.931035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:44:59.931753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquired lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:45:00.074994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:00.085832 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6c6caaf2-1ab8-4b4c-8298-798a4f0e086f tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.378270 Nov 02 13:45:00.086721 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 551/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:44:59 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:00.093511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d82f755b-3de7-4269-b657-4c6714ca603b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'create', calling method: .version_select at 0x7f6f81b0ff70>, body: {"keypair": {"name": "tempest-keypair-1596839249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM/hEGIUgVWt+HU/ZUdQf9a5IjCjNWx0jWpr/vwY6a007EWDAzJ4f1Bc9Yd9PpxyeAuLNX6FXJijv7lGiR/sJdurRg1XKLieOl1mGJ5B4dEiV4ebEpnCQ1dHU4Ti9QJwA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:00.121269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d82f755b-3de7-4269-b657-4c6714ca603b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:00.133048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d82f755b-3de7-4269-b657-4c6714ca603b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for user 832cd460bb5e4148a57d561f762ceb11 and project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:00.196143 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d82f755b-3de7-4269-b657-4c6714ca603b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107430 Nov 02 13:45:00.204199 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 552/1026] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:45:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:00.462089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-900e151a-7203-46d9-97bf-5c1d437dd588 tempest-FlavorsExtraSpecsTestJSON-442772737 tempest-FlavorsExtraSpecsTestJSON-442772737-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:00.480501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-900e151a-7203-46d9-97bf-5c1d437dd588 tempest-FlavorsExtraSpecsTestJSON-442772737 tempest-FlavorsExtraSpecsTestJSON-442772737-project] 10.222.0.18 "GET /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.280889 Nov 02 13:45:00.482498 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 553/1027] 10.222.0.18 () {58 vars in 1200 bytes} [Wed Nov 2 13:45:00 2022] GET /compute/v2.1/flavors/767481337/os-extra_specs => generated 66 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:00.492690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51abafa0-0a60-40be-a3fb-e3a2432312a3", "name": "network-vif-plugged", "status": "completed", "tag": "170b76f2-e7e1-4778-9b1d-ddb44c16387a"}, {"server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "name": "network-vif-plugged", "status": "completed", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:00.505817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:00.522255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:00.523657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:00.524735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:00.626052 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] Creating event network-vif-plugged:170b76f2-e7e1-4778-9b1d-ddb44c16387a for instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 on n-h2-858238-3 Nov 02 13:45:00.627231 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] Creating event network-vif-plugged:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:45:00.648307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-54e9eaa6-3a87-435c-8315-f84eef89b3fc req-b794620b-fa96-4b63-a035-b2022853bad3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.163114 Nov 02 13:45:00.656023 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 554/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:00.671856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-36f5e92a-2dda-4489-b395-795b353a048c tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:00.759819 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-36f5e92a-2dda-4489-b395-795b353a048c tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101169 Nov 02 13:45:00.762514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 555/1029] 10.222.0.18 () {60 vars in 1221 bytes} [Wed Nov 2 13:45:00 2022] POST /compute/v2.1/flavors/767481337/os-extra_specs => generated 66 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:00.771799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:00.774830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:00.791649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:00.793131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:00.794109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:00.797047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:00.797821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:00.799991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:01.494622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:01.505303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-47c1a30e-936a-40ef-bb64-cff13d81bb25 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1359 microversion: 2.1 time: 0.741127 Nov 02 13:45:01.524607 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 556/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:00 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1359 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:01.535027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a37e14b-9e41-4a17-87c8-be12a3ec23eb tempest-FlavorsExtraSpecsTestJSON-442772737 tempest-FlavorsExtraSpecsTestJSON-442772737-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:01.555922 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a37e14b-9e41-4a17-87c8-be12a3ec23eb tempest-FlavorsExtraSpecsTestJSON-442772737 tempest-FlavorsExtraSpecsTestJSON-442772737-project] 10.222.0.18 "GET /compute/v2.1/flavors/767481337/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.029971 Nov 02 13:45:01.563580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 557/1031] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:45:01 2022] GET /compute/v2.1/flavors/767481337/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:01.571032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8004808f-a3c6-407c-a5f5-2fda86b5e386 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a06af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:01.737406 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8004808f-a3c6-407c-a5f5-2fda86b5e386 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.171231 Nov 02 13:45:01.738822 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 558/1032] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:01 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:01.762172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:01.763357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:01.789905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:01.790724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:01.792809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:01.796337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:01.796912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:01.800132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:02.547599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:02.576631 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae0db514-a782-46e2-9ffa-f9ee9a35beb9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1316 microversion: 2.1 time: 0.829459 Nov 02 13:45:02.577545 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 559/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:01 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1316 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:02.588539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-862a2d9f-25af-4b73-bd8b-5f6f574f892e tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:02.674419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-862a2d9f-25af-4b73-bd8b-5f6f574f892e tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.092367 Nov 02 13:45:02.681666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 560/1034] 10.222.0.18 () {60 vars in 1221 bytes} [Wed Nov 2 13:45:02 2022] POST /compute/v2.1/flavors/767481337/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:02.694533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:02.695847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:02.720590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:02.721351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:02.721864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:02.722511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:02.723524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:02.723951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:03.836686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:03.855501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d60fcce5-04fe-407e-96b3-23603a2706e3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1538 microversion: 2.1 time: 1.167724 Nov 02 13:45:03.856144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 561/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:02 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1538 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:03.865068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b59591ec-54a4-4f5d-9098-abd42b96b88c tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:03.902435 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b59591ec-54a4-4f5d-9098-abd42b96b88c tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036237 Nov 02 13:45:03.906143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 562/1036] 10.222.0.18 () {58 vars in 1200 bytes} [Wed Nov 2 13:45:03 2022] GET /compute/v2.1/flavors/767481337/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:03.916399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ed40ed1-b2f2-4628-b9ba-e51dd55102d0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81af1670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:04.015166 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ed40ed1-b2f2-4628-b9ba-e51dd55102d0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.099987 Nov 02 13:45:04.016572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 563/1037] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:03 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:04.023010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:04.046062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:04.063817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:04.070175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:04.070804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:04.076049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:04.077075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:04.087403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:04.152152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Building network info cache for instance {{(pid=137558) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:45:04.653116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:04.665407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05aba0dc-f94e-4f99-a255-58b995b63af9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1466 microversion: 2.1 time: 0.647293 Nov 02 13:45:04.671005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 564/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:04 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1466 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:04.681702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3ef80961-c511-400b-a383-9a74d27ce7de req-e047ea0f-7c99-4c65-b7f4-717cf91a1259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52930fa0-4be4-4360-92c9-e26f818900c5", "name": "network-vif-deleted", "tag": "e2323723-2a70-402a-b8fe-89d625a68490"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:04.706656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3ef80961-c511-400b-a383-9a74d27ce7de req-e047ea0f-7c99-4c65-b7f4-717cf91a1259 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:04.707178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3ef80961-c511-400b-a383-9a74d27ce7de req-e047ea0f-7c99-4c65-b7f4-717cf91a1259 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:04.707592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3ef80961-c511-400b-a383-9a74d27ce7de req-e047ea0f-7c99-4c65-b7f4-717cf91a1259 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:04.728202 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3ef80961-c511-400b-a383-9a74d27ce7de req-e047ea0f-7c99-4c65-b7f4-717cf91a1259 service nova] Creating event network-vif-deleted:e2323723-2a70-402a-b8fe-89d625a68490 for instance 52930fa0-4be4-4360-92c9-e26f818900c5 on n-h1-858238-3 Nov 02 13:45:04.739527 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3ef80961-c511-400b-a383-9a74d27ce7de req-e047ea0f-7c99-4c65-b7f4-717cf91a1259 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067080 Nov 02 13:45:04.741905 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 565/1039] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:04.754930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:04.755548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:04.780543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:04.780543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:04.780543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:04.780543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:04.780984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:04.780984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:04.843716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:05.081939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a2507d7-8d80-4c2c-80d8-ed495a70d1c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.338182 Nov 02 13:45:05.083146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 566/1040] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:45:04 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-interface => generated 284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:05.089680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e777be8-d2c6-43aa-862b-f09069eea9b0 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:05.262636 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e777be8-d2c6-43aa-862b-f09069eea9b0 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/767481337/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.169972 Nov 02 13:45:05.265922 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 567/1041] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:45:05 2022] PUT /compute/v2.1/flavors/767481337/os-extra_specs/hw:numa_nodes => generated 22 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:05.280359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-49760c86-a339-4a9c-bc21-e9bede32bd2a req-d3303006-cd14-4368-8069-357aeaccab6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:05.329131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-49760c86-a339-4a9c-bc21-e9bede32bd2a req-d3303006-cd14-4368-8069-357aeaccab6a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:05.333057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-49760c86-a339-4a9c-bc21-e9bede32bd2a req-d3303006-cd14-4368-8069-357aeaccab6a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:05.336845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-49760c86-a339-4a9c-bc21-e9bede32bd2a req-d3303006-cd14-4368-8069-357aeaccab6a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:05.387212 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-49760c86-a339-4a9c-bc21-e9bede32bd2a req-d3303006-cd14-4368-8069-357aeaccab6a service nova] Creating event network-changed:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:45:05.405626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-49760c86-a339-4a9c-bc21-e9bede32bd2a req-d3303006-cd14-4368-8069-357aeaccab6a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134996 Nov 02 13:45:05.407606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 568/1042] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:05.432884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:05.438189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:05.480048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:05.485633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:05.491154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:05.494068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:05.494918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:05.500269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:05.791427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Updating instance_info_cache with network_info: [{"id": "3488126b-3c4f-42cd-8246-62f7a79facb5", "address": "fa:16:3e:c7:25:7a", "network": {"id": "78207ca2-c72f-4aba-a624-6c41b5c5faf0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-31735822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7d8d8d2ae5749748ab4fcd40d1bd747", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3488126b-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:45:05.830606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Releasing lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:45:05.834552 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a32de3a7-ce39-45a1-bf80-c2aa6aaa5f06 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action" status: 202 len: 0 microversion: 2.1 time: 5.970302 Nov 02 13:45:05.835579 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 475/1043] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:44:59 2022] POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action => generated 0 bytes in 5972 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:45:05.848078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c42f0601-e76e-4c56-91c9-f8105a5a9e70 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f820d9e50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:05.957189 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c42f0601-e76e-4c56-91c9-f8105a5a9e70 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.120187 Nov 02 13:45:05.958511 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 476/1044] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:05 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:05.966180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c045c733-d311-4670-8932-9c21a8cca177 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:06.027571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c045c733-d311-4670-8932-9c21a8cca177 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067133 Nov 02 13:45:06.038342 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 477/1045] 10.222.0.18 () {58 vars in 1200 bytes} [Wed Nov 2 13:45:05 2022] GET /compute/v2.1/flavors/767481337/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:06.053919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-824b07ae-561c-4c49-8646-30c131be9da2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '.version_select at 0x7f6f81f318b0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:06.692756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-427f5078-8cb2-4d2e-a9b5-9e2ad7e4a69a tempest-ServersOnMultiNodesTest-1614710471 tempest-ServersOnMultiNodesTest-1614710471-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1617 microversion: 2.1 time: 1.273303 Nov 02 13:45:06.716611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 569/1046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:05 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1617 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:06.724886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a3081177-b811-4d77-8f5c-03ded43c948d tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:06.785074 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-824b07ae-561c-4c49-8646-30c131be9da2 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/588b8ca4-cbad-4d02-b7a3-74bd2eb3ac45" status: 200 len: 184 microversion: 2.1 time: 0.744513 Nov 02 13:45:06.786553 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 478/1047] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:45:06 2022] GET /compute/v2.1/os-floating-ips/588b8ca4-cbad-4d02-b7a3-74bd2eb3ac45 => generated 184 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:06.791990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:06.794006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:06.826262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:06.828880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:06.832303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:06.835697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:06.836640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:06.837281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:06.889816 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a3081177-b811-4d77-8f5c-03ded43c948d tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/767481337/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.168495 Nov 02 13:45:06.890739 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 570/1048] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:45:06 2022] DELETE /compute/v2.1/flavors/767481337/os-extra_specs/hw:numa_nodes => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:45:06.922096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.31"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:06.924000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:07.092597 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-008cf5ab-6894-4dc6-afbe-0cb39ea12946 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 204 len: 0 microversion: 2.1 time: 0.304470 Nov 02 13:45:07.098208 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 479/1049] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:06 2022] DELETE /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:07.114113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d039dc5-1427-4128-993b-1d2d3e265141 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:07.193375 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9d039dc5-1427-4128-993b-1d2d3e265141 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/767481337/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.091811 Nov 02 13:45:07.196052 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 480/1050] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:45:07 2022] DELETE /compute/v2.1/flavors/767481337/os-extra_specs/hw:cpu_policy => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:45:07.213666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad3b0857-3801-4900-a831-78b35092f471 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ee11f0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:07.321176 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ad3b0857-3801-4900-a831-78b35092f471 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.121885 Nov 02 13:45:07.333969 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 481/1051] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:07 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:07.346480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:07.349561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:07.368844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:07.369701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:07.371650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:07.372929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:07.375325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:07.376391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:07.392051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:07.409500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:07.414503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:07.416707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:07.429173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:07.434018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:07.442864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:07.805108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:07.812421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=7,nova_cell1:RELEASE=3,nova_cell1:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:07.823563 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3b907e3-7796-43d1-92eb-7efaf1078547 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1472 microversion: 2.1 time: 0.482201 Nov 02 13:45:07.825350 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 482/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:07 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:07.834149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3de6974e-9e21-46bc-8bd4-e7e13d2e22c9 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:07.853457 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3de6974e-9e21-46bc-8bd4-e7e13d2e22c9 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/767481337/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025180 Nov 02 13:45:07.854968 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 483/1053] 10.222.0.18 () {58 vars in 1200 bytes} [Wed Nov 2 13:45:07 2022] GET /compute/v2.1/flavors/767481337/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:07.875652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0cdd54e-1ec3-4352-ac46-ca3e77f3dc87 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:07.909326 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0cdd54e-1ec3-4352-ac46-ca3e77f3dc87 tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/767481337" status: 202 len: 0 microversion: 2.1 time: 0.039416 Nov 02 13:45:07.911192 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 484/1054] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:45:07 2022] DELETE /compute/v2.1/flavors/767481337 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:45:07.932764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34d33821-065d-445c-9206-8cb296c7500f tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.004258 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-34d33821-065d-445c-9206-8cb296c7500f tempest-FlavorsExtraSpecsTestJSON-317969286 tempest-FlavorsExtraSpecsTestJSON-317969286-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088187 Nov 02 13:45:08.018876 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 485/1055] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:45:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:08.366649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f136b90-3d9b-46d2-bbc9-8f7d7217fe7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ee1940>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.476171 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f136b90-3d9b-46d2-bbc9-8f7d7217fe7b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.129797 Nov 02 13:45:08.486416 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 486/1056] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:08 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:08.718985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c8687cc-e384-4e44-b3ea-3ae852abc7f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '.version_select at 0x7f6f81f31dc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.722373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8687cc-e384-4e44-b3ea-3ae852abc7f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.722863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8687cc-e384-4e44-b3ea-3ae852abc7f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.726739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8687cc-e384-4e44-b3ea-3ae852abc7f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:08.741606 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8c8687cc-e384-4e44-b3ea-3ae852abc7f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.026749 Nov 02 13:45:08.764801 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 487/1057] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:45:08 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:08.777499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5dd26d77-192a-4282-ba02-19d5b0471a53 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.810583 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5dd26d77-192a-4282-ba02-19d5b0471a53 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043442 Nov 02 13:45:08.827778 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 488/1058] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:45:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:08.832513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-551eebc6-f355-4690-aa30-c20fff23c657 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-640043200", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:08.886156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-551eebc6-f355-4690-aa30-c20fff23c657 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.056934 Nov 02 13:45:08.895390 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 489/1059] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Nov 2 13:45:08 2022] POST /compute/v2.1/flavors => generated 498 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:08.912416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.913379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:08.920170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:45:08.921280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquired lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:45:08.950671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.963696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.964515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:08.965800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.966644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.967994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:09.399676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:09.420230 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a35b32d9-48ff-4949-a177-4cae42a59b24 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1472 microversion: 2.1 time: 0.520741 Nov 02 13:45:09.430332 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 490/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:08 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:09.440702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f288f52-fbe0-48f3-ac8e-afe35e2204f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:09.471083 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f288f52-fbe0-48f3-ac8e-afe35e2204f8 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031759 Nov 02 13:45:09.474290 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 491/1061] 10.222.0.18 () {58 vars in 1182 bytes} [Wed Nov 2 13:45:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:45:09.506361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7bdcbf86-b336-42b2-89ba-057c8dfd0f52 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f11ca0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:09.641612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7bdcbf86-b336-42b2-89ba-057c8dfd0f52 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.142154 Nov 02 13:45:09.662073 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 492/1062] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:09 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:09.711614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1884165604", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "0c1d2ec4-482d-4643-938d-8a7384a4b0c0"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:09.770689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:09.928125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:45:10.167143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:10.683369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:45:10.683885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:45:10.684434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:45:10.684854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:45:10.685300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:45:10.709664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.710525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.711325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:10.712439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.718627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.719149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:10.785884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:10.804058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for user 832cd460bb5e4148a57d561f762ceb11 and project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:10.837093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:45:10.861610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:45:11.043621 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-129453e8-a3ac-4399-9101-a4e3abc0fcfd tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338638 Nov 02 13:45:11.052214 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 493/1063] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:45:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:45:11.069839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:11.070798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:11.102057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:11.103355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:11.110411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:11.111445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:11.114693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:11.117105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:11.446482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Building network info cache for instance {{(pid=137559) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:45:11.520292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:11.569668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41329719-4d02-4a63-9016-0e57f2e0abd3 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1430 microversion: 2.1 time: 0.515166 Nov 02 13:45:11.582908 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 494/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:11 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1430 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:11.610809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f0dc6809-57f0-4063-96c8-ae8215412491 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f319d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:11.758727 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f0dc6809-57f0-4063-96c8-ae8215412491 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.170954 Nov 02 13:45:11.760491 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 495/1065] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:11 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:11.780915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ff8de670-8a10-41ca-b0b1-ab8a408f95a6 req-3744b167-31cb-4427-bdfa-d1434e872ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380fd169-b6bb-4da9-bac7-37950d8f2428", "tag": "223fc1ee-7c85-4aa3-8257-614ae0ade6e5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:11.857036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ff8de670-8a10-41ca-b0b1-ab8a408f95a6 req-3744b167-31cb-4427-bdfa-d1434e872ef6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:11.863825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ff8de670-8a10-41ca-b0b1-ab8a408f95a6 req-3744b167-31cb-4427-bdfa-d1434e872ef6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:11.864583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ff8de670-8a10-41ca-b0b1-ab8a408f95a6 req-3744b167-31cb-4427-bdfa-d1434e872ef6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:11.953375 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ff8de670-8a10-41ca-b0b1-ab8a408f95a6 req-3744b167-31cb-4427-bdfa-d1434e872ef6 service nova] Creating event network-changed:223fc1ee-7c85-4aa3-8257-614ae0ade6e5 for instance 380fd169-b6bb-4da9-bac7-37950d8f2428 on n-h2-858238-3 Nov 02 13:45:11.976929 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ff8de670-8a10-41ca-b0b1-ab8a408f95a6 req-3744b167-31cb-4427-bdfa-d1434e872ef6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208503 Nov 02 13:45:11.997842 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 496/1066] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:12.006193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7ca4c98-c977-4ff3-8ead-9a01431f4f46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:12.006997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f7ca4c98-c977-4ff3-8ead-9a01431f4f46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:12.254855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f7ca4c98-c977-4ff3-8ead-9a01431f4f46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:12.278122 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f7ca4c98-c977-4ff3-8ead-9a01431f4f46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1279 microversion: 2.1 time: 0.278117 Nov 02 13:45:12.280957 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 497/1067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:11 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1279 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:12.621539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:12.622690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:12.664680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.665550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.681611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.688692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.689798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.690852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.910656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.914118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.917740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.920755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid add86abd-d651-4ffc-a079-b6c2e0ebbdab {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:13.955195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:13.999626 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-480b4aa4-df7d-48ce-8a91-ac7453cbed50 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 200 len: 1306 microversion: 2.1 time: 1.385542 Nov 02 13:45:14.028509 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 498/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:12 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 1306 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:14.056067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86a1bf37-ecf6-4c11-87a5-58471eeb25e2 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f118b0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:14.064746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Updating instance_info_cache with network_info: [{"id": "3488126b-3c4f-42cd-8246-62f7a79facb5", "address": "fa:16:3e:c7:25:7a", "network": {"id": "78207ca2-c72f-4aba-a624-6c41b5c5faf0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-31735822-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7d8d8d2ae5749748ab4fcd40d1bd747", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3488126b-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137559) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:45:14.095676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Releasing lock "refresh_cache-d13b6558-179e-4fc0-9441-a6ee07235187" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:45:14.100248 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb270d4a-ed53-490b-819c-0bdadbf8f1d3 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action" status: 202 len: 0 microversion: 2.1 time: 7.197835 Nov 02 13:45:14.122110 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 571/1069] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:45:06 2022] POST /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187/action => generated 0 bytes in 7231 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:45:14.150533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:14.153813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:14.181162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.181908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.183248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.206967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.211312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.230895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.264724 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-86a1bf37-ecf6-4c11-87a5-58471eeb25e2 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.225796 Nov 02 13:45:14.296805 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 499/1070] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:14 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:14.317182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add86abd-d651-4ffc-a079-b6c2e0ebbdab", "name": "network-vif-deleted", "tag": "dd8c28cf-09cc-4c2c-9a19-70b896c67b51"}, {"name": "network-changed", "server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:14.442281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.450811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.455121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.458787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:14.500739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75cb682d-85f0-4fbc-bf48-50e9466e0823 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1331 microversion: 2.1 time: 0.371537 Nov 02 13:45:14.507602 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 572/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:14 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1331 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:14.529421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:14.530186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:14.553776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.553990 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] Creating event network-vif-deleted:dd8c28cf-09cc-4c2c-9a19-70b896c67b51 for instance add86abd-d651-4ffc-a079-b6c2e0ebbdab on n-h1-858238-3 Nov 02 13:45:14.554714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.555414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.559248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.564300 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] Creating event network-changed:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:45:14.564951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.569815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.630582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] HTTP exception thrown: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Request method failure captured: Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 HTTP/1.1 Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQVscrSsN4IZioUQVw3ZApx5fWPAZemWSMmxUMOYASkVanv4i-_1q2BgUp-yME-f6DKjIma0bCC091cE674JEs5qlKZZ5CFd93NowZLgLW0t4jGhyVrcKefk6QU9SM0hFmczuefIA-_AjRLhmKLqs2NsPYIzKGAaoTNyIHXnFnbB6Q Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:14.638165 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7d8d8d2ae5749748ab4fcd40d1bd747"}]}] Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f5d532dce5f14db7a5b029734d672aba Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.640639 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '52930fa0-4be4-4360-92c9-e26f818900c5'} Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:14.642396 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.645383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.646733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Returning 404 to user: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:14.646733 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d867a6d-7303-4bba-8212-38ffd15eed53 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "DELETE /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 404 len: 111 microversion: 2.1 time: 0.133874 Nov 02 13:45:14.648823 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-577c6b82-ed24-4b36-bda4-49ca6b983031 req-829e345e-b682-48b3-809c-12ce8f50b021 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.339365 Nov 02 13:45:14.653437 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 500/1072] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:14.657406 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 573/1073] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:14 2022] DELETE /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:14.700551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:14.710898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: 52930fa0-4be4-4360-92c9-e26f818900c5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:14.762029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.775496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.782226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.784065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.789366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.790134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.835274 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] HTTP exception thrown: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Request method failure captured: Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 HTTP/1.1 Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnQVscrSsN4IZioUQVw3ZApx5fWPAZemWSMmxUMOYASkVanv4i-_1q2BgUp-yME-f6DKjIma0bCC091cE674JEs5qlKZZ5CFd93NowZLgLW0t4jGhyVrcKefk6QU9SM0hFmczuefIA-_AjRLhmKLqs2NsPYIzKGAaoTNyIHXnFnbB6Q Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:45:14.838434 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7d8d8d2ae5749748ab4fcd40d1bd747"}]}] Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: f5d532dce5f14db7a5b029734d672aba Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.840398 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '52930fa0-4be4-4360-92c9-e26f818900c5'} Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:14.841338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. Nov 02 13:45:14.844301 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:14.852754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Returning 404 to user: Instance 52930fa0-4be4-4360-92c9-e26f818900c5 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:14.854806 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d96107f2-034a-4405-acf2-c8cabcc5b9e0 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5" status: 404 len: 111 microversion: 2.1 time: 0.188295 Nov 02 13:45:14.859440 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 501/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:14 2022] GET /compute/v2.1/servers/52930fa0-4be4-4360-92c9-e26f818900c5 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:14.872876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2ca242a-9ac0-4ce1-95ce-37d1a6b0f18b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '.version_select at 0x7f6f81a6eaf0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.052891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.058348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: add86abd-d651-4ffc-a079-b6c2e0ebbdab] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:15.094341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.094738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.095233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.095970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.096425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.100119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.150765 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance add86abd-d651-4ffc-a079-b6c2e0ebbdab could not be found. Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab HTTP/1.1 Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:45:15.152355 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance add86abd-d651-4ffc-a079-b6c2e0ebbdab could not be found. Nov 02 13:45:15.156647 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'add86abd-d651-4ffc-a079-b6c2e0ebbdab'} Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add86abd-d651-4ffc-a079-b6c2e0ebbdab could not be found. Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:15.159745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add86abd-d651-4ffc-a079-b6c2e0ebbdab could not be found. Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add86abd-d651-4ffc-a079-b6c2e0ebbdab could not be found. Nov 02 13:45:15.164613 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:15.171503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance add86abd-d651-4ffc-a079-b6c2e0ebbdab could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:15.171503 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47688971-d9d0-461c-874c-5c1788068def tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab" status: 404 len: 111 microversion: 2.1 time: 0.111625 Nov 02 13:45:15.171503 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 502/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:15 2022] GET /compute/v2.1/servers/add86abd-d651-4ffc-a079-b6c2e0ebbdab => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:15.171503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.171503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:15.187356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.188740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.190732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.196009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.197546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.198723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.337155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:15.667060 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-171c1278-5b73-4256-99d0-4a748cb25f33 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 204 len: 0 microversion: 2.1 time: 0.501931 Nov 02 13:45:15.668887 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 503/1076] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:15 2022] DELETE /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:15.681613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-507f4aa6-ef83-4ae4-a62e-54fd5ee30395 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f11dc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.833351 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-507f4aa6-ef83-4ae4-a62e-54fd5ee30395 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.161506 Nov 02 13:45:15.834828 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 504/1077] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:15 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:15.845756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.847470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:15.858751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.859990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.861019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.862552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.863723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.864974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:16.013921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:16.032024 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ba5eb7a0-4ce2-4854-86e2-2bfe8a391e6d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1339 microversion: 2.1 time: 0.194927 Nov 02 13:45:16.048324 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 505/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:15 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:16.068454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:16.069391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:16.106231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:16.110331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:16.112466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:16.115238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:16.116054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:16.122164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:16.581335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:16.604360 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bc2301f3-5870-4e2c-98c6-3d95fddd5108 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1471 microversion: 2.1 time: 0.553556 Nov 02 13:45:16.608894 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 506/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:16 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1471 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:16.867491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-43bd0ccb-3dbf-4ff1-b6b9-47f78d2eb7ae tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ff6280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:16.956093 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-43bd0ccb-3dbf-4ff1-b6b9-47f78d2eb7ae tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.103500 Nov 02 13:45:16.959340 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 507/1080] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:16 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:17.081856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:17.082824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:17.113018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:17.114432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:17.119910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:17.121376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:17.126784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:17.127871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:17.265591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:17.283403 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-799592af-9a0e-4931-be5b-e9cbdcbc2c36 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1339 microversion: 2.1 time: 0.210410 Nov 02 13:45:17.285211 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 508/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:17 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:17.648061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:17.649133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:17.694786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:17.704996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:17.705838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:17.707001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:17.712062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:17.713291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.313763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.335348 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9bd04e61-b5b4-4c52-998a-c591b3925e7d tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1471 microversion: 2.1 time: 0.693264 Nov 02 13:45:18.355288 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 509/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:17 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1471 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:18.372790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c79df0f-54b6-4c2d-861b-69575e61a387 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ee1f70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.434093 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2ca242a-9ac0-4ce1-95ce-37d1a6b0f18b tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/588b8ca4-cbad-4d02-b7a3-74bd2eb3ac45" status: 202 len: 0 microversion: 2.1 time: 3.568905 Nov 02 13:45:18.439981 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 574/1083] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:45:14 2022] DELETE /compute/v2.1/os-floating-ips/588b8ca4-cbad-4d02-b7a3-74bd2eb3ac45 => generated 0 bytes in 3576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:45:18.461301 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9c79df0f-54b6-4c2d-861b-69575e61a387 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.092668 Nov 02 13:45:18.473473 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 510/1084] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:18.490548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.491319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:18.511823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.512333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.512774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.518107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.518872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.519365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.625376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.640052 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-82b1ffc5-1251-4d8e-bd37-a8839c00772e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1337 microversion: 2.1 time: 0.163841 Nov 02 13:45:18.655368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 511/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1337 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:18.663517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.664904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:18.681845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.683906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.688241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.690728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.691282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.691827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.739575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:18.883447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dc104a1f-753d-480c-a79c-8a8838991d19 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Calling method '.version_select at 0x7f6f81ba7940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.886100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dc104a1f-753d-480c-a79c-8a8838991d19 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '19005b8bbc164d508b4e54cb2a32851b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfd996914aa99bb963121965994d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dc104a1f-753d-480c-a79c-8a8838991d19 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Request method failure captured: Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRrhDjIJC2Y4hNHLii6Q1ETCfy_ZundQzTfniryPeYRpaVVFGQDf0wqqRXnkVMS9Z-WSz9cCg5WrxbdJoPb-SxuEbVt7p-T6xvhsIupX0D4liwXIWc-YoxrhUjD2Lz1jSZy11DMPjzrC0O7mdQzafpbammtweLPUBZw9pEtKBXR690 Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:18.892770 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e7adfd996914aa99bb963121965994d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e7adfd996914aa99bb963121965994d"}]}] Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 19005b8bbc164d508b4e54cb2a32851b Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:45:18.894919 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:45:18.895874 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 13:45:18.897297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.901146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dc104a1f-753d-480c-a79c-8a8838991d19 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:18.902368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dc104a1f-753d-480c-a79c-8a8838991d19 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.461094 Nov 02 13:45:18.908126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 575/1086] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:18.919525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf9359cf-19af-4154-b82b-c8292b447499 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Calling method '.version_select at 0x7f6f81a28ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.931473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf9359cf-19af-4154-b82b-c8292b447499 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '19005b8bbc164d508b4e54cb2a32851b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfd996914aa99bb963121965994d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf9359cf-19af-4154-b82b-c8292b447499 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Request method failure captured: Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRrhDjIJC2Y4hNHLii6Q1ETCfy_ZundQzTfniryPeYRpaVVFGQDf0wqqRXnkVMS9Z-WSz9cCg5WrxbdJoPb-SxuEbVt7p-T6xvhsIupX0D4liwXIWc-YoxrhUjD2Lz1jSZy11DMPjzrC0O7mdQzafpbammtweLPUBZw9pEtKBXR690 Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:18.933822 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e7adfd996914aa99bb963121965994d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e7adfd996914aa99bb963121965994d"}]}] Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 19005b8bbc164d508b4e54cb2a32851b Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:45:18.940124 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:45:18.943388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 13:45:18.949001 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.958419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf9359cf-19af-4154-b82b-c8292b447499 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:18.958419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf9359cf-19af-4154-b82b-c8292b447499 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021418 Nov 02 13:45:18.958419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 576/1087] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:45:18.958419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1784fdec-4337-419a-ba1d-bc36db77a5ad tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Calling method '.version_select at 0x7f6f81d10160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.959566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1784fdec-4337-419a-ba1d-bc36db77a5ad tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '19005b8bbc164d508b4e54cb2a32851b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfd996914aa99bb963121965994d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1784fdec-4337-419a-ba1d-bc36db77a5ad tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Request method failure captured: Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRrhDjIJC2Y4hNHLii6Q1ETCfy_ZundQzTfniryPeYRpaVVFGQDf0wqqRXnkVMS9Z-WSz9cCg5WrxbdJoPb-SxuEbVt7p-T6xvhsIupX0D4liwXIWc-YoxrhUjD2Lz1jSZy11DMPjzrC0O7mdQzafpbammtweLPUBZw9pEtKBXR690 Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:18.960655 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e7adfd996914aa99bb963121965994d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e7adfd996914aa99bb963121965994d"}]}] Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 19005b8bbc164d508b4e54cb2a32851b Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:45:18.962102 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:45:18.963057 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 13:45:18.964326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:18.976634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1784fdec-4337-419a-ba1d-bc36db77a5ad tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:18.977929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1784fdec-4337-419a-ba1d-bc36db77a5ad tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.033120 Nov 02 13:45:18.983254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 577/1088] 10.222.0.18 () {58 vars in 1179 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:19.003619 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb22795e-d2ea-4f96-bc11-ab31cff5eb7d tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 204 len: 0 microversion: 2.1 time: 0.349109 Nov 02 13:45:19.007887 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 512/1089] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:18 2022] DELETE /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:19.035795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.042293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:19.080295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.083749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.084632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.087665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.089976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.095285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Calling method '.version_select at 0x7f6f81d18e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.097318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.099876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.101356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.102286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.131656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.133041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.134322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.157319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.158377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.159303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.170916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a62677cf-67a3-43b1-9725-be6470899162 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.185977 Nov 02 13:45:19.180781 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 578/1090] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:19.193218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-742dc39d-8fba-4371-a27b-4ec32769a7a1 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Calling method '.version_select at 0x7f6f81a068b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.196829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-742dc39d-8fba-4371-a27b-4ec32769a7a1 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '19005b8bbc164d508b4e54cb2a32851b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfd996914aa99bb963121965994d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-742dc39d-8fba-4371-a27b-4ec32769a7a1 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Request method failure captured: Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRrhDjIJC2Y4hNHLii6Q1ETCfy_ZundQzTfniryPeYRpaVVFGQDf0wqqRXnkVMS9Z-WSz9cCg5WrxbdJoPb-SxuEbVt7p-T6xvhsIupX0D4liwXIWc-YoxrhUjD2Lz1jSZy11DMPjzrC0O7mdQzafpbammtweLPUBZw9pEtKBXR690 Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:19.200453 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e7adfd996914aa99bb963121965994d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e7adfd996914aa99bb963121965994d"}]}] Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 19005b8bbc164d508b4e54cb2a32851b Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1'} Nov 02 13:45:19.203745 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:45:19.205584 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 13:45:19.207704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.211522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-742dc39d-8fba-4371-a27b-4ec32769a7a1 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:19.213091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-742dc39d-8fba-4371-a27b-4ec32769a7a1 tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.028238 Nov 02 13:45:19.221863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 579/1091] 10.222.0.18 () {58 vars in 1173 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:19.234032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4072c24e-aae4-4021-9b64-fe1929fb59ba tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Calling method '.version_select at 0x7f6f81a28ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.238894 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4072c24e-aae4-4021-9b64-fe1929fb59ba tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] HTTP exception thrown: Hypervisor with ID 'f8512b52-6c45-41ee-a188-157382b70266' could not be found. Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4072c24e-aae4-4021-9b64-fe1929fb59ba tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Request method failure captured: Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/f8512b52-6c45-41ee-a188-157382b70266/uptime HTTP/1.1 Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRthHkoCv9WcUPBaP6w7c2TjDSaeZ1nW36PzLpE8NlRU82XpZI8rSlALEgjvGOx19YE4WWTnKZ-VYLDTsH2p3HOSNxGzSEoEXJFeQslGLTAN8WodvWBiM7FSMcEtxycwjSt6qc3wU38PFwAyfaqE0wsOnDcoak83KZMMedhlAq24pg Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ca5744b9db6e44c0853caa424b118dcf Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848161293 Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:45:19.256454 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca5744b9db6e44c0853caa424b118dcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ca5744b9db6e44c0853caa424b118dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca5744b9db6e44c0853caa424b118dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ca5744b9db6e44c0853caa424b118dcf"}]}] Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848161293 Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ca5744b9db6e44c0853caa424b118dcf Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848161293 Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3e1ad9111ace4112949dd28d11adf641 Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: exception: Hypervisor with ID 'f8512b52-6c45-41ee-a188-157382b70266' could not be found. Nov 02 13:45:19.259492 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f8512b52-6c45-41ee-a188-157382b70266'} Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f8512b52-6c45-41ee-a188-157382b70266' Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 13:45:19.261307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f8512b52-6c45-41ee-a188-157382b70266' could not be found. Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.272224 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f8512b52-6c45-41ee-a188-157382b70266' could not be found. Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4072c24e-aae4-4021-9b64-fe1929fb59ba tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Returning 404 to user: Hypervisor with ID 'f8512b52-6c45-41ee-a188-157382b70266' could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4072c24e-aae4-4021-9b64-fe1929fb59ba tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/f8512b52-6c45-41ee-a188-157382b70266/uptime" status: 404 len: 123 microversion: 2.1 time: 0.040006 Nov 02 13:45:19.277120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 580/1092] 10.222.0.18 () {58 vars in 1278 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/os-hypervisors/f8512b52-6c45-41ee-a188-157382b70266/uptime => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:19.280408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Calling method '.version_select at 0x7f6f81b99af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.282238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.282716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.283199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.306927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.307485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.307928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.321603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.322096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.322540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.330277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e56721b7-93a1-4347-a7aa-58a5ac5ed14d tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053756 Nov 02 13:45:19.330949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 581/1093] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:45:19.352761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e312260-79ca-4de0-ab90-2f686b080c0f tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Calling method '.version_select at 0x7f6f81af1790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.356731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e312260-79ca-4de0-ab90-2f686b080c0f tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '19005b8bbc164d508b4e54cb2a32851b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7adfd996914aa99bb963121965994d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e312260-79ca-4de0-ab90-2f686b080c0f tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Request method failure captured: Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRrhDjIJC2Y4hNHLii6Q1ETCfy_ZundQzTfniryPeYRpaVVFGQDf0wqqRXnkVMS9Z-WSz9cCg5WrxbdJoPb-SxuEbVt7p-T6xvhsIupX0D4liwXIWc-YoxrhUjD2Lz1jSZy11DMPjzrC0O7mdQzafpbammtweLPUBZw9pEtKBXR690 Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:19.363142 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e7adfd996914aa99bb963121965994d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e7adfd996914aa99bb963121965994d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e7adfd996914aa99bb963121965994d"}]}] Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5e7adfd996914aa99bb963121965994d Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-727014591 Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 19005b8bbc164d508b4e54cb2a32851b Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-727014591-project Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1'} Nov 02 13:45:19.365004 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:45:19.366193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 13:45:19.367441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.368706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e312260-79ca-4de0-ab90-2f686b080c0f tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:19.368706 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e312260-79ca-4de0-ab90-2f686b080c0f tempest-HypervisorAdminNegativeTestJSON-727014591 tempest-HypervisorAdminNegativeTestJSON-727014591-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021730 Nov 02 13:45:19.368706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 582/1094] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:19.388334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaf17b16-0236-4817-8667-986a3ddef346 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Calling method '.version_select at 0x7f6f81b0fc10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.392097 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-eaf17b16-0236-4817-8667-986a3ddef346 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] HTTP exception thrown: Hypervisor with ID '39ab540b-0cbe-4f9f-994f-265af288a435' could not be found. Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaf17b16-0236-4817-8667-986a3ddef346 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Request method failure captured: Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-hypervisors/39ab540b-0cbe-4f9f-994f-265af288a435 HTTP/1.1 Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnRthHkoCv9WcUPBaP6w7c2TjDSaeZ1nW36PzLpE8NlRU82XpZI8rSlALEgjvGOx19YE4WWTnKZ-VYLDTsH2p3HOSNxGzSEoEXJFeQslGLTAN8WodvWBiM7FSMcEtxycwjSt6qc3wU38PFwAyfaqE0wsOnDcoak83KZMMedhlAq24pg Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ca5744b9db6e44c0853caa424b118dcf Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-848161293 Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:45:19.404843 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca5744b9db6e44c0853caa424b118dcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ca5744b9db6e44c0853caa424b118dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca5744b9db6e44c0853caa424b118dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ca5744b9db6e44c0853caa424b118dcf"}]}] Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-848161293 Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ca5744b9db6e44c0853caa424b118dcf Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-848161293 Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3e1ad9111ace4112949dd28d11adf641 Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: exception: Hypervisor with ID '39ab540b-0cbe-4f9f-994f-265af288a435' could not be found. Nov 02 13:45:19.406534 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '39ab540b-0cbe-4f9f-994f-265af288a435'} Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '39ab540b-0cbe-4f9f-994f-265af288a435' Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 13:45:19.407526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:45:19.408896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '39ab540b-0cbe-4f9f-994f-265af288a435' could not be found. Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '39ab540b-0cbe-4f9f-994f-265af288a435' could not be found. Nov 02 13:45:19.410098 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:19.412742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaf17b16-0236-4817-8667-986a3ddef346 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] Returning 404 to user: Hypervisor with ID '39ab540b-0cbe-4f9f-994f-265af288a435' could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:19.414229 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eaf17b16-0236-4817-8667-986a3ddef346 tempest-HypervisorAdminNegativeTestJSON-848161293 tempest-HypervisorAdminNegativeTestJSON-848161293-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/39ab540b-0cbe-4f9f-994f-265af288a435" status: 404 len: 123 microversion: 2.1 time: 0.033090 Nov 02 13:45:19.415780 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 583/1095] 10.222.0.18 () {58 vars in 1257 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/os-hypervisors/39ab540b-0cbe-4f9f-994f-265af288a435 => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:19.435646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.437723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:19.449817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.450569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.451539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.452534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.453414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.454043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.783226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:19.788323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:19.796686 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce4064c8-7694-49b6-b540-036af9632c96 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1525 microversion: 2.1 time: 0.786426 Nov 02 13:45:19.816460 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 513/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1525 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:19.830946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3752f12f-6ec2-49e4-8b97-1ca33b821ad1 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ea6e50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.933787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:19.957281 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ead0be5-5c7d-45ca-a3c2-0b06e01a30e4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1471 microversion: 2.1 time: 0.539493 Nov 02 13:45:19.958692 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3752f12f-6ec2-49e4-8b97-1ca33b821ad1 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.134473 Nov 02 13:45:19.959602 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 514/1097] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:19.974746 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 584/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:19.988518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.989328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:20.016999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.017523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.017964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.018680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.019419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.022426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.168058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:20.183213 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-449d6897-a493-4d85-83cd-d955b6e2b04e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1337 microversion: 2.1 time: 0.215865 Nov 02 13:45:20.183810 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 515/1099] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1337 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:20.288903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e8693562-1810-44f0-98ea-972ba081b1c1 req-c70c649f-35f1-4976-bd8d-348922413d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3428c3e-a122-4f8d-a660-b46c92ff1c59", "name": "network-vif-deleted", "tag": "ca95a7f1-7a9d-4aa8-94b1-70f7a6b766bc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:20.334032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e8693562-1810-44f0-98ea-972ba081b1c1 req-c70c649f-35f1-4976-bd8d-348922413d84 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.345977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e8693562-1810-44f0-98ea-972ba081b1c1 req-c70c649f-35f1-4976-bd8d-348922413d84 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.345977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e8693562-1810-44f0-98ea-972ba081b1c1 req-c70c649f-35f1-4976-bd8d-348922413d84 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.389145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e8693562-1810-44f0-98ea-972ba081b1c1 req-c70c649f-35f1-4976-bd8d-348922413d84 service nova] Creating event network-vif-deleted:ca95a7f1-7a9d-4aa8-94b1-70f7a6b766bc for instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 on n-h2-858238-3 Nov 02 13:45:20.425669 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e8693562-1810-44f0-98ea-972ba081b1c1 req-c70c649f-35f1-4976-bd8d-348922413d84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150463 Nov 02 13:45:20.429290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 585/1100] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:20.846120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:20.846985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:20.850201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:20.880145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.883793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.894609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.896760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.897253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.897701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:21.000297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8dbfc212-91f0-4df4-b1f2-a32fcda318e7 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81b6f310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:21.181812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8dbfc212-91f0-4df4-b1f2-a32fcda318e7 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1423 microversion: 2.1 time: 0.188716 Nov 02 13:45:21.188183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 586/1101] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:20 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1423 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:21.215754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:21.228184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:21.270063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.274178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.277214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:21.280819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.283890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.284994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:21.488116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.491551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.492184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:21.493916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid b3428c3e-a122-4f8d-a660-b46c92ff1c59 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:21.637663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:21.656088 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e01bcc1-5cb8-40b0-803c-ebc07fe7315f tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1525 microversion: 2.1 time: 0.813973 Nov 02 13:45:21.657900 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 516/1102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:20 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1525 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:21.671601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:21.676508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:21.678335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:21.696276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.697133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.697907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:21.709731 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52d7b482-5348-40f1-bdcc-c08ad8d3c5c9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 200 len: 1306 microversion: 2.1 time: 0.518930 Nov 02 13:45:21.712185 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 587/1103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:21 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 1306 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:21.726506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.726506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.728760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:22.214135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f979a2e6-2763-4d82-bb57-c080b36caf71 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a6e310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:22.260744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:22.354313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f979a2e6-2763-4d82-bb57-c080b36caf71 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1432 microversion: 2.1 time: 0.153798 Nov 02 13:45:22.362441 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 588/1104] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:22 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1432 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:22.398557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a7477b8-13a3-43a6-8085-a936486c8592 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a6ee50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:22.549191 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a7477b8-13a3-43a6-8085-a936486c8592 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 200 len: 1432 microversion: 2.1 time: 0.167586 Nov 02 13:45:22.556602 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 589/1105] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:22 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 1432 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:22.566902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:22.566902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:22.573747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:22.595124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:22.595646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:22.596084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:22.597145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:22.597608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:22.598038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:22.599298 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d533d05-5732-4915-a8a5-1013000aa662 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.922829 Nov 02 13:45:22.602208 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 517/1106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:21 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:22.616118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:22.621957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:22.652618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:22.665416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:22.666341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:22.668287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:22.680864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:22.683637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.025395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 3426fa2d-9b02-4df3-8af1-6fb412017b0e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:23.056435 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfb361cc-c8ac-4ffd-acb5-0ff317c221aa tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 2423 microversion: 2.25 time: 0.498701 Nov 02 13:45:23.057035 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 590/1107] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:22 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 2423 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:23.085992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:23.086258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.094762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.097508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.098183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.100298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.101593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.102762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.184222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.185088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.185725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.186972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lazy-loading 'fault' on Instance uuid d13b6558-179e-4fc0-9441-a6ee07235187 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:23.242168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d532dce5f14db7a5b029734d672aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7d8d8d2ae5749748ab4fcd40d1bd747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:23.253172 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1051eb7f-6e14-4079-962e-ba962a23f3de tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 200 len: 1314 microversion: 2.1 time: 0.183424 Nov 02 13:45:23.261379 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 591/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:23 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:23.272513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:23.273135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b3428c3e-a122-4f8d-a660-b46c92ff1c59] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.282325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.283003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.283796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.284898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.285371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.285941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.345972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 could not be found. Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 HTTP/1.1 Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:23.348327 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 could not be found. Nov 02 13:45:23.350193 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'b3428c3e-a122-4f8d-a660-b46c92ff1c59'} Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 could not be found. Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:23.351075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 could not be found. Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 could not be found. Nov 02 13:45:23.353133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:23.356049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance b3428c3e-a122-4f8d-a660-b46c92ff1c59 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:23.357634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8ef2050-6e0e-47cf-96b9-fc07ea355cf4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59" status: 404 len: 111 microversion: 2.1 time: 0.094166 Nov 02 13:45:23.358908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 592/1109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:23 2022] GET /compute/v2.1/servers/b3428c3e-a122-4f8d-a660-b46c92ff1c59 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:23.368548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4a5a276a-f732-4d08-af39-6ec2ecc1e115 req-faf81119-a806-4edb-bd79-17f814eb291a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13b6558-179e-4fc0-9441-a6ee07235187", "name": "network-vif-deleted", "tag": "3488126b-3c4f-42cd-8246-62f7a79facb5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:23.369818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:23.378995 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9245ed32-0e19-4f1a-8040-3667c21ff207 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1467 microversion: 2.1 time: 0.772267 Nov 02 13:45:23.392272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a5a276a-f732-4d08-af39-6ec2ecc1e115 req-faf81119-a806-4edb-bd79-17f814eb291a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.393723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a5a276a-f732-4d08-af39-6ec2ecc1e115 req-faf81119-a806-4edb-bd79-17f814eb291a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.394723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a5a276a-f732-4d08-af39-6ec2ecc1e115 req-faf81119-a806-4edb-bd79-17f814eb291a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.428411 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 518/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:22 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1467 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:23.454780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858238-3", "block_migration": "auto"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:23.459343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.460558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4a5a276a-f732-4d08-af39-6ec2ecc1e115 req-faf81119-a806-4edb-bd79-17f814eb291a service nova] Creating event network-vif-deleted:3488126b-3c4f-42cd-8246-62f7a79facb5 for instance d13b6558-179e-4fc0-9441-a6ee07235187 on n-h1-858238-3 Nov 02 13:45:23.487385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4a5a276a-f732-4d08-af39-6ec2ecc1e115 req-faf81119-a806-4edb-bd79-17f814eb291a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122525 Nov 02 13:45:23.495340 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 593/1111] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:23.504295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.505270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.506736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.509307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.510041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.510712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.516722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:23.519990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.541678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.543225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.544363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.546240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.547612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.548537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.583639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'flavor' on Instance uuid 3426fa2d-9b02-4df3-8af1-6fb412017b0e {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:23.608139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:23.616868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Going to try to live migrate instance to n-h2-858238-3 {{(pid=137558) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:45:23.875484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:23.893223 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9275cccc-2494-442d-8491-8f343f814fd2 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 204 len: 0 microversion: 2.1 time: 0.394791 Nov 02 13:45:23.894968 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 594/1112] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:23 2022] DELETE /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:23.908932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4fd832bc-7e71-432a-9e59-dbe4f9face05 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f819e1a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:24.012882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4fd832bc-7e71-432a-9e59-dbe4f9face05 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/48ddc6ee-c34b-4aba-b773-45942271b1d5" status: 200 len: 784 microversion: 2.1 time: 0.113653 Nov 02 13:45:24.024171 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 595/1113] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:23 2022] GET /compute/v2.1/images/48ddc6ee-c34b-4aba-b773-45942271b1d5 => generated 784 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:24.040645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:24.041777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:24.064531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.065426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.065903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.066650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.067177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.067752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.311333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:24.323053 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67641e6c-2ccc-4554-a20e-91864a73f66c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.293031 Nov 02 13:45:24.323798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 596/1114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:24 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:24.330796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:24.333318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:24.343807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.344564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.345152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.346025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.346663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.347396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.353324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:24.539572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:24.549288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93c6e30e-83e3-44bf-94e4-4b86f654c005 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1473 microversion: 2.1 time: 0.224350 Nov 02 13:45:24.549911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 597/1115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:24 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:24.554716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1fce3a58-5e15-41d2-b0ff-0c3ffd3983f5 req-97f4e163-9fe8-4349-8897-ad79bf7bd215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:24.566597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1fce3a58-5e15-41d2-b0ff-0c3ffd3983f5 req-97f4e163-9fe8-4349-8897-ad79bf7bd215 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.567246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1fce3a58-5e15-41d2-b0ff-0c3ffd3983f5 req-97f4e163-9fe8-4349-8897-ad79bf7bd215 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.567751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1fce3a58-5e15-41d2-b0ff-0c3ffd3983f5 req-97f4e163-9fe8-4349-8897-ad79bf7bd215 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.580563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1fce3a58-5e15-41d2-b0ff-0c3ffd3983f5 req-97f4e163-9fe8-4349-8897-ad79bf7bd215 service nova] Creating event network-changed:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:45:24.585969 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1fce3a58-5e15-41d2-b0ff-0c3ffd3983f5 req-97f4e163-9fe8-4349-8897-ad79bf7bd215 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034745 Nov 02 13:45:24.586628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 598/1116] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:24.592958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56bbc534-a5e3-46fb-8a41-2ba9b724576d tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:24.601752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56bbc534-a5e3-46fb-8a41-2ba9b724576d tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013532 Nov 02 13:45:24.602297 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 599/1117] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:45:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:24.622490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:24.623791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] [instance: d13b6558-179e-4fc0-9441-a6ee07235187] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:24.634560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.635773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.635773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.636767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.636767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.637395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.670263 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] HTTP exception thrown: Instance d13b6558-179e-4fc0-9441-a6ee07235187 could not be found. Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Request method failure captured: Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 HTTP/1.1 Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQVscrSsN4IZioUQVw3ZApx5fWPAZemWSMmxUMOYASkVanv4i-_1q2BgUp-yME-f6DKjIma0bCC091cE674JEs5qlKZZ5CFd93NowZLgLW0t4jGhyVrcKefk6QU9SM0hFmczuefIA-_AjRLhmKLqs2NsPYIzKGAaoTNyIHXnFnbB6Q Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:24.673312 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7d8d8d2ae5749748ab4fcd40d1bd747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7d8d8d2ae5749748ab4fcd40d1bd747"}]}] Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: c7d8d8d2ae5749748ab4fcd40d1bd747 Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2003490525 Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f5d532dce5f14db7a5b029734d672aba Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2003490525-project Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d13b6558-179e-4fc0-9441-a6ee07235187 could not be found. Nov 02 13:45:24.674977 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd13b6558-179e-4fc0-9441-a6ee07235187'} Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13b6558-179e-4fc0-9441-a6ee07235187 could not be found. Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:24.675852 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13b6558-179e-4fc0-9441-a6ee07235187 could not be found. Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13b6558-179e-4fc0-9441-a6ee07235187 could not be found. Nov 02 13:45:24.677286 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:24.678620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] Returning 404 to user: Instance d13b6558-179e-4fc0-9441-a6ee07235187 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:24.678620 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0244d009-7d2e-4b15-bb84-462f3c274cc1 tempest-FloatingIPsAssociationTestJSON-2003490525 tempest-FloatingIPsAssociationTestJSON-2003490525-project] 10.222.0.18 "GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187" status: 404 len: 111 microversion: 2.1 time: 0.067132 Nov 02 13:45:24.678620 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 600/1118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:24 2022] GET /compute/v2.1/servers/d13b6558-179e-4fc0-9441-a6ee07235187 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:24.685992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c79fa826-bfc7-4c01-b4ca-5e15a110e5c0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a28c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:25.838346 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c79fa826-bfc7-4c01-b4ca-5e15a110e5c0 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "DELETE /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 204 len: 0 microversion: 2.1 time: 1.159678 Nov 02 13:45:25.839833 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 601/1119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:24 2022] DELETE /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 0 bytes in 1162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:25.848870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:25.849905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:25.860171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:25.860669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:25.861334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:25.862168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:25.862681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:25.863145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:26.053237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:26.068040 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22b44397-a2d4-49cc-b13b-8182a848d804 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.225616 Nov 02 13:45:26.084435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 602/1120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:25 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:26.099213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:26.100227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:26.108112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:26.108714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:26.109227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:26.110040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:26.110773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:26.111487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:26.339943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:26.356841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d48c57c7-a64c-4d65-a581-ddec9ba393ad tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1473 microversion: 2.1 time: 0.270112 Nov 02 13:45:26.359006 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 603/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:26 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:26.385602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21c15b5e-4712-4276-9666-3b4af93e16af tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ba7af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:26.456411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-21c15b5e-4712-4276-9666-3b4af93e16af tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] HTTP exception thrown: Image not found. Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21c15b5e-4712-4276-9666-3b4af93e16af tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Request method failure captured: Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 HTTP/1.1 Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQxyU-WSmZ77EPqWV939GhGob6dpZ-6BR6nuhAfmV_ibpeO1LnYSTRiRDWP3k_tswKpOaKwQr1-OAN269iUImRqfcg7_p25snV-6e7QtKXGPSIRQ6_bAhOoy0wn6-VkBbRr2gcIs05OecxZN0s6X3gjc-Ne98LkLrW2t6pud0hkLls Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9e05ee5eb5cd4988b46b9f26dd465546 Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:26.464414 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9e05ee5eb5cd4988b46b9f26dd465546"}]}] Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9e05ee5eb5cd4988b46b9f26dd465546 Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerTestJSON-1579125506-project Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9d13699486d4f8d90b656623f88e267 Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerTestJSON-1579125506-project Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '427704f0-82c7-496d-90ca-ef1871a964b6'} Nov 02 13:45:26.467211 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:45:26.469463 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 427704f0-82c7-496d-90ca-ef1871a964b6 Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:45:26.473523 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 427704f0-82c7-496d-90ca-ef1871a964b6 could not be found. Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:45:26.476199 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21c15b5e-4712-4276-9666-3b4af93e16af tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:26.480163 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21c15b5e-4712-4276-9666-3b4af93e16af tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 404 len: 62 microversion: 2.1 time: 0.105937 Nov 02 13:45:26.486847 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 604/1122] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:26 2022] GET /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:45:26.496210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-690079199"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:26.501834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:26.516727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:26.517895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:26.518907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:26.521144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:26.522269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:26.523276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:26.948395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-776fef68-8bb6-4b14-a301-9078a087ae9f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "POST /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365/action" status: 202 len: 0 microversion: 2.1 time: 0.456720 Nov 02 13:45:26.961717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 605/1123] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:45:26 2022] POST /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:45:27.224946 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2ab4ed9f-9598-4061-b7a9-a90f8e2782e2 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/action" status: 202 len: 0 microversion: 2.25 time: 3.794695 Nov 02 13:45:27.226381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 519/1124] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:45:23 2022] POST /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/action => generated 0 bytes in 3797 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:27.232802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-80883aee-a282-4978-987a-de6d81966176 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f31dc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:27.257676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67336d4d-8645-41d0-b45b-e49d7837abf5 tempest-InstanceUsageAuditLogTestJSON-1266647944 tempest-InstanceUsageAuditLogTestJSON-1266647944-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:27.301597 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67336d4d-8645-41d0-b45b-e49d7837abf5 tempest-InstanceUsageAuditLogTestJSON-1266647944 tempest-InstanceUsageAuditLogTestJSON-1266647944-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 13:45:26" status: 200 len: 318 microversion: 2.1 time: 0.336660 Nov 02 13:45:27.303015 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 606/1125] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:45:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2013%3A45%3A26 => generated 318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:27.308587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:27.309558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:27.320495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:27.321077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:27.321517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.322298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:27.323077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:27.323538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.330619 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-80883aee-a282-4978-987a-de6d81966176 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.102421 Nov 02 13:45:27.332441 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 520/1126] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:27 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:27.349794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:27.352553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:27.364976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:27.366097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:27.367036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.368386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:27.369066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:27.370334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.576180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:27.592085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40ae95e1-b0c0-4a9e-897d-e63922100855 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.287061 Nov 02 13:45:27.593655 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 607/1127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:27 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:27.606519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df43a690-36a6-4a0b-9317-79380b4eafb5 tempest-InstanceUsageAuditLogTestJSON-1266647944 tempest-InstanceUsageAuditLogTestJSON-1266647944-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:27.629648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df43a690-36a6-4a0b-9317-79380b4eafb5 tempest-InstanceUsageAuditLogTestJSON-1266647944 tempest-InstanceUsageAuditLogTestJSON-1266647944-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.033977 Nov 02 13:45:27.630704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 608/1128] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 13:45:27 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:27.636090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:27.636930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:27.648038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:27.648881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:27.649621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.650894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:27.651599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:27.652192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.930692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:27.961838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ccc1d40-3214-42c6-8ba3-5633d6e67ead tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1473 microversion: 2.1 time: 0.325014 Nov 02 13:45:27.967170 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 609/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:27 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1473 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:28.001164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:28.028718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:28.035036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:28.038094 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40f34400-3acd-4e1d-8e0a-3667b180d43e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.704208 Nov 02 13:45:28.057359 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 521/1130] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:27 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:28.278890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-efee4bf1-cff4-46d2-ad0d-80cc12c692a1 req-d97b9c90-c4ec-4d20-88da-1f099005d5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "name": "network-vif-unplugged", "status": "completed", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:28.317643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-efee4bf1-cff4-46d2-ad0d-80cc12c692a1 req-d97b9c90-c4ec-4d20-88da-1f099005d5cf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:28.318314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-efee4bf1-cff4-46d2-ad0d-80cc12c692a1 req-d97b9c90-c4ec-4d20-88da-1f099005d5cf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:28.318853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-efee4bf1-cff4-46d2-ad0d-80cc12c692a1 req-d97b9c90-c4ec-4d20-88da-1f099005d5cf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:28.354847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-efee4bf1-cff4-46d2-ad0d-80cc12c692a1 req-d97b9c90-c4ec-4d20-88da-1f099005d5cf service nova] Creating event network-vif-unplugged:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:45:28.362110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8cf07c6f-bfe0-4ad6-93c4-29ffc91da070 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81e689d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:28.388536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-efee4bf1-cff4-46d2-ad0d-80cc12c692a1 req-d97b9c90-c4ec-4d20-88da-1f099005d5cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122088 Nov 02 13:45:28.395084 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 610/1131] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:28.464868 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8cf07c6f-bfe0-4ad6-93c4-29ffc91da070 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.113667 Nov 02 13:45:28.466237 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 522/1132] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:28 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:28.647456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:28.650473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:28.678487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:28.680286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:28.680954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:28.682592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:28.683396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:28.683989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:28.988585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:28.990908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:28.991588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:29.002462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:29.002965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:29.003447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:29.003871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43a5711e-921a-4b56-8351-7a01028b6f5a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.375719 Nov 02 13:45:29.004167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:29.004673 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 611/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:28 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:29.004840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:29.005042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:29.087766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:29.088816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:29.100738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:29.101233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:29.101667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:29.102452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:29.102909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:29.103355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:29.276626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:29.327784 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-191eef68-7461-4443-b32d-0b7accfbf927 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1431 microversion: 2.1 time: 0.339377 Nov 02 13:45:29.331642 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 523/1134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:28 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1431 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:29.357520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-78a1e7b4-243f-40e4-b922-ee66c73d32d5 req-9d531b88-d50a-49a9-9ad8-26c664f6a1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d405ec8-6f09-419d-9e99-df4cf38c9144", "name": "network-vif-deleted", "tag": "6e0b8572-13b4-4aa8-aea4-63b21f83a3ea"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:29.396183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-78a1e7b4-243f-40e4-b922-ee66c73d32d5 req-9d531b88-d50a-49a9-9ad8-26c664f6a1d6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:29.398548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-78a1e7b4-243f-40e4-b922-ee66c73d32d5 req-9d531b88-d50a-49a9-9ad8-26c664f6a1d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:29.399594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-78a1e7b4-243f-40e4-b922-ee66c73d32d5 req-9d531b88-d50a-49a9-9ad8-26c664f6a1d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:29.470028 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-78a1e7b4-243f-40e4-b922-ee66c73d32d5 req-9d531b88-d50a-49a9-9ad8-26c664f6a1d6 service nova] Creating event network-vif-deleted:6e0b8572-13b4-4aa8-aea4-63b21f83a3ea for instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 on n-h2-858238-3 Nov 02 13:45:29.480485 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-78a1e7b4-243f-40e4-b922-ee66c73d32d5 req-9d531b88-d50a-49a9-9ad8-26c664f6a1d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144498 Nov 02 13:45:29.485922 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 524/1135] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:29.497382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1fca4b16-a6f1-4140-b603-e9fc08876abd tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f823a2040>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:29.571667 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1fca4b16-a6f1-4140-b603-e9fc08876abd tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.080894 Nov 02 13:45:29.577395 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 525/1136] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:29 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:29.584224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:29.633550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:29.636065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:29.647806 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9770f4a-9c15-45b1-8ab8-7c7db7e1c1fc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.561003 Nov 02 13:45:29.650799 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 612/1137] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:29 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:45:30.032723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:30.034278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:30.047147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.048616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.049472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.050848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.051789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.052669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.259323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:30.272160 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7dba2e04-60db-4620-8af0-dd5ff32513df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.245007 Nov 02 13:45:30.273126 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 526/1138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:30 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:30.367023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:30.368932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:30.381592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.382237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.382857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.383779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.384233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.384655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.426956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.427582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.428008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.428443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid 3d405ec8-6f09-419d-9e99-df4cf38c9144 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:30.532976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:30.542022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82b97e8c-4b9c-4632-b1e6-ca9ca7bb9498 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1307 microversion: 2.1 time: 0.186168 Nov 02 13:45:30.542783 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 613/1139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:30 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:30.590440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2deee2e6-d511-46f0-9514-68ccbec8bc85 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f82241550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:30.655158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2deee2e6-d511-46f0-9514-68ccbec8bc85 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.069613 Nov 02 13:45:30.664354 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 527/1140] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:30 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:30.688278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:30.688947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:30.699890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.699890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.699890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.707871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.708355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.708789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.994100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:31.015458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:31.017063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:31.018409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc39b28a-e632-4721-a9ff-b9ddd2deab1e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.336254 Nov 02 13:45:31.019009 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 614/1141] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:30 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:31.300084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:31.300641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:31.308138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.308390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.309041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.309941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.310406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.310848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.558120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:31.568342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:31.570039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:31.583282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.585194 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c8b1067-329d-404d-89b4-dc8b96be2af8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.289489 Nov 02 13:45:31.586062 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 528/1142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:31 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:31.602353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.602353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.602353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.602353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.602792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.666587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.666867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.667277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.674643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0504e247-282b-4e66-ae52-c180d405bb4f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ea6820>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:31.680115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid 3d405ec8-6f09-419d-9e99-df4cf38c9144 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:31.746890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:31.763492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2467cda-88a7-47ad-a87d-9be6ce786291 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1307 microversion: 2.1 time: 0.198913 Nov 02 13:45:31.766185 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 615/1143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:31 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:31.775456 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0504e247-282b-4e66-ae52-c180d405bb4f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.106270 Nov 02 13:45:31.776476 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 529/1144] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:31 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:32.046799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:32.047739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:32.064560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.065872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.067315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.068926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.069857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.070676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.419878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:32.445951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:32.448336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:32.450030 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fec185e-e11e-408c-b77c-3d6fbfbabad7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.408765 Nov 02 13:45:32.460661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 616/1145] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:32 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:45:32.626346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:32.627830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:32.649037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.649530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.651276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.652211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.652844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.653435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.790153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:32.791522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:32.801923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.802290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.811155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.811155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.811155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.811155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.879988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:32.880971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:32.881888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:32.883281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid 3d405ec8-6f09-419d-9e99-df4cf38c9144 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:33.004968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.020262 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b0bc9f5-5809-45d7-a2e3-2a8e17cbf5d0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 200 len: 1307 microversion: 2.1 time: 0.234199 Nov 02 13:45:33.021914 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 617/1146] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:32 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:33.027470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-676ff4f5-f772-4ad3-9b20-85292271efd8 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f819e11f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:33.119180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.146103 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-704987c6-21df-4818-bbbc-6ee45fa07057 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.539563 Nov 02 13:45:33.146715 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 530/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:32 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:33.154317 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-676ff4f5-f772-4ad3-9b20-85292271efd8 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.130162 Nov 02 13:45:33.156484 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 618/1148] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:33 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:33.482806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:33.486372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:33.502329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:33.502878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:33.503434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:33.504668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:33.504878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:33.506549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:33.756690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.772972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.775223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.776678 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0b30437a-1927-422f-b884-98849afb3aa7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.299357 Nov 02 13:45:33.790077 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 531/1149] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:33 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:33.807814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:33.828648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.830664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Searching by: {'deleted': False, 'project_id': '3f456c505e374d62a0185db1764f0911'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:45:33.847878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:33.849107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:33.851670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:33.853658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:33.856978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:33.861658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.076498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b82ad491-9ec3-4795-90c6-cf9a198b6e25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Action: 'create', calling method: .version_select at 0x7f6f8198a670>, body: {"keypair": {"name": "tempest-keypair-132715824", "type": "ssh", "user_id": "b0bb8359673c4cc185adba4b86d2a12e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPV1nqXEj7t9aQQ7KimT2wwhCP+in6ZtFve+qKOb9AfA84DWaA1Fl6n6oy+5sAYO09HpjGdVOEmjVRGbBl2sQ8XURa6+C18Ao1NcnKuVn9tV1jEwBEZ2+2V/NR0Fvchuw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:34.121160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b82ad491-9ec3-4795-90c6-cf9a198b6e25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Getting quotas for project 82e4c4813aa640088de977233c95c2fc. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:34.134343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b82ad491-9ec3-4795-90c6-cf9a198b6e25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Getting quotas for user 483802c713994f73bdd357e96c584305 and project 82e4c4813aa640088de977233c95c2fc. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:34.162117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:45:34.195660 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b82ad491-9ec3-4795-90c6-cf9a198b6e25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.709874 Nov 02 13:45:34.198574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 619/1150] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 13:45:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 716 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:45:34.227733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.229406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: 3d405ec8-6f09-419d-9e99-df4cf38c9144] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:34.243534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.245030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.246052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.247690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.249353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.250270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.275995 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 could not be found. Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 HTTP/1.1 Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:34.278760 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 could not be found. Nov 02 13:45:34.281693 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3d405ec8-6f09-419d-9e99-df4cf38c9144'} Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 could not be found. Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:34.282625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 could not be found. Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 could not be found. Nov 02 13:45:34.284191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:34.287215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance 3d405ec8-6f09-419d-9e99-df4cf38c9144 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:34.288948 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90c44419-475a-44b7-a7cb-7f0e746222fa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144" status: 404 len: 111 microversion: 2.1 time: 0.088042 Nov 02 13:45:34.290457 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 620/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/servers/3d405ec8-6f09-419d-9e99-df4cf38c9144 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:34.306945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b6e78880-b9b3-4afc-9d60-8abeb5cee791 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81b0fe50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.326613 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-447cde69-64c9-44a5-b734-bbf01ec1054e tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.534991 Nov 02 13:45:34.339696 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 532/1152] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:45:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:34.342083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.343290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:34.350617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.351387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.352018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.352955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.353482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.353973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.393708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b6e78880-b9b3-4afc-9d60-8abeb5cee791 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.101501 Nov 02 13:45:34.395807 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 621/1153] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:34.416419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6472ea36-a35d-4f6f-80e3-c6db4db4faf6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Action: 'create', calling method: .version_select at 0x7f6f82191040>, body: {"keypair": {"name": "tempest-keypair-1297223416", "type": "ssh", "user_id": "b0bb8359673c4cc185adba4b86d2a12e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADzkplEOckyJcDZndfLED6Z0+FkD2+iu+1n9u9E+5HIvFvzCVQX2UCVqksraY0jILUQbXuUvQUv5FN8jZbVXMJtak/uNA3JpNpAQ6wxomk8bKiTTYN02tmyvgZ3Q7NCvw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:34.472301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6472ea36-a35d-4f6f-80e3-c6db4db4faf6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Getting quotas for project 82e4c4813aa640088de977233c95c2fc. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:34.479036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6472ea36-a35d-4f6f-80e3-c6db4db4faf6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Getting quotas for user 483802c713994f73bdd357e96c584305 and project 82e4c4813aa640088de977233c95c2fc. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:34.515286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6472ea36-a35d-4f6f-80e3-c6db4db4faf6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.117636 Nov 02 13:45:34.516524 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 622/1154] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 13:45:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:45:34.533959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.534947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:34.551089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.552438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.553253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.555775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.556880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.557890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.567230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:34.635416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:34.651262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f1bc135e-bf79-4e0d-a369-77097a9e5683 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.313781 Nov 02 13:45:34.652314 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 533/1155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:34.659896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.666544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:34.667336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:34.668886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Searching by: {'deleted': False, 'project_id': '3f456c505e374d62a0185db1764f0911'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:45:34.682063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.683704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.687929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.691953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.695148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.695685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.827778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b3d0347-b966-47aa-8036-bf1ed68be168 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 204 len: 0 microversion: 2.1 time: 0.309068 Nov 02 13:45:34.830054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 623/1156] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:34 2022] DELETE /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:34.840781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5452d129-2a49-42c3-b597-281668cc7896 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Calling method '.version_select at 0x7f6f81995790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.873094 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5452d129-2a49-42c3-b597-281668cc7896 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-132715824?user_id=b0bb8359673c4cc185adba4b86d2a12e" status: 200 len: 511 microversion: 2.10 time: 0.040107 Nov 02 13:45:34.877284 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 624/1157] 10.222.0.18 () {60 vars in 1337 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-132715824?user_id=b0bb8359673c4cc185adba4b86d2a12e => generated 511 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:45:34.883034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:45:34.907854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:34.913206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.914256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:34.928807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.929345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.935443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.936959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.943229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.944241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.049742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:35.094943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.099419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.100127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.261064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:35.298637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:35.310813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:35.322574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1bb1f5e-6659-4028-a6be-d5c8b45cb695 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.443420 Nov 02 13:45:35.325785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 625/1158] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:35.345577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.349496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:35.364974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.365482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.365924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.366654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.367141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.373576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.471187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:35.505654 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f12ab911-a19a-4ee9-a4cd-a5456b39ad76 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.851842 Nov 02 13:45:35.506253 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 534/1159] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:35.513965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-93186509-2208-4f72-ad75-879d3629ce25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Action: 'create', calling method: .version_select at 0x7f6f81e545e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-268976461", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABby6TpBjMa3PN1bJF93MeT8C0MXwprm1qIvEch4wUfuT99cD5bxs37V9d5YY+nJLmi/4sGu0qSZ8G3Lvl1WyWkCC2iJ+3Ox1JjqoT6icdcM1MO3rllDrVI/qTJnk9uBw=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:35.564789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-93186509-2208-4f72-ad75-879d3629ce25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Getting quotas for project 82e4c4813aa640088de977233c95c2fc. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:35.577051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:35.582006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-93186509-2208-4f72-ad75-879d3629ce25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Getting quotas for user 483802c713994f73bdd357e96c584305 and project 82e4c4813aa640088de977233c95c2fc. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:35.662574 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-93186509-2208-4f72-ad75-879d3629ce25 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.154882 Nov 02 13:45:35.665227 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 535/1160] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 13:45:35 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:45:35.680527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7fec7de8-b090-40d2-a730-0c20b8486dd2 req-bf77c01a-d655-44f4-a8d2-ef7e775ec157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "name": "network-vif-plugged", "status": "completed", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:35.698853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bddddef0-e19d-409b-a34e-305ab9c78703 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 204 len: 0 microversion: 2.1 time: 0.362604 Nov 02 13:45:35.701144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 626/1161] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:35 2022] DELETE /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:35.719139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bbe538d6-32d5-4b3b-a821-bd7c81e4a176 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f819db430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.719499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7fec7de8-b090-40d2-a730-0c20b8486dd2 req-bf77c01a-d655-44f4-a8d2-ef7e775ec157 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.719997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7fec7de8-b090-40d2-a730-0c20b8486dd2 req-bf77c01a-d655-44f4-a8d2-ef7e775ec157 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.721196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7fec7de8-b090-40d2-a730-0c20b8486dd2 req-bf77c01a-d655-44f4-a8d2-ef7e775ec157 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.782897 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7fec7de8-b090-40d2-a730-0c20b8486dd2 req-bf77c01a-d655-44f4-a8d2-ef7e775ec157 service nova] Creating event network-vif-plugged:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:45:35.802371 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7fec7de8-b090-40d2-a730-0c20b8486dd2 req-bf77c01a-d655-44f4-a8d2-ef7e775ec157 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135981 Nov 02 13:45:35.804199 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 536/1162] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:35.815747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3a2ca5e0-b97b-4414-8f38-7fe010f1ade9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.840240 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3a2ca5e0-b97b-4414-8f38-7fe010f1ade9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034531 Nov 02 13:45:35.844303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bbe538d6-32d5-4b3b-a821-bd7c81e4a176 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.137988 Nov 02 13:45:35.844625 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 537/1163] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:45:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:35.855151 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 627/1164] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:35 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:35.867826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a8c6692a-6edf-4abc-9b5e-8750c0d6ceb6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Calling method '.version_select at 0x7f6f81e719d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.874911 n-d-858238-3 devstack@n-api.service[137558]: WARNING oslo_db.sqlalchemy.utils [None req-a8c6692a-6edf-4abc-9b5e-8750c0d6ceb6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:45:35.875231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.877782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:35.886223 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a8c6692a-6edf-4abc-9b5e-8750c0d6ceb6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs?user_id=b0bb8359673c4cc185adba4b86d2a12e" status: 200 len: 725 microversion: 2.10 time: 0.023120 Nov 02 13:45:35.887710 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 538/1165] 10.222.0.18 () {60 vars in 1259 bytes} [Wed Nov 2 13:45:35 2022] GET /compute/v2.1/os-keypairs?user_id=b0bb8359673c4cc185adba4b86d2a12e => generated 725 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:45:35.894065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.895295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:35.898094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.898662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.899210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.904193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.904964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.906942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.908048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.909073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.910553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.911016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.912755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.913748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.332270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:36.353252 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-63d92608-a002-4e0e-9060-4725dfcbd063 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 200 len: 1474 microversion: 2.1 time: 0.462411 Nov 02 13:45:36.354153 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 539/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:35 2022] GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 1474 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:36.365889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:36.373651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20593d08-e41e-4e6d-9803-96d8d49b361d tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Calling method '.version_select at 0x7f6f81f119d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:36.379845 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf69f95e-73d6-4a8d-934a-eb4dc2322cdc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.529933 Nov 02 13:45:36.380439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 628/1167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:35 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:36.422327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:36.426876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:36.430619 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20593d08-e41e-4e6d-9803-96d8d49b361d tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-268976461" status: 204 len: 0 microversion: 2.10 time: 0.064289 Nov 02 13:45:36.434946 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 540/1168] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Nov 2 13:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-268976461 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:45:36.439128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:36.442227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:36.443535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.445080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:36.446197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:36.451788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.459246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:36.464852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:36.493731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:36.496644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:36.496644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.499326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:36.499827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:36.500268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.537753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:36.776424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=94,nova_api:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:36.821605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ab99d4c-74cd-4659-ae48-3a55f81f0dd9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "DELETE /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 204 len: 0 microversion: 2.1 time: 0.435833 Nov 02 13:45:36.827901 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 629/1169] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:36 2022] DELETE /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:36.838116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e38e390-801f-4057-b574-fb53e54b1abd tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Calling method '.version_select at 0x7f6f81f17a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:36.862505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:36.869534 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e38e390-801f-4057-b574-fb53e54b1abd tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297223416?user_id=b0bb8359673c4cc185adba4b86d2a12e" status: 204 len: 0 microversion: 2.10 time: 0.039157 Nov 02 13:45:36.870772 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 630/1170] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297223416?user_id=b0bb8359673c4cc185adba4b86d2a12e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:45:36.877843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:36.878046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:36.879299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:36.879504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:36.884074 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2e3b467c-aca2-4b0d-9c8b-4a8aed6c94a4 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.446772 Nov 02 13:45:36.894636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:36.895480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:36.897045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.898056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:36.898756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:36.899470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.905393 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 541/1171] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:36 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:36.938212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0b7e37d9-f712-4ab0-bbfd-33c5f87ede1e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81e71160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:37.071886 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0b7e37d9-f712-4ab0-bbfd-33c5f87ede1e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.161258 Nov 02 13:45:37.081253 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 542/1172] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:36 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:37.091397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e341b50-0ff0-4c8f-8ff0-e6ba5093eeb6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] Calling method '.version_select at 0x7f6f81f11af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:37.151635 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e341b50-0ff0-4c8f-8ff0-e6ba5093eeb6 tempest-KeyPairsV210TestJSON-1063746815 tempest-KeyPairsV210TestJSON-1063746815-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132715824?user_id=b0bb8359673c4cc185adba4b86d2a12e" status: 204 len: 0 microversion: 2.10 time: 0.075233 Nov 02 13:45:37.153337 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 543/1173] 10.222.0.18 () {60 vars in 1340 bytes} [Wed Nov 2 13:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132715824?user_id=b0bb8359673c4cc185adba4b86d2a12e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:45:37.385350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:37.386957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:37.434476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:37.437534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:37.438853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:37.440704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:37.441972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:37.442718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:38.044333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:38.047561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:38.063596 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f25fdf27-e0bd-48b1-97d4-678ae8c4cb98 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 200 len: 1432 microversion: 2.1 time: 0.683264 Nov 02 13:45:38.079887 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 544/1174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:37 2022] GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 1432 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:38.082595 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2194660-1163-4631-aee7-a95a4ad1115c tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1607 microversion: 2.1 time: 1.210481 Nov 02 13:45:38.083210 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 631/1175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:36 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1607 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:38.094476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:38.094724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:38.095089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:38.096998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:38.118263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:38.123349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:38.124403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:38.124666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:38.125296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:38.125888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:38.126385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:38.142308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:38.142827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:38.149631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:38.150256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:38.150789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.207450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:39.253132 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0bd183b2-eaa9-4676-b261-87254177eafb tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 1.171563 Nov 02 13:45:39.254393 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 545/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:38 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:39.263421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-279ffa55-0b81-4088-bbc4-c3144701a06a req-b19a007c-dcf6-4c7e-8cd9-acec2e18193f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c46a30-9bc6-4310-871c-c58756321660", "name": "network-vif-deleted", "tag": "27d86d4f-e22e-4025-9595-7c25c6c7372f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:39.305894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-279ffa55-0b81-4088-bbc4-c3144701a06a req-b19a007c-dcf6-4c7e-8cd9-acec2e18193f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:39.319250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-279ffa55-0b81-4088-bbc4-c3144701a06a req-b19a007c-dcf6-4c7e-8cd9-acec2e18193f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:39.320697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-279ffa55-0b81-4088-bbc4-c3144701a06a req-b19a007c-dcf6-4c7e-8cd9-acec2e18193f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.362816 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-279ffa55-0b81-4088-bbc4-c3144701a06a req-b19a007c-dcf6-4c7e-8cd9-acec2e18193f service nova] Creating event network-vif-deleted:27d86d4f-e22e-4025-9595-7c25c6c7372f for instance f0c46a30-9bc6-4310-871c-c58756321660 on n-h1-858238-3 Nov 02 13:45:39.378743 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-279ffa55-0b81-4088-bbc4-c3144701a06a req-b19a007c-dcf6-4c7e-8cd9-acec2e18193f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121849 Nov 02 13:45:39.391772 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 546/1177] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:39.449253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64fdc062-c1d6-4025-897a-c909fb936c0b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ec1670>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:39.580537 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-64fdc062-c1d6-4025-897a-c909fb936c0b tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.186145 Nov 02 13:45:39.582424 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 547/1178] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:39 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:39.590998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9106bd99-57b8-4c14-9106-4225c5c054bf req-4d370b14-1ae1-431a-b0e4-14a801c6b6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-plugged", "status": "completed", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:39.631328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9106bd99-57b8-4c14-9106-4225c5c054bf req-4d370b14-1ae1-431a-b0e4-14a801c6b6d4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:39.636253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9106bd99-57b8-4c14-9106-4225c5c054bf req-4d370b14-1ae1-431a-b0e4-14a801c6b6d4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:39.637306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9106bd99-57b8-4c14-9106-4225c5c054bf req-4d370b14-1ae1-431a-b0e4-14a801c6b6d4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.679393 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9106bd99-57b8-4c14-9106-4225c5c054bf req-4d370b14-1ae1-431a-b0e4-14a801c6b6d4 service nova] Creating event network-vif-plugged:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:45:39.702914 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9106bd99-57b8-4c14-9106-4225c5c054bf req-4d370b14-1ae1-431a-b0e4-14a801c6b6d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117383 Nov 02 13:45:39.704761 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 548/1179] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:39.715231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:39.716986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:39.730708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:39.731942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:39.732969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.734568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:39.735707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:39.737452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.814577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:39.817410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:39.827989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.829420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid f0c46a30-9bc6-4310-871c-c58756321660 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:40.125152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.126848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.134928 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c657902f-dc7f-458c-8e8f-5376179edeea tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 200 len: 1309 microversion: 2.1 time: 0.427991 Nov 02 13:45:40.140972 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 549/1180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:39 2022] GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 1309 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:40.152230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:40.152968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:40.155696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.165033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.166243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.169820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.170431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.174229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.174949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.175538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.176834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c2b3e35-4c0d-4982-8be5-5c71f49a8681 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 2.092299 Nov 02 13:45:40.197405 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 632/1181] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:38 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:40.283748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:40.284586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:40.301675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.303911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.304709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.309317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.311354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.313223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.530314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.541711 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-00298f76-4795-48bf-8c8c-d34e42cb848f tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1607 microversion: 2.1 time: 0.399351 Nov 02 13:45:40.544503 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 550/1182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:40 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1607 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:40.599700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8618a715-7409-4022-b3a9-49f5562efc85 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ee1430>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:40.742568 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8618a715-7409-4022-b3a9-49f5562efc85 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.148724 Nov 02 13:45:40.753091 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 551/1183] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:40 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:40.759064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c077e562-ab04-4637-a4a1-a078e79d3ba7 req-15c5b075-7425-4393-8905-cccc737bb77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d157f09d-638c-42c0-b885-8795ad3c5837", "name": "network-vif-deleted", "tag": "7a3afd1d-b54c-48be-9590-7efdb54b80eb"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:40.785353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c077e562-ab04-4637-a4a1-a078e79d3ba7 req-15c5b075-7425-4393-8905-cccc737bb77b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.788614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c077e562-ab04-4637-a4a1-a078e79d3ba7 req-15c5b075-7425-4393-8905-cccc737bb77b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.789365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c077e562-ab04-4637-a4a1-a078e79d3ba7 req-15c5b075-7425-4393-8905-cccc737bb77b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.816542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c077e562-ab04-4637-a4a1-a078e79d3ba7 req-15c5b075-7425-4393-8905-cccc737bb77b service nova] Creating event network-vif-deleted:7a3afd1d-b54c-48be-9590-7efdb54b80eb for instance d157f09d-638c-42c0-b885-8795ad3c5837 on n-h2-858238-3 Nov 02 13:45:40.849259 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c077e562-ab04-4637-a4a1-a078e79d3ba7 req-15c5b075-7425-4393-8905-cccc737bb77b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095749 Nov 02 13:45:40.851032 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 552/1184] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:40.867827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.881048 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e10cad4-bcf9-4163-889d-7cc0c358ad00 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 0.605597 Nov 02 13:45:40.900400 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 633/1185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:40 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:41.166756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:41.167506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: f0c46a30-9bc6-4310-871c-c58756321660] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:41.187743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.188135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.191814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.192963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.194622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.198570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.233160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:41.235223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:41.253678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.255250 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance f0c46a30-9bc6-4310-871c-c58756321660 could not be found. Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 HTTP/1.1 Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:45:41.262382 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance f0c46a30-9bc6-4310-871c-c58756321660 could not be found. Nov 02 13:45:41.263882 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'f0c46a30-9bc6-4310-871c-c58756321660'} Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c46a30-9bc6-4310-871c-c58756321660 could not be found. Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:41.264772 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c46a30-9bc6-4310-871c-c58756321660 could not be found. Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c46a30-9bc6-4310-871c-c58756321660 could not be found. Nov 02 13:45:41.266130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:41.267278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.267278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.269102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.270642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.272095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance f0c46a30-9bc6-4310-871c-c58756321660 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:41.272729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.275636 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d5e7fb4-7a89-40c2-954b-01b99d477214 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660" status: 404 len: 111 microversion: 2.1 time: 0.113361 Nov 02 13:45:41.278724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 553/1186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:41 2022] GET /compute/v2.1/servers/f0c46a30-9bc6-4310-871c-c58756321660 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:41.289412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:41.294736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:41.313796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.317428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.318173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.320270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.322935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.323700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.509597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:41.519998 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b418aaa-ce06-4fb9-9e3e-8a406645bbf9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1433 microversion: 2.1 time: 0.237913 Nov 02 13:45:41.547733 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 554/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:41 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1433 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:41.590604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:41.591611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:41.605866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.607439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.608463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.609413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.610102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.610912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.041087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:42.063139 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b91d2f0c-8a5a-4988-860e-595dc7c63624 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1539 microversion: 2.1 time: 0.476760 Nov 02 13:45:42.065466 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 555/1188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:41 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1539 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:42.085905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2bff0786-4bde-426c-8ee4-d4d5c0730b11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81c39160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:42.202984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:42.220287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2bff0786-4bde-426c-8ee4-d4d5c0730b11 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.150763 Nov 02 13:45:42.241730 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 556/1189] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:42 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:42.270856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:42.271806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:42.274391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:42.279000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:42.283663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd3d00f7-b900-4e8f-83fa-9146d6356c10 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.056637 Nov 02 13:45:42.284272 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 634/1190] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:41 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:45:42.310027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.310735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.311982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.313011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.313654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.314245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.571906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:42.573140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:42.632552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.633539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.636401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.641487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.642289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.642865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.806348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.812072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.812846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.813677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid d157f09d-638c-42c0-b885-8795ad3c5837 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:43.205061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:43.221554 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d39e849-fc88-4bdf-92bb-bb3522b60591 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 200 len: 1309 microversion: 2.1 time: 0.659545 Nov 02 13:45:43.226236 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 635/1191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:42 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 1309 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:43.246625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.250574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:43.271123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:43.291056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:43.292881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:43.300085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:43.300664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:43.301094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:43.652716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:43.688499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae21f86a-9e74-41d8-bf3d-3f392e042071 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1539 microversion: 2.1 time: 0.453999 Nov 02 13:45:43.690691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 636/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1539 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:43.696770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-581f0f73-a64f-470a-8cd7-8991595e12ed tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a28160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.822034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-581f0f73-a64f-470a-8cd7-8991595e12ed tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.128011 Nov 02 13:45:43.827742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:43.829998 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 637/1193] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:43.842499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.845682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:43.845935 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-24a4f0e4-b4f1-492a-8bc8-3dfd85e0bc5e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1379 microversion: 2.1 time: 1.598324 Nov 02 13:45:43.847171 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 557/1194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:42 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1379 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:43.872769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c75501a9-03fc-4b91-8ead-0f72ed3bd8ab req-04e2bc90-f684-4965-aaf8-16a85236381c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7", "name": "network-vif-deleted", "tag": "3964e435-be7d-448a-819a-3ae95e8e9617"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:43.877955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:43.880125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:43.881886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:43.885093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:43.886338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:43.943535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:43.958192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c75501a9-03fc-4b91-8ead-0f72ed3bd8ab req-04e2bc90-f684-4965-aaf8-16a85236381c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:43.965117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c75501a9-03fc-4b91-8ead-0f72ed3bd8ab req-04e2bc90-f684-4965-aaf8-16a85236381c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:43.966383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c75501a9-03fc-4b91-8ead-0f72ed3bd8ab req-04e2bc90-f684-4965-aaf8-16a85236381c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.042895 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c75501a9-03fc-4b91-8ead-0f72ed3bd8ab req-04e2bc90-f684-4965-aaf8-16a85236381c service nova] Creating event network-vif-deleted:3964e435-be7d-448a-819a-3ae95e8e9617 for instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 on n-h1-858238-3 Nov 02 13:45:44.076347 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c75501a9-03fc-4b91-8ead-0f72ed3bd8ab req-04e2bc90-f684-4965-aaf8-16a85236381c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221706 Nov 02 13:45:44.078698 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 558/1195] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:44.088437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:44.267611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:44.268848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: d157f09d-638c-42c0-b885-8795ad3c5837] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:44.292023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.292830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.293516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.294832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.300247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.301012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.337992 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance d157f09d-638c-42c0-b885-8795ad3c5837 could not be found. Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 HTTP/1.1 Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:45:44.346555 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance d157f09d-638c-42c0-b885-8795ad3c5837 could not be found. Nov 02 13:45:44.349117 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'd157f09d-638c-42c0-b885-8795ad3c5837'} Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d157f09d-638c-42c0-b885-8795ad3c5837 could not be found. Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:44.350464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d157f09d-638c-42c0-b885-8795ad3c5837 could not be found. Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d157f09d-638c-42c0-b885-8795ad3c5837 could not be found. Nov 02 13:45:44.356941 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:44.364613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance d157f09d-638c-42c0-b885-8795ad3c5837 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:44.371059 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f6323246-8dbd-4b3d-9196-c1de6041f164 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837" status: 404 len: 111 microversion: 2.1 time: 0.109465 Nov 02 13:45:44.377819 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 559/1196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:44 2022] GET /compute/v2.1/servers/d157f09d-638c-42c0-b885-8795ad3c5837 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:44.392965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-550de8dd-bfea-4120-80f4-51b5da8092aa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:44.490457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:44.501168 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-550de8dd-bfea-4120-80f4-51b5da8092aa tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/fe8a389b-e4c2-4eae-bec6-23014482bb74" status: 204 len: 0 microversion: 2.1 time: 0.110916 Nov 02 13:45:44.506612 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 560/1197] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 13:45:44 2022] DELETE /compute/v2.1/os-server-groups/fe8a389b-e4c2-4eae-bec6-23014482bb74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:44.521870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:44.522590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:44.555173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.558305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.559196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.560278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.562332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.565520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.571195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:44.590623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:44.592349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:44.599547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b0d8c37-76d0-485a-bef7-7ac13a8b5113 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.768077 Nov 02 13:45:44.615142 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 638/1198] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:44.675069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:44.723969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:44.724484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:44.744751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.745454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.746002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.751263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.755467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.759616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.781727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:45.009426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:45.028597 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-49df2a7a-aa6c-4914-9fff-b1c359976b44 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 204 len: 0 microversion: 2.1 time: 0.518208 Nov 02 13:45:45.029325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6aa73ae1-a522-4a75-a1e1-0a2ef4ade915 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.315326 Nov 02 13:45:45.029665 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 561/1199] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:44 2022] DELETE /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:45.047977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 639/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:44 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:45.054659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.055480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:45.063839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.064491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.065168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.065964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.066521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.066946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.071370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8661d279-4746-475b-b754-1f78e0d82428 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81e5f790>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.213635 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8661d279-4746-475b-b754-1f78e0d82428 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.144908 Nov 02 13:45:45.214668 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 562/1201] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:45 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:45.229169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.229847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:45.268751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.268975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.269605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.302997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.305593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.309515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.492791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:45.497335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:45.512399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c77f9dff-64c6-4456-95be-6a1416c079a8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1529 microversion: 2.1 time: 0.460929 Nov 02 13:45:45.513075 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 640/1202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:45 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1529 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:45.561335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.566937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:45.609001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.610037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.610783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.618671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.619591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.620315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.626064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:45.640497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:45.804120 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf17c042-20a6-42fb-8780-6eb29b74cc64 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 204 len: 0 microversion: 2.1 time: 0.586620 Nov 02 13:45:45.807568 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 563/1203] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:45 2022] DELETE /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:45.831505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.832431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:45.855520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.864737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.865602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.866654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.868611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.869278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.023716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.057293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03e5e1dc-2a60-43b5-9c1e-91e7de944a3c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1529 microversion: 2.1 time: 0.505972 Nov 02 13:45:46.058468 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 641/1204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:45 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1529 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:46.063924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:46.064775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:46.080903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.081651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.086701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.087773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.089400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.095845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.501713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.529891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.543070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0444a1e5-9b9d-4214-a9c4-cdc37d46dfcc tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1475 microversion: 2.1 time: 0.480895 Nov 02 13:45:46.544024 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 642/1205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:46 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1475 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:46.555687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:46.555687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:46.569605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.578478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.578478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.578478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.578478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.579040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.580242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.593153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.596886 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f217dcd8-7689-482a-bc68-b756639305ec tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.782336 Nov 02 13:45:46.637400 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 564/1206] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:45 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:46.659743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aaa2aaf6-77cc-4fb8-a0cc-13964e2ee452 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:46.734462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.754306 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9d8c5da-18a5-4fba-9f13-111eeca20cfb tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.206252 Nov 02 13:45:46.754575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aaa2aaf6-77cc-4fb8-a0cc-13964e2ee452 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/0c1d2ec4-482d-4643-938d-8a7384a4b0c0" status: 202 len: 0 microversion: 2.1 time: 0.113391 Nov 02 13:45:46.757528 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 565/1207] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:46 2022] DELETE /compute/v2.1/flavors/0c1d2ec4-482d-4643-938d-8a7384a4b0c0 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:45:46.766508 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 643/1208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:46 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:46.772853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b57a928f-412f-4209-9f94-5073867be6a9 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ea63a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:46.784016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f71f769a-8d13-4557-be28-23e82b917788 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:46.875299 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f71f769a-8d13-4557-be28-23e82b917788 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105090 Nov 02 13:45:46.891976 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 644/1209] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:45:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:46.913855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:46.917324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:46.946117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.947422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.948068 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b57a928f-412f-4209-9f94-5073867be6a9 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.188031 Nov 02 13:45:46.948602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.957191 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 566/1210] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:46 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:46.958737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.961194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.963675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.087910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:47.113152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Old instance type tempest-test_resize_flavor_-640043200, new instance type m1.heat {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:45:47.131247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:45:47.132441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:45:47.137212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:45:47.137844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:45:47.140729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:45:47.321391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b95430e2-380a-4575-94ad-347db46d5957 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02/action" status: 202 len: 0 microversion: 2.1 time: 0.417619 Nov 02 13:45:47.336324 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 645/1211] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:45:46 2022] POST /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:45:47.339675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:47.341295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:47.398252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.402508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.406639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.408272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.417435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.425034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.587546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:47.588348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:47.608554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.614947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.615400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.618060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.618570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.619041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.536302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:48.562418 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1928f3fc-b0d8-4247-bf4b-3d946e1a8152 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1475 microversion: 2.1 time: 0.978592 Nov 02 13:45:48.574311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 646/1212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:47 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1475 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:48.582930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:48.584108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:48.610881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.611808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.611908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.612664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.613205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.613669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.799844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:48.810833 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2959b572-ae7e-4f3d-8d1b-ada09c2cf0ef tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 1.482274 Nov 02 13:45:48.831659 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 567/1213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:47 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:48.842124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:48.843978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:48.860277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.861057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.863867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.864920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.865566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.871929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.057338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.073239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.074795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.076052 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b66d0e61-eb56-4f1e-921a-66359fd2d122 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.500469 Nov 02 13:45:49.080480 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 647/1214] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:48 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:49.098205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab444f79-dea7-4b5d-9c0b-aad948e83106 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81b0faf0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:49.149447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.161862 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45fbcaff-6dce-4330-b9bc-1b972d636b15 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.328760 Nov 02 13:45:49.163988 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 568/1215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:48 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:49.185821 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab444f79-dea7-4b5d-9c0b-aad948e83106 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.104031 Nov 02 13:45:49.187612 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 648/1216] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:49 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:49.605235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:49.605933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:49.617400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.617907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.618361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.619129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.622335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.622815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.804618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cf5d7d0e-88be-41b3-b9f7-a02a6c8b62ab req-1c37851e-c9fc-4001-beb6-c7bd1557759c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15ac095-b966-4223-9357-84ed254f0b5f", "name": "network-vif-deleted", "tag": "48cc2e19-6aff-4054-8c18-cac1c158d3dd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:49.847860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf5d7d0e-88be-41b3-b9f7-a02a6c8b62ab req-1c37851e-c9fc-4001-beb6-c7bd1557759c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.848771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf5d7d0e-88be-41b3-b9f7-a02a6c8b62ab req-1c37851e-c9fc-4001-beb6-c7bd1557759c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.849384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf5d7d0e-88be-41b3-b9f7-a02a6c8b62ab req-1c37851e-c9fc-4001-beb6-c7bd1557759c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.873435 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cf5d7d0e-88be-41b3-b9f7-a02a6c8b62ab req-1c37851e-c9fc-4001-beb6-c7bd1557759c service nova] Creating event network-vif-deleted:48cc2e19-6aff-4054-8c18-cac1c158d3dd for instance b15ac095-b966-4223-9357-84ed254f0b5f on n-h1-858238-3 Nov 02 13:45:49.888254 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cf5d7d0e-88be-41b3-b9f7-a02a6c8b62ab req-1c37851e-c9fc-4001-beb6-c7bd1557759c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091031 Nov 02 13:45:49.889828 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 649/1217] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:45:49.907410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:49.910404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:49.933746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.940260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.955286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.956251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.956818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.959072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.291799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:50.310497 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c77c805a-c8d1-4d33-aa9e-0369c31d4d37 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1433 microversion: 2.1 time: 0.708911 Nov 02 13:45:50.330127 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 569/1218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:49 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1433 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:50.349522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:50.352630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:50.394629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.395752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.396792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.397740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.398570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.399201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.554478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:50.570919 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb6eff54-e75c-42fa-84a7-9e1da175dc4f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 0.678662 Nov 02 13:45:50.582560 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 650/1219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:49 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:50.617238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40e2f0a7-3559-453d-a6d9-8e29f1ebda5a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f8198a3a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:50.700243 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40e2f0a7-3559-453d-a6d9-8e29f1ebda5a tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.113654 Nov 02 13:45:50.704518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 651/1220] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:50 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:50.711355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:50.712355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:50.728438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.732424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.733617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.740226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.742423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.743286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.016840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:51.032564 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc827823-575a-4ca1-b6fa-332ff0e08b42 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.326410 Nov 02 13:45:51.033955 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 652/1221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:50 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:51.344835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:51.345540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:51.386993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.388045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.392623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.394064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.394812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.396141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.508649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.511339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.512487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.516069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid b15ac095-b966-4223-9357-84ed254f0b5f {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:51.647953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:51.699642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3edda19-b02e-4d6b-99f7-a58888fe5ee9 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 200 len: 1309 microversion: 2.1 time: 0.361182 Nov 02 13:45:51.725248 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 653/1222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:51 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:51.746216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:51.749816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:51.772332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.773074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.774138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.775814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.778488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.779070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.165729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.184213 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd2d0fba-55f9-4798-a110-3a8a6640873f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 0.457321 Nov 02 13:45:52.185143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 654/1223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:51 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:52.190718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f03d9146-8318-4f11-8805-041e6f7b173e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f8194d550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:52.307438 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f03d9146-8318-4f11-8805-041e6f7b173e tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.120732 Nov 02 13:45:52.308294 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 655/1224] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:52 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:52.331494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:52.332281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:52.348820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.349320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.349755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.350469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.351034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.351495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.469313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.483490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.486111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.487649 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fac143a2-aa4b-4db0-95bf-c62daa1dd432 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 2.156151 Nov 02 13:45:52.500495 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 570/1225] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:50 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:52.602541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9c6dd315-b396-4ff1-9b0f-315a56d21f8b req-837a2e2c-eb29-4f75-835e-42e0dc4fe85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb31b3b-b447-47cc-8482-dd92d3c3ee54", "name": "network-vif-deleted", "tag": "9b705e00-2c57-491e-9f90-916ea143a563"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:52.677340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9c6dd315-b396-4ff1-9b0f-315a56d21f8b req-837a2e2c-eb29-4f75-835e-42e0dc4fe85d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.684747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9c6dd315-b396-4ff1-9b0f-315a56d21f8b req-837a2e2c-eb29-4f75-835e-42e0dc4fe85d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.685456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9c6dd315-b396-4ff1-9b0f-315a56d21f8b req-837a2e2c-eb29-4f75-835e-42e0dc4fe85d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.720579 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9c6dd315-b396-4ff1-9b0f-315a56d21f8b req-837a2e2c-eb29-4f75-835e-42e0dc4fe85d service nova] Creating event network-vif-deleted:9b705e00-2c57-491e-9f90-916ea143a563 for instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 on n-h1-858238-3 Nov 02 13:45:52.752035 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9c6dd315-b396-4ff1-9b0f-315a56d21f8b req-837a2e2c-eb29-4f75-835e-42e0dc4fe85d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154246 Nov 02 13:45:52.752936 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 571/1226] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:52.762813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.773706 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a52cd16-6a97-41ff-85ca-442ee9fede72 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.464293 Nov 02 13:45:52.774316 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 656/1227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:52 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:52.783609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:52.797020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: b15ac095-b966-4223-9357-84ed254f0b5f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:52.833743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.841162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.841821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.842892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.843748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.844435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.882494 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance b15ac095-b966-4223-9357-84ed254f0b5f could not be found. Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f HTTP/1.1 Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:45:52.886350 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance b15ac095-b966-4223-9357-84ed254f0b5f could not be found. Nov 02 13:45:52.887776 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'b15ac095-b966-4223-9357-84ed254f0b5f'} Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15ac095-b966-4223-9357-84ed254f0b5f could not be found. Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:52.888528 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15ac095-b966-4223-9357-84ed254f0b5f could not be found. Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15ac095-b966-4223-9357-84ed254f0b5f could not be found. Nov 02 13:45:52.889792 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:45:52.897461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance b15ac095-b966-4223-9357-84ed254f0b5f could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:52.898859 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0fc3e656-2124-40a6-b85d-9f42ef3cf755 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f" status: 404 len: 111 microversion: 2.1 time: 0.144366 Nov 02 13:45:52.904151 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 572/1228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:52 2022] GET /compute/v2.1/servers/b15ac095-b966-4223-9357-84ed254f0b5f => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:52.913282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:52.913731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:52.931557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.931986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.932435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.941718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.942210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.942646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.158835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.169550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.212981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.216125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lazy-loading 'fault' on Instance uuid cfb31b3b-b447-47cc-8482-dd92d3c3ee54 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:53.226122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:53.227269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:53.240835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:53.257181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.259929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.261121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.262451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.268286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.270850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.573155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:53.578163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:53.592591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a3b6cd9-70a6-4f04-86c8-560f297c8bfe tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 200 len: 1309 microversion: 2.1 time: 0.678533 Nov 02 13:45:53.598661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 657/1229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:52 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 1309 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:53.614012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a69ac5be-5a75-4a22-8dd2-0367ab7848f6 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a28af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:53.717627 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a69ac5be-5a75-4a22-8dd2-0367ab7848f6 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.117062 Nov 02 13:45:53.718309 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 658/1230] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:53 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:53.731709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:53.732271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:53.755919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.759681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.760585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.764736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.765396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.765897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.020634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:54.048299 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ef6f161-0d7e-47fe-86d6-393fe2aaf082 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 0.825889 Nov 02 13:45:54.053010 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 573/1231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:53 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:54.065863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.071289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:54.088545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.089437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.091367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.093480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.100130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.101631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.341148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:54.400046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:54.402999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:54.435026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bbcc73d8-6b22-415a-91bc-b0cbe0ca17a8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.707711 Nov 02 13:45:54.441411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 659/1232] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:53 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:54.626447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.627707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: cfb31b3b-b447-47cc-8482-dd92d3c3ee54] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:54.634331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:54.658556 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d2c0282-4ff8-42c9-a0a4-bca5a5c29d34 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.601658 Nov 02 13:45:54.659170 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 574/1233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:54 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:54.693384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.696827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.697603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.700504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.701369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.705149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.736633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-706cb733-5606-4ba6-a6cc-2f77315d1441 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81c9f1f0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.770209 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 could not be found. Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 HTTP/1.1 Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:45:54.771990 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 could not be found. Nov 02 13:45:54.773839 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'cfb31b3b-b447-47cc-8482-dd92d3c3ee54'} Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 could not be found. Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:54.774867 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 could not be found. Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 could not be found. Nov 02 13:45:54.776967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:45:54.779045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance cfb31b3b-b447-47cc-8482-dd92d3c3ee54 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:54.779433 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b880a9b4-6a02-4d45-b3a0-312ecacd9850 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54" status: 404 len: 111 microversion: 2.1 time: 0.158084 Nov 02 13:45:54.781809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 660/1234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:54 2022] GET /compute/v2.1/servers/cfb31b3b-b447-47cc-8482-dd92d3c3ee54 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:45:54.796316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06681e4e-8101-4b98-bfaf-53a716f53127 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.900857 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-706cb733-5606-4ba6-a6cc-2f77315d1441 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.170724 Nov 02 13:45:54.904629 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 575/1235] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:54 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:54.942237 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06681e4e-8101-4b98-bfaf-53a716f53127 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/4063e594-f7be-4990-b476-bd075488a561" status: 204 len: 0 microversion: 2.1 time: 0.153925 Nov 02 13:45:54.951230 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 661/1236] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 13:45:54 2022] DELETE /compute/v2.1/os-server-groups/4063e594-f7be-4990-b476-bd075488a561 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:54.958442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.959022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:54.969625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.972164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.973331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.975008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.975874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.979785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:55.088853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:55.089593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:55.099235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:55.104381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:55.106049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:55.109927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:55.110678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:55.120242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:55.141377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:55.448511 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ea54e38-ac3d-4b4f-bb57-17b6ff1db88e tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 204 len: 0 microversion: 2.1 time: 0.490678 Nov 02 13:45:55.456456 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 576/1237] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:45:54 2022] DELETE /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:55.468904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:55.471416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:55.488066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:55.490338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:55.491913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:55.493783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:55.494875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:55.496022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.018327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.045956 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d41c74a-bb6f-46be-8827-04ccbbee01e1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 0.960664 Nov 02 13:45:56.046895 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 662/1238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:55 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:56.063740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.064443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.093534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.094298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.095350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.097100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.098164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.099196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.232495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.259693 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-572ecb80-e2a4-4b55-b458-8e5900de2ddb tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1471 microversion: 2.1 time: 0.800543 Nov 02 13:45:56.292788 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 577/1239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:55 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1471 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.316802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.319016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.343971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.344710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.345454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.346906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.347157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.347548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.584478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.601770 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-efd74806-9995-48fe-be0c-2801ea1dddc9 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 0.302033 Nov 02 13:45:56.615159 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 578/1240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.615159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3756676f-4593-4ab7-b2e2-6cc880768cde tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81e5f160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.698837 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3756676f-4593-4ab7-b2e2-6cc880768cde tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.093572 Nov 02 13:45:56.712528 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 579/1241] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.824064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.846160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.852547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.855339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-086f73b3-b02c-4753-99be-03e5ebbcb2e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.806622 Nov 02 13:45:56.857041 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 663/1242] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:45:57.081922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:57.082545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:57.102211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.102851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.103504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.107390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.108179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.109342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.298159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:57.298764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:57.310916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.311954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.312560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.314195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.315860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.320760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.590660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:58.620986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b73de13e-51f9-4e04-9271-fa4734153e85 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1471 microversion: 2.1 time: 1.326921 Nov 02 13:45:58.627862 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 664/1243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:57 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1471 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:58.655971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:58.659374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:58.670116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.671801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.672550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.675625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.679394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.680626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.105060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:59.116362 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7df9584a-9d1e-4a2d-886a-bcda8e8c4b82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 2.038544 Nov 02 13:45:59.121168 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 580/1244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:57 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:59.140186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e9beddb3-01df-4948-b5a6-32cb0a24b4c6 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ea6940>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.246393 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e9beddb3-01df-4948-b5a6-32cb0a24b4c6 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.110727 Nov 02 13:45:59.247941 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 581/1245] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:59.254361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.257297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:59.286364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.288203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.291081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.291917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.292402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.292838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.636429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b9d516e828485a931fb97ba2d3c43c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f456c505e374d62a0185db1764f0911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:59.662561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-571a0cf2-6576-4af5-a7b1-0893182eddb2 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 200 len: 1251 microversion: 2.1 time: 1.029504 Nov 02 13:45:59.663607 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 665/1246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:58 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 1251 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:59.674579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.676024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:59.703083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.704118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.706310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.707348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.711001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.711768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.149823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:00.161661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b04ebbc0-9712-4cb1-b15e-06d8c7a187d4 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1471 microversion: 2.1 time: 0.494565 Nov 02 13:46:00.175771 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 666/1247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:00.188384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:00.191906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:00.205323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.216033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.216833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.217822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.218454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.219038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.568380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:00.583405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-755a8f64-4306-4f25-aedf-eca7ce9302dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1538 microversion: 2.1 time: 0.403780 Nov 02 13:46:00.588961 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 667/1248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:00 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1538 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:00.604561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2945658-9eed-4838-930a-73fba60debd2 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f819e1af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:00.728212 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2945658-9eed-4838-930a-73fba60debd2 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.137661 Nov 02 13:46:00.744073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 668/1249] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:00 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:00.765571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-06669716-1d1c-434e-a1cf-f816adeb1850 req-3b8f4639-44fb-4d62-9b34-bec738ed3015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3426fa2d-9b02-4df3-8af1-6fb412017b0e", "name": "network-vif-unplugged", "status": "completed", "tag": "63dfc207-aeb4-4650-96b1-e22bd52c850e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:00.825790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-06669716-1d1c-434e-a1cf-f816adeb1850 req-3b8f4639-44fb-4d62-9b34-bec738ed3015 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.826696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-06669716-1d1c-434e-a1cf-f816adeb1850 req-3b8f4639-44fb-4d62-9b34-bec738ed3015 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.829051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-06669716-1d1c-434e-a1cf-f816adeb1850 req-3b8f4639-44fb-4d62-9b34-bec738ed3015 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.884929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-06669716-1d1c-434e-a1cf-f816adeb1850 req-3b8f4639-44fb-4d62-9b34-bec738ed3015 service nova] Creating event network-vif-unplugged:63dfc207-aeb4-4650-96b1-e22bd52c850e for instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e on n-h1-858238-3 Nov 02 13:46:00.899995 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-06669716-1d1c-434e-a1cf-f816adeb1850 req-3b8f4639-44fb-4d62-9b34-bec738ed3015 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153433 Nov 02 13:46:00.902418 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 669/1250] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:00.910987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:00.915450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] [instance: edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:00.928051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.931417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.932264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.934655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.935268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.935721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.973989 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] HTTP exception thrown: Instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 could not be found. Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Request method failure captured: Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 HTTP/1.1 Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQAOxp2u21jogSDbFeAN-cnk6aVoMuVB4XGD7oPbIxF2ijsRFkoU_zvfVXkgO_wcwy6feCop-jAUJ3CeRJhLGLIhuHdFRB2ZkFLpaf8wp0yFgemtRQSCAqI6-myXhg4Pkd2cGf61AVdQ5cH6bGoZssi8KhmOj-7ZME2grZUMlu-ReQ Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 3f456c505e374d62a0185db1764f0911 Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestBootFromVolume-1269116492 Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:46:00.975672 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f456c505e374d62a0185db1764f0911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3f456c505e374d62a0185db1764f0911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3f456c505e374d62a0185db1764f0911"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3f456c505e374d62a0185db1764f0911"}]}] Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestBootFromVolume-1269116492 Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 3f456c505e374d62a0185db1764f0911 Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1269116492 Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestBootFromVolume-1269116492-project Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 17b9d516e828485a931fb97ba2d3c43c Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestBootFromVolume-1269116492-project Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 could not be found. Nov 02 13:46:00.977883 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7'} Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 could not be found. Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:00.979279 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 could not be found. Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 could not be found. Nov 02 13:46:00.981782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:00.984223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Returning 404 to user: Instance edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:00.984223 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39a58b1a-30d3-4ba0-b8dd-2c0ba6e092df tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7" status: 404 len: 111 microversion: 2.1 time: 0.073472 Nov 02 13:46:00.984223 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 670/1251] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:00 2022] GET /compute/v2.1/servers/edd6c71d-ff99-4e55-9ad5-13aa8b4b76a7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:00.987398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4422ed1d-a39a-4497-a78d-236a8915ec92 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] Calling method '.version_select at 0x7f6f8199dd30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.072840 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4422ed1d-a39a-4497-a78d-236a8915ec92 tempest-ServersTestBootFromVolume-1269116492 tempest-ServersTestBootFromVolume-1269116492-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751331790" status: 202 len: 0 microversion: 2.1 time: 0.084826 Nov 02 13:46:01.078510 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 671/1252] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751331790 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:46:01.191130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.191905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.220701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.223567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.224402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.229291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.230303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.231480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.819909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:01.845139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:01.850007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:01.859422 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f79e798b-4052-4cfe-9201-282d357b7972 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 2.608361 Nov 02 13:46:01.860788 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 582/1253] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 2612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:01.872707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.875823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.901583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.904665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.905908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.908783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.909538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.912758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.955334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:01.971758 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c63eafdd-1cfa-4fa3-85cf-a46317a275ab tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1471 microversion: 2.1 time: 0.786511 Nov 02 13:46:01.979808 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 672/1254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1471 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:01.992227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5118405b-f126-447b-87c8-008bd56b43ac tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f819db9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.220461 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5118405b-f126-447b-87c8-008bd56b43ac tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.234615 Nov 02 13:46:02.227481 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 673/1255] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:02.904755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.905675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.920617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.928588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.929337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.930289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.930914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.931535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.965524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:04.012867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:04.022669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:04.030110 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1cd39f4b-dbdb-4f63-80cc-5a55f8136ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.129331 Nov 02 13:46:04.051131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 674/1256] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:02 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:04.063579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.078315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:04.108513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.109383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.112236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.118827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.119994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.120971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.437613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:04.458074 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-378e0eb4-e763-4b27-a5e6-58f78b87d11d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 2.595573 Nov 02 13:46:04.484994 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 583/1257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:04.495357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-146c2674-9037-45dc-aae0-9a3b7cdda03c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81ec9670>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.584509 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-146c2674-9037-45dc-aae0-9a3b7cdda03c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.097489 Nov 02 13:46:04.585131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 584/1258] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:04.602340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.606178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:04.628966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.633606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.640388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.641825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.642663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.643673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.695539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7a7e25d4ef4a6fbb82b806a555ed87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eb3627bd244c4dbac386bfcecd21ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:04.718817 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08656b89-beeb-4bfa-a10f-286bab480120 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 200 len: 1429 microversion: 2.1 time: 0.678345 Nov 02 13:46:04.724368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 675/1259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 1429 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:04.736920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:04.749138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d0b821e0-5514-4c4f-bb17-b2a5d69c709a req-1939d368-4946-4d1e-b7f5-1f52da659879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9c1616-fc5e-4255-af98-141b90526fe4", "name": "network-vif-deleted", "tag": "af08ebd3-0ef2-4e3d-a5f5-42a0df3c85ae"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:04.806104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=5 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:04.814897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d0b821e0-5514-4c4f-bb17-b2a5d69c709a req-1939d368-4946-4d1e-b7f5-1f52da659879 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.822213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d0b821e0-5514-4c4f-bb17-b2a5d69c709a req-1939d368-4946-4d1e-b7f5-1f52da659879 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.823221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d0b821e0-5514-4c4f-bb17-b2a5d69c709a req-1939d368-4946-4d1e-b7f5-1f52da659879 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.884118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d0b821e0-5514-4c4f-bb17-b2a5d69c709a req-1939d368-4946-4d1e-b7f5-1f52da659879 service nova] Creating event network-vif-deleted:af08ebd3-0ef2-4e3d-a5f5-42a0df3c85ae for instance fa9c1616-fc5e-4255-af98-141b90526fe4 on n-h1-858238-3 Nov 02 13:46:04.905643 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d0b821e0-5514-4c4f-bb17-b2a5d69c709a req-1939d368-4946-4d1e-b7f5-1f52da659879 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175826 Nov 02 13:46:04.916576 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 676/1260] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:05.083735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.087702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:05.105099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.110197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.111198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.112259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.117049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.119520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.970885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:05.995740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:06.000410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:06.016916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88510306-7b33-4a85-9b5f-fe5024b196de tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.933623 Nov 02 13:46:06.018291 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 677/1261] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:05 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:06.032567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:06.033848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:06.064690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.065855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.067215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.074871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.075447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.076024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.175689 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3fadc0c9-7cec-4a85-9c4c-8cdf22c2959f tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1808 microversion: 2.1 time: 1.587193 Nov 02 13:46:06.182765 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 585/1262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1808 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:06.210370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-19e68ea5-2286-4211-8fa8-e0f7ec6b45da tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81f9a820>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:06.392503 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-19e68ea5-2286-4211-8fa8-e0f7ec6b45da tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.206928 Nov 02 13:46:06.401361 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 586/1263] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:06 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:06.408221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:06.412079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] [instance: fa9c1616-fc5e-4255-af98-141b90526fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:06.450552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.456834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.459403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.461920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.466818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.473664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.548375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:06.560956 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] HTTP exception thrown: Instance fa9c1616-fc5e-4255-af98-141b90526fe4 could not be found. Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Request method failure captured: Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 HTTP/1.1 Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOvH059dxbs062Qbi4iqjd8AM2anXMNrcWhYNR7vuInckjOcFBzOF0mrmu_8eufVwSR-zjewMeRv14hf_CF0aPz8cMOXT-JfuotxCu4d4dDFhz5oxNPo28osTl_OCW-wG3QMFZocG8iO4timS6tCrEeJQvtAEwi1nbb-VgFaIVrgPc Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:46:06.578494 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/56eb3627bd244c4dbac386bfcecd21ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_56eb3627bd244c4dbac386bfcecd21ef"}]}] Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 56eb3627bd244c4dbac386bfcecd21ef Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1426480724 Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 6d7a7e25d4ef4a6fbb82b806a555ed87 Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersOnMultiNodesTest-1426480724-project Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance fa9c1616-fc5e-4255-af98-141b90526fe4 could not be found. Nov 02 13:46:06.581231 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'fa9c1616-fc5e-4255-af98-141b90526fe4'} Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa9c1616-fc5e-4255-af98-141b90526fe4 could not be found. Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:06.582685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa9c1616-fc5e-4255-af98-141b90526fe4 could not be found. Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9c1616-fc5e-4255-af98-141b90526fe4 could not be found. Nov 02 13:46:06.585385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.589198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] Returning 404 to user: Instance fa9c1616-fc5e-4255-af98-141b90526fe4 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:06.596124 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3a913c8d-b9a7-4437-b655-4eba037a88e0 tempest-ServersOnMultiNodesTest-1426480724 tempest-ServersOnMultiNodesTest-1426480724-project] 10.222.0.18 "GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4" status: 404 len: 111 microversion: 2.1 time: 0.196664 Nov 02 13:46:06.597030 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5f8a26f-ceb6-4a58-927a-465df100ce19 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.547649 Nov 02 13:46:06.600132 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 678/1264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:06 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:06.600832 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 587/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:06 2022] GET /compute/v2.1/servers/fa9c1616-fc5e-4255-af98-141b90526fe4 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:06.631696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:06.659039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.664252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.667665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.671543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.678402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.681239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.801943 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af552e7a-aae7-4272-a99e-373b335a0fc5 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.196478 Nov 02 13:46:06.804924 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 588/1266] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:46:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:07.083488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:07.085144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:07.149308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:07.151988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:07.160044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:07.163623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:07.167889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:07.174392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:07.966316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc79aed8-1e90-4bdd-9a94-786d6d5f9fd2 tempest-FloatingIPDetailsNegativeTestJSON-1120570661 tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project] Calling method '.version_select at 0x7f6f81e44940>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:08.209210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG neutronclient.v2_0.client [None req-fc79aed8-1e90-4bdd-9a94-786d6d5f9fd2 tempest-FloatingIPDetailsNegativeTestJSON-1120570661 tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b5d7ad4b-b290-4fa6-b013-3f038fff9f43 could not be found", "detail": ""}} {{(pid=137558) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:46:08.210742 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-fc79aed8-1e90-4bdd-9a94-786d6d5f9fd2 tempest-FloatingIPDetailsNegativeTestJSON-1120570661 tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project] HTTP exception thrown: Floating IP not found for ID b5d7ad4b-b290-4fa6-b013-3f038fff9f43 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc79aed8-1e90-4bdd-9a94-786d6d5f9fd2 tempest-FloatingIPDetailsNegativeTestJSON-1120570661 tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project] Request method failure captured: Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-floating-ips/b5d7ad4b-b290-4fa6-b013-3f038fff9f43 HTTP/1.1 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnSeP2q-Zdxt6vKRFeSthRm8zvluz0CoSkD7dBo6xhEwdtToV1OpTECHJZEDFBBFs5oq7fFJ7TQjsku3xTD1pxLHS1Hl23sA8QopHML3V4ZIhKD3u1ZgoP6bBys7EFIJgIUMXKszIVBAeyPFci2dGrTE2G-n6iy9aEbtkHNJ_PForj0 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c7723673cf514ed3a77a0ae75ba7d5bb Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1120570661 Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:46:08.235546 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7723673cf514ed3a77a0ae75ba7d5bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7723673cf514ed3a77a0ae75ba7d5bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7723673cf514ed3a77a0ae75ba7d5bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7723673cf514ed3a77a0ae75ba7d5bb"}]}] Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1120570661 Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c7723673cf514ed3a77a0ae75ba7d5bb Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1120570661 Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 865850beb2d147f0a744669d9a0e2da2 Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: exception: Floating IP not found for ID b5d7ad4b-b290-4fa6-b013-3f038fff9f43 Nov 02 13:46:08.237891 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'b5d7ad4b-b290-4fa6-b013-3f038fff9f43'} Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:46:08.241565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b5d7ad4b-b290-4fa6-b013-3f038fff9f43 could not be found Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccf51930-a832-411c-8c7d-1aa1f610c0bd'] Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b5d7ad4b-b290-4fa6-b013-3f038fff9f43. Nov 02 13:46:08.244914 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b5d7ad4b-b290-4fa6-b013-3f038fff9f43 Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:08.246915 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:08.249657 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:08.249657 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b5d7ad4b-b290-4fa6-b013-3f038fff9f43 Nov 02 13:46:08.249657 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:46:08.255180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc79aed8-1e90-4bdd-9a94-786d6d5f9fd2 tempest-FloatingIPDetailsNegativeTestJSON-1120570661 tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project] Returning 404 to user: Floating IP not found for ID b5d7ad4b-b290-4fa6-b013-3f038fff9f43 {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:08.257955 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc79aed8-1e90-4bdd-9a94-786d6d5f9fd2 tempest-FloatingIPDetailsNegativeTestJSON-1120570661 tempest-FloatingIPDetailsNegativeTestJSON-1120570661-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/b5d7ad4b-b290-4fa6-b013-3f038fff9f43" status: 404 len: 111 microversion: 2.1 time: 1.166867 Nov 02 13:46:08.263224 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 589/1267] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:46:07 2022] GET /compute/v2.1/os-floating-ips/b5d7ad4b-b290-4fa6-b013-3f038fff9f43 => generated 111 bytes in 1175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:08.272484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:08.313183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8b90b4b3-2af2-4729-93c1-6b24a75167b4 req-e41a557e-3a0a-4c32-ba54-75c92a150bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3426fa2d-9b02-4df3-8af1-6fb412017b0e", "tag": "63dfc207-aeb4-4650-96b1-e22bd52c850e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:08.316098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:08.318476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:08.336620 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd6cf6a3-f16d-4a05-8027-104921408f9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.260106 Nov 02 13:46:08.337095 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 679/1268] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:07 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:08.365489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73d52e0e-4833-48c5-862e-b33868ecd056 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81957ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:08.397119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8b90b4b3-2af2-4729-93c1-6b24a75167b4 req-e41a557e-3a0a-4c32-ba54-75c92a150bd0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:08.397611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8b90b4b3-2af2-4729-93c1-6b24a75167b4 req-e41a557e-3a0a-4c32-ba54-75c92a150bd0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:08.398068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8b90b4b3-2af2-4729-93c1-6b24a75167b4 req-e41a557e-3a0a-4c32-ba54-75c92a150bd0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:08.476394 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8b90b4b3-2af2-4729-93c1-6b24a75167b4 req-e41a557e-3a0a-4c32-ba54-75c92a150bd0 service nova] Creating event network-changed:63dfc207-aeb4-4650-96b1-e22bd52c850e for instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e on n-h1-858238-3 Nov 02 13:46:08.516131 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73d52e0e-4833-48c5-862e-b33868ecd056 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.177489 Nov 02 13:46:08.520932 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8b90b4b3-2af2-4729-93c1-6b24a75167b4 req-e41a557e-3a0a-4c32-ba54-75c92a150bd0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247556 Nov 02 13:46:08.524046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 680/1269] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:08 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:08.529096 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 590/1270] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:08.550623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:08.551572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:08.574301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:08.579013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:08.580014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:08.582906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:08.583694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:08.585515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:09.157184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:09.166828 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9186586-8914-4477-bcc6-730338a8c854 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.641678 Nov 02 13:46:09.171874 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 681/1271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:08 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:09.428392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:09.430327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:09.523430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:09.524141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:09.524602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:09.535941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:09.536453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:09.536908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:09.586641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5345f650-9e35-4b58-8b94-e41bf7f87583 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f819db4c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:09.655009 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5345f650-9e35-4b58-8b94-e41bf7f87583 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.077013 Nov 02 13:46:09.658085 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 682/1272] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:09 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:10.199479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:10.200530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:10.254701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:10.256198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:10.257387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:10.259209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:10.265700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:10.274142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:10.528017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:10.552411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:10.554028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:10.569008 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d1fabea3-49d1-4453-9e19-f8b6530e0eed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.147411 Nov 02 13:46:10.578103 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 591/1273] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:09 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:10.683855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ffe6808f-849b-4c92-84cd-3de9f3991f14 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f8247e160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:10.858870 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ffe6808f-849b-4c92-84cd-3de9f3991f14 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1428 microversion: 2.1 time: 0.182334 Nov 02 13:46:10.869537 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 592/1274] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:10 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1428 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:11.616205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:11.616932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:11.645830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:11.650096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:11.654759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:11.656392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:11.660256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:11.661012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:11.889097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:11.933071 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-278752d8-c5ca-4120-b90a-4a3889522884 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 1.741891 Nov 02 13:46:11.953878 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 683/1275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:10 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:11.989854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7950a15a-9624-4516-a898-b9218a64de12", "device": "/dev/xvdb"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:12.001270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:12.040086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:12.040611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:12.041064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:12.047824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:12.048326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:12.048768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:12.062840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:12.628270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:12.642504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:12.663665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:12.665789 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d45502e0-12ae-4f2d-8d2a-4ccf2fc4981a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.053432 Nov 02 13:46:12.684223 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 593/1276] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:11 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:12.724519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9a13104c-5308-4848-8e6a-8d8c943ca08c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f820e5280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:12.880797 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9a13104c-5308-4848-8e6a-8d8c943ca08c tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1437 microversion: 2.1 time: 0.193745 Nov 02 13:46:12.882788 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 594/1277] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:12 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1437 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:12.914365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f6edbe9-85a6-490d-a682-199d075ed040 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f827c9dc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:12.923594 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-560c4509-8f1b-4dd4-9f11-aa63a35335a3 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "POST /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965744 Nov 02 13:46:12.937559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 684/1278] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 13:46:11 2022] POST /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:12.972113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:12.973037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:12.998032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:13.009096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:13.010402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:13.011896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:13.013984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:13.014756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:13.120812 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8f6edbe9-85a6-490d-a682-199d075ed040 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 200 len: 1437 microversion: 2.1 time: 0.189981 Nov 02 13:46:13.141434 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 595/1279] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:12 2022] GET /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 1437 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:13.160835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:13.173257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:13.188394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:13.189572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:13.190529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:13.196684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:13.197765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:13.198722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:13.966647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:13.975764 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eeccbd9e-a6e1-42d1-82d9-9ec396a5a1eb tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1467 microversion: 2.1 time: 0.830698 Nov 02 13:46:13.979900 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 596/1280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:13 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1467 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:14.003757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:14.004378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:14.026003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:14.026505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:14.026946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:14.027703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:14.028165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:14.028594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:14.661243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:14.691026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28f57c98-39a5-4a40-ac4a-7ccde83f4ca4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 1.729671 Nov 02 13:46:14.708246 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 685/1281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:12 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:14.743705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8277078-c18a-4880-8f6e-e684202f8a67 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81a98940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:15.597159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:15.630502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:15.632843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:15.634642 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e2bda099-995d-4f25-b525-9ea7c5d8b61b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.653711 Nov 02 13:46:15.647471 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 597/1282] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:13 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:15.738455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:15.740603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:15.769819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:15.770378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:15.770826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:15.774916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:15.780825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:15.794606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.098207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8277078-c18a-4880-8f6e-e684202f8a67 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "DELETE /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa" status: 204 len: 0 microversion: 2.1 time: 1.387906 Nov 02 13:46:16.100142 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 686/1283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:14 2022] DELETE /compute/v2.1/images/480c650a-c48a-46f1-86f0-8b85290430fa => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:46:16.141680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a08a7d8b-344d-4047-81c6-06805815ce2f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '.version_select at 0x7f6f81b0f040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:16.209078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:16.220014 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7d6cc601-51b0-4ce3-8d3c-8ef23de11353 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.491625 Nov 02 13:46:16.220612 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 598/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:15 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:16.227687 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a08a7d8b-344d-4047-81c6-06805815ce2f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] HTTP exception thrown: Image not found. Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a08a7d8b-344d-4047-81c6-06805815ce2f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Request method failure captured: Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 HTTP/1.1 Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQxyU-WSmZ77EPqWV939GhGob6dpZ-6BR6nuhAfmV_ibpeO1LnYSTRiRDWP3k_tswKpOaKwQr1-OAN269iUImRqfcg7_p25snV-6e7QtKXGPSIRQ6_bAhOoy0wn6-VkBbRr2gcIs05OecxZN0s6X3gjc-Ne98LkLrW2t6pud0hkLls Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9e05ee5eb5cd4988b46b9f26dd465546 Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:46:16.232067 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9e05ee5eb5cd4988b46b9f26dd465546"}]}] Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9e05ee5eb5cd4988b46b9f26dd465546 Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerTestJSON-1579125506-project Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9d13699486d4f8d90b656623f88e267 Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerTestJSON-1579125506-project Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '427704f0-82c7-496d-90ca-ef1871a964b6'} Nov 02 13:46:16.234150 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 427704f0-82c7-496d-90ca-ef1871a964b6 to delete Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:16.235000 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 427704f0-82c7-496d-90ca-ef1871a964b6 could not be found. Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:16.236259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:46:16.237519 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:16.240732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a08a7d8b-344d-4047-81c6-06805815ce2f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:16.242056 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a08a7d8b-344d-4047-81c6-06805815ce2f tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "DELETE /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6" status: 404 len: 62 microversion: 2.1 time: 0.137239 Nov 02 13:46:16.243051 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 687/1285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:16 2022] DELETE /compute/v2.1/images/427704f0-82c7-496d-90ca-ef1871a964b6 => generated 62 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:46:16.252694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:16.253098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:16.266419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.267009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.267528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.268335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.268802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.269256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.305094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:46:16.460158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ece858a3-6b4b-4755-9e3b-c160649f7041 req-694c84e2-ca4c-41d3-a658-2a833a634822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "name": "network-vif-unplugged", "status": "completed", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:16.478733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ece858a3-6b4b-4755-9e3b-c160649f7041 req-694c84e2-ca4c-41d3-a658-2a833a634822 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.480797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ece858a3-6b4b-4755-9e3b-c160649f7041 req-694c84e2-ca4c-41d3-a658-2a833a634822 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.481567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ece858a3-6b4b-4755-9e3b-c160649f7041 req-694c84e2-ca4c-41d3-a658-2a833a634822 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.529188 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ece858a3-6b4b-4755-9e3b-c160649f7041 req-694c84e2-ca4c-41d3-a658-2a833a634822 service nova] Creating event network-vif-unplugged:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:46:16.549800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ece858a3-6b4b-4755-9e3b-c160649f7041 req-694c84e2-ca4c-41d3-a658-2a833a634822 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083735 Nov 02 13:46:16.551926 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 688/1286] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:16.566793 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f1f20f77-af10-413b-b330-128623c5e9f5 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 204 len: 0 microversion: 2.1 time: 0.316623 Nov 02 13:46:16.569796 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 599/1287] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:46:16 2022] DELETE /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:46:16.576485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:16.577237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:16.592203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.593651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.594289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.595219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.595892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.596697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.686211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:16.687417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:16.719962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:16.737287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.741476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.744854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.748585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.748767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.752772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:17.179487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:17.193190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:17.216001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:17.221237 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df92e850-3a94-4bbc-98e8-c8a9258c2f92 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1473 microversion: 2.1 time: 0.648143 Nov 02 13:46:17.225644 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 689/1288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:16 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1473 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:17.228675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:17.235426 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6012a17f-b1cc-4eaf-80df-35453f6c66a6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.557736 Nov 02 13:46:17.240901 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 600/1289] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:16 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:17.269538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:17.271808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:17.303915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:17.305654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:17.307431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:17.316123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:17.318890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:17.323148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:18.269316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:18.273773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:18.300882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:18.304221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:18.305030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:18.308119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:18.309107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:18.311275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:18.771805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:18.781303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34bfb024-de98-4fab-a871-f3a732e48da0 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 1.523536 Nov 02 13:46:18.791543 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 690/1290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:17 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:18.802653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:18.803812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:18.835877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:18.836567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:18.837172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:18.838100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:18.838562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:18.838981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:19.057384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:19.090419 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-27cd1fda-79ad-4c8d-a06a-b361296c2288 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1473 microversion: 2.1 time: 0.836228 Nov 02 13:46:19.094718 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 601/1291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:18 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1473 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:19.810785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:19.812971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:19.832266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:19.834260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:19.836060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:19.845850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:19.847291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:19.849426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:19.875432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:19.891371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:19.893542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:19.909344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad240a72-93fe-43b0-aa90-90e325f4f212 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.117553 Nov 02 13:46:19.910587 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 691/1292] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:18 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:20.135754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:20.136428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:20.153238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:20.153815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:20.154168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:20.154879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:20.165430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:20.165883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:20.567390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:20.590510 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8949789e-522d-48a7-9b96-1c715a6b6f1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.783993 Nov 02 13:46:20.597850 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 602/1293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:19 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:21.069131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1661481665", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:21.180549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:46:21.181053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:46:21.181552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:46:21.181970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:46:21.182395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:46:21.217163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:21.217937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:21.218624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:21.219632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:21.220290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:21.221062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:21.265665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Getting quotas for project a31f92ae1b5e43beb07ac79aad191d32. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:21.280685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Getting quotas for user 2aafce844b6045718db889470bcb581f and project a31f92ae1b5e43beb07ac79aad191d32. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:21.317508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:46:21.331847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:46:21.450700 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9816039c-d3f6-49d9-a118-395eb8b65816 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.851287 Nov 02 13:46:21.461361 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 603/1294] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:46:21.471960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:21.493121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:21.533319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:21.547057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-638d1d53-045a-4d96-83ca-e46a74ddf690 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1473 microversion: 2.1 time: 1.420336 Nov 02 13:46:21.551604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:21.552106 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 692/1295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:20 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1473 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:21.554219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:21.560987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:21.574153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:21.575746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:21.576688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:21.607570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a9dbbee-88ec-400e-b29f-8d9d60951386 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:21.608468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a9dbbee-88ec-400e-b29f-8d9d60951386 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:21.987202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a9dbbee-88ec-400e-b29f-8d9d60951386 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.000124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a9dbbee-88ec-400e-b29f-8d9d60951386 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.031762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a9dbbee-88ec-400e-b29f-8d9d60951386 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.067434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a9dbbee-88ec-400e-b29f-8d9d60951386 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1454 microversion: 2.91 time: 0.501648 Nov 02 13:46:22.075048 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 693/1296] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:21 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1454 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:22.082849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b6b659f5-41ab-4f99-94a4-dbaf52204b59 req-cae54188-7aae-4434-81d1-9d5aff7ae00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeef8007-ad50-4311-ab2d-a90b8acfa365", "name": "network-vif-deleted", "tag": "197bb529-69e4-4d0d-98ca-ee7fe99695a6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:22.151139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6b659f5-41ab-4f99-94a4-dbaf52204b59 req-cae54188-7aae-4434-81d1-9d5aff7ae00a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.152119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6b659f5-41ab-4f99-94a4-dbaf52204b59 req-cae54188-7aae-4434-81d1-9d5aff7ae00a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.156098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6b659f5-41ab-4f99-94a4-dbaf52204b59 req-cae54188-7aae-4434-81d1-9d5aff7ae00a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.202984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b6b659f5-41ab-4f99-94a4-dbaf52204b59 req-cae54188-7aae-4434-81d1-9d5aff7ae00a service nova] Creating event network-vif-deleted:197bb529-69e4-4d0d-98ca-ee7fe99695a6 for instance eeef8007-ad50-4311-ab2d-a90b8acfa365 on n-h2-858238-3 Nov 02 13:46:22.225425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.232965 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b6b659f5-41ab-4f99-94a4-dbaf52204b59 req-cae54188-7aae-4434-81d1-9d5aff7ae00a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156041 Nov 02 13:46:22.233434 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 694/1297] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:22.245216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.249832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.255696 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c689c12b-808a-419e-8305-83d27df62f85 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 0.789618 Nov 02 13:46:22.257082 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 604/1298] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:21 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:22.273831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:22.274581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:22.309347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.309839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.320017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.321040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.321884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.323600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.578617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:22.579274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:22.588463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.588954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.589392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.590102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.590570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.594012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.692558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.693074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.693518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.693986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lazy-loading 'fault' on Instance uuid eeef8007-ad50-4311-ab2d-a90b8acfa365 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:22.730078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:22.744573 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d82cb32-c814-4f38-a60f-f781f2842215 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.496455 Nov 02 13:46:22.761473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 695/1299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:22 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:23.027942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d13699486d4f8d90b656623f88e267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e05ee5eb5cd4988b46b9f26dd465546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:23.040470 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-13425196-7a01-4b62-b932-0ecba315f218 tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 200 len: 1307 microversion: 2.1 time: 0.466410 Nov 02 13:46:23.047260 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 605/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:22 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 1307 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:23.100670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-280c2e85-1674-4608-be99-cffb244a74f2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:23.101344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-280c2e85-1674-4608-be99-cffb244a74f2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:23.291922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:23.292547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:23.312020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:23.312601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:23.313055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:23.313821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:23.314292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:23.314738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:23.327854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-280c2e85-1674-4608-be99-cffb244a74f2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:23.341261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-280c2e85-1674-4608-be99-cffb244a74f2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:23.344895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-280c2e85-1674-4608-be99-cffb244a74f2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:23.369097 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-280c2e85-1674-4608-be99-cffb244a74f2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1454 microversion: 2.91 time: 0.274232 Nov 02 13:46:23.374446 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 696/1301] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:23 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1454 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:23.773379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:23.774788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:23.789036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:23.791561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:23.795042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:23.796381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:23.800668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:23.801406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.239926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:24.261614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-243d531d-b5fc-436f-93f9-84ae4bd04347 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.491615 Nov 02 13:46:24.263843 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 697/1302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:23 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:24.303728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:24.306898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] [instance: eeef8007-ad50-4311-ab2d-a90b8acfa365] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:24.325334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:24.329586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:24.329973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.336086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:24.336866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:24.337653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.375447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] HTTP exception thrown: Instance eeef8007-ad50-4311-ab2d-a90b8acfa365 could not be found. Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Request method failure captured: Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 HTTP/1.1 Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnQxyU-WSmZ77EPqWV939GhGob6dpZ-6BR6nuhAfmV_ibpeO1LnYSTRiRDWP3k_tswKpOaKwQr1-OAN269iUImRqfcg7_p25snV-6e7QtKXGPSIRQ6_bAhOoy0wn6-VkBbRr2gcIs05OecxZN0s6X3gjc-Ne98LkLrW2t6pud0hkLls Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9e05ee5eb5cd4988b46b9f26dd465546 Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:46:24.379171 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9e05ee5eb5cd4988b46b9f26dd465546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9e05ee5eb5cd4988b46b9f26dd465546"}]}] Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9e05ee5eb5cd4988b46b9f26dd465546 Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1579125506 Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerTestJSON-1579125506-project Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9d13699486d4f8d90b656623f88e267 Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerTestJSON-1579125506-project Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance eeef8007-ad50-4311-ab2d-a90b8acfa365 could not be found. Nov 02 13:46:24.380903 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'eeef8007-ad50-4311-ab2d-a90b8acfa365'} Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeef8007-ad50-4311-ab2d-a90b8acfa365 could not be found. Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:24.381908 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeef8007-ad50-4311-ab2d-a90b8acfa365 could not be found. Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeef8007-ad50-4311-ab2d-a90b8acfa365 could not be found. Nov 02 13:46:24.383605 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:46:24.386932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] Returning 404 to user: Instance eeef8007-ad50-4311-ab2d-a90b8acfa365 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:24.388221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c0e23f8-a6fe-4d07-82ad-b1b890da45db tempest-ImagesOneServerTestJSON-1579125506 tempest-ImagesOneServerTestJSON-1579125506-project] 10.222.0.18 "GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365" status: 404 len: 111 microversion: 2.1 time: 0.099216 Nov 02 13:46:24.392770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 698/1303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:24 2022] GET /compute/v2.1/servers/eeef8007-ad50-4311-ab2d-a90b8acfa365 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:24.402067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:24.403013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:24.420905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:24.426962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:24.431360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.432885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:24.433876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:24.438600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.601664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:24.634642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:24.642069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:24.649434 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0adb935c-9800-4b7a-b2db-0a0d99d23b32 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1814 microversion: 2.25 time: 1.357912 Nov 02 13:46:24.650408 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 606/1304] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:23 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1814 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:25.070962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:25.087238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:25.088795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:25.107969 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-592e837d-c3a7-42ee-bb42-bfd8a253b123 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1514 microversion: 2.91 time: 0.710647 Nov 02 13:46:25.113452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 699/1305] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:24 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1514 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:25.294709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:25.295610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:25.298826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:25.340728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:25.345128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:25.346106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:25.352516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:25.353555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:25.360082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:25.456226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:25.684042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:25.684780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:25.712965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:25.714449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:25.715681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:25.716780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:25.721217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:25.722190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:26.756345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:26.801925 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-32d59e2d-a335-4c2e-a84f-fe5effe1a325 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 1.477180 Nov 02 13:46:26.802843 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 607/1306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:25 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:26.821355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:26.830826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:26.851687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:26.854853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:26.856262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:26.858907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:26.859803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:26.863152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:26.863836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:26.873687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:26.876687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:26.878159 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc00c9ea-9b3a-4adf-bf27-afff2413f276 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1804 microversion: 2.25 time: 1.203544 Nov 02 13:46:26.879313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 700/1307] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:25 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1804 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:26.910815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-291e5e1b-52b2-46df-8827-0fcb838d7478 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '.version_select at 0x7f6f8199d160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:26.920189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-291e5e1b-52b2-46df-8827-0fcb838d7478 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:26.922226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-291e5e1b-52b2-46df-8827-0fcb838d7478 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:26.923963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-291e5e1b-52b2-46df-8827-0fcb838d7478 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:26.958774 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-291e5e1b-52b2-46df-8827-0fcb838d7478 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3626 microversion: 2.25 time: 0.054152 Nov 02 13:46:26.964445 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 701/1308] 10.222.0.18 () {60 vars in 1184 bytes} [Wed Nov 2 13:46:26 2022] GET /compute/v2.1/os-migrations => generated 3626 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:26.982616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:26.984934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:26.998764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.000481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.004742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.006081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.006846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.007414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.185271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:27.201984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:27.204067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:27.234165 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f40590e9-f663-493f-9687-44cdf5305b07 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1512 microversion: 2.91 time: 0.416462 Nov 02 13:46:27.235313 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 608/1309] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:26 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:27.443315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 3426fa2d-9b02-4df3-8af1-6fb412017b0e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:27.489104 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af902dca-7bb9-48b9-b57b-df064a9b850a tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 2423 microversion: 2.25 time: 0.511297 Nov 02 13:46:27.489693 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 702/1310] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:26 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 2423 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:27.537581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:27.538689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:27.555758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.564311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.565063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.566187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.566861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.567547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.837064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:27.837852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:27.851224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.856509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.857158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.860412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.861855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.862666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:28.138274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 3426fa2d-9b02-4df3-8af1-6fb412017b0e {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:28.176825 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2cf07240-dd2e-4b51-8f8e-20c9a7bc6db6 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 2423 microversion: 2.25 time: 0.648518 Nov 02 13:46:28.177437 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 609/1311] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:27 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 2423 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:28.267193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:28.267810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:28.278258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:28.281497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:28.283476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:28.284393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:28.289710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:28.290388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:28.399922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:28.411515 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55c1b346-77a2-4b96-953b-74c94fbc0fbf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.578566 Nov 02 13:46:28.420255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 703/1312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:27 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:28.442964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:28.461950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:28.482506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:28.487284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:28.492904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:28.493883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:28.494498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:28.505760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:28.571852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:28.592868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:28.598997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:28.630165 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5192f435-bbf2-440e-ae89-a6587176f1d9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1533 microversion: 2.91 time: 0.366054 Nov 02 13:46:28.632925 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 610/1313] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:28 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1533 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:28.948919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lazy-loading 'services' on Instance uuid 3426fa2d-9b02-4df3-8af1-6fb412017b0e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:29.424757 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-25e07a7d-b028-4470-bfa2-f778b29bfb77 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments/13d03b71-bc03-4bf6-951a-38790950c9cb" status: 202 len: 0 microversion: 2.25 time: 1.002834 Nov 02 13:46:29.425434 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 704/1314] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Nov 2 13:46:28 2022] DELETE /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments/13d03b71-bc03-4bf6-951a-38790950c9cb => generated 0 bytes in 1005 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:46:29.447757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:29.466485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:29.497212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.497711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.498288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.499000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.500426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.501520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.515699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:29.627474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:29.628207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:29.644309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.646005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.649018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.656950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.659541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.663551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.704954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e085e25-2bcd-45db-9bae-bd75c9ef785a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.258181 Nov 02 13:46:29.712429 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 705/1315] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:29 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:29.729161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:29.730063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:29.756906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.757809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.758408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.760461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.762353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.763385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.963128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lazy-loading 'services' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:30.008936 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aba8b923-9a71-44b3-86be-48bd20797684 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1938 microversion: 2.91 time: 1.353347 Nov 02 13:46:30.019163 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 611/1316] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:28 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1938 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:30.046037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:30.046037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:30.059332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.062679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.064626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.065769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.067501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.070550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.287578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lazy-loading 'services' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:30.321027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:30.333655 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e887b772-349d-43fe-ba58-dbb1ec6ba398 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.619470 Nov 02 13:46:30.347155 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ab434df-8fcd-4892-95d0-db754abf901c tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1938 microversion: 2.91 time: 0.298566 Nov 02 13:46:30.347155 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 612/1317] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:30 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1938 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:30.347564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 706/1318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:29 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:30.397659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:30.411474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.412507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.416788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.418203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.425810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.426716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.518288 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-95f4cbb9-d8a6-4133-ba68-695b869cc2cc tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.116645 Nov 02 13:46:30.519741 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 613/1319] 10.222.0.18 () {60 vars in 1217 bytes} [Wed Nov 2 13:46:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:30.538477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:30.539294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:30.547890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.548633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.549314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.550790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.551492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.552137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.580840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lazy-loading 'flavor' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:30.718106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:30.721119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:30.737773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.741790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.742622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.743605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.745364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.746124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.845110 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-70695d50-fa98-4ce1-99dd-7ac365995e68 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130976 Nov 02 13:46:30.860360 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 614/1320] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:30 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:46:31.166939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7942bac3-47ca-4327-a9ff-b52b0594868c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action" status: 202 len: 0 microversion: 2.91 time: 0.631979 Nov 02 13:46:31.168030 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 707/1321] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:46:30 2022] POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:46:31.178733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:31.179486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:31.188967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.189491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.189930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.190643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.208113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.208585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.307232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:31.366963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:31.367776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:31.392429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.397009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.399487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.403038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.403587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.408012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.475004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:31.492393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:31.497459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:31.511668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e2eff6bf-f6ab-4690-b08f-c9bfe270cd16 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.335616 Nov 02 13:46:31.513983 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 615/1322] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:31 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:31.872035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:31.874368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:31.904446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.905010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.905495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.906775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.910795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.911355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.914091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:31.971258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30ba4e20-209f-4a49-9476-e61d82b2ace6 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.612453 Nov 02 13:46:31.994379 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 708/1323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:31 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:32.035373 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-33ce9408-34d7-4bab-8a94-7c5009a87b42 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162587 Nov 02 13:46:32.045188 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 616/1324] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:31 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:46:32.562015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:32.563547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:32.573326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.574112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.576823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.578291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.579647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.582358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.752243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:32.762430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:32.768607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:32.783820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-25f57580-96b0-4978-9ab3-e9227d9f8b0f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.224238 Nov 02 13:46:32.787749 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 709/1325] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:32 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:33.002478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.003131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:33.019325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83b5e5c7-9348-4c80-954c-068e9f209331 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81b999d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.035326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.036857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.037964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.039798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.044379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.045523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.142284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83b5e5c7-9348-4c80-954c-068e9f209331 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c" status: 200 len: 636 microversion: 2.1 time: 0.123521 Nov 02 13:46:33.154828 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 710/1326] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:33 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c => generated 636 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:33.159905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.166804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:33.190595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.191990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.193251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.196170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.196746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.197179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.296233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d8d8dab2-90c5-4461-8894-c02720f1537d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149461 Nov 02 13:46:33.298092 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 711/1327] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:33 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:33.306031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ecc7bd87-d714-4f14-adeb-4f97384a1b2d tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f81b41280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:33.333754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:33.393717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-ecc7bd87-d714-4f14-adeb-4f97384a1b2d tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:33.422674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-ecc7bd87-d714-4f14-adeb-4f97384a1b2d tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:33.701719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:33.714886 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-71e4e459-65fb-4f97-bc82-1bda22623d80 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1543 microversion: 2.1 time: 0.716647 Nov 02 13:46:33.720381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 617/1328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:32 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1543 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:33.820301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.820928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:33.838909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.839745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.841080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.841080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.841501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.841955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.928430 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ecc7bd87-d714-4f14-adeb-4f97384a1b2d tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.628323 Nov 02 13:46:33.930188 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 712/1329] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:33 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:33.945221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54ee6ca3-d797-40be-9ef8-e99534efe897 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81b41a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:34.145146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:34.155917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:34.157957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:34.166175 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-121b6f00-1906-4d39-a737-4e828a92fcdc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.348407 Nov 02 13:46:34.169442 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 618/1330] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:33 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:34.316176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:34.321263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:34.352996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:34.366927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:34.370309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:34.375388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:34.380585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:34.382153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:34.486013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54ee6ca3-d797-40be-9ef8-e99534efe897 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "DELETE /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.549484 Nov 02 13:46:34.487336 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 713/1331] 10.222.0.18 () {58 vars in 1296 bytes} [Wed Nov 2 13:46:33 2022] DELETE /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata/os_version => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:46:34.497742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-27054cb0-6e78-4c17-a3fc-c5462e986dd8 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81957ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:34.530355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04f5f092-5b33-48bd-8197-266eb2398f7a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.222862 Nov 02 13:46:34.541191 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 619/1332] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:34 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:34.567672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-27054cb0-6e78-4c17-a3fc-c5462e986dd8 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.075926 Nov 02 13:46:34.568924 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 714/1333] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:46:34 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 37 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:46:34.581371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-675702c3-447a-4586-8561-74be69682c33 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f820d9f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:34.692469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-675702c3-447a-4586-8561-74be69682c33 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:34.697955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-675702c3-447a-4586-8561-74be69682c33 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:34.746476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:34.747329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:34.791926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:34.793167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:34.798796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:34.799683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:34.800165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:34.800598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.249169 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-675702c3-447a-4586-8561-74be69682c33 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.672163 Nov 02 13:46:35.255864 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 620/1334] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:34 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:35.274740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:35.275818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:35.290867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.291652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.294786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.296045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.296706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.297299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.457228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.479261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.480665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.494005 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ccb2bd02-7cdb-4d1c-aecd-26f4b5a096f9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.236716 Nov 02 13:46:35.514013 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 621/1335] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:35 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:35.526129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3c142466-8cbf-403f-8c02-1ea22ddec236 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81fcedc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:35.600616 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3c142466-8cbf-403f-8c02-1ea22ddec236 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.083279 Nov 02 13:46:35.602979 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 622/1336] 10.222.0.18 () {58 vars in 1290 bytes} [Wed Nov 2 13:46:35 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata/os_distro => generated 33 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:35.615313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-unplugged", "status": "completed", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:35.626734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.627588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.629911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.654479 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] Creating event network-vif-unplugged:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h1-858238-3 Nov 02 13:46:35.661120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:46:35.682156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d563de30-8a48-4ad9-abb7-06e278fac0b7 req-34091806-592e-4f45-9354-9b0615c87f74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076173 Nov 02 13:46:35.686063 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 623/1337] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:35.699314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:35.707315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:35.717914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.718751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.719403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.720303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.726481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.727318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.788476 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd8cd185-0dec-4b49-814d-839cf717bcea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100389 Nov 02 13:46:35.792654 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 624/1338] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:35 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:35.812853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2c8cde11-642a-40d7-a7dc-7acc02816c73 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f827c95e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:35.919948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2c8cde11-642a-40d7-a7dc-7acc02816c73 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:35.922002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.935978 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95fe616d-c44c-489a-b764-00e119035d27 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1542 microversion: 2.1 time: 1.197178 Nov 02 13:46:35.936605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 715/1339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:34 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1542 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:35.946288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:35.948924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2c8cde11-642a-40d7-a7dc-7acc02816c73 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:35.952021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:35.960876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=81 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:35.962783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.967327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.970195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.971230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.971872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.972489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.314962 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2c8cde11-642a-40d7-a7dc-7acc02816c73 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.520870 Nov 02 13:46:36.320034 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 625/1340] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:35 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:36.326130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4a209e4-a530-4c63-a7a6-45561d4a08ce tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f8254b3a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:36.416881 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4a209e4-a530-4c63-a7a6-45561d4a08ce tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.095017 Nov 02 13:46:36.417857 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 626/1341] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:46:36 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:36.454876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3601d2f0-c19a-4ef7-8402-79248e69e7fd tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f828325e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:36.554264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3601d2f0-c19a-4ef7-8402-79248e69e7fd tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:36.563391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3601d2f0-c19a-4ef7-8402-79248e69e7fd tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:36.808942 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3601d2f0-c19a-4ef7-8402-79248e69e7fd tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.364012 Nov 02 13:46:36.809904 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 627/1342] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:36 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:36.820407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:36.822872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:36.866063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.870893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.873351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.876008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.879825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.881339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.150360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.169788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.173758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.194646 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2bdeb14-bb19-4d03-84e9-804e82dfa6b4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.383269 Nov 02 13:46:37.196507 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 628/1343] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:36 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:37.209741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:37.219507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:37.238181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.239823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.240957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.250113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.251231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.255155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.268568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:37.362489 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-710a119a-aeff-4bfc-b819-1f7187bf0180 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164410 Nov 02 13:46:37.363805 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 629/1344] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:37 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:37.379630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-324f7e22-d15a-4190-b3bc-1a13c8c62653 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f82491dc0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:37.456714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77d6e749-52b6-466a-8134-cc57a5da9d7a tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1854 microversion: 2.1 time: 1.516304 Nov 02 13:46:37.459761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-324f7e22-d15a-4190-b3bc-1a13c8c62653 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:37.460865 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 716/1345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:35 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1854 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:37.474995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:37.476503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-324f7e22-d15a-4190-b3bc-1a13c8c62653 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:37.478916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:37.495069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.498912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.501604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.502635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.505375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.507996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.018702 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-324f7e22-d15a-4190-b3bc-1a13c8c62653 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.648086 Nov 02 13:46:38.019645 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 630/1346] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:37 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 64 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:38.025368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858238-3", "block_migration": true, "disk_over_commit": false}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:38.040357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.048158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.048662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.049105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.049831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.050690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.050690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.106678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lazy-loading 'flavor' on Instance uuid 380fd169-b6bb-4da9-bac7-37950d8f2428 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:38.127936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Going to try to live migrate instance to n-h1-858238-3 {{(pid=137558) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:46:38.211372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.229148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-702ba84d-1767-47c7-82ef-9254e928adf3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1542 microversion: 2.1 time: 0.767101 Nov 02 13:46:38.229762 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 717/1347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:37 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1542 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:38.260895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0794a1ce-e125-462e-9f88-5b27e6edddf6 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81b99a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.367135 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0794a1ce-e125-462e-9f88-5b27e6edddf6 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.127840 Nov 02 13:46:38.375572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 718/1348] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 64 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:38.391556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.399303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.429938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.430483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.436143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.444593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.445216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.451216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.698194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.712311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.714273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.730077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-145e1c57-3ef9-4382-9c7b-3e94ea344067 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.352980 Nov 02 13:46:38.730975 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 719/1349] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:38.744952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:38.787027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.787556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.793424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.843775 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] Creating event network-changed:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h1-858238-3 Nov 02 13:46:38.865829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:46:38.918414 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-642a6a40-071e-4ae7-8e8f-a03486e10045 req-4f2d3458-aedc-4548-a8cb-285e596e00d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185941 Nov 02 13:46:38.919046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 720/1350] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:38.948218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.955243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.989318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.989823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.990268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.991008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.991538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.999150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.103429 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c86fa75-228e-41fd-b55e-bfd6ebf6f57c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.165941 Nov 02 13:46:39.108513 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 721/1351] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:46:39.118671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfae697a-9b15-49bd-8b63-5a7811494325 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f81b41940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:39.210535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dfae697a-9b15-49bd-8b63-5a7811494325 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:39.229824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dfae697a-9b15-49bd-8b63-5a7811494325 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:39.979614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfae697a-9b15-49bd-8b63-5a7811494325 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.872518 Nov 02 13:46:39.981580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 722/1352] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:39 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:39.990240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:39.991281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:39.998816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:40.000331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:40.001142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:40.002136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:40.002851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:40.003600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:40.441127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:40.710990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:40.740035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-710bab1e-7ce6-4aea-a296-f7d1a80a609a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1474 microversion: 2.1 time: 0.756296 Nov 02 13:46:40.741502 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 723/1353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:39 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1474 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:40.751894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:40.752904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:40.763366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:40.764688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:40.766215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:40.767554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:40.768268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:40.768908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:40.969554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:40.991756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:40.996852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:41.013257 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3768b3fe-170b-4fc6-8731-16ac2467ec32 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.267460 Nov 02 13:46:41.030453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 724/1354] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:40 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:41.042803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cceeae4-e99b-4293-9aba-4c02fea12817 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update', calling method: .version_select at 0x7f6f81d18ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:41.147032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-8cceeae4-e99b-4293-9aba-4c02fea12817 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:41.156832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-8cceeae4-e99b-4293-9aba-4c02fea12817 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:41.578569 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cceeae4-e99b-4293-9aba-4c02fea12817 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.546227 Nov 02 13:46:41.584848 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 725/1355] 10.222.0.18 () {60 vars in 1313 bytes} [Wed Nov 2 13:46:41 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata/os_version => generated 31 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:41.591765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:41.594364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:41.601657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.602633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.603395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.604438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.605444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.606139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.644116 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70a6583d-4a28-4584-bba2-cb402b1c9a34 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.057486 Nov 02 13:46:41.648149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 726/1356] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:46:41 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:41.662095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d758f05d-9dc0-4814-85e9-5e389a68b3f9 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81957940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:41.730103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d758f05d-9dc0-4814-85e9-5e389a68b3f9 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.080513 Nov 02 13:46:41.738259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 727/1357] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:46:41 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:41.744073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b57a3c9-d71b-431c-9e64-53df00370109 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'update_all', calling method: .version_select at 0x7f6f81b72d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:41.838797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6b57a3c9-d71b-431c-9e64-53df00370109 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:41.845868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6b57a3c9-d71b-431c-9e64-53df00370109 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:42.423561 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fb0807e9-fef3-4bea-9b9e-28835db1be51 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/action" status: 202 len: 0 microversion: 2.1 time: 4.402730 Nov 02 13:46:42.427421 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 631/1358] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:46:38 2022] POST /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/action => generated 0 bytes in 4407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:46:42.433592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:42.447861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:42.481809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.482521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.486599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.487740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.488465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.489331 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b57a3c9-d71b-431c-9e64-53df00370109 tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.749499 Nov 02 13:46:42.490938 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 728/1359] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:46:41 2022] PUT /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 61 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:42.500414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:42.501175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:42.503918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.529535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.530137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.533049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.533985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.537806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.538430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.565932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:42.870378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.882162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.883797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.917574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8db72fe-0be6-46db-8557-6d47069b3e0c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.417281 Nov 02 13:46:42.918366 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 729/1360] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:42 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:42.923894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:42.924510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:42.944093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.949237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.949781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.950538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.951004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.951463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.971817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.980329 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2701175-7049-426c-adca-e1b4fd0266c1 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1471 microversion: 2.1 time: 0.551525 Nov 02 13:46:42.980929 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 632/1361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:42 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:42.986164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-66150fbf-0342-4b49-9787-2cbb8959bc3c tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Action: 'create', calling method: .version_select at 0x7f6f825f4ca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:43.126149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-66150fbf-0342-4b49-9787-2cbb8959bc3c tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:43.133163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-66150fbf-0342-4b49-9787-2cbb8959bc3c tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Getting quotas for user c5a8d678c9bd4f74af6bb219a1996f5e and project 9f59d0893ef24f27894bf15a4f32d4b0. Resources: dict_keys(['metadata_items']) {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:43.774089 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-66150fbf-0342-4b49-9787-2cbb8959bc3c tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "POST /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.792071 Nov 02 13:46:43.774790 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 633/1362] 10.222.0.18 () {60 vars in 1281 bytes} [Wed Nov 2 13:46:42 2022] POST /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 85 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:43.779859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:43.781377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:43.793495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:43.800339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:43.804716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b2c72b7-5dcd-47e9-80ae-21220f282f30 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.885244 Nov 02 13:46:43.805309 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 730/1363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:42 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:43.807700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.809361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.814432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.820337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.821010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.821611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.826610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42b8a2a0-4729-4003-9d43-98491659fced tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] Calling method '.version_select at 0x7f6f81b0f160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:43.965555 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42b8a2a0-4729-4003-9d43-98491659fced tempest-ImagesMetadataTestJSON-2064796064 tempest-ImagesMetadataTestJSON-2064796064-project] 10.222.0.18 "GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.154818 Nov 02 13:46:43.966343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 731/1364] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:46:43 2022] GET /compute/v2.1/images/3f929617-12f2-4579-bb6c-e96e3cfd3b4c/metadata => generated 85 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:43.971461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.975762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:43.976374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:43.985453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.987936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.988819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.996671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.997231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.001523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.002018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.002452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.003195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.003651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.004071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.089000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:44.117450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for user 832cd460bb5e4148a57d561f762ceb11 and project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:44.565255 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3769851f-75fd-4914-b823-49103f0fa8be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02/action" status: 202 len: 0 microversion: 2.1 time: 0.788785 Nov 02 13:46:44.572270 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 634/1365] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:46:43 2022] POST /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:46:44.599394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:44.601812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:44.619785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.622946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.623690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.626789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.627660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.629869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.671828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:44.683754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:44.689120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:44.706691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e3f94d1-5db9-49cc-89bc-5caae29886aa tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.736878 Nov 02 13:46:44.707696 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 732/1366] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:43 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:44.836710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:44.838854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:44.866380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.868296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.870251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.871384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.872505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.875247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.146569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.163485 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-266d0b18-2f3e-4dce-b0a1-2d6165bec9be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1470 microversion: 2.1 time: 0.580696 Nov 02 13:46:45.179741 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 635/1367] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:44 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1470 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:45.662492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.679531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c2988c28-8dbf-4b39-8653-dd1807ed5acb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.847754 Nov 02 13:46:45.681151 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 733/1368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:44 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:45.744442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:45.745062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:45.765687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:45.766460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:45.767066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.768063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:45.768703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:45.769615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.964541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.976168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.984500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:46.002197 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e63cc6f9-6a3b-40c8-a696-3ae8f2951200 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.261778 Nov 02 13:46:46.004711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 636/1369] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:45 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:46.195364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:46.196064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:46.206285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.211520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.212073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.212905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.213615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.214237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.704644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:46.716139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:46.740680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.741183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.741847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.742744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.743413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.744001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.888302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:46.896581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de2e03df-f4cf-4f65-a62d-9dd196bb6b46 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1470 microversion: 2.1 time: 0.705178 Nov 02 13:46:46.897176 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 734/1370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:46 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1470 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:47.036550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:47.037694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:47.050801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.053082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.053807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.055316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.058857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.059565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.306563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:47.321537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:47.329107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:47.346198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56511588-612e-40fb-84c6-889dff649d55 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.311877 Nov 02 13:46:47.348157 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 735/1371] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:47 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:46:47.759463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:47.780183 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-982ed351-ac0f-4d7a-bebd-fe783ce78fab tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 1.076370 Nov 02 13:46:47.783497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 637/1372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:46 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:47.924728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:47.925985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:47.946080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.948636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.953286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.954203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.957665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.958609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.383889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:48.384872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:48.396265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.400445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.404351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.405443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.406708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.410755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.642074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.653503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.673083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.682967 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a7a81aac-b331-4792-b0d5-78dfba8ab39f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.303099 Nov 02 13:46:48.692720 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 638/1373] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:48 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:49.070953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-plugged", "status": "completed", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:49.090078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.090765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.091409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.134017 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] Creating event network-vif-plugged:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h1-858238-3 Nov 02 13:46:49.142651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:46:49.188128 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9f6b544e-2bd9-4735-adc2-710270219945 req-8b4f7f16-8f2c-4569-bd12-f4c3b52541f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.492982 Nov 02 13:46:49.195943 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 639/1374] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:49.203755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:49.204472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:49.211726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.212450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.213212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.214331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.215524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.216387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.550975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:49.560218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ff4b4b8-7ede-4fae-b95b-7d46ac916982 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1470 microversion: 2.1 time: 1.640731 Nov 02 13:46:49.562724 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 736/1375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:47 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1470 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:49.652868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:49.698177 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0fe8c2f6-28a7-4e6a-9428-6105b09cf432 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.497667 Nov 02 13:46:49.711216 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 640/1376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:49 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:49.730698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:49.731439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:49.743952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.744666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.745281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.746176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.746783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.747472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:50.270147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:50.288339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:50.290006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:50.330763 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-89f0e2e5-9efe-4691-a73e-e42459e355a8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.594006 Nov 02 13:46:50.331538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 737/1377] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:49 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:50.588904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:50.590674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:50.611029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:50.615579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:50.617074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:50.620008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:50.622516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:50.632208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:50.729792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:50.730364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:50.742414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:50.744569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:50.745536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:50.750652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:50.757404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:50.758191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:50.926484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:50.935135 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed8c79ed-eb9a-4307-b637-6c54fbce0931 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1470 microversion: 2.1 time: 0.351746 Nov 02 13:46:50.950592 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 641/1378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:50 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1470 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:51.015556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-189751247", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "32109b4d-aab8-4ab1-bdb3-dee4a86d0788"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:51.116055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] validate_networks() for [('32109b4d-aab8-4ab1-bdb3-dee4a86d0788', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:46:51.242940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:51.268978 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d495e9d-41a0-4eac-8527-720ced1895bc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.542973 Nov 02 13:46:51.271314 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 738/1379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:50 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:51.282652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f59e3b84-6d95-4dd0-b23a-cbe7875dd1ee tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f819950d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:51.363238 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f59e3b84-6d95-4dd0-b23a-cbe7875dd1ee tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/065af578-d211-4076-bc98-5834a41e8314" status: 200 len: 661 microversion: 2.1 time: 0.089481 Nov 02 13:46:51.364490 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 739/1380] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:51 2022] GET /compute/v2.1/images/065af578-d211-4076-bc98-5834a41e8314 => generated 661 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:51.371137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:51.376765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:51.386812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:51.391790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:51.392552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:51.393597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:51.394070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:51.394506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:51.647472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:51.660605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:51.666751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:51.683951 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3c8f901-d66e-437e-a586-7834bca589b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.318150 Nov 02 13:46:51.706411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 740/1381] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:51 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:51.720682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da905946-985f-453a-9482-586cc3f02bd7 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81957160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:51.830970 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da905946-985f-453a-9482-586cc3f02bd7 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/065af578-d211-4076-bc98-5834a41e8314" status: 200 len: 661 microversion: 2.1 time: 0.135148 Nov 02 13:46:51.831648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 741/1382] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:51 2022] GET /compute/v2.1/images/065af578-d211-4076-bc98-5834a41e8314 => generated 661 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:51.863901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:52.037130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-197862321", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "87b19db8-bca7-4e15-a215-fb7f6d07b020"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:52.159497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] validate_networks() for [('87b19db8-bca7-4e15-a215-fb7f6d07b020', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:46:52.616921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:46:52.618297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:46:52.618996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:46:52.619608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:46:52.620500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:46:52.650239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:52.653934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:52.654752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:52.659710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:52.663781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:52.664894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:52.749631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Getting quotas for project 1a5ecf2ec6e945e491550f5bf076ee90. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:52.784620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Getting quotas for user 81b1ac92520f4f34bff3faf6d496b07a and project 1a5ecf2ec6e945e491550f5bf076ee90. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:52.854383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:46:52.864647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:46:53.087137 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4b4499e8-c41f-48d5-840b-9e68a517badf tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149715 Nov 02 13:46:53.089667 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 642/1383] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:46:53.103114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:53.103749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:53.129859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:53.130376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:53.131582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:53.133301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:53.133788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:53.134206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:53.822170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:53.834522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:53.868042 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c9163f83-bd51-408f-b348-f352586c6774 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1536 microversion: 2.1 time: 0.777239 Nov 02 13:46:53.871645 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 643/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:53 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1536 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:53.892065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:53.897889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:53.937472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:53.940630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:53.941475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:53.943251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:53.946333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:53.947903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.769716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:54.805298 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-21147995-7df9-4578-a86c-9a9a2c9a1576 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.928038 Nov 02 13:46:54.808912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 644/1385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:53 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:54.822469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:54.833091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:54.853763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:54.854570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:54.855334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.856528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:54.857607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:54.858548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.993289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:46:54.995172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:46:54.995991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:46:54.996552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:46:54.997607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:46:55.050193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.052130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.054016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.055382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.056461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.115961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.199117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:55.210358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:55.223628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:55.243150 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cd214134-15d4-4e17-94a7-5f913b6e0411 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.432197 Nov 02 13:46:55.244159 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 645/1386] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:54 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:55.264286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:55.268984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:55.269839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:55.287381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for user 8469267606da4e50bd1e694ee7762547 and project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:55.289666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.294437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.297899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.298786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.299373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.301145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.391518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:46:55.404951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:46:55.732214 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a1a5fa88-fde8-4e46-a0e8-f73d601ebf3a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.899495 Nov 02 13:46:55.732890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 742/1387] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:46:55.752033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fddba651-095e-4844-890f-d081f1e538ba tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f823b9e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:55.757895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:55.824468 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-052aca65-b696-45bd-b20e-b2e06672cf45 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1276 microversion: 2.1 time: 0.571548 Nov 02 13:46:55.832416 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fddba651-095e-4844-890f-d081f1e538ba tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/92727e46-e89f-470c-83d5-c1474c9313d3" status: 200 len: 661 microversion: 2.1 time: 0.092641 Nov 02 13:46:55.833166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 743/1388] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:55 2022] GET /compute/v2.1/images/92727e46-e89f-470c-83d5-c1474c9313d3 => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:55.835274 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 646/1389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:55 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1276 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:55.848891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:55.849604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:55.877849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.880753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.881271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.882044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.887668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.888203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:56.034556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-unplugged", "status": "completed", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:56.117743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:56.127718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:56.128615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:56.226418 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] Creating event network-vif-unplugged:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:46:56.270108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:46:56.301060 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4db3d17c-59b9-49a1-b97a-3c2db0c0fd68 req-72e47cfd-d2b6-455b-af75-c225307155be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.463720 Nov 02 13:46:56.303061 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 647/1390] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:56.344853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57ce81ae-a4ae-4614-a96e-4e8cb365f2e9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:56.345663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-57ce81ae-a4ae-4614-a96e-4e8cb365f2e9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:56.976525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-57ce81ae-a4ae-4614-a96e-4e8cb365f2e9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:57.025895 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57ce81ae-a4ae-4614-a96e-4e8cb365f2e9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1224 microversion: 2.1 time: 0.709549 Nov 02 13:46:57.030100 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 648/1391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:56 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1224 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:57.063803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:57.067371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:57.104304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:57.110735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:57.111486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:57.115188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:57.118494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:57.121862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:57.964068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:57.975265 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35853768-36fe-4815-b1ff-8a2902c7d9df tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1536 microversion: 2.1 time: 2.141007 Nov 02 13:46:57.978373 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 744/1392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:55 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1536 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:58.006798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a50d828-0d91-4a53-9fc5-eb2a817bb034 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81bbb1f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:58.094438 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a50d828-0d91-4a53-9fc5-eb2a817bb034 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/92727e46-e89f-470c-83d5-c1474c9313d3" status: 200 len: 661 microversion: 2.1 time: 0.113098 Nov 02 13:46:58.095513 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 745/1393] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:46:57 2022] GET /compute/v2.1/images/92727e46-e89f-470c-83d5-c1474c9313d3 => generated 661 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:58.118489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:58.119198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:58.147792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.149866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.151311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.159369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.160749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.163191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.467979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:58.485634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:58.495987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:58.516303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed47446b-c8f6-404f-afed-0782e700bd11 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1560 microversion: 2.91 time: 0.416367 Nov 02 13:46:58.518797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 746/1394] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:58 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1560 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:46:58.530359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:58.546152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:58.572603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.574690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.577471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.578569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.581006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.583038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.734409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:58.746919 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-58292c02-7779-42e6-bb1f-5ca9317ac14e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 1.713483 Nov 02 13:46:58.770300 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 649/1395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:57 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:58.775484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:58.779159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:58.797433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.803285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.804012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.805914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.806549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.807200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.880334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:58.905639 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b3e783d-2fdb-4638-9452-78429d078be7 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1282 microversion: 2.1 time: 0.373442 Nov 02 13:46:58.911182 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 747/1396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:58 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1282 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:58.943520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:58.970210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.975752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.976453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.036727 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] Creating event network-changed:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:46:59.059586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:46:59.101048 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d4c7eb0a-5bd6-4cd4-af2f-143138884ae8 req-7bc74735-5c4b-452e-92d6-d1c85db1b25f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176532 Nov 02 13:46:59.103970 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 748/1397] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:59.113722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:59.122997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:59.127377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:59.129745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:59.145498 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-43c8f830-770e-465f-a60b-1bd50e106a5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1276 microversion: 2.1 time: 0.373712 Nov 02 13:46:59.154556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.155330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.161894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.163194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.163829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.164446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.167230 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 650/1398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:58 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1276 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:59.551191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:59.552768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:59.570460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.571890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.572381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.573059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.573516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.573943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.902406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:59.911164 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7bae60a-0d4d-4e39-8cff-7eed6f38a9e4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1536 microversion: 2.1 time: 0.805588 Nov 02 13:46:59.911631 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 749/1399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:59 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1536 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:59.923347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:59.923959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:59.956679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.957164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.961844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.962827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.965892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.966526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.991128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.004450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.005920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.025232 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eabe2457-243d-46ce-a509-97e0c5385892 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.479248 Nov 02 13:47:00.034342 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 651/1400] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:46:59 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:47:00.054867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:00.056705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:00.081612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.084550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.086384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.087429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.090638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.091282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.440529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.457155 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c57a691-3801-42d0-aec6-b34b5be7f840 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.544503 Nov 02 13:47:00.457875 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 750/1401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:59 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:00.474163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:00.479661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:00.506196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.507479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.507840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.508516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.513461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.514262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.521149 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe7b0721-559d-49f8-8d7a-f6c66028b913 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1282 microversion: 2.1 time: 0.476723 Nov 02 13:47:00.522387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.523959 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 652/1402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:00 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1282 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:00.539393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-252450bd-8c42-46c5-9b8a-88d0fbd80d19 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8254b700>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:00.668302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.679801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:00.740125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1d35e28-83ee-4490-8982-56f5edd17797 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1282 microversion: 2.1 time: 0.274178 Nov 02 13:47:00.741442 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 751/1403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:00 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1282 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:00.943307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:00.951626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:00.977471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.978124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.978938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.980180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.980670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.981073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.211718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:01.225604 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a6ae6df-d603-41d7-b172-ee4324c985b5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1536 microversion: 2.1 time: 0.292870 Nov 02 13:47:01.227027 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 752/1404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:00 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1536 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:01.237850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:01.239003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:01.256885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.258427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.259346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.263046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.263826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.264521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.425330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:01.439937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:01.448490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:01.459156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-405bed2d-4e5a-4ce3-aee4-d214f9d81328 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.230343 Nov 02 13:47:01.463544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 753/1405] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:01 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:01.482088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:01.482664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:01.516926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.517745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.518638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.519576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.520050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.520456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.812628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:01.830091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6b90079-1bb2-44df-acbc-82179856fbc9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.352027 Nov 02 13:47:01.834972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 754/1406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:01 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:01.851160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:01.855789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:01.866099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.869338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.870114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.871131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.872701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.874705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.259872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:02.272680 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f2bb7bb-85df-4de0-b23b-71c56ccfd398 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.436216 Nov 02 13:47:02.273618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 755/1407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:01 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:02.298014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:02.299057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:02.306853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.307759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.308436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.309451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.309976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.310621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.424414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:02.438315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6be73a50-8c70-45d4-80e0-3a8097eaa18e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1282 microversion: 2.1 time: 0.145339 Nov 02 13:47:02.451764 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 756/1408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:02 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:02.460799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:02.462290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:02.473021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.473886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.475798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.478622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.479767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.481664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.702939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=5 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:02.916955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:02.928094 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b958e5cd-0a9b-44d5-a8e0-72ffa599451a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1536 microversion: 2.1 time: 0.473195 Nov 02 13:47:02.931743 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 757/1409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:02 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1536 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:02.937731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:02.941835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:02.956581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.957508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.958225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.966543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.968286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.970461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.107705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.120921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.131532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.141850 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-008fab8f-7589-462c-9655-ccc7ca935b27 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.207853 Nov 02 13:47:03.143547 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 758/1410] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:02 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:03.163016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:03.169585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:03.204198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.205224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.207426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.208180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.208786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.209221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.565192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.585669 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-07d0a488-9375-4d1e-9cfa-bc4816c236e6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.440744 Nov 02 13:47:03.597141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 759/1411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:03 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:03.604658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:03.605931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:03.618920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.623038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.623887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.625482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.630498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.631419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.849219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.858441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ec10665-8f86-4142-84e3-c2d96e4c6af4 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.259756 Nov 02 13:47:03.859661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 760/1412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:03 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:03.866536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:03.867604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:03.881253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.882039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.885623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.886805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.887551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.888104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.124301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:04.135424 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56d2425c-f992-4899-9042-399c03bf7bb0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 0.273896 Nov 02 13:47:04.136646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 761/1413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:03 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:04.142208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:04.143201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:04.161162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.162273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.162966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.164207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.164854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.165423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.539406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:04.555761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d004cb99-79cb-421b-bbf2-ceae4b9c99de tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1536 microversion: 2.1 time: 0.414807 Nov 02 13:47:04.570610 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 762/1414] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:04 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1536 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:04.576543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:04.577172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:04.586020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.586509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.586951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.587724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.588182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.588616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.734727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:04.761092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:04.768197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:04.783157 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5fc99c52-93f5-4c0c-8783-ae4bebacb224 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.209395 Nov 02 13:47:04.784682 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 763/1415] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:04 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:04.792160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:04.792920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:04.823907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.825518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.828635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.833075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.834616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.836677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:05.198284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:05.350227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:05.401413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:05.433364 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f114564-8325-4f39-b01e-30406dc6e031 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.645749 Nov 02 13:47:05.436126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 764/1416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:04 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:05.446802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2187b019-e782-4cf5-ac87-bcafd39eca88 req-def2499e-d145-4fc1-bd07-24b77e988335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e585f63-2566-44d6-8c3a-dab947606fbb", "tag": "785b08cd-05a1-4099-a070-8cab31891d68"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:05.499739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2187b019-e782-4cf5-ac87-bcafd39eca88 req-def2499e-d145-4fc1-bd07-24b77e988335 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:05.500845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2187b019-e782-4cf5-ac87-bcafd39eca88 req-def2499e-d145-4fc1-bd07-24b77e988335 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:05.501293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2187b019-e782-4cf5-ac87-bcafd39eca88 req-def2499e-d145-4fc1-bd07-24b77e988335 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:05.528976 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2187b019-e782-4cf5-ac87-bcafd39eca88 req-def2499e-d145-4fc1-bd07-24b77e988335 service nova] Creating event network-changed:785b08cd-05a1-4099-a070-8cab31891d68 for instance 7e585f63-2566-44d6-8c3a-dab947606fbb on n-h1-858238-3 Nov 02 13:47:05.552815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2187b019-e782-4cf5-ac87-bcafd39eca88 req-def2499e-d145-4fc1-bd07-24b77e988335 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114916 Nov 02 13:47:05.553522 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 765/1417] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:05.569387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:05.569829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:05.581757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:05.582384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:05.582679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:05.589382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:05.590203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:05.590805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.014316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:06.027331 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3671374-6b5a-44be-8068-c09600c27618 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.467616 Nov 02 13:47:06.033142 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 766/1418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:05 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:06.047317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:06.056250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:06.081639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.082407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.089728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.091305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.091948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.092559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.983348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=28 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:07.123356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:07.126323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78b0f3ba-bf6f-4f2f-ba05-9cece0481737 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 1.087467 Nov 02 13:47:07.131022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 767/1419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:06 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:07.149882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:07.150508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:07.175967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.176474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.176914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.177647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.178090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.178511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.255396 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-252450bd-8c42-46c5-9b8a-88d0fbd80d19 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/f1aa993d-c346-4910-a3d1-b0bc5208c5a2" status: 200 len: 662 microversion: 2.1 time: 6.729872 Nov 02 13:47:07.258321 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 653/1420] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:00 2022] GET /compute/v2.1/images/f1aa993d-c346-4910-a3d1-b0bc5208c5a2 => generated 662 bytes in 6734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:07.279208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:07.281910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:07.302929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.312915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.314631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.317341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.320928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.321792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.496317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:07.511992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:07.515236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:07.526259 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50d76326-541a-433b-8074-8c162e8e29a1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.262787 Nov 02 13:47:07.532856 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 654/1421] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:07 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:07.606070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:07.615670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3802339a-b1a4-43fb-9484-b1a2bcd359e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1529 microversion: 2.1 time: 0.483324 Nov 02 13:47:07.632928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 768/1422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:07 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1529 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:07.653651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:07.654562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:07.670502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.671333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.672764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.673663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.674373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.676866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.687930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:07.875454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ab741d98-74f0-4e91-bc67-c4cf5afc6170 req-811b7a4b-234b-4345-8080-6973991da202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380fd169-b6bb-4da9-bac7-37950d8f2428", "name": "network-vif-unplugged", "status": "completed", "tag": "223fc1ee-7c85-4aa3-8257-614ae0ade6e5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:07.924568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ab741d98-74f0-4e91-bc67-c4cf5afc6170 req-811b7a4b-234b-4345-8080-6973991da202 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.925348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ab741d98-74f0-4e91-bc67-c4cf5afc6170 req-811b7a4b-234b-4345-8080-6973991da202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.925963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ab741d98-74f0-4e91-bc67-c4cf5afc6170 req-811b7a4b-234b-4345-8080-6973991da202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.955682 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ab741d98-74f0-4e91-bc67-c4cf5afc6170 req-811b7a4b-234b-4345-8080-6973991da202 service nova] Creating event network-vif-unplugged:223fc1ee-7c85-4aa3-8257-614ae0ade6e5 for instance 380fd169-b6bb-4da9-bac7-37950d8f2428 on n-h2-858238-3 Nov 02 13:47:07.970846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ab741d98-74f0-4e91-bc67-c4cf5afc6170 req-811b7a4b-234b-4345-8080-6973991da202 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.436425 Nov 02 13:47:07.972713 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 655/1423] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:07.985581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:07.986294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:08.002222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:08.002693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:08.006197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:08.007009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:08.009776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:08.010292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:08.226513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:08.237716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30c3511e-87aa-40dc-970e-7184fb8a4769 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.602743 Nov 02 13:47:08.255131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 769/1424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:07 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:08.255131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9358072b-a32f-4eb9-8064-6c69d44511d6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81d100d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:08.342881 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9358072b-a32f-4eb9-8064-6c69d44511d6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/f1aa993d-c346-4910-a3d1-b0bc5208c5a2" status: 200 len: 662 microversion: 2.1 time: 0.097612 Nov 02 13:47:08.347088 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 770/1425] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:08 2022] GET /compute/v2.1/images/f1aa993d-c346-4910-a3d1-b0bc5208c5a2 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:08.631316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-364275146", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:08.728630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:08.744953 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c8c54e7f-4cf6-4757-bdb4-6d93fcdf5f7a tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.764252 Nov 02 13:47:08.751944 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 656/1426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:07 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:08.768588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:08.769204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:08.778515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:08.786761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:08.787548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:08.788529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:08.790025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:08.791000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:08.791981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.066688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:09.067469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:09.068860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:09.069472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:09.070044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:09.082821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.083551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.084082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.084925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.085510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.086004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.131251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Getting quotas for project 855fbdf05b074d1c866189215a73e31a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:09.142084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Getting quotas for user 50415ac10fc74f0cad0e7af0d2d52b34 and project 855fbdf05b074d1c866189215a73e31a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:09.161841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:09.165000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:09.288175 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84d9658e-199c-4c49-9663-486127bbd8cb tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939705 Nov 02 13:47:09.290014 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 771/1427] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:47:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:47:09.307037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:09.308422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:09.325509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.326465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.327337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.328516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.332056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.333665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.602026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:09.629645 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f92510d9-6cd5-4151-a688-df29ede884bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1529 microversion: 2.1 time: 0.875839 Nov 02 13:47:09.643145 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 657/1428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:08 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1529 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:09.652820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4039e0ec-a4cd-4fb0-a1e2-4db4ee65ad32 req-0136f424-c962-4413-b9d6-10d5f6d97c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8148766-4f8e-47b9-b16b-e7591434c2b1", "tag": "9988a127-a587-4d7c-b8a4-76ed08b18e33"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:09.679625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4039e0ec-a4cd-4fb0-a1e2-4db4ee65ad32 req-0136f424-c962-4413-b9d6-10d5f6d97c67 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.680427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4039e0ec-a4cd-4fb0-a1e2-4db4ee65ad32 req-0136f424-c962-4413-b9d6-10d5f6d97c67 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.681069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4039e0ec-a4cd-4fb0-a1e2-4db4ee65ad32 req-0136f424-c962-4413-b9d6-10d5f6d97c67 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.716253 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4039e0ec-a4cd-4fb0-a1e2-4db4ee65ad32 req-0136f424-c962-4413-b9d6-10d5f6d97c67 service nova] Creating event network-changed:9988a127-a587-4d7c-b8a4-76ed08b18e33 for instance e8148766-4f8e-47b9-b16b-e7591434c2b1 on n-h2-858238-3 Nov 02 13:47:09.743981 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4039e0ec-a4cd-4fb0-a1e2-4db4ee65ad32 req-0136f424-c962-4413-b9d6-10d5f6d97c67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110003 Nov 02 13:47:09.751650 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 658/1429] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:09.773661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:09.784354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:09.794985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:09.802077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43769772-aa9f-4e77-af57-2b0aa73b6b3d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 0.510587 Nov 02 13:47:09.810706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 772/1430] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:09 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:09.823718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.828350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.835879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.837154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.838164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.839280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.840096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2103925370", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:09.998467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:10.133080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.155559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.161339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.175639 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31bdf68a-9c15-4bab-9faa-3298aabb0e7e tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.419802 Nov 02 13:47:10.188980 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 659/1431] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:09 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:10.213886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:10.214525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:10.236159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.237462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.242762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.246805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.248078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.249134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.572551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:10.574823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:10.576015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:10.576701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:10.577348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:10.589203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.590071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.592433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.593669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.594383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.595764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.621182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Getting quotas for project d726861de17a4726b20716d8f60920b5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:10.641809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Getting quotas for user 2ce568516a23489fbd362ea2fa01983b and project d726861de17a4726b20716d8f60920b5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:10.668147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.693160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:10.693779 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e84bee0-8b5b-47fa-a324-1b6f8ea0e0c9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.503333 Nov 02 13:47:10.696603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:10.696931 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 660/1432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:10 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:10.702867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:10.715985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:10.723738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.725122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.725988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.726971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.727664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.728312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.860170 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9dd819c-7926-4b7a-848c-eb5d6a5e75ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046186 Nov 02 13:47:10.872259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 773/1433] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:47:10.893034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e8e84ce-bf2d-4bf7-85ec-5bed20ae9ea6 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:10.925034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6e8e84ce-bf2d-4bf7-85ec-5bed20ae9ea6 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] HTTP exception thrown: Flavor 0c1d2ec4-482d-4643-938d-8a7384a4b0c0 could not be found. Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e8e84ce-bf2d-4bf7-85ec-5bed20ae9ea6 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Request method failure captured: Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/flavors/0c1d2ec4-482d-4643-938d-8a7384a4b0c0 HTTP/1.1 Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOxDsweTWtdEPviVQmpwr6yCCWgiSlBtf3Oftm9DyAkvdCvaRUQf1POaklHuWkRCoYJi-IMnj2x2d5SQKsHxjrBtQpMPx2WZXUUUNb7K54r7fU1SrbC-nrXZKd-UNKsdhOf0htN8-VCTEgmuF3p31WYV5HgiQWv84DhAM7ONLM8rGM Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31765594e94244dc93f0a9eb464bfc52 Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MigrationsAdminTest-598253827 Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:47:10.933759 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31765594e94244dc93f0a9eb464bfc52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31765594e94244dc93f0a9eb464bfc52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31765594e94244dc93f0a9eb464bfc52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31765594e94244dc93f0a9eb464bfc52"}]}] Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MigrationsAdminTest-598253827 Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31765594e94244dc93f0a9eb464bfc52 Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MigrationsAdminTest-598253827 Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MigrationsAdminTest-598253827-project-admin Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 4869ec3bba1d40cabf299fcada04d419 Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MigrationsAdminTest-598253827-project-admin Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: exception: Flavor 0c1d2ec4-482d-4643-938d-8a7384a4b0c0 could not be found. Nov 02 13:47:10.936373 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '0c1d2ec4-482d-4643-938d-8a7384a4b0c0'} Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0c1d2ec4-482d-4643-938d-8a7384a4b0c0 could not be found. Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:10.938626 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 0c1d2ec4-482d-4643-938d-8a7384a4b0c0 could not be found. Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0c1d2ec4-482d-4643-938d-8a7384a4b0c0 could not be found. Nov 02 13:47:10.941011 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:10.942603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e8e84ce-bf2d-4bf7-85ec-5bed20ae9ea6 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Returning 404 to user: Flavor 0c1d2ec4-482d-4643-938d-8a7384a4b0c0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:10.944603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e8e84ce-bf2d-4bf7-85ec-5bed20ae9ea6 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/0c1d2ec4-482d-4643-938d-8a7384a4b0c0" status: 404 len: 109 microversion: 2.1 time: 0.069054 Nov 02 13:47:10.947211 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 774/1434] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:47:10 2022] DELETE /compute/v2.1/flavors/0c1d2ec4-482d-4643-938d-8a7384a4b0c0 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:10.958526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.965358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:10.966904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:10.985418 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4fe25c5b-9724-4998-830f-16862e5fe498 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1214 microversion: 2.1 time: 0.286610 Nov 02 13:47:10.990373 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 661/1435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:10 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:10.997556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:10.999007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:10.999007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.004340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f88d963d-dab7-4bdc-90c5-85054ba510d5 req-9137d78f-9184-4fde-bd4e-893d4dd26ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380fd169-b6bb-4da9-bac7-37950d8f2428", "tag": "223fc1ee-7c85-4aa3-8257-614ae0ade6e5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:11.007522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.009415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.018747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.037075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f88d963d-dab7-4bdc-90c5-85054ba510d5 req-9137d78f-9184-4fde-bd4e-893d4dd26ce2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.038414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f88d963d-dab7-4bdc-90c5-85054ba510d5 req-9137d78f-9184-4fde-bd4e-893d4dd26ce2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.048580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f88d963d-dab7-4bdc-90c5-85054ba510d5 req-9137d78f-9184-4fde-bd4e-893d4dd26ce2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.086022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f88d963d-dab7-4bdc-90c5-85054ba510d5 req-9137d78f-9184-4fde-bd4e-893d4dd26ce2 service nova] Creating event network-changed:223fc1ee-7c85-4aa3-8257-614ae0ade6e5 for instance 380fd169-b6bb-4da9-bac7-37950d8f2428 on n-h2-858238-3 Nov 02 13:47:11.107334 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f88d963d-dab7-4bdc-90c5-85054ba510d5 req-9137d78f-9184-4fde-bd4e-893d4dd26ce2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114496 Nov 02 13:47:11.108334 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 662/1436] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:11.124821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:11.125534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:11.130855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:11.145511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.146951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.148186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.149819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.151210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.153097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.542827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:11.569052 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df5d825b-1d0e-40a6-b814-2911d85f3a10 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.618185 Nov 02 13:47:11.591139 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 775/1437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:10 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:11.618006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-731543866", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:11.725050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:11.738704 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-61cce428-b77d-46d5-b203-d5858602651b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 0.628262 Nov 02 13:47:11.761237 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 663/1438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:11 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:11.798872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:11.800335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:11.806335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:11.849313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.852425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.857637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.859472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.866483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.867805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.064792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:12.074180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:12.109120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:12.118969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:12.142431 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-611911a6-11a2-4673-82ac-f2262a394435 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.378325 Nov 02 13:47:12.146463 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 664/1439] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:11 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:12.156614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9a42d027-8bf4-4873-be03-42eb61bc9e1c req-c2f53f20-fea3-45e2-a777-e367ace171a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-plugged", "status": "completed", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:12.177149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9a42d027-8bf4-4873-be03-42eb61bc9e1c req-c2f53f20-fea3-45e2-a777-e367ace171a5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.178350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9a42d027-8bf4-4873-be03-42eb61bc9e1c req-c2f53f20-fea3-45e2-a777-e367ace171a5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.179442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9a42d027-8bf4-4873-be03-42eb61bc9e1c req-c2f53f20-fea3-45e2-a777-e367ace171a5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.214821 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9a42d027-8bf4-4873-be03-42eb61bc9e1c req-c2f53f20-fea3-45e2-a777-e367ace171a5 service nova] Creating event network-vif-plugged:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:47:12.241909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9a42d027-8bf4-4873-be03-42eb61bc9e1c req-c2f53f20-fea3-45e2-a777-e367ace171a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078660 Nov 02 13:47:12.243170 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 665/1440] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:12.498035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1612543972", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:12.554672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:12.559884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:12.563464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:12.566445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:12.568752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:12.592214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.594980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.596149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.598827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.600293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.601433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.666920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Getting quotas for project d726861de17a4726b20716d8f60920b5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:12.693366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Getting quotas for user 2ce568516a23489fbd362ea2fa01983b and project d726861de17a4726b20716d8f60920b5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:12.706672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:12.749657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:12.761299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:12.851909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:12.912975 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a063cf9-b7ab-482a-b037-c69cf3a1954d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330703 Nov 02 13:47:12.917164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 776/1441] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:47:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:47:12.923238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:12.924495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:12.953654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.954384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.961381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.962456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.963116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.963701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.202165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:13.213602 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cb38ef4-492e-4ada-9f78-a028d38ef17e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.295104 Nov 02 13:47:13.214676 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 777/1442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:12 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:13.222250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:13.222978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:13.230654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.231310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.231941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.232972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.233529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.234054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.444188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:13.457928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2092db0-27bc-4cbf-b794-de93313cbe91 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1276 microversion: 2.1 time: 0.241813 Nov 02 13:47:13.458517 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 778/1443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:13 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:13.486555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:13.487358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:13.513402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.520881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.524544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.525337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.525815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.526264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.829817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:13.841012 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0e4ad6b-b61c-4817-898d-1fe92e143712 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.366575 Nov 02 13:47:13.841969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 779/1444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:13 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:13.865277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:13.867712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:13.885372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.885870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.886298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.897296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.897763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.898205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.227999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.245400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab5b023b-0b06-4e19-855f-7da152481262 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 0.397524 Nov 02 13:47:14.247493 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 780/1445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:13 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:14.257743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.258358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.277570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.278099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.278630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.284015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.284569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.285008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.395892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.411935 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c735092-9e29-4bde-9051-d29cc909b165 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1213 microversion: 2.1 time: 0.163300 Nov 02 13:47:14.412815 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 781/1446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:14.427501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.428343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.445118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.446061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.446775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.447742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.448588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.449346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.611825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.628216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.635859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.654587 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1de51a05-0669-49e5-8244-4230dc6b5fa8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.233218 Nov 02 13:47:14.667128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 782/1447] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:14.681627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.682590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.695257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.699124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.699966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.701857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.702548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.703735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.097368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:15.121626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1cf8d53c-548f-4e7c-812a-0885ef1733d9 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.464864 Nov 02 13:47:15.125468 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 783/1448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:15.138924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-18059a9e-9e38-4202-baa6-ec8cee45c37d req-b543608f-99b5-4424-ba74-02d22adf6c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e585f63-2566-44d6-8c3a-dab947606fbb", "name": "network-vif-plugged", "status": "completed", "tag": "785b08cd-05a1-4099-a070-8cab31891d68"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:15.163803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-18059a9e-9e38-4202-baa6-ec8cee45c37d req-b543608f-99b5-4424-ba74-02d22adf6c23 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.164686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-18059a9e-9e38-4202-baa6-ec8cee45c37d req-b543608f-99b5-4424-ba74-02d22adf6c23 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.165439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-18059a9e-9e38-4202-baa6-ec8cee45c37d req-b543608f-99b5-4424-ba74-02d22adf6c23 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.185704 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-18059a9e-9e38-4202-baa6-ec8cee45c37d req-b543608f-99b5-4424-ba74-02d22adf6c23 service nova] Creating event network-vif-plugged:785b08cd-05a1-4099-a070-8cab31891d68 for instance 7e585f63-2566-44d6-8c3a-dab947606fbb on n-h1-858238-3 Nov 02 13:47:15.194590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-18059a9e-9e38-4202-baa6-ec8cee45c37d req-b543608f-99b5-4424-ba74-02d22adf6c23 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067427 Nov 02 13:47:15.196453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 784/1449] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:15.205894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:15.206877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:15.215968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.216618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.217053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.217904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.218514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.218952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.320098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:15.329217 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58d7e3eb-48af-493d-a5df-55c9eea7d246 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1276 microversion: 2.1 time: 0.131393 Nov 02 13:47:15.332713 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 785/1450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:15 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:15.337589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:15.338193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:15.403007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.404174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.404856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.409565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.410598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.411712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.692529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:15.714739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a63f783f-4550-4ce2-906c-0794f3110d9b tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1324 microversion: 2.1 time: 0.380700 Nov 02 13:47:15.724965 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 786/1451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:15 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:15.739793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:15.743895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:15.763075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.774772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.775077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.777517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:15.783724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:15.784314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.103552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:16.104075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:16.104639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:16.105147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:16.105672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:16.125438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.126095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.126631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.127498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.130549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.131131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.174616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:16.183884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Getting quotas for user 832cd460bb5e4148a57d561f762ceb11 and project f98d747d0ec34f2e97593bb75a32d02c. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:16.204554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:16.208015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:16.280610 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b91bb497-af1d-46fa-94ef-17f34d766842 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.027571 Nov 02 13:47:16.288443 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 666/1452] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:47:16.294712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:16.295870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:16.305301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.306312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.307228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.308375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.309255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.310072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.428241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:16.446709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42267d1e-5ca5-47d8-94de-ea96be694d7c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 0.720409 Nov 02 13:47:16.460193 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 787/1453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:15 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:16.466944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:16.482052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:16.497700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.498207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.498646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.499447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.500646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.501129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.829477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:16.851445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:16.854587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:16.864090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39f0e647-4b21-4cca-98ca-91c023455e90 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.402704 Nov 02 13:47:16.869576 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 788/1454] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:16 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:16.891888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:16.895972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:16.913997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.914968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.915670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.916751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.918697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.921941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.307778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:17.326589 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0cfba8e6-aea5-45e2-bf41-3226bd213a9a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1275 microversion: 2.1 time: 1.036587 Nov 02 13:47:17.351648 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 667/1455] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:16 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1275 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:17.360711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:17.366272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:17.392231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:17.396683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.399698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.402712 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8264751-771f-4cee-adb1-0111d04b4a7e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.531535 Nov 02 13:47:17.403510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.404942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.407466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.408361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.409106 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 789/1456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:16 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:17.429120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:17.443450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:17.452410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.460147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.463767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.464995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.465820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.472186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.549732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:17.621993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:17.630527 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-047b56f2-6268-494f-9c21-0a0a054d5725 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1276 microversion: 2.1 time: 0.219853 Nov 02 13:47:17.634456 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 790/1457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:17 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:17.659254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:17.660061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:17.695292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.696241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.696919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.699899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.700739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.704470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.325349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:18.334586 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2dffbb40-681c-4ea0-9d92-aeff7f6a83af tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1217 microversion: 2.1 time: 0.980697 Nov 02 13:47:18.341353 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 668/1458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:17 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1217 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:18.346662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:18.354115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:18.378281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.378928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.379494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.380311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.380876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.381409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.891193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:18.947375 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1393a6c0-1c61-4193-9277-a87d7cb04608 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1521 microversion: 2.1 time: 1.310754 Nov 02 13:47:18.948050 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 791/1459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:17 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1521 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:18.989156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cec5a9dc-4dda-479f-a840-306d5b4603ca req-fbd93423-90ec-4b85-bf04-ecd3e2b93f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8148766-4f8e-47b9-b16b-e7591434c2b1", "name": "network-vif-plugged", "status": "completed", "tag": "9988a127-a587-4d7c-b8a4-76ed08b18e33"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:19.071109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cec5a9dc-4dda-479f-a840-306d5b4603ca req-fbd93423-90ec-4b85-bf04-ecd3e2b93f3c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.075122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cec5a9dc-4dda-479f-a840-306d5b4603ca req-fbd93423-90ec-4b85-bf04-ecd3e2b93f3c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.080789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cec5a9dc-4dda-479f-a840-306d5b4603ca req-fbd93423-90ec-4b85-bf04-ecd3e2b93f3c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.142344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cec5a9dc-4dda-479f-a840-306d5b4603ca req-fbd93423-90ec-4b85-bf04-ecd3e2b93f3c service nova] Creating event network-vif-plugged:9988a127-a587-4d7c-b8a4-76ed08b18e33 for instance e8148766-4f8e-47b9-b16b-e7591434c2b1 on n-h2-858238-3 Nov 02 13:47:19.172767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cec5a9dc-4dda-479f-a840-306d5b4603ca req-fbd93423-90ec-4b85-bf04-ecd3e2b93f3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199147 Nov 02 13:47:19.179143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 792/1460] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:19.215497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:19.219117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:19.277901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.283415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.285254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.288769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.291735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.292908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.717626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:19.745713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:19.763127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:19.773719 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3703ca37-e2ff-435d-8192-085b68bce424 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.589244 Nov 02 13:47:19.789748 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 793/1461] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:19 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:19.808386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:19.813603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:19.848118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.851831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.856286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.857478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.861790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.865285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.865854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:19.876599 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40f7fc29-31fb-4605-8087-c292f9bc90fc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 1.533862 Nov 02 13:47:19.891618 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 669/1462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:18 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:19.893348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:19.898933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:19.919293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.920311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.920937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.929094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:19.930098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:19.930703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.431825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:20.444865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64102392-ba84-4832-97a7-4e39c7eef30d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1275 microversion: 2.1 time: 0.653215 Nov 02 13:47:20.448431 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 794/1463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:19 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1275 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:20.459501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:20.461597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:20.479214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.480373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.481469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.483353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.483876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.484378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.685609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:20.711434 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-62d7bbd8-3d9b-486c-9eac-441248b3d4ba tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.822773 Nov 02 13:47:20.717182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 670/1464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:19 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:20.723074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:20.728549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:20.749735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.751200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.751889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.753172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.753907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.755011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.842497 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] HTTP exception thrown: Action 999 not found Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Request method failure captured: Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb/os-instance-actions/999 HTTP/1.1 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTK4FkjST-gcNc41u38CJb6pEOcZcg6dfjEV8kbBEjSl2KtHaovBdTL4gtOpT-28c8ERXXMeZxGFRZr41FHernhLc-PuHcVbB3fmErglSWNYFBPFERgvCizu6DPzwLgvpYyYQvP12f2CDM3YM9TKC4kupid-s9OP94sv3GTYUr1YQ0 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1a5ecf2ec6e945e491550f5bf076ee90 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:47:20.862974 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a5ecf2ec6e945e491550f5bf076ee90"}]}] Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1a5ecf2ec6e945e491550f5bf076ee90 Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-InstanceActionsNegativeTestJSON-1689222970-project Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 81b1ac92520f4f34bff3faf6d496b07a Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1689222970-project Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: exception: Action 999 not found Nov 02 13:47:20.864528 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': '7e585f63-2566-44d6-8c3a-dab947606fbb', 'id': '999'} Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 02 13:47:20.865334 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:20.872352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Returning 404 to user: Action 999 not found {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:20.873706 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2352358b-cb01-451a-ae8b-7dc7910ceedd tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.154877 Nov 02 13:47:20.876819 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 671/1465] 10.222.0.18 () {58 vars in 1308 bytes} [Wed Nov 2 13:47:20 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb/os-instance-actions/999 => generated 66 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:47:20.893460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:20.894475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:20.904951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.912380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.913338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.914432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.915254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.915908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.084390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:21.095592 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c079a05f-0634-4ff1-b59d-4baac9b66f16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1271 microversion: 2.1 time: 0.217065 Nov 02 13:47:21.097036 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 672/1466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:20 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:21.104565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:21.105371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:21.119228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:21.121905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:21.124121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.126190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:21.129508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:21.130341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.300334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:21.321589 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-101f8cad-bd0c-4023-967e-3f4265b416b2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1318 microversion: 2.1 time: 0.871945 Nov 02 13:47:21.322196 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 795/1467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:20 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:21.360443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-00ae3eb4-42dc-4c27-b94e-46db897ace7c tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '.version_select at 0x7f6f81f9d670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:21.364473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-00ae3eb4-42dc-4c27-b94e-46db897ace7c tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:21.378087 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-00ae3eb4-42dc-4c27-b94e-46db897ace7c tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] HTTP exception thrown: Instance 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c could not be found. Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-00ae3eb4-42dc-4c27-b94e-46db897ace7c tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Request method failure captured: Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/6adb974a-1ee2-4b46-b1c3-231c27ae8d4c/os-instance-actions HTTP/1.1 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTK4FkjST-gcNc41u38CJb6pEOcZcg6dfjEV8kbBEjSl2KtHaovBdTL4gtOpT-28c8ERXXMeZxGFRZr41FHernhLc-PuHcVbB3fmErglSWNYFBPFERgvCizu6DPzwLgvpYyYQvP12f2CDM3YM9TKC4kupid-s9OP94sv3GTYUr1YQ0 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1a5ecf2ec6e945e491550f5bf076ee90 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:47:21.381958 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a5ecf2ec6e945e491550f5bf076ee90"}]}] Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1a5ecf2ec6e945e491550f5bf076ee90 Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceActionsNegativeTestJSON-1689222970-project Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 81b1ac92520f4f34bff3faf6d496b07a Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1689222970-project Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c could not be found. Nov 02 13:47:21.384686 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': '6adb974a-1ee2-4b46-b1c3-231c27ae8d4c'} Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c could not be found. Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:47:21.386355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c could not be found. Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c could not be found. Nov 02 13:47:21.388753 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:21.391544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-00ae3eb4-42dc-4c27-b94e-46db897ace7c tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Returning 404 to user: Instance 6adb974a-1ee2-4b46-b1c3-231c27ae8d4c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:21.391544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-00ae3eb4-42dc-4c27-b94e-46db897ace7c tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/6adb974a-1ee2-4b46-b1c3-231c27ae8d4c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.041688 Nov 02 13:47:21.391544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 796/1468] 10.222.0.18 () {58 vars in 1296 bytes} [Wed Nov 2 13:47:21 2022] GET /compute/v2.1/servers/6adb974a-1ee2-4b46-b1c3-231c27ae8d4c/os-instance-actions => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:21.394277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:21.395325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:21.448520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:21.449459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:21.449459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.450176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:21.450638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:21.451072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.709808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:21.725613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:21.729819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:21.745075 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5195ca95-617a-456c-b64f-e37e67ee2bc2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.646184 Nov 02 13:47:21.755147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 673/1469] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:21 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:21.776320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:21.777271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:21.785518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:21.786442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:21.787163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.793055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:21.793931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:21.794610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:21.880169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:47:22.091510 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c91c6d31-a1c3-4301-ad66-a9a07994faf5 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 204 len: 0 microversion: 2.1 time: 0.332700 Nov 02 13:47:22.097573 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 674/1470] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:47:21 2022] DELETE /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:47:22.104327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:22.105486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:22.114021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.114970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.115770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.116796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.119584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.121189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.295149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:22.320999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85f2508c-5949-4764-847e-62a18f77abf5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1324 microversion: 2.1 time: 0.933277 Nov 02 13:47:22.332504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 797/1471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:21 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1324 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:22.358241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:22.359027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:22.373197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.374145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.374750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.376027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.376474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.376895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.476656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:22.493352 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-185e976c-13ae-4cfd-90c2-d1878cd6c438 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.393328 Nov 02 13:47:22.494310 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 675/1472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:22.503900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-999266189", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e66fe5e6-396f-407f-9138-ece1c71d4efa"}], "block_device_mapping_v2": [{"uuid": "1a50d122-9159-459e-b9c1-65495d5660e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:22.617995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:22.625554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:22.636406 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-152ed2ef-37b1-443f-88bd-87cae497103b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.300914 Nov 02 13:47:22.652877 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 798/1473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:22.661147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] validate_networks() for [('e66fe5e6-396f-407f-9138-ece1c71d4efa', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:22.664322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:22.665155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:22.673184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.673940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.674584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.675528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.676148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.676738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.739821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:22.915942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:22.931181 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14e5b2d5-6740-4f16-8006-31a89533cfef tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1527 microversion: 2.1 time: 0.276839 Nov 02 13:47:22.933165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 799/1474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:22.940323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:22.942056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:22.949826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.950658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.952475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.954149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.954896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.955740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.048393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:23.060213 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96b71783-10d3-49b1-b6f9-f9a339721f69 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1271 microversion: 2.1 time: 0.124218 Nov 02 13:47:23.061380 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 800/1475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:23.066454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:23.067362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:23.076921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.078996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.079928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.081284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.082494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.083241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.465596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:23.479895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be09e2b8-a2d4-42da-a827-0da6b4022b2c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1318 microversion: 2.1 time: 0.417087 Nov 02 13:47:23.495628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 801/1476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:23 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:23.508189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:23.509142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:23.518979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.519877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.520621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.521577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.522889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.523564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.685772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:23.710210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:23.716115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:23.738797 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38666516-bb4f-47fc-b298-2c5f2855ef83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.241160 Nov 02 13:47:23.755361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 802/1477] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:23 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:23.768153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:23.769051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:23.776292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.778041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.778660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.779615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.780227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.780838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.306541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:24.307324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:24.309419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:24.310166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:24.311347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:24.370301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.370950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.371437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.372175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.377384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.378133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.425240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:24.439213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Getting quotas for user 55e26f05091944cb910f81488056c057 and project 21ac2eda404042c0871fc312f0b9f705. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:24.585559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:24.589030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a50d122-9159-459e-b9c1-65495d5660e2',volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:24.693609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:24.708839 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-024a17a3-877f-44b6-b2f4-76555513f689 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.951666 Nov 02 13:47:24.709358 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 803/1478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:23 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:24.715797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:24.716416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:24.731897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.734541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.735015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.735887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.736356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.738248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.914479 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e3f4227-e249-47c0-8c3a-5ec7ba980247 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.419037 Nov 02 13:47:24.915507 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 676/1479] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:47:24.923550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:24.929463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:24.980060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.981480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.982769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.985990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.986506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.988693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.195656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.211397 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-985da3fe-2bfd-461e-b71a-66f4863b3198 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.294777 Nov 02 13:47:25.212106 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 677/1480] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:24 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.236025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:25.236655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.255449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.256397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.257056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.258094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.258709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.259386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.497334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.508459 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2bd6e07e-1441-417e-84cd-544520381fb9 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1527 microversion: 2.1 time: 0.283832 Nov 02 13:47:25.510243 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 678/1481] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:25 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1527 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.517378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:25.518380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.537952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.538649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.539403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.541016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.541663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.542245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.708161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.716960 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a9d3e63-c2a5-4f96-910d-7d310900c06c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.205296 Nov 02 13:47:25.732539 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 679/1482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:25 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.732539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-bf818fbf-ca77-4b9f-a55a-5b1ee5b3eca1 req-e8d7df06-9b67-4e9b-afd1-e67fa0b473ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2e512c-f818-41aa-8522-652eb4c54405", "tag": "c366bf54-38b8-4690-a336-bf28511ac499"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:25.740779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bf818fbf-ca77-4b9f-a55a-5b1ee5b3eca1 req-e8d7df06-9b67-4e9b-afd1-e67fa0b473ae service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.741398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bf818fbf-ca77-4b9f-a55a-5b1ee5b3eca1 req-e8d7df06-9b67-4e9b-afd1-e67fa0b473ae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.741955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bf818fbf-ca77-4b9f-a55a-5b1ee5b3eca1 req-e8d7df06-9b67-4e9b-afd1-e67fa0b473ae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.754783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.763626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff367847-28d9-46a4-8852-95cad5ef1459 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 1.053009 Nov 02 13:47:25.767898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 804/1483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:24 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.776110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:25.790195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-bf818fbf-ca77-4b9f-a55a-5b1ee5b3eca1 req-e8d7df06-9b67-4e9b-afd1-e67fa0b473ae service nova] Creating event network-changed:c366bf54-38b8-4690-a336-bf28511ac499 for instance 4c2e512c-f818-41aa-8522-652eb4c54405 on n-h1-858238-3 Nov 02 13:47:25.794570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.806007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.806736 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-bf818fbf-ca77-4b9f-a55a-5b1ee5b3eca1 req-e8d7df06-9b67-4e9b-afd1-e67fa0b473ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086343 Nov 02 13:47:25.807281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.808376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.809570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.810230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.810872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.814150 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 680/1484] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:25.831311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:25.837620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.856852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.858231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.858827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.861320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.862600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.863404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.101189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.117159 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0e7f05f4-9a69-45d7-8e1c-57746a15c068 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.293367 Nov 02 13:47:26.119228 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 681/1485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:25 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:26.124739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.126125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.133147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.134067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.134805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.135935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.136548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.137148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.169544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:26.254378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.275437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.282616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.292223 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ba1adf12-36e4-45ef-b843-ab4f3471beff tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.171608 Nov 02 13:47:26.293436 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 682/1486] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:26.300384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.301291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.309972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.310839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.311533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.313672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.314748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.315565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.404100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.456506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca8e3257-5d4e-4625-b581-6327b8e825f5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1318 microversion: 2.1 time: 0.687007 Nov 02 13:47:26.472421 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 805/1487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:25 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:26.479790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.480514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b219fd9-3a72-418d-a2f6-7ae48c184c91 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-280476815", "metadata": {"": ""}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b219fd9-3a72-418d-a2f6-7ae48c184c91 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action HTTP/1.1 Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 106 Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:47:26.487189 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-280476815", "metadata": {"": ""}}} Nov 02 13:47:26.488670 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-280476815', 'metadata': {'': ''}}}} Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'': ''} Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:26.489490 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.490823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:26.492162 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:26.492162 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:26.492162 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:26.492162 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:26.492162 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:26.492162 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.492564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.496440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.496440 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a9a94676-8316-4071-b273-9b9d0a6bced7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1176 microversion: 2.25 time: 0.200175 Nov 02 13:47:26.497912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b219fd9-3a72-418d-a2f6-7ae48c184c91 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:26.499692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b219fd9-3a72-418d-a2f6-7ae48c184c91 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action" status: 400 len: 170 microversion: 2.1 time: 0.025817 Nov 02 13:47:26.501455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 806/1488] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Nov 2 13:47:26 2022] POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:26.506814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.507838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.519938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.521040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.521835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.522861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.523609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.524375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.539504 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 683/1489] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1176 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:26.553350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.555202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.577120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.578279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.580182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.582011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.583232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.583917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.211709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:27.220559 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1a51f06-74ea-4e73-80c7-fbb87ac421a1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.676421 Nov 02 13:47:27.245306 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 684/1490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:27.252479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:27.253398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:27.264758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.266226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.266855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.267400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.272542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.273100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.342330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.343223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.344543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.345869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lazy-loading 'fault' on Instance uuid 7e585f63-2566-44d6-8c3a-dab947606fbb {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:47:27.395912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:27.408330 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85a953b1-4170-450b-9d58-8347ea6afc6a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1713 microversion: 2.1 time: 0.905520 Nov 02 13:47:27.411302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 807/1491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1713 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:27.418692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:27.430217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:27.446874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.457085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.457927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.458931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.459698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.460510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.582000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b1ac92520f4f34bff3faf6d496b07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5ecf2ec6e945e491550f5bf076ee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:27.594599 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6044e1f2-777f-4ded-841d-ef3131834276 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 200 len: 1314 microversion: 2.1 time: 0.346204 Nov 02 13:47:27.594599 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 685/1492] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:27 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:27.635201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:27.642268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:27.669121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.681152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.684324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.686176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.688581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.689456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.210487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.223786 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-232ba040-0eeb-4fa0-bc4d-04434e7a5c50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.628553 Nov 02 13:47:28.230970 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 686/1493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:27 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:28.257595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-da00d5ff-4423-442a-8a7e-43a6cc034317 req-97a98851-933f-4531-a21b-f88af3f4fd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e585f63-2566-44d6-8c3a-dab947606fbb", "name": "network-vif-deleted", "tag": "785b08cd-05a1-4099-a070-8cab31891d68"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:28.287695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-da00d5ff-4423-442a-8a7e-43a6cc034317 req-97a98851-933f-4531-a21b-f88af3f4fd95 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.288188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-da00d5ff-4423-442a-8a7e-43a6cc034317 req-97a98851-933f-4531-a21b-f88af3f4fd95 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.288626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-da00d5ff-4423-442a-8a7e-43a6cc034317 req-97a98851-933f-4531-a21b-f88af3f4fd95 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.334871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.340403 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-da00d5ff-4423-442a-8a7e-43a6cc034317 req-97a98851-933f-4531-a21b-f88af3f4fd95 service nova] Creating event network-vif-deleted:785b08cd-05a1-4099-a070-8cab31891d68 for instance 7e585f63-2566-44d6-8c3a-dab947606fbb on n-h1-858238-3 Nov 02 13:47:28.342999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be625d57-eb94-4134-9ece-2b1a024cbe5b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.928452 Nov 02 13:47:28.343660 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 808/1494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:27 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:28.355189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:28.359906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:28.376845 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-da00d5ff-4423-442a-8a7e-43a6cc034317 req-97a98851-933f-4531-a21b-f88af3f4fd95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142520 Nov 02 13:47:28.377865 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 687/1495] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:28.379402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.379983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.380433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.381193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.381652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.382080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.390793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:28.392277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:28.416367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.417064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.419434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.420803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.422082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.422769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.564844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.586551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.591480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.611887 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-03e5d2cf-e12b-4aee-b43b-5b13187ee3b5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.230278 Nov 02 13:47:28.613530 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 688/1496] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:28 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:28.668667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:28.669677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:28.685428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.692322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.693221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.694610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.695649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.696740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.042670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.046456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:29.053635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e02097c5-cfe1-418d-963b-ed6c3cfa4f84 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.708880 Nov 02 13:47:29.069236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.070018 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 809/1497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:28 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.079340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.080223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.085932 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d634ed35-e022-4739-8ebf-daa7abacecec tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1318 microversion: 2.1 time: 0.434609 Nov 02 13:47:29.099676 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 689/1498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:28 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.101544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.102223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.102829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.103981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.104594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.105193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.120609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-599a9de1-2a42-42d3-9201-8426896512b5 req-494110ed-00af-4297-b8e4-4b36a7d640e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:29.135925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-599a9de1-2a42-42d3-9201-8426896512b5 req-494110ed-00af-4297-b8e4-4b36a7d640e9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.136284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-599a9de1-2a42-42d3-9201-8426896512b5 req-494110ed-00af-4297-b8e4-4b36a7d640e9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.136632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-599a9de1-2a42-42d3-9201-8426896512b5 req-494110ed-00af-4297-b8e4-4b36a7d640e9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.154483 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-599a9de1-2a42-42d3-9201-8426896512b5 req-494110ed-00af-4297-b8e4-4b36a7d640e9 service nova] Creating event network-changed:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:47:29.161084 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-599a9de1-2a42-42d3-9201-8426896512b5 req-494110ed-00af-4297-b8e4-4b36a7d640e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058893 Nov 02 13:47:29.162013 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 690/1499] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:29.167599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.168314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.177249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:29.181087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.182676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.182676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.183289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.183756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.184188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.310203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.320288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.322123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.324056 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-895ec059-d8a7-40a8-8e37-aba141f678ed tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1250 microversion: 2.25 time: 0.252315 Nov 02 13:47:29.325123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 810/1500] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1250 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:29.342552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.345214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] [instance: 7e585f63-2566-44d6-8c3a-dab947606fbb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.354319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.355511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.356355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.357228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.358047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.358943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.390342 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] HTTP exception thrown: Instance 7e585f63-2566-44d6-8c3a-dab947606fbb could not be found. Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Request method failure captured: Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb HTTP/1.1 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTK4FkjST-gcNc41u38CJb6pEOcZcg6dfjEV8kbBEjSl2KtHaovBdTL4gtOpT-28c8ERXXMeZxGFRZr41FHernhLc-PuHcVbB3fmErglSWNYFBPFERgvCizu6DPzwLgvpYyYQvP12f2CDM3YM9TKC4kupid-s9OP94sv3GTYUr1YQ0 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1a5ecf2ec6e945e491550f5bf076ee90 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:47:29.391897 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1a5ecf2ec6e945e491550f5bf076ee90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1a5ecf2ec6e945e491550f5bf076ee90"}]}] Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1a5ecf2ec6e945e491550f5bf076ee90 Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1689222970 Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceActionsNegativeTestJSON-1689222970-project Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 81b1ac92520f4f34bff3faf6d496b07a Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1689222970-project Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7e585f63-2566-44d6-8c3a-dab947606fbb could not be found. Nov 02 13:47:29.394880 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7e585f63-2566-44d6-8c3a-dab947606fbb'} Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e585f63-2566-44d6-8c3a-dab947606fbb could not be found. Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:29.396701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e585f63-2566-44d6-8c3a-dab947606fbb could not be found. Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e585f63-2566-44d6-8c3a-dab947606fbb could not be found. Nov 02 13:47:29.400524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.406938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] Returning 404 to user: Instance 7e585f63-2566-44d6-8c3a-dab947606fbb could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:29.406938 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7aad5303-8f20-40e6-8c7d-5637803b7917 tempest-InstanceActionsNegativeTestJSON-1689222970 tempest-InstanceActionsNegativeTestJSON-1689222970-project] 10.222.0.18 "GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb" status: 404 len: 111 microversion: 2.1 time: 0.066387 Nov 02 13:47:29.420702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 811/1501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/7e585f63-2566-44d6-8c3a-dab947606fbb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:29.432989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51defd71-33e2-4f21-bcb8-c7439b84726c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1142071617", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51defd71-33e2-4f21-bcb8-c7439b84726c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action HTTP/1.1 Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 619 Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:47:29.438023 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:29.439853 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:47:29.440505 n-d-858238-3 devstack@n-api.service[137559]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1142071617", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 02 13:47:29.440505 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:29.440505 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1142071617', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 13:47:29.440733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:29.441441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.442556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:29.443346 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:29.443346 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:29.443346 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:29.443346 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:29.443346 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:47:29.443346 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:29.456023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51defd71-33e2-4f21-bcb8-c7439b84726c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:29.457228 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-51defd71-33e2-4f21-bcb8-c7439b84726c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action" status: 400 len: 938 microversion: 2.1 time: 0.035523 Nov 02 13:47:29.458006 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 812/1502] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Nov 2 13:47:29 2022] POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action => generated 938 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:29.463292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.464143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.472982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.474205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.474803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.475729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.476598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.477424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.548922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.564703 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-384e6e87-4076-4f97-972c-3288ede9d90c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1703 microversion: 2.1 time: 0.401011 Nov 02 13:47:29.604393 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 691/1503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1703 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.611976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.612804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.621884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.622455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.623304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.625225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.627867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.628603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.797785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.813856 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88c61658-c461-4b89-88fa-f88838fa14b9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.354183 Nov 02 13:47:29.814770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 813/1504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.836978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.838548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.868644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.872129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.873135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.879451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.880218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.881118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.958518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.006460 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3da157d5-cf26-4b33-b986-2392444f7a26 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.397176 Nov 02 13:47:30.023152 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 692/1505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:30.025397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e197712-9e89-4904-9699-485c5e1f1f67 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '.version_select at 0x7f6f82186ee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.037979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e197712-9e89-4904-9699-485c5e1f1f67 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.039403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e197712-9e89-4904-9699-485c5e1f1f67 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.040224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e197712-9e89-4904-9699-485c5e1f1f67 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.058824 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e197712-9e89-4904-9699-485c5e1f1f67 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3496 microversion: 2.1 time: 0.046371 Nov 02 13:47:30.060053 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 693/1506] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/os-migrations => generated 3496 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:30.067034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.067903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.079269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.080459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.081290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.082200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.082825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.083464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.204922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.234886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.237637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.256366 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3761e8ec-734a-4329-b9da-0daa7a334fb2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1537 microversion: 2.91 time: 0.194836 Nov 02 13:47:30.257599 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 694/1507] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:30.278244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.303582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcbd6831-0e95-4ff3-937e-0204e68041ec tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.467907 Nov 02 13:47:30.304284 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 814/1508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:30.310816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.311531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.317525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.318153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.343481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.344261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.355258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.355888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.356611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.357419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.357875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.358340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.367747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.369101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.369774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.370763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.694700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.713212 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7c67241-7577-4a7e-afed-a53b717adff3 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1318 microversion: 2.1 time: 0.407717 Nov 02 13:47:30.714974 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 815/1509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:30.721367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.722317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.729336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.730327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.731002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.731992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.732691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.733339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.908112 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1bf700d4-76bb-4dfb-95a9-983ee81a9008 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1854 microversion: 2.1 time: 0.616875 Nov 02 13:47:30.924199 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 695/1510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1854 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:30.935709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.936438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.943616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.944645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.945100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.945882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.946385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.946935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.656128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:31.672825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:31.676853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:31.689796 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d05a4ea2-4b74-4d03-bba5-1504c3838b2a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1292 microversion: 2.25 time: 0.751951 Nov 02 13:47:31.691228 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 696/1511] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1292 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:31.697803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c53a8a23-b1d8-4070-aa23-8e949ea276f7 req-4a0d431d-fdff-412c-90c5-ec99cb23ef13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e512c-f818-41aa-8522-652eb4c54405", "name": "network-vif-plugged", "status": "completed", "tag": "c366bf54-38b8-4690-a336-bf28511ac499"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:31.736772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c53a8a23-b1d8-4070-aa23-8e949ea276f7 req-4a0d431d-fdff-412c-90c5-ec99cb23ef13 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.737871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c53a8a23-b1d8-4070-aa23-8e949ea276f7 req-4a0d431d-fdff-412c-90c5-ec99cb23ef13 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.738736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c53a8a23-b1d8-4070-aa23-8e949ea276f7 req-4a0d431d-fdff-412c-90c5-ec99cb23ef13 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.769930 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c53a8a23-b1d8-4070-aa23-8e949ea276f7 req-4a0d431d-fdff-412c-90c5-ec99cb23ef13 service nova] Creating event network-vif-plugged:c366bf54-38b8-4690-a336-bf28511ac499 for instance 4c2e512c-f818-41aa-8522-652eb4c54405 on n-h1-858238-3 Nov 02 13:47:31.782341 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c53a8a23-b1d8-4070-aa23-8e949ea276f7 req-4a0d431d-fdff-412c-90c5-ec99cb23ef13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088426 Nov 02 13:47:31.803265 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 697/1512] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:31.812885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6225cba5-1f32-40c4-b619-eec45c381a16", "tag": "b96607a2-d826-4bdb-a6b2-8b1e483d9f83"}, {"name": "network-changed", "server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:31.832961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.833810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.834604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.880838 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] Creating event network-changed:b96607a2-d826-4bdb-a6b2-8b1e483d9f83 for instance 6225cba5-1f32-40c4-b619-eec45c381a16 on n-h1-858238-3 Nov 02 13:47:31.882501 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] Creating event network-changed:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h2-858238-3 Nov 02 13:47:31.895144 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7bd8178a-22b4-4aa5-bb48-9e2d564d6378 req-bf3d848a-c62c-46e5-a1bc-dfd16f1acb87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089504 Nov 02 13:47:31.896447 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 698/1513] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:31.902564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:31.903488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:31.911654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.912345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.912886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.913849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.914409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.914940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.020182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.032154 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8373d81b-e4e5-4b4e-b46f-d3e7704d98ae tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 1.314151 Nov 02 13:47:32.035445 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 816/1514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:32.042886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.043533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.062289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.062821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.063307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.067217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.068151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.068911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.507833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.518846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29915c17-7f41-4544-bd59-be5d0ba3aa50 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.620589 Nov 02 13:47:32.527845 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 699/1515] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:31 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:32.539732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.540367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.549003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.549507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.550014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.550854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.551388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.551826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.779696 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2427756-ee83-4f82-8b08-15198396a5c7 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1854 microversion: 2.1 time: 0.740834 Nov 02 13:47:32.784619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 817/1516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:32 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1854 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:32.792369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.799299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.817022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.818232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.831408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.834607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.837842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.840582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.975735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.987146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.998019 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60b78b3d-e3a5-4517-9553-720ef8508e16 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.468600 Nov 02 13:47:33.001185 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 700/1517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:32 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:33.015081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.017045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.022904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.027416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.050200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e292c662-f8a2-4cd5-82fb-0064183b7a5a tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1480 microversion: 2.91 time: 0.263643 Nov 02 13:47:33.055609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 818/1518] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:32 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1480 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:33.060432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.062118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.079149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.091462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8879eded-966d-4a61-bea6-5119868d666d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:33.093416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.095312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.095747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8879eded-966d-4a61-bea6-5119868d666d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action HTTP/1.1 Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 285 Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:47:33.126479 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:47:33.129232 n-d-858238-3 devstack@n-api.service[137559]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:33.133553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:33.135892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:33.142947 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:33.144831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:33.144831 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.144831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8879eded-966d-4a61-bea6-5119868d666d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:33.148816 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8879eded-966d-4a61-bea6-5119868d666d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action" status: 400 len: 619 microversion: 2.1 time: 0.090250 Nov 02 13:47:33.154474 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 819/1519] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Nov 2 13:47:33 2022] POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action => generated 619 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:33.158679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.159331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.167676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.168174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.169862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.170284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.170820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.171299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.449575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.459880 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38f062f4-b49d-4381-a5ff-1ab2f7e9aed5 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1318 microversion: 2.1 time: 0.457247 Nov 02 13:47:33.478489 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 701/1520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:33.484291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.487363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.495807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.497516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.498161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.499594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.501019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.502282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.547368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.558502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.560878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.562326 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fbe75c43-31a2-4578-86bd-c97082c3ead9 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1292 microversion: 2.25 time: 0.408328 Nov 02 13:47:33.564406 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 820/1521] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1292 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:33.570067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858238-3"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:33.572945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.582105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.583034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.583783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.584667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.585631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.586275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.613622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:33.717588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858238-3". {{(pid=137559) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:47:33.770633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:33.892008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c91e6226-563c-4f17-b152-87c6bfbe7ce3 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action" status: 202 len: 0 microversion: 2.91 time: 0.324911 Nov 02 13:47:33.895260 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 821/1522] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:47:33 2022] POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:47:33.913548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.920426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.962026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.967381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.983056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.985150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.989961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.991436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.002024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lazy-loading 'services' on Instance uuid 380fd169-b6bb-4da9-bac7-37950d8f2428 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:47:34.288943 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-069f9d83-d644-4473-85ae-95e3bd6bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "DELETE /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments/7950a15a-9624-4516-a898-b9218a64de12" status: 202 len: 0 microversion: 2.1 time: 0.808634 Nov 02 13:47:34.307402 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 702/1523] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 13:47:33 2022] DELETE /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments/7950a15a-9624-4516-a898-b9218a64de12 => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:47:34.314624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:34.322530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:34.357460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.359843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.360823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.362237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.363295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.364043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.447493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:34.462679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=12 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:34.889014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:34.910733 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-587375b8-34f8-4f46-8d06-cc01aaac55dd tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.600415 Nov 02 13:47:34.924856 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 703/1524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:34 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:34.958800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:34.964903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:34.973925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.975691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.976605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.977926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.978645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.979378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.146293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.163557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.166438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.178079 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-23f5b102-758b-470c-a066-77ddaa60b3c5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1488 microversion: 2.91 time: 0.237685 Nov 02 13:47:35.201345 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 704/1525] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:34 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1488 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:35.216743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-aa8086ba-3041-455c-9bf4-fb72ac07ff13 req-7e70ea44-4926-4d51-a037-59265f38307a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "name": "network-vif-plugged", "status": "completed", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:35.260275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-aa8086ba-3041-455c-9bf4-fb72ac07ff13 req-7e70ea44-4926-4d51-a037-59265f38307a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.263154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-aa8086ba-3041-455c-9bf4-fb72ac07ff13 req-7e70ea44-4926-4d51-a037-59265f38307a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.263623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-aa8086ba-3041-455c-9bf4-fb72ac07ff13 req-7e70ea44-4926-4d51-a037-59265f38307a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.292882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.306678 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-aa8086ba-3041-455c-9bf4-fb72ac07ff13 req-7e70ea44-4926-4d51-a037-59265f38307a service nova] Creating event network-vif-plugged:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:47:35.317256 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-aa8086ba-3041-455c-9bf4-fb72ac07ff13 req-7e70ea44-4926-4d51-a037-59265f38307a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114228 Nov 02 13:47:35.321257 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 705/1526] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:35.323994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e051841d-4548-47a8-a280-ee7b64f5353a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 1.418923 Nov 02 13:47:35.328911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 822/1527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:35.347248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-695a9a0f-ba92-4271-a231-6d4b04b46f68 req-c42ad495-3866-468c-850f-d3f6b683b403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28579980-d489-4bff-a1cb-dcadca8bd5ee", "tag": "a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:35.363895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:35.369130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.384895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-695a9a0f-ba92-4271-a231-6d4b04b46f68 req-c42ad495-3866-468c-850f-d3f6b683b403 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.385399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-695a9a0f-ba92-4271-a231-6d4b04b46f68 req-c42ad495-3866-468c-850f-d3f6b683b403 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.387624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-695a9a0f-ba92-4271-a231-6d4b04b46f68 req-c42ad495-3866-468c-850f-d3f6b683b403 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.407689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.412957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.417059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.418239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.421007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.421701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.438261 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-695a9a0f-ba92-4271-a231-6d4b04b46f68 req-c42ad495-3866-468c-850f-d3f6b683b403 service nova] Creating event network-changed:a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec for instance 28579980-d489-4bff-a1cb-dcadca8bd5ee on n-h1-858238-3 Nov 02 13:47:35.453977 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-695a9a0f-ba92-4271-a231-6d4b04b46f68 req-c42ad495-3866-468c-850f-d3f6b683b403 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129220 Nov 02 13:47:35.460380 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 706/1528] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:35.484935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:35.491536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.522749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.523947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.524560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.531673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.533217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.535009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.651158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c167858-1f1f-49d2-b1ff-c767ebf29a10 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189145 Nov 02 13:47:35.659815 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 707/1529] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:35 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:35.665305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:35.666144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.676862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.677598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.678185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.679086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.679715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.680294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.101679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.114561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46877355-32e4-4de8-acbc-5fda684f56c4 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.777526 Nov 02 13:47:36.115815 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 823/1530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:35 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:36.130729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:36.131687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:36.142463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.147787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.148294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.148731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.149501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.149946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.150358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.158567 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e00f568b-6cf9-48c6-ae9b-d5bed516fb21 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1466 microversion: 2.1 time: 0.497207 Nov 02 13:47:36.163663 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 708/1531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:35 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1466 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:36.179215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:36.180181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:36.203395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.205028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.212955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.214484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.219569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.224813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.853818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.875939 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-16f53285-22fd-49cb-94ca-a30a5119bd1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.715133 Nov 02 13:47:36.891082 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 709/1532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:36 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:36.902452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:36.903389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.904392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:36.929643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.930633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.935817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.944018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.944526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.945180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.945777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.948212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.956681 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a46fd502-4ba4-43b4-b2ae-4aaaf5fedba0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1292 microversion: 2.25 time: 0.839120 Nov 02 13:47:36.960532 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 824/1533] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:36 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1292 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:37.111637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1547270858", "block_migration": true, "disk_over_commit": false}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:37.115010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:37.132664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.133230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.133817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.134561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.141457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.141909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.221624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lazy-loading 'flavor' on Instance uuid 4c2e512c-f818-41aa-8522-652eb4c54405 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:47:37.263948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Going to try to live migrate instance to tempest-host-1547270858 {{(pid=137559) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:47:37.303489 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] HTTP exception thrown: Compute host tempest-host-1547270858 could not be found. Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Request method failure captured: Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405/action HTTP/1.1 Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 107 Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTbjMd-WNIRDXc5Nui9WV_ysgDShpb_GXxdz8pJUav1IxBwA7Pq_JOqFSS-C6I9aEvc-MtK0L7Eouwn15O8odXR-518ICYAMjvLoCgbX-4x41o7mByofFVcz4xiqlsUwJi00S09oTaHzvKIzYYFiOwZj-crz0R4_sQyIpMUBhrAT-I Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 660c8a2bba6b4aa482f21f7cbea1cadc Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveMigrationNegativeTest-201335214 Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:47:37.333397 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/660c8a2bba6b4aa482f21f7cbea1cadc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/660c8a2bba6b4aa482f21f7cbea1cadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/660c8a2bba6b4aa482f21f7cbea1cadc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_660c8a2bba6b4aa482f21f7cbea1cadc"}]}] Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveMigrationNegativeTest-201335214 Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 660c8a2bba6b4aa482f21f7cbea1cadc Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-201335214 Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveMigrationNegativeTest-201335214-project-admin Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: cc93c877e182468f94bf274cfec57ae4 Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveMigrationNegativeTest-201335214-project-admin Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: {"os-migrateLive": {"host": "tempest-host-1547270858", "block_migration": true, "disk_over_commit": false}} Nov 02 13:47:37.335787 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: exception: Compute host tempest-host-1547270858 could not be found. Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '4c2e512c-f818-41aa-8522-652eb4c54405', 'body': {'os-migrateLive': {'host': 'tempest-host-1547270858', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:47:37.337047 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1547270858 could not be found. Nov 02 13:47:37.339328 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1547270858 could not be found. Nov 02 13:47:37.341446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1547270858 could not be found. Nov 02 13:47:37.343372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.351969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Returning 400 to user: Compute host tempest-host-1547270858 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:37.351969 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a04da68-b70c-4f99-a666-6bba61fc6edd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405/action" status: 400 len: 100 microversion: 2.1 time: 0.386294 Nov 02 13:47:37.351969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 825/1534] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Nov 2 13:47:36 2022] POST /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405/action => generated 100 bytes in 389 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:37.363700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:37.364668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:37.376914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.378289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.379245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.381232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.382022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.382719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.627387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.681693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.693007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.730993 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cac2bb8f-02e0-4521-910f-d6dcaa36281f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.377044 Nov 02 13:47:37.747307 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 826/1535] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:37 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:37.896514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.917330 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d0a41988-aa4a-4bd2-af34-c20581d7e61a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 1.024078 Nov 02 13:47:37.919935 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 710/1536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:36 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:37.938329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-492704635"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:37.943182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:37.972144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.972930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.973735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.979687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.982057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.982057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.133295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.136308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.143716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.144626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.145230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.146114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.146725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.147329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.197729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:38.228867 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1532958-ca46-406b-9382-5dee35c97959 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.495212 Nov 02 13:47:38.234798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 827/1537] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:37 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:38.240502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.241443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.249905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.251770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.251770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.253043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.253201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.253703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.395584 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-376b397d-c6fa-4207-a8f6-79a8a0e8027f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action" status: 202 len: 0 microversion: 2.1 time: 0.472182 Nov 02 13:47:38.410361 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 711/1538] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:47:37 2022] POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:47:38.438727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.440614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.458224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.461062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.463410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.465221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.466669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.467825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.608880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:38.629681 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-802f7614-dbfd-4e70-a288-3edb6ac09a11 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.393446 Nov 02 13:47:38.630299 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 828/1539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:38.652883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.659531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.676852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.678297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.679379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.680989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.682246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.683360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.117797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.129851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.133260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.134647 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b0cc114d-34d1-44af-b24a-f6e9b563d1d0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 0.500597 Nov 02 13:47:39.139467 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 829/1540] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:39.145922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2095476688"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:39.154202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.182013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.196610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.198272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.199923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-db06155c-5ed5-4932-acec-34e3c763b877 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1466 microversion: 2.1 time: 0.785173 Nov 02 13:47:39.202151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.202659 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 712/1541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1466 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:39.204254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.205370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.206338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.210792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:39.212570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.222041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.223084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.223838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.224849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.225625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.226538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.471651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Cannot 'createImage' instance e8148766-4f8e-47b9-b16b-e7591434c2b1 while it is in task_state image_snapshot Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action HTTP/1.1 Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 85 Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:47:39.475710 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2095476688"}} Nov 02 13:47:39.477507 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'createImage' instance e8148766-4f8e-47b9-b16b-e7591434c2b1 while it is in task_state image_snapshot Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2095476688'}}} Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:39.478355 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e8148766-4f8e-47b9-b16b-e7591434c2b1 while it is in task_state image_snapshot Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e8148766-4f8e-47b9-b16b-e7591434c2b1 while it is in task_state image_snapshot Nov 02 13:47:39.479664 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.487630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 409 to user: Cannot 'createImage' instance e8148766-4f8e-47b9-b16b-e7591434c2b1 while it is in task_state image_snapshot {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:39.489847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-20eb04a1-6535-47bc-8584-5cf55a83a11b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action" status: 409 len: 159 microversion: 2.1 time: 0.348799 Nov 02 13:47:39.494423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 830/1542] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:47:39 2022] POST /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1/action => generated 159 bytes in 351 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:47:39.521721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0e2d212f-e2bc-4baa-808a-273e12b477f3 req-226046aa-ae50-4f6d-bcf8-02323028a5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6225cba5-1f32-40c4-b619-eec45c381a16", "name": "network-vif-plugged", "status": "completed", "tag": "b96607a2-d826-4bdb-a6b2-8b1e483d9f83"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:39.573914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e2d212f-e2bc-4baa-808a-273e12b477f3 req-226046aa-ae50-4f6d-bcf8-02323028a5f2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.575729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e2d212f-e2bc-4baa-808a-273e12b477f3 req-226046aa-ae50-4f6d-bcf8-02323028a5f2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.578080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e2d212f-e2bc-4baa-808a-273e12b477f3 req-226046aa-ae50-4f6d-bcf8-02323028a5f2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.612867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.614498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0e2d212f-e2bc-4baa-808a-273e12b477f3 req-226046aa-ae50-4f6d-bcf8-02323028a5f2 service nova] Creating event network-vif-plugged:b96607a2-d826-4bdb-a6b2-8b1e483d9f83 for instance 6225cba5-1f32-40c4-b619-eec45c381a16 on n-h1-858238-3 Nov 02 13:47:39.628334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0e2d212f-e2bc-4baa-808a-273e12b477f3 req-226046aa-ae50-4f6d-bcf8-02323028a5f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132668 Nov 02 13:47:39.630486 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 831/1543] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:39.651049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.668249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:39.673824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.676592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.695463 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a7622a5-e448-429f-99a5-d088d0f0cecc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.489866 Nov 02 13:47:39.710878 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 713/1544] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:39 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:39.720025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.738256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:39.743209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.750609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.754371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.763672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.765080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.766818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.790126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.791063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.792005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.793504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.794347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.809141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.894949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d8fd3ecb-01f5-40de-b216-f209d4d62cc4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182739 Nov 02 13:47:39.899664 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 714/1545] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:39 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:39.911734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-773818772", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:40.103311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:40.450114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:40.462511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b329ec5-7104-4504-aab6-9456fa53932c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.826311 Nov 02 13:47:40.463971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 832/1546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:39 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:40.482149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b651c652-11b3-464d-a495-02b61e5e20f3 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '.version_select at 0x7f6f81f6fee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:40.776814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b651c652-11b3-464d-a495-02b61e5e20f3 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/images/ae3532bb-6f75-4f46-845c-1d4dafb26793" status: 204 len: 0 microversion: 2.1 time: 0.311359 Nov 02 13:47:40.777608 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 833/1547] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:40 2022] DELETE /compute/v2.1/images/ae3532bb-6f75-4f46-845c-1d4dafb26793 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:47:40.784657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:40.785283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:40.801761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:40.802948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:40.806498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:40.807463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:40.808238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:40.808791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.020198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:41.021474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:41.022599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:41.023710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:41.024700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:41.049103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.055569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.056589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.057631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.059046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.062321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.117419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Getting quotas for project 855fbdf05b074d1c866189215a73e31a. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:41.124189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Getting quotas for user 50415ac10fc74f0cad0e7af0d2d52b34 and project 855fbdf05b074d1c866189215a73e31a. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:41.165374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:41.172526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:41.182074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.196883 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-084595c5-44d5-4cb5-bce9-aec79698aa94 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.414537 Nov 02 13:47:41.198891 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 834/1548] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:40 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:41.215260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.217025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.235952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.237486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.237947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.240479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.240963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.243742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.318663 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5678215-2b19-46ae-bea5-8d92d94b21d7 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411772 Nov 02 13:47:41.323294 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 715/1549] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:47:41.352268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.356092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.398021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.404050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.405040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.406153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.409708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.410415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.618966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.663905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.674282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.691387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.714095 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0023ba46-3aec-40b2-8a63-5c33bf1bd616 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.388675 Nov 02 13:47:41.719035 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 716/1550] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:41.726142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.736267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.739309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.741171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a148575-1be2-497a-8915-81cfd2581c26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 0.538568 Nov 02 13:47:41.743966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.745518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 835/1551] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:41.762595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.765453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.765986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.766863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.767688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.769310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.771185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.772781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.795088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.801094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.802153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.808931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.814774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.815530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.958137 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e9d49d97-cbd3-42c5-9026-6b2202b4b53d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202681 Nov 02 13:47:41.959921 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 836/1552] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:41.974502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11936b2d-999d-4122-9426-0ab5a83e8302 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.975649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11936b2d-999d-4122-9426-0ab5a83e8302 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:42.195550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-11936b2d-999d-4122-9426-0ab5a83e8302 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:42.236859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11936b2d-999d-4122-9426-0ab5a83e8302 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1218 microversion: 2.1 time: 0.270767 Nov 02 13:47:42.252980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 837/1553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:42.275750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:42.278926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:42.320285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:42.322009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:42.323232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:42.328795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:42.334432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:42.345091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:42.384086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:42.397057 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-218e9a70-f6f0-4220-b278-79a0250e5d74 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1538 microversion: 2.1 time: 0.675216 Nov 02 13:47:42.404910 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 717/1554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1538 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:42.416074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8f84d557-1be3-430a-bb24-80fb5c88e022 req-8a3c02ae-02b4-453d-9140-02acf4a8726a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "name": "network-vif-plugged", "status": "completed", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:42.466435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8f84d557-1be3-430a-bb24-80fb5c88e022 req-8a3c02ae-02b4-453d-9140-02acf4a8726a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:42.479915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8f84d557-1be3-430a-bb24-80fb5c88e022 req-8a3c02ae-02b4-453d-9140-02acf4a8726a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:42.482740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8f84d557-1be3-430a-bb24-80fb5c88e022 req-8a3c02ae-02b4-453d-9140-02acf4a8726a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:42.559086 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8f84d557-1be3-430a-bb24-80fb5c88e022 req-8a3c02ae-02b4-453d-9140-02acf4a8726a service nova] Creating event network-vif-plugged:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h2-858238-3 Nov 02 13:47:42.576115 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8f84d557-1be3-430a-bb24-80fb5c88e022 req-8a3c02ae-02b4-453d-9140-02acf4a8726a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167885 Nov 02 13:47:42.582556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 718/1555] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:42.602604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:42.608408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:42.634326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:42.636184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:42.637107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:42.651242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:42.652426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:42.653706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:42.755693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:43.121341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.151307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80f93efb-4955-49bb-8479-7c68c996589c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1317 microversion: 2.1 time: 0.904170 Nov 02 13:47:43.158104 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 838/1556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:42 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:43.193736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:43.194906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:43.222732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.237262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.246002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.248858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.252798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.253900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.473044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.495823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.502366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.520623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e68804c-b901-4ef9-b73b-f787da1d9750 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.351736 Nov 02 13:47:43.522705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 839/1557] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:43 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:43.534382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:43.535838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:43.565983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.571672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.572849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.576202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.579603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.582447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.937829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.958611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.969624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.972707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01a8f524-e9bc-4910-9303-765e362f8e29 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 0.447870 Nov 02 13:47:43.974929 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 840/1558] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:43 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:43.982644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:43.988474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.002137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.003437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.004858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.006243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.007088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.008052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.068576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8f73381-64a2-4b28-a295-f375b29a8609 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091878 Nov 02 13:47:44.073943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 841/1559] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:43 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:44.081770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.082393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.089936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.090436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.090863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.091613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.092072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.092495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.148056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.157842 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b1f83b1-bdb8-420d-b937-e99d1b59ebb2 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 1.573089 Nov 02 13:47:44.159524 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 719/1560] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:42 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:44.165609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.166405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.177269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.178130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.178889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.179990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.184810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.184810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.198934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.209364 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e3c2e400-ba59-43b5-9479-0b52cc08ebb1 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1270 microversion: 2.1 time: 0.134253 Nov 02 13:47:44.210520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 842/1561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:44.216217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.216880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.224457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.225133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.225565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.226269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.226716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.227353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.412157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.416453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.424299 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c55290b-95a8-4815-a440-0b43c204d92f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1520 microversion: 2.1 time: 0.262905 Nov 02 13:47:44.425474 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 720/1562] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:44.429420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-499678d6-98d8-404e-819b-09fd1d7d5ed0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1467 microversion: 2.1 time: 0.216006 Nov 02 13:47:44.429797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 843/1563] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1467 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:44.457673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.458572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.468275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.469644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.470980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.471742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.471928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.473874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.474987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.476083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.478665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.479067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.479531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.480270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.480711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.481327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.518550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:47:44.715518 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2713a16b-d9ad-41d4-9da6-18a2f82eeb2d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 204 len: 0 microversion: 2.1 time: 0.259938 Nov 02 13:47:44.717677 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 721/1564] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:47:44 2022] DELETE /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:47:44.738535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.741411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.759160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.760329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.761674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.764234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.765545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.766889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.888978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.889773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.916663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.918887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.919065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abb68cdd-a67c-45be-bd06-7ed79fec64f4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1467 microversion: 2.1 time: 0.448613 Nov 02 13:47:44.924289 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 844/1565] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1467 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:44.931015 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-52576b49-7643-422d-9559-cd5863453698 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.206765 Nov 02 13:47:44.945662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ae8e23b7-c616-46b1-b29b-bc0f11bd031a req-d1a79521-4a07-41b0-ae06-2e16dafa49bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8148766-4f8e-47b9-b16b-e7591434c2b1", "name": "network-vif-plugged", "status": "completed", "tag": "9988a127-a587-4d7c-b8a4-76ed08b18e33"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:44.948867 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 722/1566] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:44.986230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.986923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.001676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.002443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.003122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.004447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.004963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.005734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.011811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ae8e23b7-c616-46b1-b29b-bc0f11bd031a req-d1a79521-4a07-41b0-ae06-2e16dafa49bd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.012524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ae8e23b7-c616-46b1-b29b-bc0f11bd031a req-d1a79521-4a07-41b0-ae06-2e16dafa49bd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.013270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ae8e23b7-c616-46b1-b29b-bc0f11bd031a req-d1a79521-4a07-41b0-ae06-2e16dafa49bd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.048949 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ae8e23b7-c616-46b1-b29b-bc0f11bd031a req-d1a79521-4a07-41b0-ae06-2e16dafa49bd service nova] Creating event network-vif-plugged:9988a127-a587-4d7c-b8a4-76ed08b18e33 for instance e8148766-4f8e-47b9-b16b-e7591434c2b1 on n-h2-858238-3 Nov 02 13:47:45.062760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ae8e23b7-c616-46b1-b29b-bc0f11bd031a req-d1a79521-4a07-41b0-ae06-2e16dafa49bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134049 Nov 02 13:47:45.072077 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 845/1567] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:45.092885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-882970865"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:45.096732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.106068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.107678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.108856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.110339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.111341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.112350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.355888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:45.382881 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1ab7e235-d235-403b-815e-12df3801513d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1526 microversion: 2.1 time: 0.429581 Nov 02 13:47:45.385131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 723/1568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1526 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:45.397549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:45.403971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.437415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.444669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:45.456317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.456787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.459924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.461802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.462923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.506323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec49e040-8623-4d59-95d7-3aa445b8cdd4 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "POST /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb/action" status: 202 len: 0 microversion: 2.1 time: 0.429514 Nov 02 13:47:45.516188 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 846/1569] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:47:45 2022] POST /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:47:45.524081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:45.527721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.536866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.537990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.538591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.539536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.540152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.540736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.605200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e907182-0a5f-47ec-a28f-d4a6805218ee tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084817 Nov 02 13:47:45.610896 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 847/1570] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:45 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:45.623580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:45.624391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.641622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.642591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.643022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.643846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.644363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.645001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.869928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:45.894437 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef4bc2b4-c769-4bd5-8cb8-73028cf3f11f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.281872 Nov 02 13:47:45.896020 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 848/1571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:45 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:45.908241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:45.911191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.921852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.923181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.924616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.927689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.928551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.929637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.072794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.099541 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d392c15-ae9c-4b82-a8cc-8c135f6f30de tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1270 microversion: 2.1 time: 0.201576 Nov 02 13:47:46.109676 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 849/1572] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:45 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:46.121392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6181d5d4-a96d-4e7d-931d-27a76beb855a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81f6f1f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.138040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.248824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.266419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.278851 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfa6435b-8e32-406d-8a9a-1e9bdccac51f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 0.888676 Nov 02 13:47:46.299209 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 724/1573] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:45 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:46.317685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.318420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:46.358296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.358965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.359418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.360739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.366524 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6181d5d4-a96d-4e7d-931d-27a76beb855a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1452 microversion: 2.1 time: 0.255363 Nov 02 13:47:46.368837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.369797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.378006 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 850/1574] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:46.415877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.416872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:46.455480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.460127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.461190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.462609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.465763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.473013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.564883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.583251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.588185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.598716 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6326ec17-49e2-4175-b0d2-fdc42031abd6 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.309766 Nov 02 13:47:46.600157 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 725/1575] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:46.628738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.633864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:46.642126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:46.654968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.656276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.657811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.662211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.663467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.664634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.727681 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8b5f42c8-3fee-43bb-b152-7d04a3c12879 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104802 Nov 02 13:47:46.756651 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 726/1576] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:47:46.939753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.945325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:46.975537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.977637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.982863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.984064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.984250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.985379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.992801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:47.004190 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ceba4b1-42c3-408a-93a2-3e0ba3759257 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1526 microversion: 2.1 time: 0.595530 Nov 02 13:47:47.004863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 851/1577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1526 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:47.137978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:47.138674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:47.148854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.152644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.152644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.152644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.152644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.154270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.376506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:47.390005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:47.408822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67c9d2e7-2e34-4107-930d-d21fd432082f tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1270 microversion: 2.1 time: 0.274251 Nov 02 13:47:47.412517 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b591c8ea-0a2f-4687-919e-804e5af7699f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1313 microversion: 2.1 time: 0.487269 Nov 02 13:47:47.417314 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 727/1578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:47.430930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:47.431930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:47.436374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 852/1579] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:47 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:47.463053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3490f2a-3bca-4ca9-9ffb-31d0fbc31f46 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85f488b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:47.495197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.496255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.501528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.506744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.508432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.510160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.620824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3490f2a-3bca-4ca9-9ffb-31d0fbc31f46 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1452 microversion: 2.1 time: 0.182724 Nov 02 13:47:47.630159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 853/1580] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:47 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1452 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:47.665320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:47.666199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:47.712276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.716853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.719737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.725919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.728279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.731989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.986341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.004826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.020536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.021781 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c05dd8f3-824d-467c-8d7a-b78d72157e67 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 0.602918 Nov 02 13:47:48.037398 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 728/1581] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:47 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:48.047173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:48.053567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:48.073500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.074001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.074433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.075234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.075858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.076361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.158816 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fea0d497-5c8f-4ce2-b85b-767f1ebb3c18 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134902 Nov 02 13:47:48.159453 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 729/1582] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:48 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:48.164363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:48.164970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:48.184298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.184677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.185116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.185837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.186285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.186726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.450637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.532257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.544564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.575182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-edd9ac4e-2f12-4071-b090-f41d10fa3742 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.921788 Nov 02 13:47:48.600420 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 854/1583] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:47 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:48.628030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.645715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:48.649994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:48.669229 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8f808b1a-9aef-407a-a3de-b11dd7321e7a tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1526 microversion: 2.1 time: 0.507962 Nov 02 13:47:48.673042 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 730/1584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:48 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1526 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:48.683648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.686991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.690324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.692348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:48.695519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:48.697909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.700858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.707576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.717336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.718642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.720176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.722257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.723879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.725244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.926145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.957369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a626ed88-2711-4af2-858b-ceaac91d4990 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1270 microversion: 2.1 time: 0.349855 Nov 02 13:47:48.966680 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 855/1585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:48 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:48.986143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35a4a544-a727-49f6-99cb-d9486ba886ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8198a5e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.152301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35a4a544-a727-49f6-99cb-d9486ba886ac tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1452 microversion: 2.1 time: 0.183259 Nov 02 13:47:49.161414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 856/1586] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:48 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:49.174388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bdbb0c39-e768-4c4d-ab65-e2e4b72f20f0 req-bb9c0f7e-b437-4731-afe6-3d34c7f50f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8148766-4f8e-47b9-b16b-e7591434c2b1", "name": "network-vif-unplugged", "status": "completed", "tag": "9988a127-a587-4d7c-b8a4-76ed08b18e33"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:49.221713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bdbb0c39-e768-4c4d-ab65-e2e4b72f20f0 req-bb9c0f7e-b437-4731-afe6-3d34c7f50f9a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.240164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bdbb0c39-e768-4c4d-ab65-e2e4b72f20f0 req-bb9c0f7e-b437-4731-afe6-3d34c7f50f9a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.241429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bdbb0c39-e768-4c4d-ab65-e2e4b72f20f0 req-bb9c0f7e-b437-4731-afe6-3d34c7f50f9a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.316108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bdbb0c39-e768-4c4d-ab65-e2e4b72f20f0 req-bb9c0f7e-b437-4731-afe6-3d34c7f50f9a service nova] Creating event network-vif-unplugged:9988a127-a587-4d7c-b8a4-76ed08b18e33 for instance e8148766-4f8e-47b9-b16b-e7591434c2b1 on n-h2-858238-3 Nov 02 13:47:49.354266 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bdbb0c39-e768-4c4d-ab65-e2e4b72f20f0 req-bb9c0f7e-b437-4731-afe6-3d34c7f50f9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186636 Nov 02 13:47:49.367733 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 857/1587] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:49.399538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.401617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:49.439469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.440818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.441832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.443355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.447213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.448563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.772554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:49.804974 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-227d7634-aeb8-4ff7-9b5c-d0d99c2b86e9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1461 microversion: 2.1 time: 1.127534 Nov 02 13:47:49.810922 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 731/1588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:48 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1461 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:49.832496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.846239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:49.875048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.880428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.883737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.885219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.888476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.894057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.040728 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1a489c6-c057-4c9d-afe3-34d1ad52fbdc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.223482 Nov 02 13:47:50.057209 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 732/1589] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:47:49 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428/os-volume_attachments => generated 25 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:47:50.073329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:50.082023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:50.108039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.109403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.111698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.114152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.118139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.119458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.343695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.384896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.404686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.430021 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf734615-1fe6-421a-af06-feb7558d3a91 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.368464 Nov 02 13:47:50.439587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 733/1590] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:50 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:50.471065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:50.474227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:50.512681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.515034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.517592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.520604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.523601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.524568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.543746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.602215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.633010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.635432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60c6e7b1-491a-48a7-a37d-f21b8d008e26 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 1.265447 Nov 02 13:47:50.651797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 858/1591] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:49 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:50.730645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:51.042114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:51.087378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:51.140727 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bdb01e21-1be3-467b-8678-ced9d2522592 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 200 len: 1484 microversion: 2.1 time: 0.704197 Nov 02 13:47:51.160266 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 734/1592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:50 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 1484 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:51.183897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.186412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.229576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:51.234286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.237498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.237498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.238658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.239410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.240082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.426010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:51.442785 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-849387ce-d37c-498a-bba5-3333cf48179e tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1276 microversion: 2.1 time: 0.274374 Nov 02 13:47:51.443776 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 735/1593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:51.459233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54a3cfa5-e875-421a-aefb-bba1a99905a5 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8228baf0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.597393 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54a3cfa5-e875-421a-aefb-bba1a99905a5 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1452 microversion: 2.1 time: 0.152827 Nov 02 13:47:51.598801 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 736/1594] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:51.618401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-37cce912-e684-4b72-90a2-f63a36ddba89 req-7c3fc39a-dd00-4df8-b8c1-0451c76d7269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8148766-4f8e-47b9-b16b-e7591434c2b1", "name": "network-vif-deleted", "tag": "9988a127-a587-4d7c-b8a4-76ed08b18e33"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:51.657512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-37cce912-e684-4b72-90a2-f63a36ddba89 req-7c3fc39a-dd00-4df8-b8c1-0451c76d7269 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.669043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-37cce912-e684-4b72-90a2-f63a36ddba89 req-7c3fc39a-dd00-4df8-b8c1-0451c76d7269 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.673755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-37cce912-e684-4b72-90a2-f63a36ddba89 req-7c3fc39a-dd00-4df8-b8c1-0451c76d7269 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.687120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.694854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.726167 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-37cce912-e684-4b72-90a2-f63a36ddba89 req-7c3fc39a-dd00-4df8-b8c1-0451c76d7269 service nova] Creating event network-vif-deleted:9988a127-a587-4d7c-b8a4-76ed08b18e33 for instance e8148766-4f8e-47b9-b16b-e7591434c2b1 on n-h2-858238-3 Nov 02 13:47:51.733229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.734337 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-37cce912-e684-4b72-90a2-f63a36ddba89 req-7c3fc39a-dd00-4df8-b8c1-0451c76d7269 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131916 Nov 02 13:47:51.735635 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 737/1595] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:51.740031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.743597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.744271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.748980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.756610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.757108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.758910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.759803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.760265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.760725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.763142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.763987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.764771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.231741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:52.329582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:52.375007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:52.379746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:52.434379 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f1f73f1-ecb2-440f-b64c-6931ba644689 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.696798 Nov 02 13:47:52.436742 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 738/1596] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:52.443660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:52.453021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:52.471488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.474053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.474944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.476872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.479343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.481665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.084945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.099751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.101202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.102417 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f63eaf83-fc90-4825-b1d7-80fb7e102cf0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 0.662597 Nov 02 13:47:53.102949 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 739/1597] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:52 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:53.112628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:53.113235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:53.135638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.136135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.136567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.137262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.137717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.138124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.177001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cfefaede-79de-43bb-92f0-884380112d9b tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1612 microversion: 2.1 time: 2.514869 Nov 02 13:47:53.178492 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 859/1598] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:50 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1612 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:53.193732 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:47:53.195227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 HTTP/1.1 Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:47:53.196016 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:47:53.200398 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1'} Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:53.201813 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:47:53.204989 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.210941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:53.213001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:53.213001 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b97a02fd-c14c-4756-8d46-2f62a95ec67f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 404 len: 111 microversion: 2.1 time: 0.091123 Nov 02 13:47:53.213001 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 740/1599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:53 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:53.213001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-44da4944-c92b-4150-b21b-21d4d7f35b67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a48310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:53.269812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.270654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.271423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.272619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.276714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.278905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.110385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:54.146378 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b675a2e4-a7e3-411b-885c-ba8ca777995a tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1318 microversion: 2.1 time: 0.966339 Nov 02 13:47:54.171723 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 860/1600] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:53 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1318 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:54.186379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-99de0cf3-1f37-443a-aacf-879c4b550a19 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'create', calling method: .version_select at 0x7f6f85f615e0>, body: {"keypair": {"name": "tempest-keypair-1616992815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPROxQi8XZLpV5xmiMBAb2uT6w43ft1P2ZSNGbbIwgrC/hbtd4zsdXAJ8fe+hFb/32ZgBFTmzmfoUE5HBkqsptnOF7RqbjHm0zKeaPjp4tGyMWQVZ04jMRhMaNL9qZZxfQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:54.246425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-99de0cf3-1f37-443a-aacf-879c4b550a19 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:54.263365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-99de0cf3-1f37-443a-aacf-879c4b550a19 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for user 8469267606da4e50bd1e694ee7762547 and project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:54.334398 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-99de0cf3-1f37-443a-aacf-879c4b550a19 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160661 Nov 02 13:47:54.335613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 861/1601] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:47:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:54.340592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:54.360258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:54.375360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.375991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.376589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.377384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.385492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.386050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.645147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4869ec3bba1d40cabf299fcada04d419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31765594e94244dc93f0a9eb464bfc52', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:54.646063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] flavor_id is None. Assuming migration. {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 13:47:54.646628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:47:55.866527 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96239819-1abd-42fd-a1b0-04bca412c67f tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099/action" status: 202 len: 0 microversion: 2.1 time: 1.529517 Nov 02 13:47:55.876512 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 862/1602] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:47:54 2022] POST /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099/action => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:47:55.902504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:55.903673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:55.937370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.942343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.944377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.948286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.949793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.952331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.229503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:56.265720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:56.273867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:56.299607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b568956-465f-4caa-a2c4-ba53d7c87d43 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.412694 Nov 02 13:47:56.316125 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 863/1603] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:55 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:56.345789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:56.347666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:56.357831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:56.360108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.361158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.362172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.364419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.365515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.366502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.575411 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-44da4944-c92b-4150-b21b-21d4d7f35b67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1452 microversion: 2.1 time: 4.375497 Nov 02 13:47:57.588404 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 741/1604] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:53 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1452 bytes in 4389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:57.631316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b6b3bbd9-5641-41a7-a40b-72dcac532171 req-53fe3260-fd32-4efe-bdc7-c8548dd0a9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28579980-d489-4bff-a1cb-dcadca8bd5ee", "name": "network-vif-plugged", "status": "completed", "tag": "a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:57.686068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b6b3bbd9-5641-41a7-a40b-72dcac532171 req-53fe3260-fd32-4efe-bdc7-c8548dd0a9b6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.692682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b6b3bbd9-5641-41a7-a40b-72dcac532171 req-53fe3260-fd32-4efe-bdc7-c8548dd0a9b6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.695017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b6b3bbd9-5641-41a7-a40b-72dcac532171 req-53fe3260-fd32-4efe-bdc7-c8548dd0a9b6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.718433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:57.745319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:57.749997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:57.754993 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e75005c7-59c2-42a0-bafa-a62984bfc5b1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 1.436604 Nov 02 13:47:57.757185 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b6b3bbd9-5641-41a7-a40b-72dcac532171 req-53fe3260-fd32-4efe-bdc7-c8548dd0a9b6 service nova] Creating event network-vif-plugged:a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec for instance 28579980-d489-4bff-a1cb-dcadca8bd5ee on n-h1-858238-3 Nov 02 13:47:57.761425 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 864/1605] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:56 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:57.790490 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b6b3bbd9-5641-41a7-a40b-72dcac532171 req-53fe3260-fd32-4efe-bdc7-c8548dd0a9b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200444 Nov 02 13:47:57.791343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0d86e162-2aa2-42cf-ad4d-b8b82f85bcc7 req-7e12d72f-bbe7-4063-93e6-c0d5a4a20dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2189e303-aa3b-45d9-b133-8b8424b278a6", "tag": "4c695278-f550-4500-97c7-c4be5d963c67"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:57.808515 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 742/1606] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:57.817064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d86e162-2aa2-42cf-ad4d-b8b82f85bcc7 req-7e12d72f-bbe7-4063-93e6-c0d5a4a20dae service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.820004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d86e162-2aa2-42cf-ad4d-b8b82f85bcc7 req-7e12d72f-bbe7-4063-93e6-c0d5a4a20dae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.820851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d86e162-2aa2-42cf-ad4d-b8b82f85bcc7 req-7e12d72f-bbe7-4063-93e6-c0d5a4a20dae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.838802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:57.842821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:57.861378 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0d86e162-2aa2-42cf-ad4d-b8b82f85bcc7 req-7e12d72f-bbe7-4063-93e6-c0d5a4a20dae service nova] Creating event network-changed:4c695278-f550-4500-97c7-c4be5d963c67 for instance 2189e303-aa3b-45d9-b133-8b8424b278a6 on n-h2-858238-3 Nov 02 13:47:57.868572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.876398 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0d86e162-2aa2-42cf-ad4d-b8b82f85bcc7 req-7e12d72f-bbe7-4063-93e6-c0d5a4a20dae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089137 Nov 02 13:47:57.877616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.879688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.879980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 865/1607] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:57.880829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.889537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.890577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.892286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:57.900116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:57.931702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.932241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.940614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.941498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.946661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.949921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.037395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:58.601920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.620746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94c7c876-2118-4d80-8ad3-4e1e01808391 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1470 microversion: 2.1 time: 0.737809 Nov 02 13:47:58.624848 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 866/1608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:57 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1470 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:58.635391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:58.641590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:58.661699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.671585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.672086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.672517 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-61d007b3-dc6f-4b26-8b95-c54319e0b708 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1318 microversion: 2.1 time: 0.861927 Nov 02 13:47:58.672637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.673341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.684633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.684633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.685664 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 743/1609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:47:57 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:58.702610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-388cc536-ee66-43dd-9471-88b617cb6f19 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a420d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:58.980705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.992967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.996410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:59.015158 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-176dadf0-b3e4-43a2-9749-863af8421a83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.388061 Nov 02 13:47:59.016791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 867/1610] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:58 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:47:59.030034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:59.031872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:59.050252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.051994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.055497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.057626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.060108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.060906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.214088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:00.253371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:00.268055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:00.291237 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efb30707-ed29-407a-af82-8052200feec5 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1280 microversion: 2.25 time: 1.270433 Nov 02 13:48:00.330293 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 868/1611] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:47:59 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1280 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:00.356472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:00.362078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:00.401717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.415690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.427376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.433140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.443630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.444726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:01.574564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:01.603921 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffc3f1cb-98d9-4b38-9d1a-21e3e22f5b58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1470 microversion: 2.1 time: 1.268012 Nov 02 13:48:01.616338 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 869/1612] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:00 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1470 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:01.646831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:01.648024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:01.679655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:01.680463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:01.681226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:01.682520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:01.683286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:01.687572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.213892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:02.227685 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d373d4d-0e29-4fe2-8e4a-03cf53f9445d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1318 microversion: 2.1 time: 0.609543 Nov 02 13:48:02.256333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 870/1613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:01 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:02.269097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:02.270315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:02.286135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.287383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.288976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.290918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.291985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.292921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.532403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:02.548676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:02.551935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:02.568788 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-493e2157-c065-4674-a146-70468b7b2c45 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.309424 Nov 02 13:48:02.584220 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 871/1614] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:02 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:02.599577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-abfce264-e493-4f65-9e00-c6efc9775a03 req-32195300-5b3b-4608-81bd-f735a04bf3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "name": "network-vif-plugged", "status": "completed", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:02.627958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-abfce264-e493-4f65-9e00-c6efc9775a03 req-32195300-5b3b-4608-81bd-f735a04bf3ac service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.628760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-abfce264-e493-4f65-9e00-c6efc9775a03 req-32195300-5b3b-4608-81bd-f735a04bf3ac service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.629372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-abfce264-e493-4f65-9e00-c6efc9775a03 req-32195300-5b3b-4608-81bd-f735a04bf3ac service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.653415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-abfce264-e493-4f65-9e00-c6efc9775a03 req-32195300-5b3b-4608-81bd-f735a04bf3ac service nova] Creating event network-vif-plugged:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:48:02.667227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-abfce264-e493-4f65-9e00-c6efc9775a03 req-32195300-5b3b-4608-81bd-f735a04bf3ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080776 Nov 02 13:48:02.679455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 872/1615] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:02.685898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:02.686906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:02.699200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.701734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.704763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.705693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.708656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.709295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:03.089199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:03.104882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:03.106683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:03.108244 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e4a61f5-04b2-4e5a-be90-357154ca1c78 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1475 microversion: 2.25 time: 0.427171 Nov 02 13:48:03.134151 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 873/1616] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:02 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1475 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:03.147495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-201315874", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:04.283033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:07.870218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=34 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:08.676963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=32 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:12.828674 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-388cc536-ee66-43dd-9471-88b617cb6f19 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1461 microversion: 2.1 time: 14.141515 Nov 02 13:48:12.830187 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 744/1617] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:47:58 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1461 bytes in 14143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:12.837066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:12.840761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:12.840926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] validate_networks() for [('87b19db8-bca7-4e15-a215-fb7f6d07b020', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:48:12.851525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.852124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.852558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:12.853253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.853699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.854155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.039858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.054425 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5880b87b-bf49-4d32-ab2e-52b484a44060 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.222234 Nov 02 13:48:13.056295 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 745/1618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:12 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:13.096330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=40 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:13.223409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=24 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:13.242639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.243641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.256835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.257708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.258950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.261404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.262790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.263613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.407407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:48:13.408136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:48:13.408820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:48:13.411891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:48:13.413993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:48:13.422104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 28579980-d489-4bff-a1cb-dcadca8bd5ee {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:13.428698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.429615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.430172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.431291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.432094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.432732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.437569 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d852b375-9f7c-4f7d-a2b9-57390ddd473f tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1967 microversion: 2.25 time: 0.379951 Nov 02 13:48:13.438220 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 746/1619] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1967 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:13.443581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.444553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.451730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.452552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.453274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.454235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.454906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.455581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.460324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:48:13.466961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for user 8469267606da4e50bd1e694ee7762547 and project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:48:13.487404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:48:13.489837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:13.555679 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d558be8d-497c-4e5c-a943-0483fcbafff7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 10.419881 Nov 02 13:48:13.556386 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 874/1620] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:48:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 10421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:48:13.562347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.563253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.570475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.571357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.572109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.573063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.573751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.574391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.661444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.676779 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d5ebf697-61a3-4f17-a9b5-76616da2a0a6 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1318 microversion: 2.1 time: 0.237176 Nov 02 13:48:13.677559 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 747/1621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:13.698500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.716601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.719122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.729016 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3258af8d-835b-4c3d-9d60-bd7fd0220124 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1533 microversion: 2.91 time: 0.171096 Nov 02 13:48:13.735624 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 875/1622] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1533 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:13.746466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-33728b5b-b15c-45d3-a30e-b90e4955bf4a req-5ffcdd87-ca46-40c7-859b-d15567265cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2189e303-aa3b-45d9-b133-8b8424b278a6", "name": "network-vif-plugged", "status": "completed", "tag": "4c695278-f550-4500-97c7-c4be5d963c67"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:13.759382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-33728b5b-b15c-45d3-a30e-b90e4955bf4a req-5ffcdd87-ca46-40c7-859b-d15567265cc5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.759860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-33728b5b-b15c-45d3-a30e-b90e4955bf4a req-5ffcdd87-ca46-40c7-859b-d15567265cc5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.760364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-33728b5b-b15c-45d3-a30e-b90e4955bf4a req-5ffcdd87-ca46-40c7-859b-d15567265cc5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.774622 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-33728b5b-b15c-45d3-a30e-b90e4955bf4a req-5ffcdd87-ca46-40c7-859b-d15567265cc5 service nova] Creating event network-vif-plugged:4c695278-f550-4500-97c7-c4be5d963c67 for instance 2189e303-aa3b-45d9-b133-8b8424b278a6 on n-h2-858238-3 Nov 02 13:48:13.782130 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-33728b5b-b15c-45d3-a30e-b90e4955bf4a req-5ffcdd87-ca46-40c7-859b-d15567265cc5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050042 Nov 02 13:48:13.783247 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 876/1623] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:13.791745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-767f88be-b89b-41e3-9245-fe559e798a8a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85eb4790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.809688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-454132725", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "473093aa-1828-4d24-9a45-1f4328684ff9"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:13.864329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-767f88be-b89b-41e3-9245-fe559e798a8a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 200 len: 1461 microversion: 2.1 time: 0.077495 Nov 02 13:48:13.869070 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 877/1624] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:13.881140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.881884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.899269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.900082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.900764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.901891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.902693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.903081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.951062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] validate_networks() for [('473093aa-1828-4d24-9a45-1f4328684ff9', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:48:14.102186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 28579980-d489-4bff-a1cb-dcadca8bd5ee {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:14.162894 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6afee28-634d-4707-80da-664ce2404897 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1967 microversion: 2.25 time: 0.290456 Nov 02 13:48:14.165858 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 878/1625] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1967 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:14.190078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e8102e5-6f89-4be4-8b84-c7c3fbf4582d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:14.193175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e8102e5-6f89-4be4-8b84-c7c3fbf4582d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:14.290098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e8102e5-6f89-4be4-8b84-c7c3fbf4582d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:14.303368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e8102e5-6f89-4be4-8b84-c7c3fbf4582d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1224 microversion: 2.1 time: 0.135844 Nov 02 13:48:14.304670 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 879/1626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:14 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:14.313663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:14.315493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:14.326593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.327597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.328446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.329735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.330686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.331505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.511585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lazy-loading 'services' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:14.543305 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-754ccb99-e3af-4351-8593-1f7ad8f3cc2e tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1938 microversion: 2.91 time: 0.234922 Nov 02 13:48:14.543305 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 880/1627] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:14 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1938 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:14.550439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:14.551263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:14.559158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.559419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.559995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.560610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.561453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.562700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.733678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:48:14.734507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:48:14.736424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:48:14.737256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:48:14.738217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:48:14.757317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.758322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.759017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.760318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.761114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.761835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.796681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:14.796994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Getting quotas for project faa16093dc2848ae9758690c9a507115. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:48:14.809179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Getting quotas for user d59c0d1831e4439381c37b506249da30 and project faa16093dc2848ae9758690c9a507115. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:48:14.809755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a56925f-25b1-4a3b-83b3-67f2b6d27d5e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1467 microversion: 2.1 time: 0.266225 Nov 02 13:48:14.810343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 881/1628] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:14 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1467 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:14.816231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:14.817180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:14.824071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.825126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.825631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.826450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.827356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.827844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.836910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Going to run 3 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:48:14.854571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:14.908668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=85f651e0-b174-40a4-ae6e-02581828ae37,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:14.969913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=d9162009-bf24-46d0-b941-ef08428ff4d9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:15.074873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:15.086365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4455a896-abd9-49bb-93cc-6c496409d231 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.274495 Nov 02 13:48:15.087584 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 882/1629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:14 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:15.093695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:15.099934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.100768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.101522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.102687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.103528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.104389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.123235 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-039c4733-0fe7-4165-84b0-a18dc9847db2 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444282 Nov 02 13:48:15.130931 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 748/1630] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:48:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:48:15.130931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:15.130931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:15.140096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.140930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.141434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.144154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.145031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.146018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.174509 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4398b201-90b5-4ef4-ac36-951b673d86e9 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085516 Nov 02 13:48:15.175513 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 883/1631] 10.222.0.18 () {60 vars in 1217 bytes} [Wed Nov 2 13:48:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:48:15.182524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:15.184255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:15.185514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lazy-loading 'flavor' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:15.205925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.206797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.207510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.208534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.209290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.209964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.534976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:15.548057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ac8a234-aac9-4a43-a9f1-c4fef39a2445 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1318 microversion: 2.1 time: 0.370384 Nov 02 13:48:15.549330 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 884/1632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:15 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:15.555164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1737416693"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:15.558132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:15.565193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.565990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.566401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.567159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.567738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.568519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.581120 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-25c28344-7ba8-42cd-922d-c846544a1c46 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action" status: 202 len: 0 microversion: 2.91 time: 0.455328 Nov 02 13:48:15.582065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 749/1633] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:48:15 2022] POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:15.589437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:15.598924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:15.601295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:48:15.647010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.653082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.653901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.656633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.663689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.664688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.727191 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d7fa21da-f9e9-42f5-8b92-8b81a9011f8d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.130347 Nov 02 13:48:15.727191 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 750/1634] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:48:15 2022] GET /compute/v2.1/servers => generated 1015 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:15.746585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858238-3", "block_migration": "auto"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:15.753166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:15.774662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.775199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.775684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.776407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.776862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.777287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.862649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'flavor' on Instance uuid 28579980-d489-4bff-a1cb-dcadca8bd5ee {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:15.864970 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98ae302b-21ed-475f-af7f-7b5ea3bb516a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "POST /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16/action" status: 202 len: 0 microversion: 2.1 time: 0.313006 Nov 02 13:48:15.866337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 885/1635] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:15 2022] POST /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:48:15.884494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Going to try to live migrate instance to n-h2-858238-3 {{(pid=137558) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:48:15.888952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:15.889855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:15.912472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.915561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.917002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:15.927473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:15.928545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:15.929168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.106051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.123234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d35c962-297c-47f3-bfb3-887e58215e04 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1284 microversion: 2.1 time: 0.254757 Nov 02 13:48:16.128760 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 886/1636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:15 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:16.147032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:16.150426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:16.170415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.172852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.173353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.174074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.176506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.178130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.324632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.338366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.345270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.355710 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-549a4b34-0a5f-4e7e-a4e5-6ef193de45eb tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.224857 Nov 02 13:48:16.357133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 887/1637] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:16 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:16.369930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf3c6b85-5d38-4c7e-ac56-b156dec10321 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:16.372172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf3c6b85-5d38-4c7e-ac56-b156dec10321 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:16.515443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf3c6b85-5d38-4c7e-ac56-b156dec10321 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.537726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf3c6b85-5d38-4c7e-ac56-b156dec10321 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1222 microversion: 2.1 time: 0.178839 Nov 02 13:48:16.538716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 888/1638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:16 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:16.576027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c82376a5-030b-47a8-97ae-e3cfb6e7d8e3 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e9fca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:16.699247 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c82376a5-030b-47a8-97ae-e3cfb6e7d8e3 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.134029 Nov 02 13:48:16.700944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 889/1639] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:16 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:16.721466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:16.721799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:16.761469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.762311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.763073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.778161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.779504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.779748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.122411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:17.150776 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e27fd35a-9a19-40d0-b8de-0db611ae953c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.447920 Nov 02 13:48:17.152778 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 890/1640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:16 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:17.160070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:17.160957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:17.181614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.187320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.188878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.190612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.191272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.191860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.583040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:17.595880 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-baa876b4-daf1-431b-8be8-23cf2deeaec2 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1467 microversion: 2.1 time: 0.441740 Nov 02 13:48:17.596937 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 891/1641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:17 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1467 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:17.605752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-69a5f23c-9e60-4dfc-a0f9-85b438c7e3e5 req-cc12c240-ca98-4a14-8d41-33fb8303f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "name": "network-vif-unplugged", "status": "completed", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:17.617166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-69a5f23c-9e60-4dfc-a0f9-85b438c7e3e5 req-cc12c240-ca98-4a14-8d41-33fb8303f1c1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.618031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-69a5f23c-9e60-4dfc-a0f9-85b438c7e3e5 req-cc12c240-ca98-4a14-8d41-33fb8303f1c1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.618586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-69a5f23c-9e60-4dfc-a0f9-85b438c7e3e5 req-cc12c240-ca98-4a14-8d41-33fb8303f1c1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.634814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-69a5f23c-9e60-4dfc-a0f9-85b438c7e3e5 req-cc12c240-ca98-4a14-8d41-33fb8303f1c1 service nova] Creating event network-vif-unplugged:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:48:17.644047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-69a5f23c-9e60-4dfc-a0f9-85b438c7e3e5 req-cc12c240-ca98-4a14-8d41-33fb8303f1c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045382 Nov 02 13:48:17.645056 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 892/1642] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:17.651033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:17.651604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:17.661328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.661810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.662420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.663153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.663598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.664035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.103289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:18.111315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7996f16b-c83e-4c09-8434-41e17fa1bbaf tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 0.465028 Nov 02 13:48:18.112658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 893/1643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:17 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:18.117388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:18.118278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:18.168355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:18.176931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:18.198171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.200654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:18.203798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:18.208305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.739827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:18.778587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:18.781416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:18.797350 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3d7ebbb7-fca9-4e25-8a38-d9a677931193 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.683051 Nov 02 13:48:18.802267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 894/1644] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:18 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:18.818111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:18.819179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:18.851729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:18.852586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:18.853349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.854604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:18.855509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:18.856268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.879383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:19.134894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:19.173895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ecb099b5-e5f6-43d3-8c56-90a56cbd873c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1274 microversion: 2.1 time: 0.366196 Nov 02 13:48:19.175846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 895/1645] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:18 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:19.182350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:19.183707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:19.210832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.212052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.214351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.215582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.216678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.217709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.316327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lazy-loading 'flavor' on Instance uuid 2189e303-aa3b-45d9-b133-8b8424b278a6 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:19.515339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-32cd0139-c816-49b7-93bc-f3a71647691c tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6/action" status: 202 len: 0 microversion: 2.1 time: 0.336986 Nov 02 13:48:19.517737 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 896/1646] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:19 2022] POST /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:48:19.541554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3fcaad20-8e0e-4af6-8ba8-ac390f0661b2 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e58820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:19.657736 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3fcaad20-8e0e-4af6-8ba8-ac390f0661b2 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.135917 Nov 02 13:48:19.657736 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 897/1647] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:19 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:19.678899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:19.679917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:19.719387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.721101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.721702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.730360 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-867dabab-6736-48de-9023-5751cda26a21 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee/action" status: 202 len: 0 microversion: 2.25 time: 3.998322 Nov 02 13:48:19.734368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 751/1648] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:48:15 2022] POST /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee/action => generated 0 bytes in 4017 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:19.742555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.746127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:19.747353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.748068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.749427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:19.772154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.773678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.775515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.777437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.778862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.781505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.130479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.150038 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abf3b5b0-3365-4958-b81f-07728ca3093d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.492314 Nov 02 13:48:20.151892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 898/1649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:19 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:20.160290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.161695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.168881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.169839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.170480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.171860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.172490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.173534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.403998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.421341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88a35caf-3f7f-4abb-93b7-14e44c291085 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1475 microversion: 2.1 time: 0.268056 Nov 02 13:48:20.425661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 899/1650] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1475 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:20.432914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.433573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.456662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.460444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.463783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.465667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.469190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.469823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.479465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.501438 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e07ac76-4d83-46d8-be77-0c3bf05f7e9d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 0.763379 Nov 02 13:48:20.505611 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 752/1651] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:19 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:20.520272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.522369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.543122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.546424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.549574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.553508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.556222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.557368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.786697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.804324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.810793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.829359 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-776af396-c4bb-438d-be9f-a98a4c518e5b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.319251 Nov 02 13:48:20.830880 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 753/1652] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:20.856664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.861253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.875626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.877378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.882052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.884361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.885210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.885876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.069445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:21.084406 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6acad4fe-6cd6-4f40-8c9d-af8c9bd0e9ce tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1280 microversion: 2.1 time: 0.252055 Nov 02 13:48:21.087804 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 754/1653] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:21.104611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b44b118f-6a60-4ea8-98b0-bcd03ae273e0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8228b310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:21.217319 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b44b118f-6a60-4ea8-98b0-bcd03ae273e0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.125773 Nov 02 13:48:21.222639 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 755/1654] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:21 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:21.247354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-32047d60-b83b-4a64-81e9-d83a9da2e5bc req-aa90f918-31a1-460c-aef6-d7879837e273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0640dee1-2b77-42c1-8eb8-a2217a3b54ee", "tag": "48054201-47b9-4acf-adf1-f585f6d2e1e4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:21.290218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-32047d60-b83b-4a64-81e9-d83a9da2e5bc req-aa90f918-31a1-460c-aef6-d7879837e273 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.293578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-32047d60-b83b-4a64-81e9-d83a9da2e5bc req-aa90f918-31a1-460c-aef6-d7879837e273 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.294819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-32047d60-b83b-4a64-81e9-d83a9da2e5bc req-aa90f918-31a1-460c-aef6-d7879837e273 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.320415 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-32047d60-b83b-4a64-81e9-d83a9da2e5bc req-aa90f918-31a1-460c-aef6-d7879837e273 service nova] Creating event network-changed:48054201-47b9-4acf-adf1-f585f6d2e1e4 for instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee on n-h1-858238-3 Nov 02 13:48:21.331767 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-32047d60-b83b-4a64-81e9-d83a9da2e5bc req-aa90f918-31a1-460c-aef6-d7879837e273 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107151 Nov 02 13:48:21.336155 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 756/1655] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:21.352211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:21.353371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:21.373471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.374375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.375844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.379531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.381132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.383485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.476492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:21.485428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:21.486864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:21.515325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4909df15-6e24-4a90-b35e-7b2d620f17fe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 1.088298 Nov 02 13:48:21.517145 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 900/1656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:21.527813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:21.536599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:21.553294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.553918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.554315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.555047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.565264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.565721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.805203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:21.820978 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ffcb3b4-ab9b-422b-b164-9481d8e7f915 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.481688 Nov 02 13:48:21.823085 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 757/1657] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:21 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:21.853628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:21.855932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:21.878609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.884917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.887682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.896013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.896886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.897526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:22.568793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:22.615968 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-884913b1-d0ec-40ec-bd16-18d0955b2b45 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1458 microversion: 2.1 time: 1.092025 Nov 02 13:48:22.616871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 901/1658] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:21 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1458 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:22.645252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:22.646105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:22.666312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:22.666818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:22.667380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:22.668203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:22.668831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:22.669414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.017826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.034844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.070416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.079353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3335bff8-2a71-4c43-a8fa-cb79d9bbd332 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.457813 Nov 02 13:48:23.082982 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 902/1659] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:22 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:23.102172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.103366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:23.124588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.125272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.125943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.126758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.127375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.128132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.337724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.353603 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-24378d51-fb3f-4b74-bf28-4a66b7bfda72 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 1.513450 Nov 02 13:48:23.367577 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 758/1660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:21 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:23.369913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.380711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2e97ec69-5fe8-4b1c-8e09-9769b152db04 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81ec1b80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.386210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87720fc7-3645-4c32-89c8-9275a321fa5a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1280 microversion: 2.1 time: 0.301752 Nov 02 13:48:23.395893 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 903/1661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:23.401112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.417324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:23.433776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.442046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.446191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.447202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.451849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.455005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.483398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2e97ec69-5fe8-4b1c-8e09-9769b152db04 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.114148 Nov 02 13:48:23.484660 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 759/1662] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:23.503828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.505048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:23.523894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.527928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.528630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.529574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.530515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.533292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.878305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.890898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.894964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.904616 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eaf9a033-48d9-42c7-841b-f3044b35ff76 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.507244 Nov 02 13:48:23.905407 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 904/1663] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:23.910470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.916671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:23.939336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.939831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.940362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.941079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.942397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.942397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.612011 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-68e9bdc2-af9c-4ea1-aba7-609ee734f8dd tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1609 microversion: 2.1 time: 1.126004 Nov 02 13:48:24.613211 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 760/1664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1609 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:24.621540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b6f9e9ca-4c5a-447b-9033-5b18b1677c6a req-60b76e9d-c19a-427d-90ca-8eba57068600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6225cba5-1f32-40c4-b619-eec45c381a16", "name": "network-vif-plugged", "status": "completed", "tag": "b96607a2-d826-4bdb-a6b2-8b1e483d9f83"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:24.644040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b6f9e9ca-4c5a-447b-9033-5b18b1677c6a req-60b76e9d-c19a-427d-90ca-8eba57068600 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.651230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b6f9e9ca-4c5a-447b-9033-5b18b1677c6a req-60b76e9d-c19a-427d-90ca-8eba57068600 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.652468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b6f9e9ca-4c5a-447b-9033-5b18b1677c6a req-60b76e9d-c19a-427d-90ca-8eba57068600 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.673957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:24.684121 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f6133a1-e7a1-4418-bda7-8dcfc10e7af9 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.776894 Nov 02 13:48:24.688762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:24.691330 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b6f9e9ca-4c5a-447b-9033-5b18b1677c6a req-60b76e9d-c19a-427d-90ca-8eba57068600 service nova] Creating event network-vif-plugged:b96607a2-d826-4bdb-a6b2-8b1e483d9f83 for instance 6225cba5-1f32-40c4-b619-eec45c381a16 on n-h1-858238-3 Nov 02 13:48:24.693735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 905/1665] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:24.700590 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b6f9e9ca-4c5a-447b-9033-5b18b1677c6a req-60b76e9d-c19a-427d-90ca-8eba57068600 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085717 Nov 02 13:48:24.701861 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 761/1666] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:24.709392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:24.710396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:24.721005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.722207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.723245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.724666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.725880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.726875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:24.727140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.727752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:24.774580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.776016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.777469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.778957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.780066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.780973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.825305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:24.902129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:24.912889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:24.923933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:24.941202 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af46f7d8-ac9c-478c-8fb7-2ff7e98c71dc tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.224252 Nov 02 13:48:24.945129 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 906/1667] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:24 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:24.958420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:24.959506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:24.976613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.977335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.977998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.979013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.981387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.982841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:25.120082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:25.572149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:25.584497 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-edbb8232-838d-43fc-a121-183e2389cdd7 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 0.880977 Nov 02 13:48:25.585100 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 762/1668] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:24 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:25.602567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64d1de44-9c77-46c4-8733-697af5f12b3c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81994550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:25.686224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:25.705987 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-64d1de44-9c77-46c4-8733-697af5f12b3c tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.118007 Nov 02 13:48:25.706556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 763/1669] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:25 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:25.734626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:25.757485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:25.758328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:25.759122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:25.760051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:25.760707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:25.761256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:25.855198 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d609824e-5fda-465b-be99-d9701e455bbb tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.147501 Nov 02 13:48:25.855794 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 764/1670] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:48:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:25.873215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:25.873928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:25.906158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:25.910984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:25.914081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:25.919686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:25.920362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:25.920815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.008217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.027466 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-daf64e73-443c-4372-9d16-79b5e510552d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 1.079096 Nov 02 13:48:26.030259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 907/1671] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:24 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:26.043661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:26.044832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:26.056967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.060673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.061325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.062261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.062889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.064746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.320848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.341054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.347252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.356707 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3887e480-ccc0-4ee9-b9b1-33db84e8d4f2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.491137 Nov 02 13:48:26.357636 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 765/1672] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:25 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:26.362510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858238-3", "block_migration": true, "disk_over_commit": false}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:26.378040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:26.395499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.400432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.401188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.402134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.402620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.403051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.479541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Lazy-loading 'flavor' on Instance uuid 2189e303-aa3b-45d9-b133-8b8424b278a6 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:26.511774 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 2189e303-aa3b-45d9-b133-8b8424b278a6 while it is in vm_state suspended Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Request method failure captured: Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6/action HTTP/1.1 Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 97 Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTbjMd-WNIRDXc5Nui9WV_ysgDShpb_GXxdz8pJUav1IxBwA7Pq_JOqFSS-C6I9aEvc-MtK0L7Eouwn15O8odXR-518ICYAMjvLoCgbX-4x41o7mByofFVcz4xiqlsUwJi00S09oTaHzvKIzYYFiOwZj-crz0R4_sQyIpMUBhrAT-I Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 660c8a2bba6b4aa482f21f7cbea1cadc Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-LiveMigrationNegativeTest-201335214 Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 13:48:26.513899 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/660c8a2bba6b4aa482f21f7cbea1cadc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/660c8a2bba6b4aa482f21f7cbea1cadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/660c8a2bba6b4aa482f21f7cbea1cadc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_660c8a2bba6b4aa482f21f7cbea1cadc"}]}] Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-LiveMigrationNegativeTest-201335214 Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 660c8a2bba6b4aa482f21f7cbea1cadc Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-201335214 Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-LiveMigrationNegativeTest-201335214-project-admin Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: cc93c877e182468f94bf274cfec57ae4 Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-LiveMigrationNegativeTest-201335214-project-admin Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: {"os-migrateLive": {"host": "n-h1-858238-3", "block_migration": true, "disk_over_commit": false}} Nov 02 13:48:26.516158 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'os-migrateLive' instance 2189e303-aa3b-45d9-b133-8b8424b278a6 while it is in vm_state suspended Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2189e303-aa3b-45d9-b133-8b8424b278a6', 'body': {'os-migrateLive': {'host': 'n-h1-858238-3', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 13:48:26.517392 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:48:26.518829 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 2189e303-aa3b-45d9-b133-8b8424b278a6 while it is in vm_state suspended Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 2189e303-aa3b-45d9-b133-8b8424b278a6 while it is in vm_state suspended Nov 02 13:48:26.520523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.522860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 2189e303-aa3b-45d9-b133-8b8424b278a6 while it is in vm_state suspended {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:26.522860 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-32bf34ad-eb03-4351-93a5-e767f3da5f8b tempest-LiveMigrationNegativeTest-201335214 tempest-LiveMigrationNegativeTest-201335214-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6/action" status: 409 len: 155 microversion: 2.1 time: 0.156722 Nov 02 13:48:26.525799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:26.527383 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 766/1673] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:26 2022] POST /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6/action => generated 155 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:48:26.540877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:26.541486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:26.559023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.559547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.560110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.561052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.561510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.561938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.704274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.718659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.720198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.743628 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98992113-70f3-492e-983e-323ffcbd65dd tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.214813 Nov 02 13:48:26.744228 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 767/1674] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:26 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:26.763955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-0ed7cf37-c4c2-4729-a1be-4825aedf7a73 req-403d36c3-d075-4dc2-9d1f-d0d0fd55588e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f651e0-b174-40a4-ae6e-02581828ae37", "tag": "d2835ec8-7a8c-4ee0-b7c9-48187ef8d1f5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:26.801640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0ed7cf37-c4c2-4729-a1be-4825aedf7a73 req-403d36c3-d075-4dc2-9d1f-d0d0fd55588e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.802117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0ed7cf37-c4c2-4729-a1be-4825aedf7a73 req-403d36c3-d075-4dc2-9d1f-d0d0fd55588e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.802541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0ed7cf37-c4c2-4729-a1be-4825aedf7a73 req-403d36c3-d075-4dc2-9d1f-d0d0fd55588e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.825082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-0ed7cf37-c4c2-4729-a1be-4825aedf7a73 req-403d36c3-d075-4dc2-9d1f-d0d0fd55588e service nova] Creating event network-changed:d2835ec8-7a8c-4ee0-b7c9-48187ef8d1f5 for instance 85f651e0-b174-40a4-ae6e-02581828ae37 on n-h2-858238-3 Nov 02 13:48:26.839070 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-0ed7cf37-c4c2-4729-a1be-4825aedf7a73 req-403d36c3-d075-4dc2-9d1f-d0d0fd55588e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093534 Nov 02 13:48:26.842626 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 768/1675] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:26.856310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:26.856888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:26.878959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.879493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.879921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.880654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.881097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.881546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.926600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:27.117351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:27.149436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-547b2cec-5a87-4119-be66-f4ab605b5e6e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 1.114820 Nov 02 13:48:27.169986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 908/1676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:26 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:27.192105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:27.194131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:27.200575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-420a56c6-460e-4560-a860-df18c766f586 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 204 len: 0 microversion: 2.1 time: 0.356201 Nov 02 13:48:27.202895 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 769/1677] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:48:26 2022] DELETE /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:27.220615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f99b25a-d645-4d0c-b65e-3d5cb4537035 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a093a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:27.221240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.222234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.222992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.229240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.233059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.234599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.373558 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8f99b25a-d645-4d0c-b65e-3d5cb4537035 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.166428 Nov 02 13:48:27.374678 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 770/1678] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:27 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:27.394491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:27.403474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:27.435786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.437117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.441037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.442750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.446622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.447884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.725939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:27.736902 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad1ebde8-f8e5-485e-bd81-33cce7d4ca4b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 0.565407 Nov 02 13:48:27.745412 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 909/1679] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:27 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:27.763568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:27.764328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:27.782769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.783306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.783837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.784571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.785017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.785430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.994554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.008741 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d09f028d-0782-451c-8481-55674ab329c3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 0.632673 Nov 02 13:48:28.010575 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 771/1680] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:27 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:28.016790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:28.017391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:28.039713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.040940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.041734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.046209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.048728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.052261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.481645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.491413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.492883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.494062 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d80ddd1e-e651-47b1-9bb1-90bfc5434e9a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.482505 Nov 02 13:48:28.497799 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 772/1681] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:28 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:28.502797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:28.503502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:28.517503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.518000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.518433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.524494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.525105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.527566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.538026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.563851 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a017c1ba-7ff5-47a8-a8d5-13ec57cce87d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1464 microversion: 2.1 time: 0.809992 Nov 02 13:48:28.569523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 910/1682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:27 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1464 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:28.596857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:28.597503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:28.628454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:28.652027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.654035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.656013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.663140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.668448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.668711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.691659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.708962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.713132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.726541 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b6dae4c-3309-435d-93f3-8d7eddd7d5ac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.227537 Nov 02 13:48:28.727193 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 773/1683] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:28 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:28.734108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a437061-58c6-4f93-89d5-1581f906ad44 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a28a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:28.775939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:28.867650 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a437061-58c6-4f93-89d5-1581f906ad44 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.139265 Nov 02 13:48:28.868267 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 774/1684] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:28 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:28.874062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-54c175d8-761a-414e-a6b7-28152e310238 req-c3da0bcc-bf74-4aa9-a0fe-a90eccf0b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49590101-83f7-4aa2-a3ca-ea29a1e877e0", "tag": "cb9bb33b-1c03-487c-9894-328a5e4e71e8"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:28.894523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-54c175d8-761a-414e-a6b7-28152e310238 req-c3da0bcc-bf74-4aa9-a0fe-a90eccf0b4f0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:28.895142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-54c175d8-761a-414e-a6b7-28152e310238 req-c3da0bcc-bf74-4aa9-a0fe-a90eccf0b4f0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:28.897453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-54c175d8-761a-414e-a6b7-28152e310238 req-c3da0bcc-bf74-4aa9-a0fe-a90eccf0b4f0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.965581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-54c175d8-761a-414e-a6b7-28152e310238 req-c3da0bcc-bf74-4aa9-a0fe-a90eccf0b4f0 service nova] Creating event network-changed:cb9bb33b-1c03-487c-9894-328a5e4e71e8 for instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 on n-h2-858238-3 Nov 02 13:48:28.987491 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-54c175d8-761a-414e-a6b7-28152e310238 req-c3da0bcc-bf74-4aa9-a0fe-a90eccf0b4f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115950 Nov 02 13:48:28.989347 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 775/1685] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:29.011922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:29.014680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:29.045399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.046862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.049786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:29.053275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.055194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.056950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:29.079330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:29.089159 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfc34d91-a80b-4c21-8690-1dad21025ddf tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1475 microversion: 2.1 time: 0.517837 Nov 02 13:48:29.099538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 911/1686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:28 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1475 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:29.119065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c225077d-5dde-4412-8075-5ff1ea3cb63f req-97e04bc7-0b8c-442c-b27b-71f85cfa666d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9162009-bf24-46d0-b941-ef08428ff4d9", "tag": "32869b38-10e2-4e59-beda-531cdaa3eed1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:29.154879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c225077d-5dde-4412-8075-5ff1ea3cb63f req-97e04bc7-0b8c-442c-b27b-71f85cfa666d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.155210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c225077d-5dde-4412-8075-5ff1ea3cb63f req-97e04bc7-0b8c-442c-b27b-71f85cfa666d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.155457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c225077d-5dde-4412-8075-5ff1ea3cb63f req-97e04bc7-0b8c-442c-b27b-71f85cfa666d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:29.205316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c225077d-5dde-4412-8075-5ff1ea3cb63f req-97e04bc7-0b8c-442c-b27b-71f85cfa666d service nova] Creating event network-changed:32869b38-10e2-4e59-beda-531cdaa3eed1 for instance d9162009-bf24-46d0-b941-ef08428ff4d9 on n-h1-858238-3 Nov 02 13:48:29.213868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c225077d-5dde-4412-8075-5ff1ea3cb63f req-97e04bc7-0b8c-442c-b27b-71f85cfa666d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109561 Nov 02 13:48:29.214841 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 912/1687] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:29.220658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:29.232185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:29.263744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.266540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.267944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:29.270203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.271301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.271995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:30.313348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:30.323551 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7dd753a8-8ba8-40fd-948c-82898ac20434 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 1.332312 Nov 02 13:48:30.340174 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 776/1688] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:28 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:30.345967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:30.346581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:30.368335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:30.368997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:30.369445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:30.370156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:30.370605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:30.371020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:30.544981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:30.567431 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fe5f8e2-d0ec-48bb-aa01-a290b1d6821a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 1.346030 Nov 02 13:48:30.568632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 913/1689] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:29 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:30.603960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:30.606663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:30.629001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:30.629001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:30.629565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:30.630062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:30.630569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:30.631436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.057754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.073423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.077700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.084935 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e3a9361f-0db4-4475-9d94-3f6ad0f8dbdf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.741750 Nov 02 13:48:31.108773 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 777/1690] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:30 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:31.121547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:31.123789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:31.142896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.144236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.145309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.146885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.151321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.152107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.287666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.299800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.302043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.310262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe901788-1f35-4713-adf7-624b25df3bf5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.198339 Nov 02 13:48:31.324442 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 778/1691] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:31 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:31.346548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ef09d67b-a576-4322-9d22-b14160bd88a5 req-394bbacd-e87d-400e-b299-8641426ce280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0640dee1-2b77-42c1-8eb8-a2217a3b54ee", "name": "network-vif-plugged", "status": "completed", "tag": "48054201-47b9-4acf-adf1-f585f6d2e1e4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:31.366645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:31.417250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ef09d67b-a576-4322-9d22-b14160bd88a5 req-394bbacd-e87d-400e-b299-8641426ce280 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.417250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ef09d67b-a576-4322-9d22-b14160bd88a5 req-394bbacd-e87d-400e-b299-8641426ce280 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.417250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ef09d67b-a576-4322-9d22-b14160bd88a5 req-394bbacd-e87d-400e-b299-8641426ce280 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.467877 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ef09d67b-a576-4322-9d22-b14160bd88a5 req-394bbacd-e87d-400e-b299-8641426ce280 service nova] Creating event network-vif-plugged:48054201-47b9-4acf-adf1-f585f6d2e1e4 for instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee on n-h1-858238-3 Nov 02 13:48:31.474968 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ef09d67b-a576-4322-9d22-b14160bd88a5 req-394bbacd-e87d-400e-b299-8641426ce280 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149016 Nov 02 13:48:31.476496 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 779/1692] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:31.483035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9279a084-6f45-472b-b5f3-9a023d4688ba tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f819edca0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:31.534308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.552162 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-63c89ce4-2e62-40ab-850d-51579710308b tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1464 microversion: 2.1 time: 0.965258 Nov 02 13:48:31.554513 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9279a084-6f45-472b-b5f3-9a023d4688ba tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.076530 Nov 02 13:48:31.556330 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 780/1693] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:31 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:31.560740 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 914/1694] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:30 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1464 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:31.574730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:31.576118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:31.582419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:31.583042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:31.588443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.589421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.590152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.593155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.593991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.594700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.606367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.606888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.607362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.608101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:31.608601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:31.609031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.947470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.964340 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c80812d8-627e-4568-a653-2d6931a68674 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1474 microversion: 2.1 time: 0.406247 Nov 02 13:48:31.965247 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 781/1695] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:31 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:31.988571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:31.989382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:31.997329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.000637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.001811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:32.002665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.003308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.003865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:32.282927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:32.304731 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-722ef6f8-baab-436b-9785-41d7dc47e21c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 0.320995 Nov 02 13:48:32.307731 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 782/1696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:31 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:32.312831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:32.325390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:32.351963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.352482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.352931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:32.360173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.362057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.362517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:32.428132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:32.807732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:32.818353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:32.847649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:32.849345 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75ad0d27-1ded-4e13-b912-9e5be7b3227d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.539902 Nov 02 13:48:32.850374 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 783/1697] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:32 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:32.898381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:32.900860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:32.908288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:32.913368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-063ae2b1-19f0-463f-9a3b-3b99e0eae5b6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1324 microversion: 2.1 time: 1.345379 Nov 02 13:48:32.914083 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 915/1698] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:31 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1324 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:32.940985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.941421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.941872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:32.942605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.942742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1863185461", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e0293639-a49a-47d1-9a03-7fbc87f19e62"}], "block_device_mapping_v2": [{"uuid": "6e4e13e7-dc12-4c5d-a6f5-1078d9acea5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:32.943058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.946715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.183695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] validate_networks() for [('e0293639-a49a-47d1-9a03-7fbc87f19e62', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:48:33.316310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:33.342461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:33.352197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:33.365343 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-70bf7af5-c5a1-4123-b513-df9492f921b1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.479814 Nov 02 13:48:33.382867 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 784/1699] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:32 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:33.382867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a9603a8-4f43-4232-928b-e1f9e0c429a9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f819941f0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:33.503470 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8a9603a8-4f43-4232-928b-e1f9e0c429a9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.135161 Nov 02 13:48:33.506829 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 785/1700] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:33 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:33.519785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:33.529354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:33.562538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:33.566641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:33.568992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.571075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:33.571976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:33.574617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.669426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:33.669976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:33.671237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.671959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lazy-loading 'fault' on Instance uuid 2189e303-aa3b-45d9-b133-8b8424b278a6 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:34.103449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:48:34.104345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:48:34.105330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:48:34.106466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:48:34.108251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:48:34.130725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:34.140300 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98c5b405-5c22-4d32-9c37-44322c54d2ce tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 200 len: 1308 microversion: 2.1 time: 0.631263 Nov 02 13:48:34.140748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.141724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.155692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 786/1701] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:33 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:34.155692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a78f175a-59f7-4632-ae2e-600b07696acb req-b10278d5-0110-43ec-b81b-3d8ce6f602d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2189e303-aa3b-45d9-b133-8b8424b278a6", "name": "network-vif-deleted", "tag": "4c695278-f550-4500-97c7-c4be5d963c67"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:34.156423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.158134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.159515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.160566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.180281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a78f175a-59f7-4632-ae2e-600b07696acb req-b10278d5-0110-43ec-b81b-3d8ce6f602d3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.182044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a78f175a-59f7-4632-ae2e-600b07696acb req-b10278d5-0110-43ec-b81b-3d8ce6f602d3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.182562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a78f175a-59f7-4632-ae2e-600b07696acb req-b10278d5-0110-43ec-b81b-3d8ce6f602d3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.195219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:48:34.204111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Getting quotas for user 23d76f5c29444358864d0bc25c83b4b4 and project 89354db644694189ac3ae9ec09e7e786. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:48:34.218399 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a78f175a-59f7-4632-ae2e-600b07696acb req-b10278d5-0110-43ec-b81b-3d8ce6f602d3 service nova] Creating event network-vif-deleted:4c695278-f550-4500-97c7-c4be5d963c67 for instance 2189e303-aa3b-45d9-b133-8b8424b278a6 on n-h2-858238-3 Nov 02 13:48:34.233263 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a78f175a-59f7-4632-ae2e-600b07696acb req-b10278d5-0110-43ec-b81b-3d8ce6f602d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087408 Nov 02 13:48:34.236329 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 787/1702] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:34.247549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:34.248725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:34.261856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.262555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.263929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.265497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.266173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.267611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.294917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:48:34.298638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e4e13e7-dc12-4c5d-a6f5-1078d9acea5c',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:34.528532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:34.538322 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-95942702-695a-44d2-8977-19c7647fe8fa tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1474 microversion: 2.1 time: 0.299069 Nov 02 13:48:34.539449 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 788/1703] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:34 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1474 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:34.545940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:34.546948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:34.555169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.555664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.555782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.556476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.557072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.557470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.580391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-201e71eb-b3c4-4a43-8bcd-c464ad4422ae tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.664269 Nov 02 13:48:34.588836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 916/1704] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:48:34.599028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "name": "network-vif-unplugged", "status": "completed", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:34.648522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.649531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.650197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.669882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] Creating event network-vif-unplugged:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h1-858238-3 Nov 02 13:48:34.713100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:48:34.757245 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-75b86601-96b9-4039-a2a4-8e3c66997288 req-28d00eba-69d4-425d-a6bb-54c3d755754a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162839 Nov 02 13:48:34.759235 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 917/1705] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:34.772751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:34.775416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:34.791610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.793373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.794408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.796709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.798410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.799686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.184281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.197775 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d0ab21a-44df-43e8-94bf-de4ae40d47fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 0.657240 Nov 02 13:48:35.205799 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 789/1706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:34 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:35.227810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:35.232061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:35.257320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.257737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.258257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.259016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.259506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.260134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.305326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.320246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.325898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.332607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-908d20b3-30a4-44ec-b74f-30622ef610f7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.567569 Nov 02 13:48:35.342203 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 918/1707] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:34 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:35.348199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:35.360996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:35.381804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.382643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.383366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.384412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.388984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.389793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.681932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.698620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.707462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.729366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d8dd237-8466-47b0-b03f-b88784847fd1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.372401 Nov 02 13:48:35.733134 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 919/1708] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:35 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:35.741875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-870e3667-70cd-4a60-8715-57188dc54fbc tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e58160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:35.790876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:35.866986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-870e3667-70cd-4a60-8715-57188dc54fbc tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.132710 Nov 02 13:48:35.867781 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 920/1709] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:35 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:35.872362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:35.872981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:35.898513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.901290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.901760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.902513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.903015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.903508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.126016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:36.169982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:36.179210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7d1045e-459c-42e3-8ffb-1bf5b04a2b06 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1103 microversion: 2.1 time: 0.294784 Nov 02 13:48:36.181569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 921/1710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:35 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1103 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:36.183857 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7563709a-5839-42cb-98e6-837b5ada98ce tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1520 microversion: 2.1 time: 0.976871 Nov 02 13:48:36.199622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:36.204439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 2189e303-aa3b-45d9-b133-8b8424b278a6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:36.211324 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 790/1711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:35 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1520 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:36.222460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:36.223443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:36.232287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.240440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.240762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.241288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.241820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.242461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.242968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.251586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.252999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.255033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.255709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.256351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.276483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] HTTP exception thrown: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 could not be found. Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Request method failure captured: Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 HTTP/1.1 Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTZfAihk9tHOWFDskSD7e4wL9I3R1YSMykmX5KHsSQmK092SVwSO48ooklPrJu1MaJ7XwnKH_-KiEpGlwhFi40M1gobIIdO6NMwnHOX9h1dNkKHtNcD77sQ_ExzUI_0pOZYul8w_oNMdrMn1g9GWlY7w9v7xnPIwTVspasCewpDFAI Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 855fbdf05b074d1c866189215a73e31a Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveMigrationNegativeTest-162420294 Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:48:36.278749 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/855fbdf05b074d1c866189215a73e31a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/855fbdf05b074d1c866189215a73e31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/855fbdf05b074d1c866189215a73e31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_855fbdf05b074d1c866189215a73e31a"}]}] Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveMigrationNegativeTest-162420294 Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 855fbdf05b074d1c866189215a73e31a Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-162420294 Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveMigrationNegativeTest-162420294-project Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 50415ac10fc74f0cad0e7af0d2d52b34 Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveMigrationNegativeTest-162420294-project Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 could not be found. Nov 02 13:48:36.280530 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2189e303-aa3b-45d9-b133-8b8424b278a6'} Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 could not be found. Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:36.281514 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 could not be found. Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 could not be found. Nov 02 13:48:36.284900 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:48:36.287953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Returning 404 to user: Instance 2189e303-aa3b-45d9-b133-8b8424b278a6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:36.289028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba1ba439-8167-4913-b220-58997a189457 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6" status: 404 len: 111 microversion: 2.1 time: 0.103264 Nov 02 13:48:36.290123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 922/1712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:36 2022] GET /compute/v2.1/servers/2189e303-aa3b-45d9-b133-8b8424b278a6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:48:36.300234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:36.301625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:36.309288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.310574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.311523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.312530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.313213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.314193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.837363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:36.857162 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8230c10c-3ec0-41f0-a156-c77be9750a83 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1474 microversion: 2.1 time: 0.644177 Nov 02 13:48:36.869835 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 791/1713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:36 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1474 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:36.877298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:36.880508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:36.899443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.900335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.901565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.902550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.903285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.904677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.037161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.049597 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f343b871-1580-4a08-8cf4-a659d72def2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1520 microversion: 2.1 time: 0.758099 Nov 02 13:48:37.051531 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 923/1714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:36 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1520 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:37.064036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:37.084787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.085207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.085629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.103777 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] Creating event network-changed:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h1-858238-3 Nov 02 13:48:37.112109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:48:37.136425 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-acec8040-1ee0-468e-adf9-58559722ea82 req-107b8ad8-5cf0-4273-b029-06b942d61732 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080880 Nov 02 13:48:37.138094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 924/1715] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:37.146283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.147187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.153736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.154468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.155057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.156164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.156919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.157644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.211200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:37.275442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.291303 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dfb8ebc3-91b6-4490-b069-33d18c603827 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 0.419289 Nov 02 13:48:37.303700 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 792/1716] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:36 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:37.316477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.316477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.368097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.369224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.370684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.371671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.374589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.375267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.388832 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f593a731-bcb7-4c24-bc1f-6949df2f211d tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 204 len: 0 microversion: 2.1 time: 0.248821 Nov 02 13:48:37.391276 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 925/1717] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:48:37 2022] DELETE /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:37.397883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.399075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.407827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.408764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.409432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.410407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.411124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.411857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.583647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.602484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.608474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.622758 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b1e5f32-6899-4ef0-85f8-f8e21bc94fe5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1560 microversion: 2.91 time: 0.229489 Nov 02 13:48:37.624544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 926/1718] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:37 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:37.640508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88115d80-5732-4fd0-a48b-dfc717e5627e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85dce160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.706644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.729943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.732105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:37.733630 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8fe7006a-e0aa-41c9-8005-d5f81ba16f70 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.431784 Nov 02 13:48:37.735086 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 793/1719] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:37 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:37.742319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1484868925"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:37.745898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.753757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.754689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.755313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.756174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.756767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.757332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.761302 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88115d80-5732-4fd0-a48b-dfc717e5627e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.134204 Nov 02 13:48:37.762344 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 927/1720] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:37 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:37.774586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.775675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.789171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.790180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.795376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.796242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.799128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.799697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.019454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:38.032897 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1da8d76b-fb79-4d7e-90a9-4d2ecb9b1e1b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1169 microversion: 2.1 time: 0.268512 Nov 02 13:48:38.051186 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 928/1721] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:37 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1169 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:38.057640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:38.061340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:38.076232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.077117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.078269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.081432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.082765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.083438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.184393 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf6835c5-7ba1-425a-805b-48965f894e2c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee/action" status: 202 len: 0 microversion: 2.1 time: 0.447374 Nov 02 13:48:38.189112 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 794/1722] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:37 2022] POST /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:48:38.200312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:38.201026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:38.212042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.217194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.217648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.224086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.224707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.225167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.451383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:38.472680 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-504c9cec-5be7-4634-b32a-d6e9f549dd11 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1472 microversion: 2.1 time: 0.420148 Nov 02 13:48:38.473871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 929/1723] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:38 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:38.478642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6da60528-66db-459f-9845-303053ebf767 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '.version_select at 0x7f6f85df7a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:38.670963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:38.695468 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d1d80baf-6e6a-4488-a3f1-f817bc242b9d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1472 microversion: 2.1 time: 0.502596 Nov 02 13:48:38.696942 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 795/1724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:38 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:38.726924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:38.731703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:38.745087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.745848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.746447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.747567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.748820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.749653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.947730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:38.957343 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-786d6135-60ab-4f7b-8201-76260e8ce9d3 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 0.240108 Nov 02 13:48:38.958118 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 796/1725] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:38 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:38.962713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:38.963343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:38.980237 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6da60528-66db-459f-9845-303053ebf767 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639" status: 204 len: 0 microversion: 2.1 time: 0.504947 Nov 02 13:48:38.981206 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 930/1726] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:38 2022] DELETE /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:38.987326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.987831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.988270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.988984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:38.989450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:38.989867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.996386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7d8183d9-ad56-4d10-b6c9-ba44e88b2921 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85dceee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.137274 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7d8183d9-ad56-4d10-b6c9-ba44e88b2921 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.154413 Nov 02 13:48:39.151189 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 931/1727] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:38 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:39.162077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.175474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:39.193554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.194846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.197669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.199292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.202026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.203533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.324521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.339598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.350167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.359417 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3057fbd0-cf9a-4025-bd19-492aae9e659f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1560 microversion: 2.91 time: 0.400081 Nov 02 13:48:39.362232 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 797/1728] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:38 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1560 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:39.368814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ad10f7bf-36a2-4794-b6ca-4d29ae70a3e6 req-b814710f-231e-427c-8403-c91b9d9ddd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9162009-bf24-46d0-b941-ef08428ff4d9", "name": "network-vif-plugged", "status": "completed", "tag": "32869b38-10e2-4e59-beda-531cdaa3eed1"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:39.393911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ad10f7bf-36a2-4794-b6ca-4d29ae70a3e6 req-b814710f-231e-427c-8403-c91b9d9ddd3f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.394742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ad10f7bf-36a2-4794-b6ca-4d29ae70a3e6 req-b814710f-231e-427c-8403-c91b9d9ddd3f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.395473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ad10f7bf-36a2-4794-b6ca-4d29ae70a3e6 req-b814710f-231e-427c-8403-c91b9d9ddd3f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.417384 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ad10f7bf-36a2-4794-b6ca-4d29ae70a3e6 req-b814710f-231e-427c-8403-c91b9d9ddd3f service nova] Creating event network-vif-plugged:32869b38-10e2-4e59-beda-531cdaa3eed1 for instance d9162009-bf24-46d0-b941-ef08428ff4d9 on n-h1-858238-3 Nov 02 13:48:39.429920 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ad10f7bf-36a2-4794-b6ca-4d29ae70a3e6 req-b814710f-231e-427c-8403-c91b9d9ddd3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061735 Nov 02 13:48:39.431146 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 798/1729] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:39.443530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c5ba97ef-b647-45b5-a90d-7c35d967f235 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '.version_select at 0x7f6f81968a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.488522 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-c5ba97ef-b647-45b5-a90d-7c35d967f235 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Image not found. Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c5ba97ef-b647-45b5-a90d-7c35d967f235 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639 HTTP/1.1 Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:48:39.490737 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: exception: Image not found. Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '4b633c81-efa8-467e-a58c-3ad3227b2639'} Nov 02 13:48:39.492721 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:48:39.493826 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4b633c81-efa8-467e-a58c-3ad3227b2639 Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:48:39.495294 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b633c81-efa8-467e-a58c-3ad3227b2639 could not be found. Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:48:39.496843 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:39.498380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c5ba97ef-b647-45b5-a90d-7c35d967f235 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Image not found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:39.500420 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c5ba97ef-b647-45b5-a90d-7c35d967f235 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639" status: 404 len: 62 microversion: 2.1 time: 0.067837 Nov 02 13:48:39.501922 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 799/1730] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:39 2022] GET /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:48:39.513223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.514188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:39.530559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.531706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.532343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.535932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.536627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.539220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.587268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.591774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:39.610115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.616267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.618776 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e6aad3f-a7d3-4d63-a2c5-c1413720b2e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.465296 Nov 02 13:48:39.622485 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 932/1731] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:39 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:39.631664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.634342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:39.657155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.658626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.661083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.662581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.664297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.666730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.920747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.930289 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-752b2086-0680-47f5-aeab-c27d362ad6c7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1211 microversion: 2.1 time: 0.426073 Nov 02 13:48:39.941928 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 800/1732] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:39 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1211 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:39.957458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.960312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:39.979008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.981865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.986267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.988974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.989499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.989947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.197825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:40.212199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:40.213913 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-531c90a1-ba05-4490-81b6-091c6be4bf4c tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1472 microversion: 2.1 time: 0.589783 Nov 02 13:48:40.214782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 933/1733] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:39 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:40.225385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:40.225385 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-565568d7-aa94-4776-b862-cb5d15e1fe5b tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1540 microversion: 2.1 time: 0.278020 Nov 02 13:48:40.225385 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 801/1734] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:39 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1540 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:40.228654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:40.228945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:40.242871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.243394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.243832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.245043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.245529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.246045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.246620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:40.250666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:40.269190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.269713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.270319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.271216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.271985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.272435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.464206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:40.477200 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-de5e2cf5-dc81-43d4-997f-be007c345563 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1472 microversion: 2.1 time: 0.252852 Nov 02 13:48:40.494154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 802/1735] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:40 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:40.494154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ee641c7-ddf3-46b7-a011-a3426f1b76e6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a23f70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:40.600279 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ee641c7-ddf3-46b7-a011-a3426f1b76e6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.120339 Nov 02 13:48:40.611238 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 803/1736] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:40 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:40.622867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:40.624388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:40.650408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.655503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.656119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.662698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.663387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.663938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.882226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:40.907212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:40.909609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:40.920796 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c6de36be-c757-4565-8bda-496878ef1d79 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1560 microversion: 2.91 time: 0.307171 Nov 02 13:48:40.945561 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 804/1737] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:40 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:40.958015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:40.958941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:40.987386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:40.991668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:40.993694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:40.994630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.000076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.000923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.291135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:41.301870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f88252d4-25e5-4b93-88aa-607fb640276e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 1.065565 Nov 02 13:48:41.312227 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 934/1738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:40 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:41.318440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:41.319364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:41.344080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.344903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.345510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.346408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.347019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.347836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.538878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:41.552982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:41.559362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:41.566571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1eabdd3-44ea-4f84-a890-d868dd4f58be tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.619492 Nov 02 13:48:41.579919 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 805/1739] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:40 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:41.594539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:41.598568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:41.605644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.606498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.607137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.608349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.608965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.609774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.841747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:41.852545 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-efbece30-bd8d-431f-88d7-50b308ab05b9 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1472 microversion: 2.1 time: 0.271112 Nov 02 13:48:41.853926 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 806/1740] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:41 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:41.859412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:41.860934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:41.868332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.869374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.870149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.871608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.872642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.873465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.139589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:42.149947 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e8c2632-7489-4720-b137-7de33a673b1e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1532 microversion: 2.1 time: 0.294417 Nov 02 13:48:42.165785 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 807/1741] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:41 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1532 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:42.184206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:42.189068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f651e0-b174-40a4-ae6e-02581828ae37", "name": "network-vif-plugged", "status": "completed", "tag": "d2835ec8-7a8c-4ee0-b7c9-48187ef8d1f5"}, {"server_uuid": "49590101-83f7-4aa2-a3ca-ea29a1e877e0", "name": "network-vif-plugged", "status": "completed", "tag": "cb9bb33b-1c03-487c-9894-328a5e4e71e8"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:42.199762 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b50c5d2c-1e2f-421e-bf4a-a2093d20cbe2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1211 microversion: 2.1 time: 0.884006 Nov 02 13:48:42.217326 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 935/1742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:41 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1211 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:42.232626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:42.233501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:42.239861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.240526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.240967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.253471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.253992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.256303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.257598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.260444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.261047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.272973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] Creating event network-vif-plugged:d2835ec8-7a8c-4ee0-b7c9-48187ef8d1f5 for instance 85f651e0-b174-40a4-ae6e-02581828ae37 on n-h2-858238-3 Nov 02 13:48:42.276864 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] Creating event network-vif-plugged:cb9bb33b-1c03-487c-9894-328a5e4e71e8 for instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 on n-h2-858238-3 Nov 02 13:48:42.294669 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-eefc473e-3d2e-4598-b214-161f4308a5f7 req-05c27747-b19f-4f2b-9202-253c2088030e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125855 Nov 02 13:48:42.296888 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 808/1743] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:42.312588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-450f20e3-708f-4e44-855a-aba813bc6bca tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a28430>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:42.385867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-450f20e3-708f-4e44-855a-aba813bc6bca tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1453 microversion: 2.1 time: 0.084654 Nov 02 13:48:42.387838 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 809/1744] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:42 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:42.394909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:42.396117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:42.406277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.408131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.408909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.410319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.411130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.411861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.527169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:42.539029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:42.540999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:42.547292 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9115330-1996-4602-ab15-77e06a17a7b2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.157655 Nov 02 13:48:42.559570 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 810/1745] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:42 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:42.581398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e96d6d1f-6a94-46ec-8ad7-bd020720174e req-a3ca33b1-8b4f-43b4-801a-510cf3b481af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e488881-f0fd-4003-8123-191cb92828d2", "tag": "6fed398e-5731-4b96-a8ff-6f32125ca657"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:42.596296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e96d6d1f-6a94-46ec-8ad7-bd020720174e req-a3ca33b1-8b4f-43b4-801a-510cf3b481af service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.597054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e96d6d1f-6a94-46ec-8ad7-bd020720174e req-a3ca33b1-8b4f-43b4-801a-510cf3b481af service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.597680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e96d6d1f-6a94-46ec-8ad7-bd020720174e req-a3ca33b1-8b4f-43b4-801a-510cf3b481af service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.629842 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e96d6d1f-6a94-46ec-8ad7-bd020720174e req-a3ca33b1-8b4f-43b4-801a-510cf3b481af service nova] Creating event network-changed:6fed398e-5731-4b96-a8ff-6f32125ca657 for instance 6e488881-f0fd-4003-8123-191cb92828d2 on n-h2-858238-3 Nov 02 13:48:42.638658 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e96d6d1f-6a94-46ec-8ad7-bd020720174e req-a3ca33b1-8b4f-43b4-801a-510cf3b481af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077656 Nov 02 13:48:42.643028 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 811/1746] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:42.656182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:42.657142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:42.664399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.667809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.668481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.669616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.671703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.672369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.812030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:42.823755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e84313d-8de9-4c19-b66a-489ce44a2343 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1469 microversion: 2.1 time: 0.604899 Nov 02 13:48:42.824347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 936/1747] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:42 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:42.851332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:42.854034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:42.881424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.882299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.883367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.884465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.885263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.886009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.148135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:43.157503 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c6bdb1b-25ce-4415-ae46-1447b423668a tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1322 microversion: 2.1 time: 0.513008 Nov 02 13:48:43.168193 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 812/1748] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:42 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:43.185646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:43.186079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:43.209192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.209682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.210111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.210840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.211320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.211746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.322475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:43.369379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:43.370850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:43.374778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fd78ba1-fd42-49cf-b776-1f3eb90fe8e1 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.532176 Nov 02 13:48:43.375689 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 937/1749] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:42 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:43.388583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:43.389951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:43.420682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.421460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.424826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.427822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.433950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.436042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.542191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.542672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.543121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.552174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lazy-loading 'fault' on Instance uuid 4c2e512c-f818-41aa-8522-652eb4c54405 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:43.595345 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f69b2067-9435-4373-be42-3e8e85660f18 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "POST /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099/action" status: 202 len: 0 microversion: 2.1 time: 0.423351 Nov 02 13:48:43.599318 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 813/1750] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:43 2022] POST /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:48:43.633958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:43.636286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:43.668996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.673518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.674240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.676921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.679279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.681032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.703494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50415ac10fc74f0cad0e7af0d2d52b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855fbdf05b074d1c866189215a73e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:43.715133 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-592fb9bd-90f0-43c1-a634-a9a6437e51ff tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 200 len: 1308 microversion: 2.1 time: 0.336214 Nov 02 13:48:43.725422 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 938/1751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:43 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:43.740677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:43.741531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:43.754151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.754927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.755700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.756715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:43.757335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:43.758147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:44.183188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:44.218813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:44.305907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:44.319046 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-15714c9d-7065-43bd-8fb8-32c903afe9b1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1538 microversion: 2.1 time: 0.718149 Nov 02 13:48:44.322297 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 814/1752] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:43 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1538 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:44.338161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f81cb704-63a8-4d4e-ac20-1858cd86596d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f819ed550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:44.391208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:44.415830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4732ad01-fd84-42af-957d-1262e35ae16e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1211 microversion: 2.1 time: 0.688403 Nov 02 13:48:44.424302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 939/1753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:43 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1211 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:44.430297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:44.442678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:44.471703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:44.473484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:44.475296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:44.476422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:44.477099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:44.486344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:44.671343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:44.721912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:44.727695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:44.749824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7437856a-8c0c-4c84-86c3-cdb3885e716b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.323455 Nov 02 13:48:44.752891 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 940/1754] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:44 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:44.779197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:44.786210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:44.804657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:44.805573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:44.806180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:44.807360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:44.808374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:44.809041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:46.905168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:46.923426 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f2bf6c3-a2cb-47d6-823a-590a623ea467 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 2.161677 Nov 02 13:48:46.934609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 941/1755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:44 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:46.947558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:46.951783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:46.974844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:46.975733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:46.976565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:46.977606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:46.978279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:46.978923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.081954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:48.102046 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-97b8272b-f475-4ee2-bec0-2c870e2e7894 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1513 microversion: 2.1 time: 1.165754 Nov 02 13:48:48.104186 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 942/1756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:46 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1513 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:48.119687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "name": "network-vif-plugged", "status": "completed", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:48.174590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.176867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.177753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.204891 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] Creating event network-vif-plugged:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h1-858238-3 Nov 02 13:48:48.214266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:48:48.234962 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-592d22cc-7f16-4314-9b2a-30d4cae9f9b0 req-686ff0dd-89d1-40b1-acd0-524ed623d974 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127872 Nov 02 13:48:48.236403 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 943/1757] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:48.242746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-41934492-d1d1-450b-9128-5d23b8a2a180 req-37a4e8d7-647a-45be-a414-b71fc43324a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28579980-d489-4bff-a1cb-dcadca8bd5ee", "name": "network-vif-unplugged", "status": "completed", "tag": "a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:48.254683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-41934492-d1d1-450b-9128-5d23b8a2a180 req-37a4e8d7-647a-45be-a414-b71fc43324a7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.255217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-41934492-d1d1-450b-9128-5d23b8a2a180 req-37a4e8d7-647a-45be-a414-b71fc43324a7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.255679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-41934492-d1d1-450b-9128-5d23b8a2a180 req-37a4e8d7-647a-45be-a414-b71fc43324a7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.284143 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-41934492-d1d1-450b-9128-5d23b8a2a180 req-37a4e8d7-647a-45be-a414-b71fc43324a7 service nova] Creating event network-vif-unplugged:a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec for instance 28579980-d489-4bff-a1cb-dcadca8bd5ee on n-h1-858238-3 Nov 02 13:48:48.296869 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-41934492-d1d1-450b-9128-5d23b8a2a180 req-37a4e8d7-647a-45be-a414-b71fc43324a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058140 Nov 02 13:48:48.298774 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 944/1758] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:48.315931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:48.317162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:48.327464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.328681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.329466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.330828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.338409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.339590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.343249 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f81cb704-63a8-4d4e-ac20-1858cd86596d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1462 microversion: 2.1 time: 4.018676 Nov 02 13:48:48.353527 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 815/1759] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:44 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1462 bytes in 4030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:48.359569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5877637e-c221-432c-b5e2-1b4fbdf4f528 req-56747c73-6377-4784-882c-c712d5d302ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e512c-f818-41aa-8522-652eb4c54405", "name": "network-vif-deleted", "tag": "c366bf54-38b8-4690-a336-bf28511ac499"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:48.373849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5877637e-c221-432c-b5e2-1b4fbdf4f528 req-56747c73-6377-4784-882c-c712d5d302ca service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.374369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5877637e-c221-432c-b5e2-1b4fbdf4f528 req-56747c73-6377-4784-882c-c712d5d302ca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.374813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5877637e-c221-432c-b5e2-1b4fbdf4f528 req-56747c73-6377-4784-882c-c712d5d302ca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.389037 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5877637e-c221-432c-b5e2-1b4fbdf4f528 req-56747c73-6377-4784-882c-c712d5d302ca service nova] Creating event network-vif-deleted:c366bf54-38b8-4690-a336-bf28511ac499 for instance 4c2e512c-f818-41aa-8522-652eb4c54405 on n-h1-858238-3 Nov 02 13:48:48.394986 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5877637e-c221-432c-b5e2-1b4fbdf4f528 req-56747c73-6377-4784-882c-c712d5d302ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040051 Nov 02 13:48:48.396275 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 816/1760] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:48.411879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:48.420032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] [instance: 4c2e512c-f818-41aa-8522-652eb4c54405] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:48.429203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.430356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.431008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.431967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.432640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.433241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.449387 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] HTTP exception thrown: Instance 4c2e512c-f818-41aa-8522-652eb4c54405 could not be found. Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Request method failure captured: Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 HTTP/1.1 Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTZfAihk9tHOWFDskSD7e4wL9I3R1YSMykmX5KHsSQmK092SVwSO48ooklPrJu1MaJ7XwnKH_-KiEpGlwhFi40M1gobIIdO6NMwnHOX9h1dNkKHtNcD77sQ_ExzUI_0pOZYul8w_oNMdrMn1g9GWlY7w9v7xnPIwTVspasCewpDFAI Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 855fbdf05b074d1c866189215a73e31a Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-LiveMigrationNegativeTest-162420294 Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:48:48.451827 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/855fbdf05b074d1c866189215a73e31a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/855fbdf05b074d1c866189215a73e31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/855fbdf05b074d1c866189215a73e31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_855fbdf05b074d1c866189215a73e31a"}]}] Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-LiveMigrationNegativeTest-162420294 Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 855fbdf05b074d1c866189215a73e31a Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-162420294 Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-LiveMigrationNegativeTest-162420294-project Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 50415ac10fc74f0cad0e7af0d2d52b34 Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-LiveMigrationNegativeTest-162420294-project Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 4c2e512c-f818-41aa-8522-652eb4c54405 could not be found. Nov 02 13:48:48.453571 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '4c2e512c-f818-41aa-8522-652eb4c54405'} Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2e512c-f818-41aa-8522-652eb4c54405 could not be found. Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:48.454590 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2e512c-f818-41aa-8522-652eb4c54405 could not be found. Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2e512c-f818-41aa-8522-652eb4c54405 could not be found. Nov 02 13:48:48.456431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:48:48.459268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] Returning 404 to user: Instance 4c2e512c-f818-41aa-8522-652eb4c54405 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:48.461021 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c47e6b4e-1169-4a8e-80b0-8ee6ed43ed86 tempest-LiveMigrationNegativeTest-162420294 tempest-LiveMigrationNegativeTest-162420294-project] 10.222.0.18 "GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405" status: 404 len: 111 microversion: 2.1 time: 0.062924 Nov 02 13:48:48.465248 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 817/1761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:48 2022] GET /compute/v2.1/servers/4c2e512c-f818-41aa-8522-652eb4c54405 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:48:48.472360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:48.474594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:48.482358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.483322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.484008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.485054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.486393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.487082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.607235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:48.620057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:48.621840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:48.623602 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fca5dda-c738-4430-8e6c-753023876132 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.322078 Nov 02 13:48:48.624737 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 945/1762] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:48 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:48.650091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:48.651559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:48.671380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.672265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.673048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.680416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.681436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.682664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.823481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:48.835252 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-691200eb-75a1-4bcb-b537-8d1c3ab0ed23 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1533 microversion: 2.1 time: 0.368160 Nov 02 13:48:48.836318 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 818/1763] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:48 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1533 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:48.842693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:48.843679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:48.853773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.855179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.855970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.858988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.859858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.860727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.028179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.059913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.061744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.064489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.071612 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e639f262-000c-4437-b5f1-37988b853be1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1211 microversion: 2.1 time: 0.436543 Nov 02 13:48:49.072864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 946/1764] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:48 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1211 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:49.083883 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79905fbc-3aaa-4636-bb1f-5b678c8def21 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.245938 Nov 02 13:48:49.097387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:49.098147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 819/1765] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:48 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:49.101319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:49.113279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:49.114698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:49.118062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.118833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.120247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.126234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.127173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.127625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.135389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.138124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.139333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.140438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.142394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.143357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.353188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.364711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d6b7f51-693c-4ae9-a70a-71e5ec5b7a39 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 0.290159 Nov 02 13:48:49.365712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 947/1766] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:49 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:49.402657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e4f5c4b-7321-4ef4-897f-7c5e7b64a56d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e49280>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:49.462512 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e4f5c4b-7321-4ef4-897f-7c5e7b64a56d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 200 len: 1462 microversion: 2.1 time: 0.064691 Nov 02 13:48:49.474368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 948/1767] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:49 2022] GET /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 1462 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:49.480322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:49.481350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:49.489786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.490651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.491771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.493583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.495081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.496263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.502273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.538683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a5e454b-fca5-44cc-b48f-24301ac48884 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9" status: 200 len: 1513 microversion: 2.1 time: 0.429890 Nov 02 13:48:49.539862 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 820/1768] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:49 2022] GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:49.579523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:49.581378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:49.592569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.594240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.599977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.601973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.603221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.604403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.800867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.857391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e68225fb-4c04-47c3-b507-522325d78e02 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1480 microversion: 2.1 time: 0.381200 Nov 02 13:48:49.866934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 949/1769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:49 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1480 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:49.894188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:49.907708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:49.932184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.934270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.934792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.935819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:49.938825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:49.940580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.080235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.118858 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a143894-6515-4963-896a-97fcc3d7ce10 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 200 len: 1514 microversion: 2.1 time: 0.546672 Nov 02 13:48:50.119528 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 821/1770] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:49 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 1514 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:50.153488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:50.156872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:50.177291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.177778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.178249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.179006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.179506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.184396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.267222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:50.381770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.400637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.402161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.403552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-043e25ed-d0b4-4ce5-8ecb-088def6d27e7 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.531243 Nov 02 13:48:50.409760 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 950/1771] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:49 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:50.431591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:50.436138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:50.450156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.451534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.452170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.453094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.453750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.454408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.460737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:50.573297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.592750 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eedbca65-6494-4357-83e4-394cd74a996c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1533 microversion: 2.1 time: 0.447950 Nov 02 13:48:50.608639 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 822/1772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:50 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1533 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:50.625946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:50.626910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:50.638546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.639397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.640171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.641864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.642540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.643197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.662219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.672300 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30f2b502-7f8a-41aa-85b0-b7b4291ec5d1 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 0.260683 Nov 02 13:48:50.693929 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 951/1773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:50 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:50.700980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:50.701785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:50.707591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:50.713217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.714131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.714950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.716492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.717341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.718152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.761315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:50.767243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.782886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.784997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:50.793028 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6242bbed-cc65-42b2-b3de-2b62409e836c tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.171962 Nov 02 13:48:50.794290 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 823/1774] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:50 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:50.802389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-712da314-e0c3-4e87-9ec0-a66161dbf398 req-b4ceb950-bf34-48ec-8f66-fdac110ed8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0640dee1-2b77-42c1-8eb8-a2217a3b54ee", "name": "network-vif-plugged", "status": "completed", "tag": "48054201-47b9-4acf-adf1-f585f6d2e1e4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:50.819075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-712da314-e0c3-4e87-9ec0-a66161dbf398 req-b4ceb950-bf34-48ec-8f66-fdac110ed8d7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.823529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-712da314-e0c3-4e87-9ec0-a66161dbf398 req-b4ceb950-bf34-48ec-8f66-fdac110ed8d7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.824164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-712da314-e0c3-4e87-9ec0-a66161dbf398 req-b4ceb950-bf34-48ec-8f66-fdac110ed8d7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.843037 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-712da314-e0c3-4e87-9ec0-a66161dbf398 req-b4ceb950-bf34-48ec-8f66-fdac110ed8d7 service nova] Creating event network-vif-plugged:48054201-47b9-4acf-adf1-f585f6d2e1e4 for instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee on n-h1-858238-3 Nov 02 13:48:50.850340 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-712da314-e0c3-4e87-9ec0-a66161dbf398 req-b4ceb950-bf34-48ec-8f66-fdac110ed8d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054189 Nov 02 13:48:50.851406 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 824/1775] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:50.857134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8760fb71-a2a0-495e-aecb-80c86d73de4a req-964216f3-ca4c-4882-81e6-cf59255a9d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28579980-d489-4bff-a1cb-dcadca8bd5ee", "tag": "a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:50.868864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8760fb71-a2a0-495e-aecb-80c86d73de4a req-964216f3-ca4c-4882-81e6-cf59255a9d80 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.869546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8760fb71-a2a0-495e-aecb-80c86d73de4a req-964216f3-ca4c-4882-81e6-cf59255a9d80 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.870039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8760fb71-a2a0-495e-aecb-80c86d73de4a req-964216f3-ca4c-4882-81e6-cf59255a9d80 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.893136 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8760fb71-a2a0-495e-aecb-80c86d73de4a req-964216f3-ca4c-4882-81e6-cf59255a9d80 service nova] Creating event network-changed:a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec for instance 28579980-d489-4bff-a1cb-dcadca8bd5ee on n-h1-858238-3 Nov 02 13:48:50.907733 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8760fb71-a2a0-495e-aecb-80c86d73de4a req-964216f3-ca4c-4882-81e6-cf59255a9d80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054099 Nov 02 13:48:50.912158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 825/1776] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:50.934346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:50.935723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:50.948210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:50.953399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.954220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.954887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.956158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.956886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.959433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.991035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb24df6f-bcb6-4053-9d4a-0b66753b6b05 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "DELETE /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 204 len: 0 microversion: 2.1 time: 0.295166 Nov 02 13:48:50.995789 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 952/1777] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:48:50 2022] DELETE /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:51.010039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:51.010371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:51.027429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.028245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.031712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.036985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.036985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.037945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.393913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:51.418749 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-67a93dc2-8118-4aaa-adf6-b6ddc77b9c37 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 0.500155 Nov 02 13:48:51.436603 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 826/1778] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:50 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:51.441752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:51.442402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:51.449824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.450320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.450764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.451622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.452085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.452873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.738579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:51.765200 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29a80b58-9db3-4cc0-859d-cc60e88ceca4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 200 len: 1520 microversion: 2.1 time: 0.327716 Nov 02 13:48:51.766636 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 827/1779] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:51 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:51.770220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:51.774511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:51.776185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:51.785825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.786510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.787246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.788438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.789156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.790179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.835559 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7bdc116d-df83-4967-add7-1f957e33ea67 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1467 microversion: 2.1 time: 0.808591 Nov 02 13:48:51.835559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 953/1780] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:50 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1467 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:51.868297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:51.871900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:51.889628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.890579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.891430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.892674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:51.893404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:51.894572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.118747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.119998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.123277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.126049 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c3c974ad-9ccf-4184-81db-faefe8e2913c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.356916 Nov 02 13:48:52.127822 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 828/1781] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:51 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:52.134960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:52.135549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:52.153127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.155807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.158037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.160129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.161462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.163671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.225891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.236792 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e33e225-dfd5-4dd7-bfca-9005a7801e3c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1520 microversion: 2.1 time: 0.404708 Nov 02 13:48:52.255272 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 954/1782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:51 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:52.286127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:52.286874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:52.307454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.308637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.309682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.311263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.312340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.313372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.442363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.458920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.463508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.475089 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76abf073-40f2-4a4c-922a-820c47a48350 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.209238 Nov 02 13:48:52.476316 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 955/1783] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:52 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:52.482501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1530990156"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:52.485118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:52.507002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.507875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.508493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.510560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.512870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.513729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.527818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:52.554533 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-faec2804-e9b0-4dd7-b407-51a161376ada tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 0.425171 Nov 02 13:48:52.563341 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 829/1784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:52 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:52.577890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:52.582605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:52.613595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.614366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.614865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.616123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.616919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.617477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.681792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:52.945718 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1f1d9f2e-03a9-4ba9-83de-a02394d5962c tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 204 len: 0 microversion: 2.1 time: 0.379287 Nov 02 13:48:52.952643 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 830/1785] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:48:52 2022] DELETE /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:52.973049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:52.974769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:53.000465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.015422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.017340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.024435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.025608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.028311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.087589 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-803e2e4c-ce0c-4892-8a67-7cc4a54aa965 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "POST /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb/action" status: 202 len: 0 microversion: 2.1 time: 0.609720 Nov 02 13:48:53.096117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 956/1786] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:48:52 2022] POST /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:48:53.104134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:53.105221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:53.122306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.126425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.128108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.129115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.131624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.136070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.410031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:53.423325 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c5759bf4-ce12-4dc4-88b8-594d48977110 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 0.469208 Nov 02 13:48:53.435200 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 831/1787] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:52 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:53.435200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:53.435200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:53.439152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.439152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.439986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.439986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.440407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.440959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.755431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:53.779063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:53.785440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b707491-73b4-44bf-840f-262d565a88fd tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 200 len: 1520 microversion: 2.1 time: 0.686719 Nov 02 13:48:53.793056 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 957/1788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:53 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 1520 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:53.801432 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38bfe0a8-c5a8-438e-9f4a-d185766a10ef tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1526 microversion: 2.1 time: 0.375142 Nov 02 13:48:53.809887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0701bcd2-87aa-4e67-a3a7-c11870cca117 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e58310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:53.835834 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 832/1789] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:53 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1526 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:53.844561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:53.845970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:53.872441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.873967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.877935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.879450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.880252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.882070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.932708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0701bcd2-87aa-4e67-a3a7-c11870cca117 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.135142 Nov 02 13:48:53.935929 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 958/1790] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:53 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:53.952828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:53.953463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:53.971599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.972447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.977836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.979686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:53.980261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:53.980711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.253577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.269569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.275058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.304944 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-384cac12-27cf-43f6-95f8-8be927ebe0db tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.367280 Nov 02 13:48:54.335892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 959/1791] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:53 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:54.360976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:54.361628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:54.375483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.377169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.390007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.392537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.396380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.399553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.497120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.535849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.562224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.569628 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-674dc9f6-b58f-4c12-8336-e88c4ffc7eb6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.726304 Nov 02 13:48:54.607282 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 833/1792] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:53 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:54.626377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ffec7ccf-6239-44b8-9ac1-fbfe59e13cad req-54e52982-c641-416c-b09f-709604e4cd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0640dee1-2b77-42c1-8eb8-a2217a3b54ee", "name": "network-vif-unplugged", "status": "completed", "tag": "48054201-47b9-4acf-adf1-f585f6d2e1e4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:54.667293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ffec7ccf-6239-44b8-9ac1-fbfe59e13cad req-54e52982-c641-416c-b09f-709604e4cd43 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.674079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ffec7ccf-6239-44b8-9ac1-fbfe59e13cad req-54e52982-c641-416c-b09f-709604e4cd43 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.674775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ffec7ccf-6239-44b8-9ac1-fbfe59e13cad req-54e52982-c641-416c-b09f-709604e4cd43 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.717772 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ffec7ccf-6239-44b8-9ac1-fbfe59e13cad req-54e52982-c641-416c-b09f-709604e4cd43 service nova] Creating event network-vif-unplugged:48054201-47b9-4acf-adf1-f585f6d2e1e4 for instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee on n-h1-858238-3 Nov 02 13:48:54.749997 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ffec7ccf-6239-44b8-9ac1-fbfe59e13cad req-54e52982-c641-416c-b09f-709604e4cd43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140244 Nov 02 13:48:54.754951 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 834/1793] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:54.778272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:54.779855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:54.795065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.799920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.800787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.802222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.808113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.809013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.979431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.008497 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d29abe5-9277-40e5-b296-fd2f1485d164 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 0.670829 Nov 02 13:48:55.015618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 960/1794] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:54 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:55.059324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:55.061049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:55.098226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.100526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.103779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.107705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.111377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.113025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.138958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.178259 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b21aa967-a92a-42b6-a2d3-aea5684719dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 0.418610 Nov 02 13:48:55.181878 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 835/1795] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:54 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:55.209524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:55.211220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:55.247404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.248208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.248990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.254428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.255386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.256155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.821906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.864852 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b98d9183-9517-4391-b7eb-efbc1ee94fd1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1526 microversion: 2.1 time: 0.675349 Nov 02 13:48:55.868931 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 836/1796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:55 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1526 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:55.892666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bb6d2f4b-6949-46f7-add5-fe26e08c9dd9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81918310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:55.989474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.009868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5af4a33-9f0b-4630-aa87-ca8bd8439d1d tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 200 len: 1520 microversion: 2.1 time: 0.991791 Nov 02 13:48:56.024286 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 961/1797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:55 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 1520 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:56.058179 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bb6d2f4b-6949-46f7-add5-fe26e08c9dd9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.179639 Nov 02 13:48:56.074143 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 837/1798] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:55 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:56.104261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:56.113122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.154218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.154741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.156348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.159149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.159649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.160087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.361558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52f6a4a3-ab4a-40f2-aaf8-bfc0c2bcc49f tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Calling method '.version_select at 0x7f6f85d9ea60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:56.436194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.462374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.491906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.509029 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cb08fc28-6cd5-4e85-b9d5-e42bdbc4ff83 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.432502 Nov 02 13:48:56.524659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52f6a4a3-ab4a-40f2-aaf8-bfc0c2bcc49f tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 371 microversion: 2.1 time: 0.498081 Nov 02 13:48:56.537961 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 962/1799] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:48:56 2022] GET /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 371 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:56.545303 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 838/1800] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:56 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:56.546601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:56.548564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.561426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.562653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.563626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.564844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.565538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.566212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.578175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:56.595395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.624749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.625271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.632106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.638536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.644043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.647035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:57.217942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:57.250062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:57.258495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:57.268548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14a7983a-8e29-4de6-97c7-e54805c2c63a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 0.725202 Nov 02 13:48:57.295638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 963/1801] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:56 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:57.306426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:57.311967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:57.330992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:57.332873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:57.336691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:57.339836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:57.343367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:57.344411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.002691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:58.045000 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1ea90a33-052a-4d1d-934b-771998ae8a1a tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 1.486619 Nov 02 13:48:58.045866 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 839/1802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:56 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:58.072389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Action: 'update', calling method: .version_select at 0x7f6f81900b80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:58.296637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:58.308488 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8abbf61b-351b-48f0-b811-d21fd707dd58 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 1.011213 Nov 02 13:48:58.339766 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 964/1803] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:57 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:58.375277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.376981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.377661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.378738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.380330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.381980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.433570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6225cba5-1f32-40c4-b619-eec45c381a16", "name": "network-vif-unplugged", "status": "completed", "tag": "b96607a2-d826-4bdb-a6b2-8b1e483d9f83"}, {"server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "name": "network-vif-unplugged", "status": "completed", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:58.453806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.456042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.457743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.492482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Creating event network-vif-unplugged:b96607a2-d826-4bdb-a6b2-8b1e483d9f83 for instance 6225cba5-1f32-40c4-b619-eec45c381a16 on n-h1-858238-3 Nov 02 13:48:58.493518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Creating event network-vif-unplugged:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h2-858238-3 Nov 02 13:48:58.509063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:48:58.545119 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-67d19ec9-aa40-43d9-960a-078c192739d6 req-f57ec609-a7cc-4ee3-baf9-fe1851734807 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.192379 Nov 02 13:48:58.546215 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 965/1804] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:58.566088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:58.569214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:58.583696 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3d7a0228-1802-41f7-b467-41d7e6594cc0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 328 microversion: 2.1 time: 0.532916 Nov 02 13:48:58.594558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.600020 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 840/1805] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:48:58 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 328 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:58.602495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.605684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.612127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.615540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.622273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.629861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a1a71ff6-78fc-486a-bf14-782e35ad69c8 req-2bf7472e-a29a-4554-8309-98dd0c1c4ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f651e0-b174-40a4-ae6e-02581828ae37", "name": "network-vif-deleted", "tag": "d2835ec8-7a8c-4ee0-b7c9-48187ef8d1f5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:58.679698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a1a71ff6-78fc-486a-bf14-782e35ad69c8 req-2bf7472e-a29a-4554-8309-98dd0c1c4ef0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.684589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a1a71ff6-78fc-486a-bf14-782e35ad69c8 req-2bf7472e-a29a-4554-8309-98dd0c1c4ef0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.687656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a1a71ff6-78fc-486a-bf14-782e35ad69c8 req-2bf7472e-a29a-4554-8309-98dd0c1c4ef0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.750883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:58.770120 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a1a71ff6-78fc-486a-bf14-782e35ad69c8 req-2bf7472e-a29a-4554-8309-98dd0c1c4ef0 service nova] Creating event network-vif-deleted:d2835ec8-7a8c-4ee0-b7c9-48187ef8d1f5 for instance 85f651e0-b174-40a4-ae6e-02581828ae37 on n-h2-858238-3 Nov 02 13:48:58.819411 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a1a71ff6-78fc-486a-bf14-782e35ad69c8 req-2bf7472e-a29a-4554-8309-98dd0c1c4ef0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216193 Nov 02 13:48:58.832042 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 841/1806] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:58.859143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.860079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.861404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.862265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lazy-loading 'fault' on Instance uuid 0640dee1-2b77-42c1-8eb8-a2217a3b54ee {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:58.881092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:58.887730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:58.964863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.965813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.972600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.977423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.985124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.989189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.132245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:59.151921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:59.163159 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae9485e6-82c3-4ce4-84d0-81ae306f657e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 200 len: 1314 microversion: 2.1 time: 0.613276 Nov 02 13:48:59.169860 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 966/1807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:58 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:59.198041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7119dbfd-6bf0-4126-957c-e52e8204af23 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81364ee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:59.233537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.248178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.249243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.253061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lazy-loading 'fault' on Instance uuid 85f651e0-b174-40a4-ae6e-02581828ae37 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:59.558484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7119dbfd-6bf0-4126-957c-e52e8204af23 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.385732 Nov 02 13:48:59.563661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 967/1808] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:48:59 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:59.587956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:59.589443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:59.620184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.621047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.621780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.628914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.630082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.630362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.772517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:59.800006 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-43a3517d-41fe-40dc-a536-838cdbfe6590 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 200 len: 1312 microversion: 2.1 time: 0.963244 Nov 02 13:48:59.802205 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 842/1809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:58 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 1312 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:59.811784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:59.813320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:59.836371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.837682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.838797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.843867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.845718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.852585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.869263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:59.887525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:59.900783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:59.928896 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-51a7dfc2-a209-40d8-8170-ef0d076ad253 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.359624 Nov 02 13:48:59.943124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 968/1810] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:59 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:59.960510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:00.007413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:00.008437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:00.009225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:00.056631 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] Creating event network-changed:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h2-858238-3 Nov 02 13:49:00.086026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:49:00.121870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-91de18e4-d5e4-4af2-8996-08478555acc9 req-6d45211d-c905-41cf-b71e-69975182248d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187892 Nov 02 13:49:00.128201 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 969/1811] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:00.438809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-507472091", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:01.575490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:01.658497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:01.662276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:01.671631 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7cff662e-ebef-4c06-94b6-904775145470 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1485 microversion: 2.25 time: 1.867030 Nov 02 13:49:01.673341 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 843/1812] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:48:59 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1485 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:01.697867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:01.745813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:01.786940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:01.788071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:01.790717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:01.793296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:01.800277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:01.801454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:02.626487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:02.674556 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0880714d-45bd-40dc-88cf-8ee0b578ef59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 0.995628 Nov 02 13:49:02.704777 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 844/1813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:01 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:02.736508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:02.738207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:02.784078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:02.785520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:02.786529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:02.788178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:02.793004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:02.794233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.489461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:03.511738 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c39ab3f-43f4-47e6-b148-3e900575530e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1468 microversion: 2.1 time: 0.804811 Nov 02 13:49:03.514543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 845/1814] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:02 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1468 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:03.520274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:03.521243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:03.557965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:03.558576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:03.559121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.559838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:03.560302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:03.560726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.609400 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee HTTP/1.1 Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:03.611689 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:03.613300 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '0640dee1-2b77-42c1-8eb8-a2217a3b54ee'} Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:03.614175 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:03.615606 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:03.617484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:03.617484 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8008f754-e631-4ef8-83c4-3416ea932de5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 404 len: 111 microversion: 2.1 time: 0.097063 Nov 02 13:49:03.631201 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 846/1815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:03 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:03.650732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-17dae17b-14a5-4139-9cb3-bdd0bb5a509e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f819a9550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:06.515553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:08.294512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:49:08.313843 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-17dae17b-14a5-4139-9cb3-bdd0bb5a509e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 4.692582 Nov 02 13:49:08.329285 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 847/1816] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:03 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 4710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:08.340246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:08.341181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:08.357718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.358234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.358679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.359626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.360247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.361443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.381034 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] HTTP exception thrown: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 HTTP/1.1 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:08.384144 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:08.386105 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '85f651e0-b174-40a4-ae6e-02581828ae37'} Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:08.387234 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:08.389003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.390590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 404 to user: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:08.390590 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2ef29eee-d41c-4bbe-b649-d9e6740ee279 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 404 len: 111 microversion: 2.1 time: 0.055413 Nov 02 13:49:08.393889 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 848/1817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:08 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:08.399292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d9644a79-390e-44f2-84e5-b2a29cfa5db0 req-dff91519-3db2-46ca-b5a8-4dc90a8c10b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0640dee1-2b77-42c1-8eb8-a2217a3b54ee", "name": "network-vif-deleted", "tag": "48054201-47b9-4acf-adf1-f585f6d2e1e4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:08.405820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:08.422021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d9644a79-390e-44f2-84e5-b2a29cfa5db0 req-dff91519-3db2-46ca-b5a8-4dc90a8c10b4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.425144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d9644a79-390e-44f2-84e5-b2a29cfa5db0 req-dff91519-3db2-46ca-b5a8-4dc90a8c10b4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.425144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d9644a79-390e-44f2-84e5-b2a29cfa5db0 req-dff91519-3db2-46ca-b5a8-4dc90a8c10b4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.445305 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d9644a79-390e-44f2-84e5-b2a29cfa5db0 req-dff91519-3db2-46ca-b5a8-4dc90a8c10b4 service nova] Creating event network-vif-deleted:48054201-47b9-4acf-adf1-f585f6d2e1e4 for instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee on n-h1-858238-3 Nov 02 13:49:08.452083 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d9644a79-390e-44f2-84e5-b2a29cfa5db0 req-dff91519-3db2-46ca-b5a8-4dc90a8c10b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056863 Nov 02 13:49:08.452850 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 849/1818] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:08.458974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:08.459711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:08.466968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.468382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.469503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.471886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.473162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.474180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.568054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:08.610268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.617375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:08.618168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:08.619013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:08.619175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.619804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:08.620517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:08.620640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.629355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2c2e4f29-77ca-4293-b8e6-8fe47bb639ef tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1555 microversion: 2.91 time: 0.175119 Nov 02 13:49:08.643120 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 850/1819] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:08 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:08.643120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:08.643120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:08.643570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.643747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.646108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.650097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.650718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.651376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.665205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.666624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.667566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.668551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.669294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.669947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.679497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Getting quotas for project 40d8540c19394ea2ab5f77154403b756. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:08.686595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Getting quotas for user e07b0b98fbc045c4836c77cd445ea7d3 and project 40d8540c19394ea2ab5f77154403b756. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:08.704632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.utils [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] cores quota exceeded for 40d8540c19394ea2ab5f77154403b756, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137559) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 13:49:08.706157 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Request method failure captured: Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 144 Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnVFEIonxaqe6H0qLn3_-7TZvkYf4uir7XoWECp4xxdfpz--iGueEhOeT4k4GIBHP57t2vjVe9y-RP7z16qbPfhw4yA_v-iYf1GDoA-oLQ_oG2A0CkcOSyXNkTZ5xn45dc8IYMRMcFOypDZVu7KUR0aVy672NOBCFLTEsYxTNh6r8XY Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:08.737603 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40d8540c19394ea2ab5f77154403b756"}]}] Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e07b0b98fbc045c4836c77cd445ea7d3 Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-507472091", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} Nov 02 13:49:08.739254 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-507472091', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452'}}} Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:49:08.740176 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:08.741492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.742977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17f1102f-5b56-4b94-bc55-68638409dcf1 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 8.609701 Nov 02 13:49:08.745987 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 970/1820] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:49:00 2022] POST /compute/v2.1/servers => generated 111 bytes in 8617 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:08.753368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:08.754295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:08.768541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.769399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.770148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.771316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.772214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.773032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.869682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.880005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.882435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.883888 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0cfa1517-28f1-49ac-93b3-242df0793cbb tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1475 microversion: 2.25 time: 0.247986 Nov 02 13:49:08.884649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 851/1821] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:08 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1475 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:08.890523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b919c0fd-6193-414e-9b4f-deb89484c147 req-7d842af8-9386-4277-bbf9-f5ca9e36dab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e488881-f0fd-4003-8123-191cb92828d2", "name": "network-vif-plugged", "status": "completed", "tag": "6fed398e-5731-4b96-a8ff-6f32125ca657"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:08.908768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b919c0fd-6193-414e-9b4f-deb89484c147 req-7d842af8-9386-4277-bbf9-f5ca9e36dab5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.909625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b919c0fd-6193-414e-9b4f-deb89484c147 req-7d842af8-9386-4277-bbf9-f5ca9e36dab5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.910361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b919c0fd-6193-414e-9b4f-deb89484c147 req-7d842af8-9386-4277-bbf9-f5ca9e36dab5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.929448 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b919c0fd-6193-414e-9b4f-deb89484c147 req-7d842af8-9386-4277-bbf9-f5ca9e36dab5 service nova] Creating event network-vif-plugged:6fed398e-5731-4b96-a8ff-6f32125ca657 for instance 6e488881-f0fd-4003-8123-191cb92828d2 on n-h2-858238-3 Nov 02 13:49:08.938012 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b919c0fd-6193-414e-9b4f-deb89484c147 req-7d842af8-9386-4277-bbf9-f5ca9e36dab5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050765 Nov 02 13:49:08.942480 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 852/1822] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:08.975132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1631883692", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:09.036095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.050643 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4470a8a7-b4f9-43f7-bc66-c0b17528d48f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 0.301387 Nov 02 13:49:09.068306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 971/1823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:08 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:09.093650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] validate_networks() for [('87b19db8-bca7-4e15-a215-fb7f6d07b020', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:49:09.095546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:09.096462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:09.105353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.106294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.106925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.108230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.109244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.109973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.723385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.737845 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87a4100d-58bb-4157-993a-c0057cb66d82 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1461 microversion: 2.1 time: 0.661059 Nov 02 13:49:09.745229 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 972/1824] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:09 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1461 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:09.750520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:09.768380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.771309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:09.781078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.782384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.783845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.785351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.786209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.786998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.846120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:09.847400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:09.848142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:09.849370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:09.850018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:09.865328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.866834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.867581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.869073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.872699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.874732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.907265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:09.914870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Getting quotas for user 8469267606da4e50bd1e694ee7762547 and project f09feb16167e4c8ab42a3ae26d00424a. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:09.932964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:09.936174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:09.951887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c9caf23-5ec6-498e-aa21-1574077e29d7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.204493 Nov 02 13:49:09.961384 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 973/1825] 10.222.0.18 () {58 vars in 1230 bytes} [Wed Nov 2 13:49:09 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:49:09.966750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Action: 'update', calling method: .version_select at 0x7f6f813655e0>, body: {"quota_set": {"cores": 20}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:10.041586 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-807edb65-65f8-4643-8e0e-b46f8b32cec0 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.093119 Nov 02 13:49:10.044208 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 853/1826] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:49:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:49:10.061373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-779f3944-ad02-48ce-9eea-9fec431ce43c tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '.version_select at 0x7f6f81931b80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.069361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-779f3944-ad02-48ce-9eea-9fec431ce43c tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.070255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-779f3944-ad02-48ce-9eea-9fec431ce43c tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.070999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-779f3944-ad02-48ce-9eea-9fec431ce43c tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.091608 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-779f3944-ad02-48ce-9eea-9fec431ce43c tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 4892 microversion: 2.25 time: 0.045602 Nov 02 13:49:10.093084 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 854/1827] 10.222.0.18 () {60 vars in 1184 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/os-migrations => generated 4892 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:10.099587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe04e539-7920-4977-a75e-9decfabace7a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81931af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.105714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.106199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.106632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.107389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.107835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.108824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.190490 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67425714-2f3c-4828-8fba-bb4444d78c8b tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 329 microversion: 2.1 time: 0.227848 Nov 02 13:49:10.191660 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 974/1828] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:09 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:10.203251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.204188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.216066 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe04e539-7920-4977-a75e-9decfabace7a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.121513 Nov 02 13:49:10.217477 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 855/1829] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:10.226915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.226915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.226915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.226915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.227531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.227531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.233612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.234505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.242895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.244844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.245882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.247480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.248373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.249612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.335926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.350767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.353875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.364901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-47937cda-3506-43c9-a50e-383902d52146 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1537 microversion: 2.91 time: 0.171838 Nov 02 13:49:10.380607 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 975/1830] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:10.382310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-537b62ea-5bb5-4422-93e2-35b904b8bff7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-537b62ea-5bb5-4422-93e2-35b904b8bff7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:10.397289 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 13:49:10.399325 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:10.400922 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:10.405374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-537b62ea-5bb5-4422-93e2-35b904b8bff7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-537b62ea-5bb5-4422-93e2-35b904b8bff7 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.035049 Nov 02 13:49:10.414032 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 976/1831] 10.222.0.18 () {58 vars in 1182 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:10.421732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b872b41-1850-4d43-bc73-1490d6b8d0e8 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.422507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b872b41-1850-4d43-bc73-1490d6b8d0e8 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.500810 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d781b7ab-1afd-4afd-8e07-ea1705063581 tempest-MigrationsAdminTest-598253827 tempest-MigrationsAdminTest-598253827-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1612 microversion: 2.1 time: 0.271457 Nov 02 13:49:10.505268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 856/1832] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1612 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:10.524566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.529409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.549125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.549580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b872b41-1850-4d43-bc73-1490d6b8d0e8 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.549723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.550070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.551050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.553296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.553728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.558867 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b872b41-1850-4d43-bc73-1490d6b8d0e8 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1225 microversion: 2.1 time: 0.151694 Nov 02 13:49:10.560063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 977/1833] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:10.566202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.567084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.573909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.574769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.575463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.576565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.577253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.577907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.801251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] Lazy-loading 'services' on Instance uuid 28579980-d489-4bff-a1cb-dcadca8bd5ee {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:10.828432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82ba7822-a4e3-4337-ba41-57cab436a657 tempest-LiveAutoBlockMigrationV225Test-1514966709 tempest-LiveAutoBlockMigrationV225Test-1514966709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1967 microversion: 2.25 time: 0.266742 Nov 02 13:49:10.829945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 978/1834] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1967 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:10.842305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a836c201-2006-4e3c-b6e9-1b40600c0c55 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Calling method '.version_select at 0x7f6f81364310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.873410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.895031 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-771528b9-59b9-4187-9517-a309001b1be7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1199 microversion: 2.1 time: 0.388345 Nov 02 13:49:10.898635 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 857/1835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1199 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:10.904341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.919267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.920478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:10.931233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.931522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.932039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.934629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.936377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.937271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.966382 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a836c201-2006-4e3c-b6e9-1b40600c0c55 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 371 microversion: 2.1 time: 0.134665 Nov 02 13:49:10.967661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 979/1836] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:10.980633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.981461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.993092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.993949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.994442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.995324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.995958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.996559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.000697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:49:11.054881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:11.061076 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c2dfec04-bc09-4dcf-a202-bf22ff6c12a6 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.159549 Nov 02 13:49:11.062875 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 858/1837] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers => generated 681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:11.080860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.082116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:11.094435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.096241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.097281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.099511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.100764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.101764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.161765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:11.204902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:11.227194 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b230ab5-39dc-41f9-8f3b-a9d398c9c335 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 204 len: 0 microversion: 2.1 time: 0.255767 Nov 02 13:49:11.227194 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 980/1838] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:10 2022] DELETE /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:11.233047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "name": "network-vif-plugged", "status": "completed", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}, {"server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "name": "network-vif-plugged", "status": "completed", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:11.245369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.245877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.246341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.265899 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] Creating event network-vif-plugged:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:49:11.266409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] Creating event network-vif-plugged:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h2-858238-3 Nov 02 13:49:11.275058 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1ec8657e-33a6-47bf-b190-95db514c23b1 req-5c07866b-66c4-4f12-a319-ea85171f4982 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047235 Nov 02 13:49:11.276363 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 981/1839] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:11.291295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Action: 'update', calling method: .version_select at 0x7f6f85eb44c0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:11.312051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:11.322071 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bdeadf21-5744-4a1a-83f3-f0ff632731c0 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 204 len: 0 microversion: 2.25 time: 0.255590 Nov 02 13:49:11.323886 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 859/1840] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:49:11 2022] DELETE /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:11.390696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.461888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:11.462890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.servers [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Removing options 'limit' from query {{(pid=137558) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 13:49:11.464036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:11.485524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.495343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.495343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.495343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.495343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.495843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.498718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.499499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.500537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.501610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.502278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.502895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.572527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:49:11.584226 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-27c81864-0e68-4868-a528-61a733c45bf8 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 328 microversion: 2.1 time: 0.306468 Nov 02 13:49:11.597719 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 982/1841] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:11 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:11.597719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.598169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:11.626916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.627657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.629400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.631225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.632657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.633370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.675790 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29055338-d03c-4c4f-884c-230c7bf6e0e9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.348806 Nov 02 13:49:11.691453 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 860/1842] 10.222.0.18 () {58 vars in 1144 bytes} [Wed Nov 2 13:49:11 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:11.714670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1d60a7dd-fe66-452e-a8cf-935d2c473260 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a0bdc0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.841147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1d60a7dd-fe66-452e-a8cf-935d2c473260 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.147968 Nov 02 13:49:11.851724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 861/1843] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:11 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:11.874108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.877183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:11.906562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.907793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.908839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.913197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.916401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.916401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.034572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.046435 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49b1372b-a4ba-4d8e-aa39-d12276fe0523 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1467 microversion: 2.1 time: 0.457426 Nov 02 13:49:12.048020 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 983/1844] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:11 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1467 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:12.053624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.054621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:12.062862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.064219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.065178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.066477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.067323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.068565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.182281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.186411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:12.199606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.201355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.206929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.208491 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2e098de-e0ca-4f2b-840f-283ec5a1aa98 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1481 microversion: 2.25 time: 0.355082 Nov 02 13:49:12.209142 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 862/1845] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:11 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1481 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:12.212196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.214129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.226857 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8a138db5-8685-43de-be36-162c6c97c221 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1540 microversion: 2.91 time: 0.177017 Nov 02 13:49:12.234147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.235408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:12.243910 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 984/1846] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1540 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:12.244364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.245009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.245540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.246395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.247066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.247635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.261119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05a3f330-5fb1-4499-b84a-c1d9f194fee8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05a3f330-5fb1-4499-b84a-c1d9f194fee8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:12.265788 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 13:49:12.267663 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '-1' Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:12.268543 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.270631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.271999 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:12.271999 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:12.271999 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:49:12.271999 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:49:12.271999 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 13:49:12.271999 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.274691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05a3f330-5fb1-4499-b84a-c1d9f194fee8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:12.275862 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05a3f330-5fb1-4499-b84a-c1d9f194fee8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.030695 Nov 02 13:49:12.276945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 985/1847] 10.222.0.18 () {58 vars in 1142 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:12.285455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-855138600", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:12.352506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:49:12.357887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.379040 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ec8744f0-6cc6-4699-ac44-ccc11202fa43 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1221 microversion: 2.1 time: 0.156657 Nov 02 13:49:12.395543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 863/1848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:12.405957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.406582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:12.415872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.416371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.416806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.417525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.417978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.418403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.657199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:12.658012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:12.658875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:12.659498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:12.660357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:12.675440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.677581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.678487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.679545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.681688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.682447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.682895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.704267 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-23f6151a-fb9e-48ac-a83f-8ad8074d103d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1378 microversion: 2.1 time: 0.307287 Nov 02 13:49:12.705951 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 864/1849] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1378 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:12.711482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:12.714338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:12.735146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Getting quotas for project 40d8540c19394ea2ab5f77154403b756. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:12.740451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.741430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.742087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.742696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Getting quotas for user e07b0b98fbc045c4836c77cd445ea7d3 and project 40d8540c19394ea2ab5f77154403b756. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:12.742969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.743826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.744535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.780242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.utils [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] instances quota exceeded for 40d8540c19394ea2ab5f77154403b756, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137559) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 13:49:12.780892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Request method failure captured: Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 144 Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnVFEIonxaqe6H0qLn3_-7TZvkYf4uir7XoWECp4xxdfpz--iGueEhOeT4k4GIBHP57t2vjVe9y-RP7z16qbPfhw4yA_v-iYf1GDoA-oLQ_oG2A0CkcOSyXNkTZ5xn45dc8IYMRMcFOypDZVu7KUR0aVy672NOBCFLTEsYxTNh6r8XY Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:12.783201 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40d8540c19394ea2ab5f77154403b756"}]}] Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e07b0b98fbc045c4836c77cd445ea7d3 Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-855138600", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} Nov 02 13:49:12.786150 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-855138600', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452'}}} Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:49:12.787375 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.789276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.790870 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49710269-5136-4a02-9d16-704e006c4c19 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.507800 Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 986/1850] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:49:12 2022] POST /compute/v2.1/servers => generated 119 bytes in 509 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:12.792963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7af2a08e-c37d-4549-b2b6-30dbe156e174 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7af2a08e-c37d-4549-b2b6-30dbe156e174 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:12.797317 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 13:49:12.799191 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'testing' Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:12.800313 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.802230 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7af2a08e-c37d-4549-b2b6-30dbe156e174 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7af2a08e-c37d-4549-b2b6-30dbe156e174 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010813 Nov 02 13:49:12.808290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 987/1851] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:12.843331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858238-3". {{(pid=137558) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:49:12.963685 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5f7b604-6e66-4810-b81d-033f764c60f0 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action" status: 202 len: 0 microversion: 2.91 time: 0.256358 Nov 02 13:49:12.967630 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 865/1852] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:49:12 2022] POST /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:12.973225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Action: 'update', calling method: .version_select at 0x7f6f81a09160>, body: {"quota_set": {"instances": 10}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:13.073085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.074281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:13.076643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.077379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.077969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.079205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.080111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.080822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.084810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.087514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.088061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.088836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.089317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.090749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.163199 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c4f8a5fc-3493-4a0c-a0e5-4f13c75bd7a0 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 329 microversion: 2.1 time: 0.194355 Nov 02 13:49:13.164120 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 866/1853] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:12 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 329 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:13.171424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53c42cf2-fe43-4ee2-afbb-8bbdb7d4858f tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.177716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-53c42cf2-fe43-4ee2-afbb-8bbdb7d4858f tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.178707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-53c42cf2-fe43-4ee2-afbb-8bbdb7d4858f tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:13.187120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.servers [None req-53c42cf2-fe43-4ee2-afbb-8bbdb7d4858f tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Flavor 'non_existing_flavor' could not be found {{(pid=137558) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 02 13:49:13.188182 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53c42cf2-fe43-4ee2-afbb-8bbdb7d4858f tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023114 Nov 02 13:49:13.188825 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 867/1854] 10.222.0.18 () {58 vars in 1178 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:49:13.194662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ddb8f5b9-2fa5-45a5-a4d8-67723ee65d42 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a23160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.359968 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b719bec-2c0f-4345-a609-e5faad24b461 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1529 microversion: 2.1 time: 0.551761 Nov 02 13:49:13.367985 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 988/1855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1529 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:13.381221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.384759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:13.402063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.402852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.403543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.404266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.406732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.406732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.443147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ddb8f5b9-2fa5-45a5-a4d8-67723ee65d42 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.252688 Nov 02 13:49:13.451909 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 868/1856] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:13.457353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.458259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:13.466073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.466938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.467489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.468227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.468676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.469100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.530052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.580281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.598286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.614462 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab4fc691-90cd-4685-8fbf-2ecd004cf572 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1488 microversion: 2.91 time: 0.244859 Nov 02 13:49:13.615466 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 989/1857] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1488 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:13.627556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-782dca99-0259-486d-aaaa-34b7845ade46 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Calling method '.version_select at 0x7f6f81337430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.895602 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-782dca99-0259-486d-aaaa-34b7845ade46 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 371 microversion: 2.1 time: 0.272743 Nov 02 13:49:13.897685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 990/1858] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:13.919068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.941204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.945014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:13.957339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.967249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.968032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.968403 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4d376e02-ac86-4cbe-b284-16232ac51704 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1467 microversion: 2.1 time: 0.515022 Nov 02 13:49:13.969016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.971161 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 869/1859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1467 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:13.977990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.988742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.991721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.992298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.993233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:14.035195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.040267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.046859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.048790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.049473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.050115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.292980 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac704e35-de56-45a6-a18d-54ebf35d92d4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.393439 Nov 02 13:49:14.295017 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 991/1860] 10.222.0.18 () {58 vars in 1174 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:49:14.326103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:14.328400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:14.344656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.356454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.357424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.360031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.365414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.365869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.912212 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5ad10892-da17-433f-9fc2-82ad36a028d6 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1529 microversion: 2.1 time: 0.616209 Nov 02 13:49:14.916893 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 992/1861] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:14 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1529 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:14.924602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:14.925387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:14.948647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.949141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.949583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.950306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.950763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.951221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.056970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:15.363039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:15.372085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:15.381646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:15.388585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bbd85cd6-c17a-418b-ab7e-fb753bc1b9af tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1481 microversion: 2.25 time: 1.415488 Nov 02 13:49:15.389767 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 870/1862] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1481 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:15.432266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Action: 'update', calling method: .version_select at 0x7f6f81918e50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:15.530161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:15.543980 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-089a1451-0e98-4d18-8538-5a14448b9d02 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.625862 Nov 02 13:49:15.544909 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 993/1863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:14 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:15.549592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.560131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:15.561093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:15.566770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.567562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.582354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.583582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.584232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.584876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.656878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.657745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.659334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.660523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.668656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.669365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.819151 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-836ed8de-5dec-4d0b-baff-1eaed5d4fb24 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.272856 Nov 02 13:49:15.827306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 994/1864] 10.222.0.18 () {58 vars in 1184 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:49:15.832249 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c433c29-d463-45b0-bd4f-4d321b957fb3 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 325 microversion: 2.1 time: 0.439846 Nov 02 13:49:15.832921 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 871/1865] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:15 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 325 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:15.838032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b23c451-11c8-4515-955a-83c06a812633 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81f17790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.842430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.845998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.874641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.875460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.878504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.879604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.880555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.881594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.918094 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b23c451-11c8-4515-955a-83c06a812633 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1453 microversion: 2.1 time: 0.093052 Nov 02 13:49:15.918689 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 995/1866] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:15.930701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.948357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.948894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.949343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.951965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.952448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.952883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.025451 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe1ac238-1a5a-4544-a7ec-f0837cc17251 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104665 Nov 02 13:49:16.026394 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 996/1867] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:16.031443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.032069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.051145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.052095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.053538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.054998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.056075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.056764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.285048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.295519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.297608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.305169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.305704 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-27d3affc-108e-44ad-b226-84e54728ee66 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 200 len: 1467 microversion: 2.1 time: 0.278253 Nov 02 13:49:16.306903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 997/1868] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:16 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 1467 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:16.322965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.330953 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-730956ad-4d1e-4a77-9b4e-065f6f03630b tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.494821 Nov 02 13:49:16.333906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.334552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:16.336382 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 872/1869] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:16.351739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-652132178", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:16.355242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.371635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.372434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.373454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.374091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.374707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.485340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:49:16.995602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:49:17.165795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:17.196244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.197374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.198142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.555955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7968dde-f3bf-4a66-b1bc-04fecea01988 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 3019 microversion: 2.1 time: 1.247290 Nov 02 13:49:17.583443 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 998/1870] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:49:16 2022] GET /compute/v2.1/servers/detail => generated 3019 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:17.594554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858238-3", "block_migration": false, "disk_over_commit": false}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:17.597835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.615063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.617640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.619384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.621310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.624688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.625404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.645101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:17.646263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:17.646908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:17.647514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:17.648088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:17.683302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.688692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.690096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.692788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.695123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.696396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.718054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lazy-loading 'flavor' on Instance uuid 6e488881-f0fd-4003-8123-191cb92828d2 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:17.753837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Getting quotas for project 40d8540c19394ea2ab5f77154403b756. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:17.765411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Getting quotas for user e07b0b98fbc045c4836c77cd445ea7d3 and project 40d8540c19394ea2ab5f77154403b756. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:17.777348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Going to try to live migrate instance to n-h1-858238-3 {{(pid=137559) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 13:49:17.791478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.utils [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] ram quota exceeded for 40d8540c19394ea2ab5f77154403b756, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137558) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 13:49:17.795873 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Request method failure captured: Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 144 Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnVFEIonxaqe6H0qLn3_-7TZvkYf4uir7XoWECp4xxdfpz--iGueEhOeT4k4GIBHP57t2vjVe9y-RP7z16qbPfhw4yA_v-iYf1GDoA-oLQ_oG2A0CkcOSyXNkTZ5xn45dc8IYMRMcFOypDZVu7KUR0aVy672NOBCFLTEsYxTNh6r8XY Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:17.807340 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40d8540c19394ea2ab5f77154403b756"}]}] Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e07b0b98fbc045c4836c77cd445ea7d3 Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-652132178", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} Nov 02 13:49:17.809119 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-652132178', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452'}}} Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:49:17.810140 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:17.811618 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.815785 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:17.818857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:17.818857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:17.818857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:17.818857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:17.818857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:49:17.818857 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:17.821899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:17.823909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a98cdd9-a941-4329-b0d0-350bc80afad0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.485377 Nov 02 13:49:17.825223 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 873/1871] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:49:16 2022] POST /compute/v2.1/servers => generated 110 bytes in 1488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:17.832275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.833192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.844286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.844955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.846130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.847594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.848484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.849147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.031350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.044973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.047487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.049469 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-24b48156-1a75-4337-98af-7d30460c2fea tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.222623 Nov 02 13:49:18.050336 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 874/1872] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:17 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:18.055946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:18.057337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:18.065534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.067394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.068239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.069417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.070507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.071239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.432897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.480016 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fce1aa24-d992-4527-b9da-5d9dac692cff tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.425602 Nov 02 13:49:18.499138 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 875/1873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:18 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:18.510991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8a9b523f-6d8a-4050-9b48-9963eb2fc99c req-713bb0ff-a1b6-4711-807e-68345df6fe21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099", "name": "network-vif-deleted", "tag": "ec43d5ff-2979-4d6d-9cf7-7a3997910977"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:18.575040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a9b523f-6d8a-4050-9b48-9963eb2fc99c req-713bb0ff-a1b6-4711-807e-68345df6fe21 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.582231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a9b523f-6d8a-4050-9b48-9963eb2fc99c req-713bb0ff-a1b6-4711-807e-68345df6fe21 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.584492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a9b523f-6d8a-4050-9b48-9963eb2fc99c req-713bb0ff-a1b6-4711-807e-68345df6fe21 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.633676 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8a9b523f-6d8a-4050-9b48-9963eb2fc99c req-713bb0ff-a1b6-4711-807e-68345df6fe21 service nova] Creating event network-vif-deleted:ec43d5ff-2979-4d6d-9cf7-7a3997910977 for instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 on n-h2-858238-3 Nov 02 13:49:18.644761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8a9b523f-6d8a-4050-9b48-9963eb2fc99c req-713bb0ff-a1b6-4711-807e-68345df6fe21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156979 Nov 02 13:49:18.655912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 876/1874] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:18.672484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3ea7d94-ecef-4a3f-b38d-0c7b0536a274 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81a27700>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:19.387575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d3ea7d94-ecef-4a3f-b38d-0c7b0536a274 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1462 microversion: 2.1 time: 0.729244 Nov 02 13:49:19.420114 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 877/1875] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:18 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1462 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:19.425380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:19.436514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:19.453997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.456387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.457581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.469155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.472571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.473141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.515063 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] HTTP exception thrown: Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 could not be found. Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Request method failure captured: Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 HTTP/1.1 Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOwRRobiZjta6cA67j6MWDRAWVZYVr-SeY9utExqxufKSE-nbfWj-TRAxs37wu3cUELlJIuVr-SXsOE6h2x-feqNZfhkljWTblmwexe1Ysk_Yr-O76O67AScI1BxfkXsnhq7r3dYjP64X2Uon5c_pHcaKNWXrYNRniSjXSQJ2Nflnw Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:19.520923 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f98d747d0ec34f2e97593bb75a32d02c"}]}] Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 832cd460bb5e4148a57d561f762ceb11 Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 could not be found. Nov 02 13:49:19.523176 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099'} Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 could not be found. Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:19.524031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 could not be found. Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 could not be found. Nov 02 13:49:19.526130 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:19.529012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Returning 404 to user: Instance 2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:19.530123 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-da726519-f360-4902-9ff9-040a0f0a93dc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099" status: 404 len: 111 microversion: 2.1 time: 0.108672 Nov 02 13:49:19.530769 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 878/1876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:19 2022] GET /compute/v2.1/servers/2ada1ea7-0b94-48f4-aee0-e3b0d8fbf099 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:19.536149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:19.536968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:19.545131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.545874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.546515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.548995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.549775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.550399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.684266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:19.721811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:19.728636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:19.745515 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fd478a25-bc80-427e-a1dd-d9134598319d tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.213386 Nov 02 13:49:19.747918 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 879/1877] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:19 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:19.755067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a638080f-1fc4-4f68-8f26-f58e332d7a6e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:19.762889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a638080f-1fc4-4f68-8f26-f58e332d7a6e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:19.764612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a638080f-1fc4-4f68-8f26-f58e332d7a6e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014769 Nov 02 13:49:19.765497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 880/1878] 10.222.0.18 () {58 vars in 1178 bytes} [Wed Nov 2 13:49:19 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:49:19.772227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Action: 'update', calling method: .version_select at 0x7f6f8184d280>, body: {"quota_set": {"ram": 51200}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:19.922642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.923795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.924471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.926235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.926926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.927361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.030401 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a8970254-80bb-470f-9154-d63ebfc3d693 tempest-QuotasAdminNegativeTest-963493851 tempest-QuotasAdminNegativeTest-963493851-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 200 len: 329 microversion: 2.1 time: 0.262978 Nov 02 13:49:20.031621 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 881/1879] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:19 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 329 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:20.038258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ecf886c4-d6dc-4933-9746-65ceed35e0ee req-cd6c58da-c65c-4a89-9575-3a8b7ee8c8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f67f39-a9e7-49f2-8651-2ca39525707b", "tag": "64b168ec-b26f-4f86-8a4e-e2674315d300"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:20.063031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ecf886c4-d6dc-4933-9746-65ceed35e0ee req-cd6c58da-c65c-4a89-9575-3a8b7ee8c8ad service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.063555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ecf886c4-d6dc-4933-9746-65ceed35e0ee req-cd6c58da-c65c-4a89-9575-3a8b7ee8c8ad service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.064556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ecf886c4-d6dc-4933-9746-65ceed35e0ee req-cd6c58da-c65c-4a89-9575-3a8b7ee8c8ad service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.085168 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ecf886c4-d6dc-4933-9746-65ceed35e0ee req-cd6c58da-c65c-4a89-9575-3a8b7ee8c8ad service nova] Creating event network-changed:64b168ec-b26f-4f86-8a4e-e2674315d300 for instance 19f67f39-a9e7-49f2-8651-2ca39525707b on n-h1-858238-3 Nov 02 13:49:20.091036 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ecf886c4-d6dc-4933-9746-65ceed35e0ee req-cd6c58da-c65c-4a89-9575-3a8b7ee8c8ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058421 Nov 02 13:49:20.091990 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 882/1880] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:20.098125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:20.098864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:20.102761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:20.107791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.108412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.108854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.109806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.110321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.111416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.210636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.222696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.225149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.226374 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-509fa84c-de2f-4b75-b926-e02c74191a6b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.133114 Nov 02 13:49:20.231144 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 883/1881] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:20 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:20.243335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a2f22a7-713e-40b8-a340-aeb41fa18786 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8184d0d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:20.365527 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a2f22a7-713e-40b8-a340-aeb41fa18786 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 200 len: 1462 microversion: 2.1 time: 0.131612 Nov 02 13:49:20.377281 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 884/1882] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:20 2022] GET /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 1462 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:20.386010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:20.396419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:20.414371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.421722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.424068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.427010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.430901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.431996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.790274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.821876 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c4eb0ab0-8d53-45a4-86c4-05799ab65780 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.442466 Nov 02 13:49:20.824514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 885/1883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:20 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:20.836615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:20.839009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:20.853213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.857528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.858655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.860298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.861362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.862427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.930917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:21.106970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:21.203677 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c1b3c0d9-1cfe-42e8-8656-3a6ef21a463c tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 204 len: 0 microversion: 2.1 time: 0.376328 Nov 02 13:49:21.205920 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 886/1884] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:20 2022] DELETE /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:21.216121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:21.226588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.228138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Searching by: {'deleted': False, 'project_id': 'faa16093dc2848ae9758690c9a507115'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:49:21.240476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.241253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.242263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.243621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.244702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.245355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.294803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:49:21.351870 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-757ebd48-5b52-484b-9dec-78f56ff692fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.143002 Nov 02 13:49:21.366063 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 887/1885] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:49:21 2022] GET /compute/v2.1/servers => generated 681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:21.372945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-33aa7bde-b13b-4c6d-8a45-f90249963cf0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Action: 'update', calling method: .version_select at 0x7f6f819009d0>, body: {"quota_set": {"ram": 0}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:21.383503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-33aa7bde-b13b-4c6d-8a45-f90249963cf0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e07b0b98fbc045c4836c77cd445ea7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d8540c19394ea2ab5f77154403b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-33aa7bde-b13b-4c6d-8a45-f90249963cf0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Request method failure captured: Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 HTTP/1.1 Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 25 Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnVFEIonxaqe6H0qLn3_-7TZvkYf4uir7XoWECp4xxdfpz--iGueEhOeT4k4GIBHP57t2vjVe9y-RP7z16qbPfhw4yA_v-iYf1GDoA-oLQ_oG2A0CkcOSyXNkTZ5xn45dc8IYMRMcFOypDZVu7KUR0aVy672NOBCFLTEsYxTNh6r8XY Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:21.392019 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/40d8540c19394ea2ab5f77154403b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_40d8540c19394ea2ab5f77154403b756"}]}] Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 40d8540c19394ea2ab5f77154403b756 Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-739727390 Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e07b0b98fbc045c4836c77cd445ea7d3 Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-QuotasAdminNegativeTest-739727390-project Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: {"quota_set": {"ram": 0}} Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 13:49:21.395377 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '40d8540c19394ea2ab5f77154403b756', 'body': {'quota_set': {'ram': 0}}} Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:21.397568 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:21.400952 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-33aa7bde-b13b-4c6d-8a45-f90249963cf0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:21.408509 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-33aa7bde-b13b-4c6d-8a45-f90249963cf0 tempest-QuotasAdminNegativeTest-739727390 tempest-QuotasAdminNegativeTest-739727390-project] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756" status: 403 len: 116 microversion: 2.1 time: 0.028532 Nov 02 13:49:21.412598 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 888/1886] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:21 2022] PUT /compute/v2.1/os-quota-sets/40d8540c19394ea2ab5f77154403b756 => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:21.430932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:21.431620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:21.461773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.462586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.463361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.464533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.469760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.470530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.939726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.988275 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4340f273-ddcc-4e65-9d89-1339b5f851d0 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1467 microversion: 2.1 time: 0.560776 Nov 02 13:49:22.004300 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 889/1887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:21 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1467 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:22.004300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5c547c30-8379-4f97-ae1f-639bb2b5ae45 req-4a0b4e16-ee32-4134-9ec4-05bd9de5c4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28579980-d489-4bff-a1cb-dcadca8bd5ee", "name": "network-vif-deleted", "tag": "a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:22.035569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5c547c30-8379-4f97-ae1f-639bb2b5ae45 req-4a0b4e16-ee32-4134-9ec4-05bd9de5c4ea service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.036487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5c547c30-8379-4f97-ae1f-639bb2b5ae45 req-4a0b4e16-ee32-4134-9ec4-05bd9de5c4ea service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.037544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5c547c30-8379-4f97-ae1f-639bb2b5ae45 req-4a0b4e16-ee32-4134-9ec4-05bd9de5c4ea service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.071314 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5c547c30-8379-4f97-ae1f-639bb2b5ae45 req-4a0b4e16-ee32-4134-9ec4-05bd9de5c4ea service nova] Creating event network-vif-deleted:a9ae2a4c-49d7-4e8e-b1f4-bed6589b3aec for instance 28579980-d489-4bff-a1cb-dcadca8bd5ee on n-h2-858238-3 Nov 02 13:49:22.088324 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5c547c30-8379-4f97-ae1f-639bb2b5ae45 req-4a0b4e16-ee32-4134-9ec4-05bd9de5c4ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093821 Nov 02 13:49:22.090849 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 890/1888] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:22.107557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.115413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.145661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.146464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.150913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.155155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.156741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.158628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.372082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.384981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.386941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.401269 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a9198dcd-859c-4cd1-bd77-a5f1bb0e8641 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.305128 Nov 02 13:49:22.411135 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 891/1889] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:22 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:22.411416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.427129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.430197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.435542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.435542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.435542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.436215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.447818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.751391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.764424 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-77be384e-0cd0-40d7-a2ac-c729ff95af1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.361259 Nov 02 13:49:22.765022 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 892/1890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:22 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:22.770679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.771320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.780111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.780677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.781248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.782157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.783248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.783699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.932613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.961221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.964170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.966276 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29e3a089-af45-485b-9c0f-ad75c7215c9c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.199947 Nov 02 13:49:22.968341 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 893/1891] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:22 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:22.976672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.977592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.988178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.989051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.989786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.990922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.992127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.992316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.026197 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] HTTP exception thrown: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 HTTP/1.1 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:23.028551 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:23.030261 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '85f651e0-b174-40a4-ae6e-02581828ae37'} Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:23.031204 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:23.033249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.037989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 404 to user: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:23.037989 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45760c46-623b-4eb1-8f31-2a2a3ceff31c tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "DELETE /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 404 len: 111 microversion: 2.1 time: 0.060965 Nov 02 13:49:23.037989 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 894/1892] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:22 2022] DELETE /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:23.039790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.040088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.047678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.048304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.048852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.049639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.050166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.050665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.236255 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0d8b1eb-2523-4e6a-ae22-ec13ecb24998 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2/action" status: 202 len: 0 microversion: 2.1 time: 5.651097 Nov 02 13:49:23.236814 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 999/1893] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:49:17 2022] POST /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2/action => generated 0 bytes in 5652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:49:23.244459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9783421b-0a6f-40b8-b369-625ff41e77f8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e9faf0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.261950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:23.272136 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-64ce888a-d71c-4420-a98f-be4b1444aec5 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.239944 Nov 02 13:49:23.272738 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 895/1894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:23.277896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.278393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.294383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.295640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.296803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.297990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.298812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.299818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.352700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:23.380316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9783421b-0a6f-40b8-b369-625ff41e77f8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?changes-since=2022-11-02T13%3A46%3A58Z" status: 200 len: 1903 microversion: 2.1 time: 0.141850 Nov 02 13:49:23.391649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1000/1895] 10.222.0.18 () {58 vars in 1199 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/images?changes-since=2022-11-02T13%3A46%3A58Z => generated 1903 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:23.400360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.401048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.414308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.415125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.415911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.416846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.417497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.419112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.558419 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-def01d7e-b91c-4dad-b53d-674ab945099e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9" status: 204 len: 0 microversion: 2.1 time: 0.283870 Nov 02 13:49:23.567356 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 896/1896] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:23 2022] DELETE /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:23.582223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b71c4e0-3f8c-490c-a1d0-01bb080590ce tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81c59160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.768678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:23.781756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2afda5d-81c2-4432-bd52-0027d4843afb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.385425 Nov 02 13:49:23.796762 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1001/1897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:23.801018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.801910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.814990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.819879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.820601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.821536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.822163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.822843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.825741 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b71c4e0-3f8c-490c-a1d0-01bb080590ce tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-764883475" status: 200 len: 484 microversion: 2.1 time: 0.255661 Nov 02 13:49:23.832523 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 897/1898] 10.222.0.18 () {58 vars in 1229 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-764883475 => generated 484 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:23.857049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.859446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.896091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.898333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.899700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.903309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.905135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.907656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.988268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.004856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.008731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.024301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-51d00298-7feb-45f3-b72d-740b91c2b3d4 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.238422 Nov 02 13:49:24.028213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:24.039691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1002/1899] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:24.058725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f7f4c5d4-8e3e-403c-9fe8-5a1c6c2da9a8 req-216401b2-ddf4-44f7-af77-032cabef92e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "name": "network-vif-unplugged", "status": "completed", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:24.079269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f7f4c5d4-8e3e-403c-9fe8-5a1c6c2da9a8 req-216401b2-ddf4-44f7-af77-032cabef92e1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.080652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f7f4c5d4-8e3e-403c-9fe8-5a1c6c2da9a8 req-216401b2-ddf4-44f7-af77-032cabef92e1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.081724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f7f4c5d4-8e3e-403c-9fe8-5a1c6c2da9a8 req-216401b2-ddf4-44f7-af77-032cabef92e1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.106602 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f7f4c5d4-8e3e-403c-9fe8-5a1c6c2da9a8 req-216401b2-ddf4-44f7-af77-032cabef92e1 service nova] Creating event network-vif-unplugged:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:49:24.119060 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f7f4c5d4-8e3e-403c-9fe8-5a1c6c2da9a8 req-216401b2-ddf4-44f7-af77-032cabef92e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077987 Nov 02 13:49:24.121696 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1003/1900] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:24.132727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.134476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:24.149033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.149853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.152146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.155934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.158429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.161008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.353754 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b8fa23ef-7dd6-4664-a77d-aea6f5cb49a8 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "DELETE /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 204 len: 0 microversion: 2.1 time: 0.515764 Nov 02 13:49:24.363647 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 898/1901] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:23 2022] DELETE /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:24.387226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2bf21f08-ad55-4956-97e7-9433b06b8aba tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f819efe50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.492491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.505630 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d3aa21e-77b5-4569-8f1e-1e8bac0fb097 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.381818 Nov 02 13:49:24.506277 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1004/1902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:24.519260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.520131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:24.558010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.561283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.561941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.563597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.579461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.582452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.660441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2bf21f08-ad55-4956-97e7-9433b06b8aba tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?server=7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 957 microversion: 2.1 time: 0.294312 Nov 02 13:49:24.662227 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 899/1903] 10.222.0.18 () {58 vars in 1209 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/images?server=7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 957 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:24.681516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.688533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:24.709457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.713977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.727853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.728850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.729477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.731699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.781153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.793764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.797342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.799782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73a45c81-75a0-4c2d-b183-4bb325e2b466 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.292490 Nov 02 13:49:24.800917 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1005/1904] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:24.806655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.807587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 85f651e0-b174-40a4-ae6e-02581828ae37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:24.819216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.820328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.821297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.822891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.823875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.824777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.852412 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] HTTP exception thrown: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 HTTP/1.1 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:24.855721 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:24.858444 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '85f651e0-b174-40a4-ae6e-02581828ae37'} Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:24.860104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. Nov 02 13:49:24.862743 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:24.870292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 404 to user: Instance 85f651e0-b174-40a4-ae6e-02581828ae37 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:24.870292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba9894f2-0fb3-44ff-bdcb-86e4f7493272 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37" status: 404 len: 111 microversion: 2.1 time: 0.061283 Nov 02 13:49:24.870292 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1006/1905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/servers/85f651e0-b174-40a4-ae6e-02581828ae37 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:24.875058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a23aebae-77e8-48e2-8607-72dad5d32c60 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85d9e430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.079624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.095055 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ff1aebd0-152c-495a-bb76-bb2124ef2f44 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.431063 Nov 02 13:49:25.095662 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a23aebae-77e8-48e2-8607-72dad5d32c60 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 485 microversion: 2.1 time: 0.198685 Nov 02 13:49:25.097612 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1007/1906] 10.222.0.18 () {58 vars in 1317 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16 => generated 485 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:25.113128 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 900/1907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:25.120127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.120675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:25.128261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.128715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.129236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.129851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.130149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.130343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.130721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.131372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:25.169168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.169659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.170092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.170800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.186327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.186889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.491201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.505446 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7dd4af18-93e8-40d2-ba6c-adff339cbb18 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9" status: 200 len: 1519 microversion: 2.1 time: 0.390712 Nov 02 13:49:25.519401 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 901/1908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:25.533820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.534611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:25.553378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.556989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.557728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.560519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.561250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.563495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.714006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.727219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.728846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.764915 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-104a1181-a051-4981-8f02-7b5dc1f71827 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.244077 Nov 02 13:49:25.776268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 902/1909] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:25.808252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-17f5a101-45cd-4f89-9cc1-35fd2611bac9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8184d160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.922468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.932512 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-17f5a101-45cd-4f89-9cc1-35fd2611bac9 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 485 microversion: 2.1 time: 0.154748 Nov 02 13:49:25.938332 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-81192258-459a-4dfc-af03-890cb3d564c6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.838933 Nov 02 13:49:25.940949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1008/1910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:25.946269 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 903/1911] 10.222.0.18 () {58 vars in 1303 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16 => generated 485 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:25.962399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.963497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.964405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:25.966295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:25.980853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.981341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.982052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.983729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.984285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.984745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.003845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.005797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.013369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.014367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.015938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.019187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.032205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:26.235576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.280380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.284643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.293215 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aa914c8f-f62f-4961-a7c2-040180049222 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.345268 Nov 02 13:49:26.303226 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 904/1912] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:26.308246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15d77ea7-da8c-40f1-93ca-be578be22e89 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81807af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:26.484984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.523026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:26.528163 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba09fe06-0cda-469f-9806-172575283e5f tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.582234 Nov 02 13:49:26.529677 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1009/1913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:26.544283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:26.547311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:26.566068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.566941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.568171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.569270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.571160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.572189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.612879 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-15d77ea7-da8c-40f1-93ca-be578be22e89 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.315989 Nov 02 13:49:26.616692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 905/1914] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:49:26 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:26.635041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-75952fcc-5f61-4e05-ac32-eeae714f3586 req-2ad59612-c1f3-43a0-b7db-77ec4c4a493d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f67f39-a9e7-49f2-8651-2ca39525707b", "name": "network-vif-plugged", "status": "completed", "tag": "64b168ec-b26f-4f86-8a4e-e2674315d300"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:26.665506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-75952fcc-5f61-4e05-ac32-eeae714f3586 req-2ad59612-c1f3-43a0-b7db-77ec4c4a493d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.666582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-75952fcc-5f61-4e05-ac32-eeae714f3586 req-2ad59612-c1f3-43a0-b7db-77ec4c4a493d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.667541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-75952fcc-5f61-4e05-ac32-eeae714f3586 req-2ad59612-c1f3-43a0-b7db-77ec4c4a493d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.693381 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-75952fcc-5f61-4e05-ac32-eeae714f3586 req-2ad59612-c1f3-43a0-b7db-77ec4c4a493d service nova] Creating event network-vif-plugged:64b168ec-b26f-4f86-8a4e-e2674315d300 for instance 19f67f39-a9e7-49f2-8651-2ca39525707b on n-h1-858238-3 Nov 02 13:49:26.708428 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-75952fcc-5f61-4e05-ac32-eeae714f3586 req-2ad59612-c1f3-43a0-b7db-77ec4c4a493d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077439 Nov 02 13:49:26.711566 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 906/1915] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:26.726593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:26.729881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:26.750410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.757748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.758469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.759723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.760458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.761074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.848244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.848964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.849615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.850349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lazy-loading 'fault' on Instance uuid d9162009-bf24-46d0-b941-ef08428ff4d9 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:26.911761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.925222 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0bcc3067-6293-4ca4-9e74-b9d9290c918f tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.394071 Nov 02 13:49:26.925892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1010/1916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:26 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:26.932230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-76793e86-c2c9-4269-9122-1bcd68dfd51e req-4f077ca0-c4f6-4e38-9852-bf7d1aba3216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9162009-bf24-46d0-b941-ef08428ff4d9", "name": "network-vif-deleted", "tag": "32869b38-10e2-4e59-beda-531cdaa3eed1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:26.960973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-76793e86-c2c9-4269-9122-1bcd68dfd51e req-4f077ca0-c4f6-4e38-9852-bf7d1aba3216 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.961465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-76793e86-c2c9-4269-9122-1bcd68dfd51e req-4f077ca0-c4f6-4e38-9852-bf7d1aba3216 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.961888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-76793e86-c2c9-4269-9122-1bcd68dfd51e req-4f077ca0-c4f6-4e38-9852-bf7d1aba3216 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.963860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.992365 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c4a6f0de-dc20-471f-9264-29ff6e4dcb0e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9" status: 200 len: 1312 microversion: 2.1 time: 0.279037 Nov 02 13:49:26.993613 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-76793e86-c2c9-4269-9122-1bcd68dfd51e req-4f077ca0-c4f6-4e38-9852-bf7d1aba3216 service nova] Creating event network-vif-deleted:32869b38-10e2-4e59-beda-531cdaa3eed1 for instance d9162009-bf24-46d0-b941-ef08428ff4d9 on n-h1-858238-3 Nov 02 13:49:26.997339 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 907/1917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:26 2022] GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.014839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da3e2266-0954-490e-902b-7e821240fcab tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8184d160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.015329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-76793e86-c2c9-4269-9122-1bcd68dfd51e req-4f077ca0-c4f6-4e38-9852-bf7d1aba3216 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087887 Nov 02 13:49:27.016469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1011/1918] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:27.023797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.024877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.034595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.039753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.041381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.042216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.044852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.047365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.144756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=36 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:27.183058 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-da3e2266-0954-490e-902b-7e821240fcab tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.184140 Nov 02 13:49:27.198082 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 908/1919] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:49:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.198515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.204131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.205773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.209724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.217816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.221426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.221953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.222390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.223189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.223946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.224872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.237305 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d57e8b8c-8f7a-45f0-b954-28ed20bd9cac tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.219137 Nov 02 13:49:27.237925 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1012/1920] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:27.242732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-505fe7e9-3131-4e90-a4e7-0176bcd5e01d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85e9fc10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.347628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-505fe7e9-3131-4e90-a4e7-0176bcd5e01d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.108098 Nov 02 13:49:27.358294 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1013/1921] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:27.358294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.358294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.367144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.367656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.368099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.368826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.369447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.369989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.478255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.482164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.486435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:27.488507 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8648ab92-b615-4351-be8c-ff68dd5e70fc tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.291656 Nov 02 13:49:27.491202 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 909/1922] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.508617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ae992c5-a3ac-4412-bc20-cdb02ec23e83 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f818fdee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.518119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.524886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.526234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-508ec06e-1925-4c7d-9d2a-97d2918cd921 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.175542 Nov 02 13:49:27.526986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1014/1923] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:27.554827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.571968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.632433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.635207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.636132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.637262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.640536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.643679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.776003 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2ae992c5-a3ac-4412-bc20-cdb02ec23e83 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T13%3A46%3A49Z" status: 200 len: 6327 microversion: 2.1 time: 0.280166 Nov 02 13:49:27.777863 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 910/1924] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T13%3A46%3A49Z => generated 6327 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.805922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-88d4ce7d-fafd-42c8-8905-2a8f6a97830d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f817fed30>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.887065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-88d4ce7d-fafd-42c8-8905-2a8f6a97830d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-764883475" status: 200 len: 664 microversion: 2.1 time: 0.085938 Nov 02 13:49:27.891643 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 911/1925] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-764883475 => generated 664 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:27.916630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7be44340-7715-475c-8ee6-9796868a1615 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81918af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.936354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.947739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b121ad7-7f0a-4d09-b713-f54ddd9fcf1d tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.398978 Nov 02 13:49:27.960650 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1015/1926] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.960650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.960650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.960650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:27.961665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.962261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.963254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.963920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.964563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.965091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.999607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7be44340-7715-475c-8ee6-9796868a1615 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1465 microversion: 2.1 time: 0.083867 Nov 02 13:49:28.000267 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 912/1927] 10.222.0.18 () {58 vars in 1338 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1465 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.016029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-761b8609-3afb-455d-9736-0d062520a3f2 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81900a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.092885 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-761b8609-3afb-455d-9736-0d062520a3f2 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1465 microversion: 2.1 time: 0.080692 Nov 02 13:49:28.097245 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 913/1928] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1465 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.118416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.121719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:28.134422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.135020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.135703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.136637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.137298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.137633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.209011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.209698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.210463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.211133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lazy-loading 'fault' on Instance uuid d9162009-bf24-46d0-b941-ef08428ff4d9 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:28.219701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.243202 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efa1b2a0-75e1-47f5-85c2-932875ce17dd tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1325 microversion: 2.1 time: 0.281352 Nov 02 13:49:28.245583 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1016/1929] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.260928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21fda4f5-0c0c-42f3-a5f4-5ef88ccefb46 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85da20d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.323911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.334961 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ffad9d47-8230-4b5b-9710-c7a3effbb119 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9" status: 200 len: 1312 microversion: 2.1 time: 0.235068 Nov 02 13:49:28.335894 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 914/1930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.353210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.353849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:28.360559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.361284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.362515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.369268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.370084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.376550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.470789 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21fda4f5-0c0c-42f3-a5f4-5ef88ccefb46 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.222260 Nov 02 13:49:28.471876 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1017/1931] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.503080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa10d11f-d1ce-4665-bb16-0429a9069efb tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85da2dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.569894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.583079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.585113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.592074 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0600b986-96b7-44c5-a277-7feb6b389e03 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.255063 Nov 02 13:49:28.592909 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 915/1932] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:28.597870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.598775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:28.606721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.607854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.614263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.616159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.616822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.617321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.677969 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa10d11f-d1ce-4665-bb16-0429a9069efb tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.179115 Nov 02 13:49:28.681518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1018/1933] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.699400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.699400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:28.723502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.725066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.725934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.727264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.729424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.731997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.841679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.855026 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-72941ca3-4759-45b3-b0d7-55de2ced6904 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.260617 Nov 02 13:49:28.856284 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 916/1934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.862046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e73c935-e904-4275-9b0e-97a6e6277a21 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8184df70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.914375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.939377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.942417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.944765 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40196081-31a9-47c5-8613-49fde3184068 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.262043 Nov 02 13:49:28.946155 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e73c935-e904-4275-9b0e-97a6e6277a21 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/48ddc6ee-c34b-4aba-b773-45942271b1d5" status: 200 len: 784 microversion: 2.1 time: 0.088322 Nov 02 13:49:28.946488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1019/1935] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:28.947154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 917/1936] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/images/48ddc6ee-c34b-4aba-b773-45942271b1d5 => generated 784 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:28.967870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3ab2b740-2733-44f9-8052-c51ffbdd40cb tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f817fe040>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:29.068110 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3ab2b740-2733-44f9-8052-c51ffbdd40cb tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.106843 Nov 02 13:49:29.075645 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 918/1937] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:29.089485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:29.090128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:29.097640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.098140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.098580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.099389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.099913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.100344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.195279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1219987868", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:29.273708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:29.274875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:29.276206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:29.277187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:29.278665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:29.280291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:29.288900 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-62f7d065-846f-4306-8a73-3e58a9ffbb4a tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.208431 Nov 02 13:49:29.289698 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 919/1938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:29 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:29.289900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.290300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.290730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.291493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.291947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.292367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.300607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6da7259f-3f46-4e87-bfba-e648d5afbd99 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f818b79d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:29.337492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Getting quotas for project 0d729b67e3dc4f5e8d038f6974e24426. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:29.344154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Getting quotas for user 2e9ab3998cff4d61b862a285864e0a0d and project 0d729b67e3dc4f5e8d038f6974e24426. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:29.362816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:29.365491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:29.453415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe199616-b1bf-4211-8d91-be3bbdad9a9f tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.484815 Nov 02 13:49:29.455310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1020/1939] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:49:29.460500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:29.461373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:29.491491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.492330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.492898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.506885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.510234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.512998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.828270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:29.855658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1115922-f85b-448d-ae72-0f3fe4790743 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1521 microversion: 2.1 time: 0.397005 Nov 02 13:49:29.856757 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1021/1940] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:29 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:29.862989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:29.863640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: d9162009-bf24-46d0-b941-ef08428ff4d9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:29.869981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.870461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.870897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.871759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.872222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.872789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.900313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] HTTP exception thrown: Instance d9162009-bf24-46d0-b941-ef08428ff4d9 could not be found. Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 HTTP/1.1 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:29.902611 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d9162009-bf24-46d0-b941-ef08428ff4d9 could not be found. Nov 02 13:49:29.904440 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd9162009-bf24-46d0-b941-ef08428ff4d9'} Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9162009-bf24-46d0-b941-ef08428ff4d9 could not be found. Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:29.905423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9162009-bf24-46d0-b941-ef08428ff4d9 could not be found. Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9162009-bf24-46d0-b941-ef08428ff4d9 could not be found. Nov 02 13:49:29.906980 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:29.909921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 404 to user: Instance d9162009-bf24-46d0-b941-ef08428ff4d9 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:29.910959 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ebecc7f-375c-4293-8b6e-ee9df99222a4 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9" status: 404 len: 111 microversion: 2.1 time: 0.053258 Nov 02 13:49:29.912083 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1022/1941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:29 2022] GET /compute/v2.1/servers/d9162009-bf24-46d0-b941-ef08428ff4d9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:29.918555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13283366-4a74-48a5-9f82-c2bebb1cf146 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:29.921702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13283366-4a74-48a5-9f82-c2bebb1cf146 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.019480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:30.022724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13283366-4a74-48a5-9f82-c2bebb1cf146 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.033878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13283366-4a74-48a5-9f82-c2bebb1cf146 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.036315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13283366-4a74-48a5-9f82-c2bebb1cf146 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.042978 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13283366-4a74-48a5-9f82-c2bebb1cf146 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "PUT /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1359 microversion: 2.75 time: 0.129258 Nov 02 13:49:30.059164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1023/1942] 10.222.0.18 () {62 vars in 1297 bytes} [Wed Nov 2 13:49:29 2022] PUT /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1359 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:30.074940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.075724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.082500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.083001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.083470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.084186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.084673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.085102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.197189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.210461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.213528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.247537 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13837d4c-9e0d-42a7-8b38-e5a9f6e7a0b9 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.184247 Nov 02 13:49:30.247537 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1024/1943] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:30.256549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-15b5d594-aee1-45d7-8fac-8929efb7422a req-2f510290-40bb-4866-a5f8-516f645f7b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-unplugged", "status": "completed", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:30.268956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-15b5d594-aee1-45d7-8fac-8929efb7422a req-2f510290-40bb-4866-a5f8-516f645f7b7e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.269700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-15b5d594-aee1-45d7-8fac-8929efb7422a req-2f510290-40bb-4866-a5f8-516f645f7b7e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.270287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-15b5d594-aee1-45d7-8fac-8929efb7422a req-2f510290-40bb-4866-a5f8-516f645f7b7e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.288052 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-15b5d594-aee1-45d7-8fac-8929efb7422a req-2f510290-40bb-4866-a5f8-516f645f7b7e service nova] Creating event network-vif-unplugged:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:49:30.295436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-15b5d594-aee1-45d7-8fac-8929efb7422a req-2f510290-40bb-4866-a5f8-516f645f7b7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045932 Nov 02 13:49:30.302183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1025/1944] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:30.309033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.309610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.316939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.317425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.318132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.318964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.319433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.319846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.351714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:30.557587 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba996acc-7e0e-4512-8d85-328332b47abc tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 204 len: 0 microversion: 2.1 time: 0.253436 Nov 02 13:49:30.558464 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1026/1945] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:30 2022] DELETE /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:30.565173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.566182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.574984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.575525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.575963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.576838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.577149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.577942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.738116 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6da7259f-3f46-4e87-bfba-e648d5afbd99 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03" status: 204 len: 0 microversion: 2.1 time: 1.447135 Nov 02 13:49:30.738735 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 920/1946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:29 2022] DELETE /compute/v2.1/images/791eb83b-2897-4282-8e77-7e6340fd6d03 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:30.748509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.749252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.760566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.762951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.765196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.767300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.768347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.769348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.858652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.888082 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7299e48e-2667-4a5b-b2ad-7a3b1038e200 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.328115 Nov 02 13:49:30.889619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1027/1947] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:30.909284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.910264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.920947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.922435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.924910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.925856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.928095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.929885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.010207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.027014 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a55d91e8-1a1b-485d-95f7-81e3a492a11e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1519 microversion: 2.1 time: 0.282590 Nov 02 13:49:31.028382 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 921/1948] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:31.049220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.052767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.053583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.064077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.066166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.070637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.075423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.076123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.077344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4c79624-a55b-4ea6-8c7c-3622e04f7c16 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.176820 Nov 02 13:49:31.077725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.078367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.078626 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1028/1949] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:31.079727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.084885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.085609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.097136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.098209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.099023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.100152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.101083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.101954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.158635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.167666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.169213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.175381 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e8caba61-f64c-453b-ab77-d2bc2ed2e3ea tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1355 microversion: 2.75 time: 0.135238 Nov 02 13:49:31.175964 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 922/1950] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:31 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1355 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:31.180767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.181656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.188042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.189345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.190006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.190933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.191413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.191837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.268064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=16 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:31.315399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.323866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d846ec5-a66d-4f7a-a23b-98b152e5a381 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.243933 Nov 02 13:49:31.324537 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1029/1951] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:31 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:31.342753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ac6e36a-d4ba-433e-a218-9d6567c46a52 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f8133d9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.431345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.444585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-30a0fd8f-499d-4609-a40f-b4839fd13b3e tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1527 microversion: 2.1 time: 0.266426 Nov 02 13:49:31.445708 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 923/1952] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:31 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:31.455439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.456858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.466973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.467832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.468456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.469368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.470544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.470981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.578690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.607152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.608784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.618309 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fdb16e9a-0013-48ac-a70b-440d09e56406 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.170630 Nov 02 13:49:31.619395 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 924/1953] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:31 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:31.942375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.943132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.952048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.952048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.952425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.953055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.953584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.954630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.289318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ac6e36a-d4ba-433e-a218-9d6567c46a52 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6" status: 204 len: 0 microversion: 2.1 time: 0.950869 Nov 02 13:49:32.290020 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1030/1954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:31 2022] DELETE /compute/v2.1/images/d52e6ffb-67c8-482e-bbc4-5874b232b3f6 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:32.295144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.296016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:32.312829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.314201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.314826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.315811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.316449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.317051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.532651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.556434 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c0d547b8-28c7-49b4-93a6-ea84883bcbe8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.621451 Nov 02 13:49:32.576427 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 925/1955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:31 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:32.581858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.582720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:32.590571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.591532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.592149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.593073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.593695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.594325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.685415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.699143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.700890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.702283 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ffbc9c9-c8cb-4e8a-896c-a1d2294fec7d tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.124475 Nov 02 13:49:32.703243 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 926/1956] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:32 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:32.708975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.710044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:32.730364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.730652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.730865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.731349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.732069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.732531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.734375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.764855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fd92b4a-c922-4cfc-8187-c7402b4e4a36 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1519 microversion: 2.1 time: 0.472642 Nov 02 13:49:32.767782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1031/1957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:32 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:32.772614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b65bead-a2bc-4a78-b377-b5509665a4ee tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f85da2700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.839675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.875887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.879300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.891521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-17564451-ab10-4489-93da-8f905f71dece tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1429 microversion: 2.75 time: 0.185934 Nov 02 13:49:32.895712 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 927/1958] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:32 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1429 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:32.905425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.906751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:32.917129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.918054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.918420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.919176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:32.919733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:32.920250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.090713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.099409 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-badc74f2-4281-4f22-b735-bf2cc5bce3f3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.202595 Nov 02 13:49:33.103163 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 928/1959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:32 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.105055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.105689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.112493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.112992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.113417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.114120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.114723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.115212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.208275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.218645 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45ff2849-afb7-4bf8-8afb-b01f84a2d835 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1485 microversion: 2.1 time: 0.117070 Nov 02 13:49:33.219368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 929/1960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1485 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.225331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.226272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.231398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:33.236358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.237186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.238164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.239348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.240751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.241395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.247549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:33.332178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.342540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.344250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.350728 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9fcd452-f824-4d1e-b11a-63bdf4d99ee5 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.129496 Nov 02 13:49:33.359277 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 930/1961] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:33.370700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e1ef4f34-d3d5-4811-96fb-0d5fc6d44450 req-2dfa9c68-2eeb-46cb-a8ee-cfc8926bad26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f67f39-a9e7-49f2-8651-2ca39525707b", "name": "network-vif-deleted", "tag": "64b168ec-b26f-4f86-8a4e-e2674315d300"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:33.388243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1ef4f34-d3d5-4811-96fb-0d5fc6d44450 req-2dfa9c68-2eeb-46cb-a8ee-cfc8926bad26 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.388820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1ef4f34-d3d5-4811-96fb-0d5fc6d44450 req-2dfa9c68-2eeb-46cb-a8ee-cfc8926bad26 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.389452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1ef4f34-d3d5-4811-96fb-0d5fc6d44450 req-2dfa9c68-2eeb-46cb-a8ee-cfc8926bad26 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.404019 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e1ef4f34-d3d5-4811-96fb-0d5fc6d44450 req-2dfa9c68-2eeb-46cb-a8ee-cfc8926bad26 service nova] Creating event network-vif-deleted:64b168ec-b26f-4f86-8a4e-e2674315d300 for instance 19f67f39-a9e7-49f2-8651-2ca39525707b on n-h1-858238-3 Nov 02 13:49:33.410432 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e1ef4f34-d3d5-4811-96fb-0d5fc6d44450 req-2dfa9c68-2eeb-46cb-a8ee-cfc8926bad26 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048073 Nov 02 13:49:33.411160 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 931/1962] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:33.462162 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b65bead-a2bc-4a78-b377-b5509665a4ee tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995" status: 204 len: 0 microversion: 2.1 time: 0.693118 Nov 02 13:49:33.463391 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1032/1963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:32 2022] DELETE /compute/v2.1/images/c51557f6-f8ef-4f48-acfc-df8ed20f3995 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:33.477155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.477943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.485836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.486331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.486770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.487522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.487969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.488799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.515585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:33.586806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.587743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.599364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.600609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.601601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.603115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.604162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.605155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.660254 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ac05fcbb-e29f-4090-8888-34c91fe9d297 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 204 len: 0 microversion: 2.1 time: 0.191129 Nov 02 13:49:33.663138 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 932/1964] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:33 2022] DELETE /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:33.670669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.672015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.681003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.682118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.682802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.683827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.684696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.685386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.806863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.819590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43de9e6c-871a-4b5b-b1b6-f219ee1d2976 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.240568 Nov 02 13:49:33.821295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1033/1965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.826433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.827430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.834146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.834958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.835989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.836734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.837351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.837754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.880910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.890973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3fc767fb-b68e-4edc-ad6b-78f69ed70f12 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1473 microversion: 2.1 time: 0.224557 Nov 02 13:49:33.893003 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 933/1966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1473 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.898504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.899160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.906068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.906813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.907746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.908630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.909238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.909989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.943759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.960069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.961624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.962792 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6181204-7cf5-4fae-9612-0b6b04b81d89 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1265 microversion: 2.25 time: 0.140538 Nov 02 13:49:33.963394 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1034/1967] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:33.968898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.969769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.979263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.980034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.980622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.981591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.982195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.982765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.070260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.079178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.081511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.087503 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a4d3d396-4f30-49d2-8cb5-15ac60e25c72 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1417 microversion: 2.75 time: 0.122712 Nov 02 13:49:34.099616 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1035/1968] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1417 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:34.122283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.127015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.127836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.139627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.140593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.141219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.142307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.142923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.145098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.147869 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a4ff12ac-9e4d-4cbe-8f48-ef1eaec800fb tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1519 microversion: 2.1 time: 0.253343 Nov 02 13:49:34.178564 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 934/1969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:34.250118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.253192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.269993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.270491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.270920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.271677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.272422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.273042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.385753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.397417 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a121bad-d6c2-49e4-acea-edefcb7277d2 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1310 microversion: 2.1 time: 0.153303 Nov 02 13:49:34.398719 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 935/1970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:34.403539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.404341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.411460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.412179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.413198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.414080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.414700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.415333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.428365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.437450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:34.441760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54c729ad-15f1-498e-bfb9-002d23331425 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1535 microversion: 2.1 time: 0.321324 Nov 02 13:49:34.459649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1036/1971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1535 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:34.535834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.551683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.554287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.561928 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-73493c1b-0ecb-4b44-884c-7daaee79ccb1 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.161741 Nov 02 13:49:34.572739 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 936/1972] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:34.849791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.851487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.882555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.883757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.884415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.885424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.886787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.887709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.920881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.921924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.933067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.935769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.938633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.940515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.942031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.943272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.210838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.224108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be188ecc-2f6b-48df-bfc7-b75b05e17ca4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.381502 Nov 02 13:49:35.225133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1037/1973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:35.225615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.232372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3bc4da71-b449-4ea5-915a-477d17c9ce01 req-f104777e-e1c6-4a22-9439-c3dc109faa61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49590101-83f7-4aa2-a3ca-ea29a1e877e0", "name": "network-vif-deleted", "tag": "cb9bb33b-1c03-487c-9894-328a5e4e71e8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:35.239251 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0472fb1d-2476-44ef-8cf5-a4256d9164a8 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1473 microversion: 2.1 time: 0.323466 Nov 02 13:49:35.241026 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 937/1974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:35.251873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.253688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.259535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3bc4da71-b449-4ea5-915a-477d17c9ce01 req-f104777e-e1c6-4a22-9439-c3dc109faa61 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.260032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3bc4da71-b449-4ea5-915a-477d17c9ce01 req-f104777e-e1c6-4a22-9439-c3dc109faa61 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.260475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3bc4da71-b449-4ea5-915a-477d17c9ce01 req-f104777e-e1c6-4a22-9439-c3dc109faa61 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.262659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.263632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.264298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.265777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.267202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.267880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.286013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3bc4da71-b449-4ea5-915a-477d17c9ce01 req-f104777e-e1c6-4a22-9439-c3dc109faa61 service nova] Creating event network-vif-deleted:cb9bb33b-1c03-487c-9894-328a5e4e71e8 for instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 on n-h2-858238-3 Nov 02 13:49:35.292284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3bc4da71-b449-4ea5-915a-477d17c9ce01 req-f104777e-e1c6-4a22-9439-c3dc109faa61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065253 Nov 02 13:49:35.293347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1038/1975] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:35.309738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.310906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.321274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.322526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.323555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.323756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.324345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.324852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.325370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lazy-loading 'fault' on Instance uuid 28579980-d489-4bff-a1cb-dcadca8bd5ee {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:35.325906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.326773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.327506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.406457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.448610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.449893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.452081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.453545 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e14dc7ad-2de6-42ec-bcb9-30ce2db399b6 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 200 len: 1270 microversion: 2.25 time: 0.210340 Nov 02 13:49:35.456935 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 938/1976] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:35.464159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.471305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.486056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.486553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.487048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.487813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.488267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.488916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.509803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.511497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.528218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6da2ad14-1a8b-43a4-bd38-0dec6bfeea8a tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1417 microversion: 2.75 time: 0.221399 Nov 02 13:49:35.536567 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1039/1977] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1417 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:35.554269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.555082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.563868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.564724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.565573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.566575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.567324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.567942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.590271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.605579 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f626a0d2-817e-4420-a3e3-d061932b8192 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1477 microversion: 2.1 time: 0.145324 Nov 02 13:49:35.606539 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 939/1978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1477 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:35.615537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-55f601ff-07a5-443d-ba0e-e476b01b3bdf req-a6afe755-73e6-4228-bc0c-a68770f56979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02", "name": "network-vif-deleted", "tag": "5b2f2a47-d020-48c3-abfd-4a524baf6738"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:35.643490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-55f601ff-07a5-443d-ba0e-e476b01b3bdf req-a6afe755-73e6-4228-bc0c-a68770f56979 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.644046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-55f601ff-07a5-443d-ba0e-e476b01b3bdf req-a6afe755-73e6-4228-bc0c-a68770f56979 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.644498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-55f601ff-07a5-443d-ba0e-e476b01b3bdf req-a6afe755-73e6-4228-bc0c-a68770f56979 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.657177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.661828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.665434 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-55f601ff-07a5-443d-ba0e-e476b01b3bdf req-a6afe755-73e6-4228-bc0c-a68770f56979 service nova] Creating event network-vif-deleted:5b2f2a47-d020-48c3-abfd-4a524baf6738 for instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 on n-h2-858238-3 Nov 02 13:49:35.666669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.669483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lazy-loading 'fault' on Instance uuid 19f67f39-a9e7-49f2-8651-2ca39525707b {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:35.672352 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-55f601ff-07a5-443d-ba0e-e476b01b3bdf req-a6afe755-73e6-4228-bc0c-a68770f56979 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063927 Nov 02 13:49:35.674313 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 940/1979] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:35.680907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.682066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.694678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.695734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.696709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.698108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.699054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.700155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.780391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.788864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.796152 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9fae6b0-6062-4384-9057-724dc3e9520d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1315 microversion: 2.1 time: 0.265221 Nov 02 13:49:35.815045 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1040/1980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:35.815045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.815045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.816780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.817543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.818193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.819327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.820075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.820924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.831832 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7174ca88-665d-4cf5-a74b-49d2366375bc tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1493 microversion: 2.1 time: 0.155742 Nov 02 13:49:35.833157 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 941/1981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:36.044481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.066753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.068613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.081571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abd950c0-04fd-4a35-96b3-fde2d29d4b64 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.282143 Nov 02 13:49:36.087344 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1041/1982] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:36.283055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.284303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.289517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.290702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.293039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.293881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.294533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.295460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.296111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.296710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.304319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.304319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.305517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.306803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.307640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.308374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.561614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.572017 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-91624007-19be-4b85-be43-01394eee8258 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1473 microversion: 2.1 time: 0.293997 Nov 02 13:49:36.573602 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 942/1983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:36.579642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.591180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 28579980-d489-4bff-a1cb-dcadca8bd5ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.611065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.611851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.612521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.613482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.614163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.614800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.643994 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] HTTP exception thrown: Instance 28579980-d489-4bff-a1cb-dcadca8bd5ee could not be found. Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Request method failure captured: Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee HTTP/1.1 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnONizrRuvh9Qi3guAVicr5HCnpjUIE7xvDeQh4miwHJl3AJYCuGaslYLwjaV_Gnux9u3HNhVKhXVH62e-PP1QYB06YjKC9VMvsCGuCtTFRyF8kcMTsWOHgbzGMGysOCoerm2rOFuyJikFi97URrYK-4Z_eXn9GMmYeAyj8-F8lfAhc Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:36.651749 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_21ac2eda404042c0871fc312f0b9f705"}]}] Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 55e26f05091944cb910f81488056c057 Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 28579980-d489-4bff-a1cb-dcadca8bd5ee could not be found. Nov 02 13:49:36.655602 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '28579980-d489-4bff-a1cb-dcadca8bd5ee'} Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28579980-d489-4bff-a1cb-dcadca8bd5ee could not be found. Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:36.657380 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28579980-d489-4bff-a1cb-dcadca8bd5ee could not be found. Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28579980-d489-4bff-a1cb-dcadca8bd5ee could not be found. Nov 02 13:49:36.662004 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:36.666665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Returning 404 to user: Instance 28579980-d489-4bff-a1cb-dcadca8bd5ee could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:36.666665 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b7f52ecc-18bd-445d-a27b-888f7ed8403b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee" status: 404 len: 111 microversion: 2.25 time: 0.081421 Nov 02 13:49:36.666665 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 943/1984] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/28579980-d489-4bff-a1cb-dcadca8bd5ee => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:36.684610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.686565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.696111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.697043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.697723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.698715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.699476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.700205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.748835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.761735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-406e6b31-01d1-4904-aa94-57967edfed84 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.481766 Nov 02 13:49:36.777688 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1042/1985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:36.791780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.792908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.816436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.817296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.818099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.829939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.830743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.831506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.950904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.979145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.980323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.981144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.981834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lazy-loading 'fault' on Instance uuid 49590101-83f7-4aa2-a3ca-ea29a1e877e0 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:37.036628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.041466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.060456 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0a91a109-1a50-4784-818d-95ba39df0418 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1417 microversion: 2.75 time: 0.395302 Nov 02 13:49:37.061562 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 944/1986] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1417 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:37.132952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.134392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.135962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.143797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.145308 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c2580a5a-8c58-4637-a61d-98cd1d203dd9 tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1312 microversion: 2.1 time: 0.365999 Nov 02 13:49:37.145636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.155395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1043/1987] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:37.155395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.155395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.158902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.162318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.162987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.163645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.165815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.166695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.167512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.168366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.168940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.171524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.213963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.214783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.214988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.215720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.216060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.216396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.216969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lazy-loading 'fault' on Instance uuid 19f67f39-a9e7-49f2-8651-2ca39525707b {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:37.217954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lazy-loading 'fault' on Instance uuid 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:37.345476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8469267606da4e50bd1e694ee7762547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09feb16167e4c8ab42a3ae26d00424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.367389 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e61b75a6-f704-4255-98a5-fcc1663ae567 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 200 len: 1315 microversion: 2.1 time: 0.249623 Nov 02 13:49:37.370640 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 945/1988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:37.393410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.394352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.400990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.415016 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39197ed3-eb5f-490f-be81-54f6277421be tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 200 len: 1369 microversion: 2.1 time: 0.267694 Nov 02 13:49:37.416147 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1044/1989] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 1369 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:37.417562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.418272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.419336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.420271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.420897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.421499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.466880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:37.595458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.612690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.614565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.615412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.616562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.634788 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f125357d-811e-40ab-8c39-d858fe071c18 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.261953 Nov 02 13:49:37.638034 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 946/1990] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:37.640073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.640073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.642740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.648172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.651055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.651622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.772364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.775478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.793150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.793925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.794945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lazy-loading 'fault' on Instance uuid 6225cba5-1f32-40c4-b619-eec45c381a16 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:37.795477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.820858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.824772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.827709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.830912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.835750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.836660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.159613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.181961 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26930da8-132a-44c2-8975-00985aa8ac6f tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 200 len: 1307 microversion: 2.1 time: 0.571134 Nov 02 13:49:38.185061 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1045/1991] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 1307 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:38.197602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f84dc3d9-432c-48c9-aa33-405ef0c6e4e9 req-0671a871-5301-482c-89c6-f6a19ad6f1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6225cba5-1f32-40c4-b619-eec45c381a16", "name": "network-vif-deleted", "tag": "b96607a2-d826-4bdb-a6b2-8b1e483d9f83"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:38.215507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f84dc3d9-432c-48c9-aa33-405ef0c6e4e9 req-0671a871-5301-482c-89c6-f6a19ad6f1da service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.216279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f84dc3d9-432c-48c9-aa33-405ef0c6e4e9 req-0671a871-5301-482c-89c6-f6a19ad6f1da service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.216783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f84dc3d9-432c-48c9-aa33-405ef0c6e4e9 req-0671a871-5301-482c-89c6-f6a19ad6f1da service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.265288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f84dc3d9-432c-48c9-aa33-405ef0c6e4e9 req-0671a871-5301-482c-89c6-f6a19ad6f1da service nova] Creating event network-vif-deleted:b96607a2-d826-4bdb-a6b2-8b1e483d9f83 for instance 6225cba5-1f32-40c4-b619-eec45c381a16 on n-h1-858238-3 Nov 02 13:49:38.281520 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f84dc3d9-432c-48c9-aa33-405ef0c6e4e9 req-0671a871-5301-482c-89c6-f6a19ad6f1da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096007 Nov 02 13:49:38.282269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1046/1992] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:38.294154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.294882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.307586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.308424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.309086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.310296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.310993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.323785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.397806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.437773 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-34b47f6f-a09b-45c2-b77c-aadd447c5664 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.651229 Nov 02 13:49:38.438914 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 947/1993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:38.452118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.455929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.478553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.482466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.484768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.487582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.492214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.496733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.520506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.548064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.555306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.572798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.574383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.575800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:38.578674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf31eaf1-4472-4619-ae57-d6ceb9051b66 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1438 microversion: 2.75 time: 0.292120 Nov 02 13:49:38.581394 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1047/1994] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1438 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:38.588885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.589769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 19f67f39-a9e7-49f2-8651-2ca39525707b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.590309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.590784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lazy-loading 'fault' on Instance uuid 49590101-83f7-4aa2-a3ca-ea29a1e877e0 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:38.602939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.603720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.604495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.605397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.606287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.606900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.644381 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance 19f67f39-a9e7-49f2-8651-2ca39525707b could not be found. Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b HTTP/1.1 Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:38.646889 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 19f67f39-a9e7-49f2-8651-2ca39525707b could not be found. Nov 02 13:49:38.649143 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '19f67f39-a9e7-49f2-8651-2ca39525707b'} Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19f67f39-a9e7-49f2-8651-2ca39525707b could not be found. Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:38.650195 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f67f39-a9e7-49f2-8651-2ca39525707b could not be found. Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f67f39-a9e7-49f2-8651-2ca39525707b could not be found. Nov 02 13:49:38.652303 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.655496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance 19f67f39-a9e7-49f2-8651-2ca39525707b could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:38.656590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-901de907-4b7d-4b70-ab26-c7c437ca72d1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b" status: 404 len: 111 microversion: 2.1 time: 0.072981 Nov 02 13:49:38.657420 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1048/1995] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/19f67f39-a9e7-49f2-8651-2ca39525707b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:38.665957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.666706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.676350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.676952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.677850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.678666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.679219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.679658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.701834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] HTTP exception thrown: Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 could not be found. Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Request method failure captured: Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 HTTP/1.1 Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOwRRobiZjta6cA67j6MWDRAWVZYVr-SeY9utExqxufKSE-nbfWj-TRAxs37wu3cUELlJIuVr-SXsOE6h2x-feqNZfhkljWTblmwexe1Ysk_Yr-O76O67AScI1BxfkXsnhq7r3dYjP64X2Uon5c_pHcaKNWXrYNRniSjXSQJ2Nflnw Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:38.703489 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f98d747d0ec34f2e97593bb75a32d02c"}]}] Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 832cd460bb5e4148a57d561f762ceb11 Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 could not be found. Nov 02 13:49:38.705480 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02'} Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 could not be found. Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:38.706522 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 could not be found. Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 could not be found. Nov 02 13:49:38.708347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.710975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Returning 404 to user: Instance 9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:38.712047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3fe1605-4e83-42b6-9022-98b1b8eda1f7 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02" status: 404 len: 111 microversion: 2.1 time: 0.053387 Nov 02 13:49:38.713165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1049/1996] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/9487bb8a-7e66-4f71-a8d8-0ce8b30e9e02 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:38.719165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:38.722693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59c0d1831e4439381c37b506249da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa16093dc2848ae9758690c9a507115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.723192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.732063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.732818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.733418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.734310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.735520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.736188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.766605 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-26c2b3b6-45b9-4729-b138-b8d674f897db tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 200 len: 1312 microversion: 2.1 time: 0.323451 Nov 02 13:49:38.770142 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 948/1997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:38.784888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4305c842-04b7-4066-baca-27db143c5eb6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '.version_select at 0x7f6f81a62d30>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.869189 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-4305c842-04b7-4066-baca-27db143c5eb6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Image not found. Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4305c842-04b7-4066-baca-27db143c5eb6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639 HTTP/1.1 Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:38.872347 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: exception: Image not found. Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '4b633c81-efa8-467e-a58c-3ad3227b2639'} Nov 02 13:49:38.874200 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b633c81-efa8-467e-a58c-3ad3227b2639 to delete Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.875842 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b633c81-efa8-467e-a58c-3ad3227b2639 could not be found. Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:38.877947 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:49:38.879743 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:38.884142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4305c842-04b7-4066-baca-27db143c5eb6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Image not found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:38.885654 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4305c842-04b7-4066-baca-27db143c5eb6 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639" status: 404 len: 62 microversion: 2.1 time: 0.113675 Nov 02 13:49:38.886912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 949/1998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:38 2022] DELETE /compute/v2.1/images/4b633c81-efa8-467e-a58c-3ad3227b2639 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:49:38.898746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.899812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.927135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.927979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.928773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.929912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.930763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.931797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.968235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:38.971830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:38.972390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:38.972801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:38.973219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:39.089908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.125670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.128934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.139922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.151273 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dad0e7eb-844f-490c-afe0-7ca0085552a0 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1546 microversion: 2.91 time: 0.261021 Nov 02 13:49:39.164669 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 950/1999] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:39.164939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.165560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.167133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.167441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76bca5b7-71eb-43a9-a044-88c88945697e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '.version_select at 0x7f6f81a628b0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.179641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.180888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.181758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.215998 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76bca5b7-71eb-43a9-a044-88c88945697e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596839249" status: 202 len: 0 microversion: 2.1 time: 0.062616 Nov 02 13:49:39.217444 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 951/2000] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 13:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596839249 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:49:39.242588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.244042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.251233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.252089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.252291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.253135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.253656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.254134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.275618 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee HTTP/1.1 Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:39.277879 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.279936 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '0640dee1-2b77-42c1-8eb8-a2217a3b54ee'} Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:39.281043 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.283307 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.285249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:39.285249 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9b2759f-f759-436a-8c7d-7cb8c73981c1 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 404 len: 111 microversion: 2.1 time: 0.059381 Nov 02 13:49:39.285249 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 952/2001] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:39 2022] DELETE /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:39.290322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.291062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 6225cba5-1f32-40c4-b619-eec45c381a16] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.298269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.298766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.299529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.300264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.300781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.301427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.312582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:39.324304 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] HTTP exception thrown: Instance 6225cba5-1f32-40c4-b619-eec45c381a16 could not be found. Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Request method failure captured: Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 HTTP/1.1 Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTIw0edaKGzLgXXrBwkGrtjQvybeLuZeq5EnnwZjGn61vDPp30y7TCtQdQX6-8gUEltkInvFopLOST-SaREfSixr0A-BpOdXubVcFBUdRRR-ZzmUh_npUYsfkqmltFWYYDPNfJ_mt9Ghq4lBYaUZ2XoaD_h0s15TdNJs6fjMDEqOdQ Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d726861de17a4726b20716d8f60920b5 Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ListImageFiltersTestJSON-632486438 Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:39.334788 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d726861de17a4726b20716d8f60920b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d726861de17a4726b20716d8f60920b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d726861de17a4726b20716d8f60920b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d726861de17a4726b20716d8f60920b5"}]}] Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ListImageFiltersTestJSON-632486438 Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d726861de17a4726b20716d8f60920b5 Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-632486438 Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ListImageFiltersTestJSON-632486438-project Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 2ce568516a23489fbd362ea2fa01983b Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ListImageFiltersTestJSON-632486438-project Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 6225cba5-1f32-40c4-b619-eec45c381a16 could not be found. Nov 02 13:49:39.337930 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '6225cba5-1f32-40c4-b619-eec45c381a16'} Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6225cba5-1f32-40c4-b619-eec45c381a16 could not be found. Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:39.339015 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6225cba5-1f32-40c4-b619-eec45c381a16 could not be found. Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6225cba5-1f32-40c4-b619-eec45c381a16 could not be found. Nov 02 13:49:39.340691 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.342156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Returning 404 to user: Instance 6225cba5-1f32-40c4-b619-eec45c381a16 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:39.342156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f568b0ad-e71c-43fb-8583-3acb0b3d11af tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16" status: 404 len: 111 microversion: 2.1 time: 0.054446 Nov 02 13:49:39.345082 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 953/2002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/6225cba5-1f32-40c4-b619-eec45c381a16 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:39.363219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.364369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: 0640dee1-2b77-42c1-8eb8-a2217a3b54ee] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.387641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.394753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.397990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.398776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.399601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.400934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.419744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.435285 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee HTTP/1.1 Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:39.437115 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.438945 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '0640dee1-2b77-42c1-8eb8-a2217a3b54ee'} Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:39.441385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. Nov 02 13:49:39.443089 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:39.447121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance 0640dee1-2b77-42c1-8eb8-a2217a3b54ee could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:39.447121 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4f6b55bc-01a0-4576-8492-90f5864950a9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee" status: 404 len: 111 microversion: 2.1 time: 0.097567 Nov 02 13:49:39.447350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.450665 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 954/2003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/0640dee1-2b77-42c1-8eb8-a2217a3b54ee => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:39.451950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:39.468320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.472762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.480379 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9a3a362-efd7-4b23-b4e2-cee94bd09ec6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "POST /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff/action" status: 202 len: 1495 microversion: 2.75 time: 0.760623 Nov 02 13:49:39.482926 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1050/2004] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:49:38 2022] POST /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff/action => generated 1495 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:49:39.500904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.502650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-884a48b6-caa8-454e-9448-34126f8e69ab tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '.version_select at 0x7f6f85f67820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.503272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.503743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.506696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.507200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.507905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.562354 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-884a48b6-caa8-454e-9448-34126f8e69ab tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616992815" status: 202 len: 0 microversion: 2.1 time: 0.077660 Nov 02 13:49:39.565725 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1051/2005] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 13:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616992815 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:49:39.583836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.586693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.604665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.605188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.605637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.608868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.611193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.612038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.672178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:39.937394 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af0026eb-c05a-45d7-aac2-6f83b31d3122 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 204 len: 0 microversion: 2.1 time: 0.481300 Nov 02 13:49:39.942883 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 955/2006] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:39 2022] DELETE /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:39.964107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.964896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.979125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.979828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.980030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.986552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.988007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.988470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.029831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:40.267965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.279734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-908529f6-fee0-4106-b60c-8d94e3c2055b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.712637 Nov 02 13:49:40.283810 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1052/2007] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:40.290875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.297739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] [instance: 49590101-83f7-4aa2-a3ca-ea29a1e877e0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:40.311568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.314332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.314959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.315535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.316365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.319380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.319960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.338182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.339934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.356421 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af35b606-86ad-4b18-833f-632b62591246 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.411130 Nov 02 13:49:40.357446 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 956/2008] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:40.366918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.367588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:40.378032 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] HTTP exception thrown: Instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 could not be found. Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Request method failure captured: Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 HTTP/1.1 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnUUseSPfBZ21wMbKXJRGg_3JwX-g2oNbYFWGCqBOftiVk0CbRmMsBVYg2kisLau3XmxGQ8tglGu1LpQaO9Kl2Ijhq2yNndreGtKhSt_ES5DG4VfuKuI-QEzyy-VfYdk_xb_R05fVDSHyU8YdzAklQIM-D_uRj69wcpaCfg_tY6uh30 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:40.379911 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/faa16093dc2848ae9758690c9a507115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/faa16093dc2848ae9758690c9a507115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_faa16093dc2848ae9758690c9a507115"}]}] Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: faa16093dc2848ae9758690c9a507115 Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1412693918 Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d59c0d1831e4439381c37b506249da30 Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServersNegativeTestJSON-1412693918-project Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 could not be found. Nov 02 13:49:40.382667 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '49590101-83f7-4aa2-a3ca-ea29a1e877e0'} Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 could not be found. Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:40.384296 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 could not be found. Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 could not be found. Nov 02 13:49:40.385817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:40.387046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] Returning 404 to user: Instance 49590101-83f7-4aa2-a3ca-ea29a1e877e0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:40.387046 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bffcbd14-c95b-4132-aff8-c50b07ece26e tempest-ListServersNegativeTestJSON-1412693918 tempest-ListServersNegativeTestJSON-1412693918-project] 10.222.0.18 "GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0" status: 404 len: 111 microversion: 2.1 time: 0.095523 Nov 02 13:49:40.387046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1053/2009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:40 2022] GET /compute/v2.1/servers/49590101-83f7-4aa2-a3ca-ea29a1e877e0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:40.390128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.403208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:40.409396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.417471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.420813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.423190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.423927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.424946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.426134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.429260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.430152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.435510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.436135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.436583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.478209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:40.593519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.620099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.623356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.642369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78fadb15-194c-48e4-b55e-b6e4f0156bf2 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1533 microversion: 2.91 time: 0.258523 Nov 02 13:49:40.651053 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1054/2010] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:40 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1533 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:40.678230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.678953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:40.696514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.697288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.697938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.698834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.699483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.700274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.880082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] Lazy-loading 'services' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:40.946754 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a3887fd-d3a3-435e-91e6-fd1d14211b49 tempest-UnshelveToHostMultiNodesTest-79141579 tempest-UnshelveToHostMultiNodesTest-79141579-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1938 microversion: 2.91 time: 0.272953 Nov 02 13:49:40.962566 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1055/2011] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:40 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1938 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:49:40.990889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.991799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.000450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.005128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.007367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.008832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.010908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.013426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.070963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:41.252318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-515b4f45-8381-48ce-9a28-7063769849ab tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 204 len: 0 microversion: 2.91 time: 0.262608 Nov 02 13:49:41.257687 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1056/2012] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:49:40 2022] DELETE /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:41.268409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.269391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.279492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.280464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.281434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.283157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.283818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.284390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.388530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.413977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.424916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.436885 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fff55bad-1417-4ba4-8b55-91727080c63f tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.176424 Nov 02 13:49:41.438395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1057/2013] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:41.456629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.458173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.470645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.471867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.472604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.473811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.474778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.475511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.585627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.600680 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-48f772b5-c519-4949-b18c-fec68d33522e tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1473 microversion: 2.1 time: 1.238793 Nov 02 13:49:41.604379 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 957/2014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:40 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1473 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:41.618936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.620055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.641618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.642719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.643319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.644187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.644789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.645331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.693734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.704535 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8faf9120-5088-42c7-8827-38f5726a1106 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.263991 Nov 02 13:49:41.705437 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1058/2015] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:41.714314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.715220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.724342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.725137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.725746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.726794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.727522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.728219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.764595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:41.876258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21de4ee2-add0-4993-8242-4cc494afc6a3 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 204 len: 0 microversion: 2.1 time: 0.165476 Nov 02 13:49:41.877324 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1059/2016] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:41 2022] DELETE /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:41.886531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.887271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.895407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.895709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.896195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.897027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.897533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.898009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.098781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.112891 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40cc784d-4d68-425b-ad22-bc4d5eba5847 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1467 microversion: 2.1 time: 0.230374 Nov 02 13:49:42.129587 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1060/2017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:42.140093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.158231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.159805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.181355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e038ce10-899e-48a2-8630-814bbe3c78ef tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.574965 Nov 02 13:49:42.183321 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 958/2018] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:42.322237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a7c0f16-520e-402d-9ac4-daa364938896 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '.version_select at 0x7f6f85df74c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.365947 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6a7c0f16-520e-402d-9ac4-daa364938896 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Image not found. Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a7c0f16-520e-402d-9ac4-daa364938896 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/ae3532bb-6f75-4f46-845c-1d4dafb26793 HTTP/1.1 Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:42.368912 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ae3532bb-6f75-4f46-845c-1d4dafb26793'} Nov 02 13:49:42.371764 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae3532bb-6f75-4f46-845c-1d4dafb26793 to delete Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.373589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae3532bb-6f75-4f46-845c-1d4dafb26793 could not be found. Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:42.377966 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a7c0f16-520e-402d-9ac4-daa364938896 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:42.380278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a7c0f16-520e-402d-9ac4-daa364938896 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/images/ae3532bb-6f75-4f46-845c-1d4dafb26793" status: 404 len: 62 microversion: 2.1 time: 0.055725 Nov 02 13:49:42.381570 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1061/2019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:42 2022] DELETE /compute/v2.1/images/ae3532bb-6f75-4f46-845c-1d4dafb26793 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:49:42.385658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.386259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.401043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.402596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.403547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.404693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.405356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.406081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.435630 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 HTTP/1.1 Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:42.437605 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.439539 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1'} Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:42.440913 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.443708 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.445749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:42.445749 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f90de26-68fb-47dc-814f-e77d324737f9 tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 404 len: 111 microversion: 2.1 time: 0.062331 Nov 02 13:49:42.445749 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 959/2020] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:42 2022] DELETE /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:49:42.448400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.449032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] [instance: e8148766-4f8e-47b9-b16b-e7591434c2b1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.458743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.459285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.459730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.460473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.460938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.461372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.472582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.474187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.483326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.484252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.484963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.486734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.487513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.488184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.498678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] HTTP exception thrown: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Request method failure captured: Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 HTTP/1.1 Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnTLMwiJnNSiogVDklyehDmb9HSyf1ncfL4hvW_dNqw5clLcXK103k4i4ZlBCLzFLjDT_FQV1N2TMjWd76DWG2bKh2R3rLyhIJr2bsSTmXDDy2uulc0NXV3pjyo_X5zjVX1msXPEuCNfi-Mc5Iw6Q89NXzZFh_aHEUWGRQqLmUgKPm8 Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:42.500916 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f09feb16167e4c8ab42a3ae26d00424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f09feb16167e4c8ab42a3ae26d00424a"}]}] Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f09feb16167e4c8ab42a3ae26d00424a Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-814710766 Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8469267606da4e50bd1e694ee7762547 Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-814710766-project Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.502873 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e8148766-4f8e-47b9-b16b-e7591434c2b1'} Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:42.503916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. Nov 02 13:49:42.505866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:42.508102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] Returning 404 to user: Instance e8148766-4f8e-47b9-b16b-e7591434c2b1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:42.508102 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9ff097f-06a3-443d-819c-245f14c1129d tempest-ImagesOneServerNegativeTestJSON-814710766 tempest-ImagesOneServerNegativeTestJSON-814710766-project] 10.222.0.18 "GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1" status: 404 len: 111 microversion: 2.1 time: 0.058846 Nov 02 13:49:42.518690 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1062/2021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/e8148766-4f8e-47b9-b16b-e7591434c2b1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:42.643721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.643944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.644427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.651936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.652435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.652876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.653888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.654068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.654470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.663075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.666657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.674323 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d11ba9d-594c-475a-9982-48dc5e2c8201 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.207842 Nov 02 13:49:42.675767 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 960/2022] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:42.736964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.738341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.748414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.748988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.752240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.753025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.755471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.755942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.042262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.064678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-159898e4-b12f-4a0c-8cd5-e1fd62cc462a tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1473 microversion: 2.1 time: 0.425421 Nov 02 13:49:43.069782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1063/2023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:43.147584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:43.148564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:43.163673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.170706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.171454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.174044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.174738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.175396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.238036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.254728 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0f28566b-d769-4db6-ba9f-b3f526e01e59 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.525223 Nov 02 13:49:43.271587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 961/2024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:43.288882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:43.301062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:43.325152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.325664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.330925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.333373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.333889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.334329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.501822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.523271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.524799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.533741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:43.544558 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-624dcb06-6c56-4310-9111-5da500454f64 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.278140 Nov 02 13:49:43.545163 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 962/2025] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:43 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:43.670808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.698109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62caf5a8-1afd-4516-8f9e-ad0eea5629e8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1467 microversion: 2.1 time: 0.554243 Nov 02 13:49:43.701259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1064/2026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:43 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1467 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:43.717110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:43.717731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:43.737006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.737912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.740964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.742085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.742746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.745742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.779005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:43.779797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:43.792442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.796229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.796229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.796622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.797046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.803461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.886207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:43.910219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.943609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.945735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.970890 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98b9b085-23c1-49fb-ad31-aa2ce8b30634 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.258137 Nov 02 13:49:43.975996 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 963/2027] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:43 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:44.103622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:44.104540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:44.119611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.120654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.121390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.124071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.124782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.128824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.153357 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e8a94e7-6e91-4775-8eff-655626e2dfbe tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 204 len: 0 microversion: 2.25 time: 0.378320 Nov 02 13:49:44.158167 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1065/2028] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:49:43 2022] DELETE /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:49:44.172861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:44.174309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:44.183723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.184699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.185312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.186427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.187062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.188431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.621023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:44.648412 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5575b30a-b506-42c6-b650-e269ad742bb6 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1473 microversion: 2.1 time: 0.552498 Nov 02 13:49:44.649471 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 964/2029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:44 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1473 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:44.681790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:44.688834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:44.714519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.715337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.723534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.724504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.724798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.725547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.771370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.793785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:45.800668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c0ee45ca-06f7-4bb4-886a-29072f3bccc7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 1.149555 Nov 02 13:49:45.803019 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 965/2030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:44 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:45.817477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:45.818662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:45.825312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.837391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.838397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.840690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.841791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.844648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.845753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.852666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.857419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.860459 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe59ba1d-9271-414d-87f4-f7fc7269171e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1732 microversion: 2.25 time: 1.695352 Nov 02 13:49:45.877930 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1066/2031] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:44 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1732 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:45.910028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:45.911062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:45.941904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.942840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.943797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.945065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.946014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.946904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.965864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:46.180555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.196085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.198241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.205906 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a143381-b7f6-4e9d-bec3-ec797e776f2d tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.400014 Nov 02 13:49:46.221583 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 966/2032] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:45 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:46.239504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:46.240551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:46.248326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.249532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.250303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.251886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.252589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.253200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.448928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.468821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.486840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.502386 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b6d238e-1a4d-4c19-9d4a-0cb94e516164 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1539 microversion: 2.91 time: 0.278946 Nov 02 13:49:46.503475 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 967/2033] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:46 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1539 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:46.524497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:46.525675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:46.548687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.549514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.550321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.551621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.552703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.553440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.867835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.880288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc8c04aa-a8c2-49d4-bb57-2275fa75c7d5 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1467 microversion: 2.1 time: 1.000272 Nov 02 13:49:46.881584 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1067/2034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:45 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1467 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:46.889343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:46.891655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:46.902733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.904037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.905299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.908181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.909048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.909983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.956215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.965542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-947f551e-2cdf-4b88-9d10-42a60a16c470 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1473 microversion: 2.1 time: 0.460629 Nov 02 13:49:46.966155 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 968/2035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:46 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1473 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:46.975800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:46.976237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:46.996523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.997290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.997906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.998828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.999472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.000061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.268501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.298487 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77e6f231-b1c7-47e4-85da-5d66e9a2f09f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.415221 Nov 02 13:49:47.303520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1068/2036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:46 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:47.340056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.345308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.370882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.374432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.381805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.385480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.386440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.391745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.742616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.761041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.770883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.772434 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5849d393-f491-4c9b-9c36-81ae622e7bae tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1732 microversion: 2.25 time: 0.802238 Nov 02 13:49:47.780968 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 969/2037] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:46 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1732 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:47.804431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.804688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.806095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.821785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.824725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.829811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.833702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.837859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.838987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.841288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.843215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.846504 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3f4f028-a405-4295-ab50-b842d7fb4984 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.541205 Nov 02 13:49:47.856079 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1069/2038] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:47.866027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2e412c9d-5a00-4827-91a3-451e0abfe022 req-61497257-7049-419d-b767-e63c847c4fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51abafa0-0a60-40be-a3fb-e3a2432312a3", "name": "network-vif-deleted", "tag": "170b76f2-e7e1-4778-9b1d-ddb44c16387a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:47.900051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e412c9d-5a00-4827-91a3-451e0abfe022 req-61497257-7049-419d-b767-e63c847c4fd5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.901314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e412c9d-5a00-4827-91a3-451e0abfe022 req-61497257-7049-419d-b767-e63c847c4fd5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.901937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e412c9d-5a00-4827-91a3-451e0abfe022 req-61497257-7049-419d-b767-e63c847c4fd5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.916439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2e412c9d-5a00-4827-91a3-451e0abfe022 req-61497257-7049-419d-b767-e63c847c4fd5 service nova] Creating event network-vif-deleted:170b76f2-e7e1-4778-9b1d-ddb44c16387a for instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 on n-h2-858238-3 Nov 02 13:49:47.923635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2e412c9d-5a00-4827-91a3-451e0abfe022 req-61497257-7049-419d-b767-e63c847c4fd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069672 Nov 02 13:49:47.925522 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1070/2039] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:47.938526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.941877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.958337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.959175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.959873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.960812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.961552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.962149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.989114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.989705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.998603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.999211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lazy-loading 'fault' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:48.013385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.013943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.014381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.014850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lazy-loading 'fault' on Instance uuid 51abafa0-0a60-40be-a3fb-e3a2432312a3 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:48.139357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.157380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.160571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.172858 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-00543645-8d20-425a-be67-bc612830bcd8 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1544 microversion: 2.91 time: 0.388979 Nov 02 13:49:48.180156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.193141 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d99c3854-1989-4f6b-8098-7ba6b990df85 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 200 len: 1301 microversion: 2.1 time: 0.263609 Nov 02 13:49:48.204635 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1071/2041] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 1301 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:48.205096 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 970/2041] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1544 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:48.222039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.222719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.239340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.240579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.243241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.244231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.244883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.246055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.333821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.335086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.354306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.357665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.358212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.359128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.375189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.375189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.840910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.898839 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f1b2c32-981a-4e1e-8aaf-400051ac8f78 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.570819 Nov 02 13:49:48.910329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce568516a23489fbd362ea2fa01983b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726861de17a4726b20716d8f60920b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.923150 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fa995a7-7b9b-4f1e-b172-78e50ee57680 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 200 len: 1473 microversion: 2.1 time: 0.716803 Nov 02 13:49:48.923743 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1072/2043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 1473 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:48.926740 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 971/2043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:48.940269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.940887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.947810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.947942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.948273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.952112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.955391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.956109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.969884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-664558fc-7192-4fc9-a428-41dcae8eb1f2 req-6fc03096-a13d-4368-8410-9e18a3cde417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e21f8e6-6847-46ed-baa2-5e32250d0fdb", "name": "network-vif-deleted", "tag": "3e32b06e-d1bc-47d8-a388-baf3c82b7ef5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:49.022040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-664558fc-7192-4fc9-a428-41dcae8eb1f2 req-6fc03096-a13d-4368-8410-9e18a3cde417 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.023333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-664558fc-7192-4fc9-a428-41dcae8eb1f2 req-6fc03096-a13d-4368-8410-9e18a3cde417 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.024060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-664558fc-7192-4fc9-a428-41dcae8eb1f2 req-6fc03096-a13d-4368-8410-9e18a3cde417 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.084061 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-664558fc-7192-4fc9-a428-41dcae8eb1f2 req-6fc03096-a13d-4368-8410-9e18a3cde417 service nova] Creating event network-vif-deleted:3e32b06e-d1bc-47d8-a388-baf3c82b7ef5 for instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb on n-h2-858238-3 Nov 02 13:49:49.089893 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-664558fc-7192-4fc9-a428-41dcae8eb1f2 req-6fc03096-a13d-4368-8410-9e18a3cde417 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131207 Nov 02 13:49:49.091539 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 972/2044] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:49.101585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.102296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.117483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.117990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.119066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.119828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.120344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.120715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.159417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.186912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.193505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.196984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-975594a4-af4d-47b5-9f32-652141e6897f tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1665 microversion: 2.25 time: 0.260728 Nov 02 13:49:49.199275 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1073/2045] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1665 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:49.221240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.222368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: 51abafa0-0a60-40be-a3fb-e3a2432312a3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.273826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.277906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.278611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.281491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.284341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.288555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.289085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.298039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.299669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.319299 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-191d1f60-f02b-4767-89b2-5b236cf6b9b0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.223473 Nov 02 13:49:49.321747 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 973/2046] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:49.328391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.329588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.368257 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] HTTP exception thrown: Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 could not be found. Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Request method failure captured: Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 HTTP/1.1 Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnOwRRobiZjta6cA67j6MWDRAWVZYVr-SeY9utExqxufKSE-nbfWj-TRAxs37wu3cUELlJIuVr-SXsOE6h2x-feqNZfhkljWTblmwexe1Ysk_Yr-O76O67AScI1BxfkXsnhq7r3dYjP64X2Uon5c_pHcaKNWXrYNRniSjXSQJ2Nflnw Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:49.370539 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f98d747d0ec34f2e97593bb75a32d02c"}]}] Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 832cd460bb5e4148a57d561f762ceb11 Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 could not be found. Nov 02 13:49:49.372719 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '51abafa0-0a60-40be-a3fb-e3a2432312a3'} Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 could not be found. Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:49.374119 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 could not be found. Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 could not be found. Nov 02 13:49:49.377017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.383042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.383042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.383042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.383571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Returning 404 to user: Instance 51abafa0-0a60-40be-a3fb-e3a2432312a3 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:49.383571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7983f6a-2cf9-400c-9f89-0db8aaf51238 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3" status: 404 len: 111 microversion: 2.1 time: 0.165842 Nov 02 13:49:49.383571 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1074/2047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/51abafa0-0a60-40be-a3fb-e3a2432312a3 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:49:49.384631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.385477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.392822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.393723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.401090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.405568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.407039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.407954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.409151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.410110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.411315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.518017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.519988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.520673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.521435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lazy-loading 'fault' on Instance uuid 4c7da56a-4515-4112-893e-7d0cdb1b1f62 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:49.559500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:49.861061 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-755508c2-5353-4951-9790-ee2b54573b61 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 204 len: 0 microversion: 2.1 time: 0.469338 Nov 02 13:49:49.862294 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1075/2048] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:49:49 2022] DELETE /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:49.872044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.872756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.912609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.915578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.916181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.917263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.920856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.922430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.212851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.229543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.235997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aafce844b6045718db889470bcb581f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f92ae1b5e43beb07ac79aad191d32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.255523 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4c122b5f-2aed-407e-bb92-31f365f9e325 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 200 len: 1544 microversion: 2.91 time: 0.931341 Nov 02 13:49:50.257030 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 974/2049] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 1544 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:50.308027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.308915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.343799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.346062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.346952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.349527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.353903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.354765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.650414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.659859 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4b89e3f9-3cb7-4f9c-9a59-f4d2fda1c2a2 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.358958 Nov 02 13:49:50.660465 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 975/2050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:50.668158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.669038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] [instance: 7e21f8e6-6847-46ed-baa2-5e32250d0fdb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.676036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.676734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.677618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.678499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.679156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.679885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.713873 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] HTTP exception thrown: Instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb could not be found. Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Request method failure captured: Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb HTTP/1.1 Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnTIw0edaKGzLgXXrBwkGrtjQvybeLuZeq5EnnwZjGn61vDPp30y7TCtQdQX6-8gUEltkInvFopLOST-SaREfSixr0A-BpOdXubVcFBUdRRR-ZzmUh_npUYsfkqmltFWYYDPNfJ_mt9Ghq4lBYaUZ2XoaD_h0s15TdNJs6fjMDEqOdQ Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d726861de17a4726b20716d8f60920b5 Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ListImageFiltersTestJSON-632486438 Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:50.715600 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d726861de17a4726b20716d8f60920b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d726861de17a4726b20716d8f60920b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d726861de17a4726b20716d8f60920b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d726861de17a4726b20716d8f60920b5"}]}] Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ListImageFiltersTestJSON-632486438 Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d726861de17a4726b20716d8f60920b5 Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-632486438 Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ListImageFiltersTestJSON-632486438-project Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 2ce568516a23489fbd362ea2fa01983b Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ListImageFiltersTestJSON-632486438-project Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb could not be found. Nov 02 13:49:50.717402 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '7e21f8e6-6847-46ed-baa2-5e32250d0fdb'} Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb could not be found. Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:50.718412 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb could not be found. Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb could not be found. Nov 02 13:49:50.720214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.721714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Returning 404 to user: Instance 7e21f8e6-6847-46ed-baa2-5e32250d0fdb could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:50.721714 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e6302fba-8ca9-4e42-a979-7a3b1732f38d tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb" status: 404 len: 111 microversion: 2.1 time: 0.052682 Nov 02 13:49:50.721714 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 976/2051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/7e21f8e6-6847-46ed-baa2-5e32250d0fdb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:50.726364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.726973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.738513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.739005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.740333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.741349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.742857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.743370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.846965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.864421 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93f86473-3b01-4683-a0ef-c9eb136bb42b tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1469 microversion: 2.1 time: 0.996546 Nov 02 13:49:50.866846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1076/2052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1469 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:50.879792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.890395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.891052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.912550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.926955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:50.927868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.933899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.934145 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5210e4eb-04f2-462d-bd45-5ccc218fac8b tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 200 len: 1665 microversion: 2.25 time: 0.210707 Nov 02 13:49:50.936877 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 977/2053] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 1665 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:50.938347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.939927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.940826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.944045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.944988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.958493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-52dad66a-e68c-49d6-b005-d893c18f6ad7 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81c734c0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.256104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.279745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.282123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.297490 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7016bb0b-32a5-4bb3-bc9c-1670c2c9f74b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.428416 Nov 02 13:49:51.314642 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1077/2054] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:51.336154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7724ed15-95c2-4ff1-81d1-6b4f4bef4bf1 req-6f9592d7-ec27-4ea5-931c-d7a04fe48224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3426fa2d-9b02-4df3-8af1-6fb412017b0e", "name": "network-vif-deleted", "tag": "63dfc207-aeb4-4650-96b1-e22bd52c850e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:51.380163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7724ed15-95c2-4ff1-81d1-6b4f4bef4bf1 req-6f9592d7-ec27-4ea5-931c-d7a04fe48224 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.380538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7724ed15-95c2-4ff1-81d1-6b4f4bef4bf1 req-6f9592d7-ec27-4ea5-931c-d7a04fe48224 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.384369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7724ed15-95c2-4ff1-81d1-6b4f4bef4bf1 req-6f9592d7-ec27-4ea5-931c-d7a04fe48224 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.409038 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7724ed15-95c2-4ff1-81d1-6b4f4bef4bf1 req-6f9592d7-ec27-4ea5-931c-d7a04fe48224 service nova] Creating event network-vif-deleted:63dfc207-aeb4-4650-96b1-e22bd52c850e for instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e on n-h2-858238-3 Nov 02 13:49:51.419628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7724ed15-95c2-4ff1-81d1-6b4f4bef4bf1 req-6f9592d7-ec27-4ea5-931c-d7a04fe48224 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103575 Nov 02 13:49:51.432224 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1078/2055] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:51.439008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.441288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] [instance: 4c7da56a-4515-4112-893e-7d0cdb1b1f62] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.463818 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-52dad66a-e68c-49d6-b005-d893c18f6ad7 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/images/f1aa993d-c346-4910-a3d1-b0bc5208c5a2" status: 204 len: 0 microversion: 2.1 time: 0.524113 Nov 02 13:49:51.468557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 978/2056] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:50 2022] DELETE /compute/v2.1/images/f1aa993d-c346-4910-a3d1-b0bc5208c5a2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:51.476139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-59bd632f-aa2a-4ef5-ae73-d0ba2f1cb6b5 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f81f2f0d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.477692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.479889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.481025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.486624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.487783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.488396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.506371 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] HTTP exception thrown: Instance 4c7da56a-4515-4112-893e-7d0cdb1b1f62 could not be found. Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Request method failure captured: Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 HTTP/1.1 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnSqlMf4hq6zNRxOiHxl6QO0lO0vUVTs9VzuyYY5x6ZXb886Oa_KEQuuU6nG8jObb_FfaRnFuMvYr5-bjonAKd5NQFHAAOlTAayX5VQk8XOrp2sm-lVkaaD3ZjDxRj6m6-9_dIUvjdq2fYkE2Ownc3RKozWVOWYjNi-R1LV8kGD9SNo Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a31f92ae1b5e43beb07ac79aad191d32 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1518378708 Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:51.508102 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a31f92ae1b5e43beb07ac79aad191d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a31f92ae1b5e43beb07ac79aad191d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a31f92ae1b5e43beb07ac79aad191d32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a31f92ae1b5e43beb07ac79aad191d32"}]}] Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1518378708 Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a31f92ae1b5e43beb07ac79aad191d32 Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1518378708 Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-UnshelveToHostMultiNodesTest-1518378708-project Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 2aafce844b6045718db889470bcb581f Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1518378708-project Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 4c7da56a-4515-4112-893e-7d0cdb1b1f62 could not be found. Nov 02 13:49:51.510326 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '4c7da56a-4515-4112-893e-7d0cdb1b1f62'} Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7da56a-4515-4112-893e-7d0cdb1b1f62 could not be found. Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:51.511983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7da56a-4515-4112-893e-7d0cdb1b1f62 could not be found. Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7da56a-4515-4112-893e-7d0cdb1b1f62 could not be found. Nov 02 13:49:51.513771 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.517026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] Returning 404 to user: Instance 4c7da56a-4515-4112-893e-7d0cdb1b1f62 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:51.517026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb260524-3691-4c83-8324-c1b8b96cc745 tempest-UnshelveToHostMultiNodesTest-1518378708 tempest-UnshelveToHostMultiNodesTest-1518378708-project] 10.222.0.18 "GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62" status: 404 len: 111 microversion: 2.91 time: 0.075861 Nov 02 13:49:51.517026 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1079/2057] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:51 2022] GET /compute/v2.1/servers/4c7da56a-4515-4112-893e-7d0cdb1b1f62 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:51.717460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.718447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.754820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.755416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.757782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.761029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.762510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.762956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.285991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.294007 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-72fdeff2-53c0-40b3-8fd4-dd442bc535dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.603638 Nov 02 13:49:52.294596 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1080/2058] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:51 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:52.306725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.308432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.324543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.325069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.325677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.326735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.328207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.342912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.533223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.542355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-59bd632f-aa2a-4ef5-ae73-d0ba2f1cb6b5 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/images/92727e46-e89f-470c-83d5-c1474c9313d3" status: 204 len: 0 microversion: 2.1 time: 1.071328 Nov 02 13:49:52.543252 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ca70c90-a10e-4d67-8b36-96e5f9c089c8 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1427 microversion: 2.1 time: 0.247408 Nov 02 13:49:52.546431 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1081/2060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1427 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:52.547890 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 979/2060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:51 2022] DELETE /compute/v2.1/images/92727e46-e89f-470c-83d5-c1474c9313d3 => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:52.553710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.554318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.556555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.557168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 3426fa2d-9b02-4df3-8af1-6fb412017b0e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.583082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.583696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.584142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.587971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.588453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.588881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.595277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.596064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.596673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.604179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.604644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.605044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.641395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] HTTP exception thrown: Instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e could not be found. Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Request method failure captured: Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e HTTP/1.1 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnONizrRuvh9Qi3guAVicr5HCnpjUIE7xvDeQh4miwHJl3AJYCuGaslYLwjaV_Gnux9u3HNhVKhXVH62e-PP1QYB06YjKC9VMvsCGuCtTFRyF8kcMTsWOHgbzGMGysOCoerm2rOFuyJikFi97URrYK-4Z_eXn9GMmYeAyj8-F8lfAhc Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:49:52.642973 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_21ac2eda404042c0871fc312f0b9f705"}]}] Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 55e26f05091944cb910f81488056c057 Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e could not be found. Nov 02 13:49:52.644772 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3426fa2d-9b02-4df3-8af1-6fb412017b0e'} Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e could not be found. Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:52.645714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e could not be found. Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e could not be found. Nov 02 13:49:52.647166 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.651171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Returning 404 to user: Instance 3426fa2d-9b02-4df3-8af1-6fb412017b0e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:52.651171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f0d3405-da59-428c-bd11-4f8c17a2d639 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e" status: 404 len: 111 microversion: 2.25 time: 0.091937 Nov 02 13:49:52.653556 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1082/2061] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/3426fa2d-9b02-4df3-8af1-6fb412017b0e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:52.659294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02cb878e-829a-4b63-806c-763e08648421 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] Calling method '.version_select at 0x7f6f820cf940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.861515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.875132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.876912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.889471 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-abf1fede-98a1-488a-a3a0-c7cdc6eccddc tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.340387 Nov 02 13:49:52.894459 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 980/2062] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:52.910253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3dc777e-03c4-4c62-bbbd-2d1dba383a00 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '.version_select at 0x7f6f81f2f4c0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.959996 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3dc777e-03c4-4c62-bbbd-2d1dba383a00 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701718549" status: 204 len: 0 microversion: 2.25 time: 0.063538 Nov 02 13:49:52.963129 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 981/2063] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701718549 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:53.329168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.330128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.362080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.362652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.366290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.369041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.376811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.376811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.814554 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02cb878e-829a-4b63-806c-763e08648421 tempest-ListImageFiltersTestJSON-632486438 tempest-ListImageFiltersTestJSON-632486438-project] 10.222.0.18 "DELETE /compute/v2.1/images/065af578-d211-4076-bc98-5834a41e8314" status: 204 len: 0 microversion: 2.1 time: 1.159563 Nov 02 13:49:53.819448 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1083/2064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:52 2022] DELETE /compute/v2.1/images/065af578-d211-4076-bc98-5834a41e8314 => generated 0 bytes in 1161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:53.833667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.836132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.871160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.871782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.873869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.881588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.883861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.887224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.917211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.941025 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-95ca6b3b-2bb7-4c2d-a263-b27ab044e698 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.619999 Nov 02 13:49:53.953662 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 982/2065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:53.974520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.975335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.991570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.992100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.992591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.006218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.008560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.010640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.011579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lazy-loading 'fault' on Instance uuid c8169e59-d6a0-4edd-8a16-a69424518ad1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:54.023828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.027559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.031767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.200901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:54.224436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:54.228468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:54.244210 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d3c6f3de-c97c-4957-b81b-8781f8391b5b tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.286250 Nov 02 13:49:54.245572 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 983/2066] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:54.265273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d6ce5839-05ab-4ecb-a0db-657dc5efb7ae req-42f2c7f1-2b7a-4899-b074-2a359d887a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8169e59-d6a0-4edd-8a16-a69424518ad1", "name": "network-vif-deleted", "tag": "cbc2b2f0-a287-4e97-aa3b-58d2e0db3533"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:54.301456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d6ce5839-05ab-4ecb-a0db-657dc5efb7ae req-42f2c7f1-2b7a-4899-b074-2a359d887a7c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.303337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d6ce5839-05ab-4ecb-a0db-657dc5efb7ae req-42f2c7f1-2b7a-4899-b074-2a359d887a7c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.306102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d6ce5839-05ab-4ecb-a0db-657dc5efb7ae req-42f2c7f1-2b7a-4899-b074-2a359d887a7c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.356134 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d6ce5839-05ab-4ecb-a0db-657dc5efb7ae req-42f2c7f1-2b7a-4899-b074-2a359d887a7c service nova] Creating event network-vif-deleted:cbc2b2f0-a287-4e97-aa3b-58d2e0db3533 for instance c8169e59-d6a0-4edd-8a16-a69424518ad1 on n-h1-858238-3 Nov 02 13:49:54.360179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832cd460bb5e4148a57d561f762ceb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98d747d0ec34f2e97593bb75a32d02c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:54.369180 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7151f3d1-31cc-4be0-bc06-bc05303e4740 tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 200 len: 1303 microversion: 2.1 time: 0.547935 Nov 02 13:49:54.373343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1084/2067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 1303 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:54.382407 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d6ce5839-05ab-4ecb-a0db-657dc5efb7ae req-42f2c7f1-2b7a-4899-b074-2a359d887a7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128398 Nov 02 13:49:54.384011 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 984/2068] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:54.645011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.646229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:54.657389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.657964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.658347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.659618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.660078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.660728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.710254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:54.713459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:54.853641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95fd18d5-1fc0-4935-bc87-20466f70840a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 204 len: 0 microversion: 2.25 time: 0.213145 Nov 02 13:49:54.859913 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1085/2069] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:49:54 2022] DELETE /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:54.891875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.893839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:54.925006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.925980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.929265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.935129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.937934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.941573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.990522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.993479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:55.018549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:55.019423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:55.020046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.021108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:55.021792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:55.022363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.401640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.421497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.428315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.432355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ad68fa87-2acd-41fe-b275-e7e72d93bcac tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1548 microversion: 2.25 time: 0.570546 Nov 02 13:49:55.435326 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 985/2070] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:54 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1548 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:55.451364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:55.451364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:55.458808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:55.458808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:55.458808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.459909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:55.460623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:55.461226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.553527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.567321 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e119ced-76c2-4352-ae70-97c1cd47f803 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.587885 Nov 02 13:49:55.577335 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1086/2071] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:54 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:55.587776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.590634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:55.621280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.624330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.634419 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a64e6ebd-3489-48de-a7d8-07e6f779b5ff tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.196457 Nov 02 13:49:55.641298 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 986/2072] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:55 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:55.654255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:55.654881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] [instance: c8169e59-d6a0-4edd-8a16-a69424518ad1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:55.662103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:55.662970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:55.663806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.664566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:55.665831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:55.667137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.712283 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] HTTP exception thrown: Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 could not be found. Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Request method failure captured: Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 HTTP/1.1 Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnOwRRobiZjta6cA67j6MWDRAWVZYVr-SeY9utExqxufKSE-nbfWj-TRAxs37wu3cUELlJIuVr-SXsOE6h2x-feqNZfhkljWTblmwexe1Ysk_Yr-O76O67AScI1BxfkXsnhq7r3dYjP64X2Uon5c_pHcaKNWXrYNRniSjXSQJ2Nflnw Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:55.715297 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f98d747d0ec34f2e97593bb75a32d02c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f98d747d0ec34f2e97593bb75a32d02c"}]}] Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f98d747d0ec34f2e97593bb75a32d02c Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-MigrationsAdminTest-1356591282 Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 832cd460bb5e4148a57d561f762ceb11 Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-MigrationsAdminTest-1356591282-project Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 could not be found. Nov 02 13:49:55.717272 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'c8169e59-d6a0-4edd-8a16-a69424518ad1'} Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 could not be found. Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:55.719079 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 could not be found. Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 could not be found. Nov 02 13:49:55.721256 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:55.722797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] Returning 404 to user: Instance c8169e59-d6a0-4edd-8a16-a69424518ad1 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:55.722797 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fb04a255-5a06-4134-8126-8faa06a8384e tempest-MigrationsAdminTest-1356591282 tempest-MigrationsAdminTest-1356591282-project] 10.222.0.18 "GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1" status: 404 len: 111 microversion: 2.1 time: 0.076036 Nov 02 13:49:55.722797 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 987/2073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:55 2022] GET /compute/v2.1/servers/c8169e59-d6a0-4edd-8a16-a69424518ad1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:55.989970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-950138119", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:56.083485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:56.084963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:56.085839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:56.086437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:56.087013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:56.098587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.099407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.100028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.101089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.101719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.102330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.141376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Getting quotas for project 0b20b8b5a5dd4b16b50b5a21e7404434. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:56.148955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Getting quotas for user 40202cc920ce485f9aaec9a12a17ad5f and project 0b20b8b5a5dd4b16b50b5a21e7404434. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:56.169228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:56.172349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:56.237420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a690c541-841a-483c-850f-b70d48b6c10d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.647373 Nov 02 13:49:56.247113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1087/2074] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:49:56.255620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5ccede5b-827a-400b-b695-77377002598b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:56.256293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5ccede5b-827a-400b-b695-77377002598b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:56.383626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5ccede5b-827a-400b-b695-77377002598b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.397399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5ccede5b-827a-400b-b695-77377002598b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.400629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5ccede5b-827a-400b-b695-77377002598b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.401830 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5ccede5b-827a-400b-b695-77377002598b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1280 microversion: 2.47 time: 0.152996 Nov 02 13:49:56.422137 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 988/2075] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:56 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:56.448523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8fd2ee12-82ba-41f9-bfa9-2cab9371287b req-0be15746-ffc1-470a-9b53-a1160f02752c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e488881-f0fd-4003-8123-191cb92828d2", "name": "network-vif-unplugged", "status": "completed", "tag": "6fed398e-5731-4b96-a8ff-6f32125ca657"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:56.466532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:56.467212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:56.474512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.474992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.485524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.486520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8fd2ee12-82ba-41f9-bfa9-2cab9371287b req-0be15746-ffc1-470a-9b53-a1160f02752c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.487011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8fd2ee12-82ba-41f9-bfa9-2cab9371287b req-0be15746-ffc1-470a-9b53-a1160f02752c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.488044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.489415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.490968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8fd2ee12-82ba-41f9-bfa9-2cab9371287b req-0be15746-ffc1-470a-9b53-a1160f02752c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.495292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.528603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8fd2ee12-82ba-41f9-bfa9-2cab9371287b req-0be15746-ffc1-470a-9b53-a1160f02752c service nova] Creating event network-vif-unplugged:6fed398e-5731-4b96-a8ff-6f32125ca657 for instance 6e488881-f0fd-4003-8123-191cb92828d2 on n-h2-858238-3 Nov 02 13:49:56.553284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8fd2ee12-82ba-41f9-bfa9-2cab9371287b req-0be15746-ffc1-470a-9b53-a1160f02752c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104937 Nov 02 13:49:56.556705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1088/2076] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:56.597843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:56.598652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:56.613367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.614053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.614672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.615576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.616197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.616975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.912162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.926210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.931405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.935691 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d81989e5-83bb-4ec1-b900-d8e0c83cdcd2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1548 microversion: 2.25 time: 0.471109 Nov 02 13:49:56.938538 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 989/2077] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:56 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1548 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:56.945636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:56.946525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:56.963506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.975966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.978251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.979721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.981501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.982953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.137348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.154810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.166383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.186680 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-25e224b1-d7dc-4ede-b0eb-22745b06d480 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.246654 Nov 02 13:49:57.192274 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 990/2078] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:56 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:57.446957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:57.447633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.466260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.466849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.467338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.468242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.469269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.471694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.521083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.541824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ddfd943b-c0d9-47c5-9676-ba04321397da tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.948287 Nov 02 13:49:57.552777 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1089/2079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:56 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:57.776857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.786679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.789629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.791536 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2675c68-2e21-4571-9f97-e6a5dad2fc63 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1332 microversion: 2.47 time: 0.361711 Nov 02 13:49:57.796880 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 991/2080] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:57 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1332 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:57.973288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:57.974162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.983762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.985059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.985705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.987018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.987815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.988589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.051974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.053159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.053766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.054826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lazy-loading 'fault' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:58.144186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.161195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.164797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.169271 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92d361b7-a9e0-4ae1-ab02-577a80464467 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1352 microversion: 2.25 time: 0.202586 Nov 02 13:49:58.172584 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1090/2081] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:57 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1352 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:58.224141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:58.225016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:58.242404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.245808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.246892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.250868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.251807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.254961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.408857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.417505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.421408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.431017 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5820a254-12ff-4c4f-9af4-be187d862569 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.211332 Nov 02 13:49:58.431781 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 992/2082] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:58 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:58.573617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1", "name": "network-vif-deleted", "tag": "f76f283a-7454-4b94-a823-c32b31a249d0"}, {"name": "network-changed", "server_uuid": "6e488881-f0fd-4003-8123-191cb92828d2", "tag": "6fed398e-5731-4b96-a8ff-6f32125ca657"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:58.582296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:58.582932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:58.592600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.593865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.594461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.597391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.598013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.598326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.599051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.599541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.599983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.612705 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] Creating event network-vif-deleted:f76f283a-7454-4b94-a823-c32b31a249d0 for instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 on n-h2-858238-3 Nov 02 13:49:58.613496 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] Creating event network-changed:6fed398e-5731-4b96-a8ff-6f32125ca657 for instance 6e488881-f0fd-4003-8123-191cb92828d2 on n-h2-858238-3 Nov 02 13:49:58.620634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f3d4ecf0-ee62-455d-b914-f66f24031590 req-b57bb7db-191e-4733-91f8-fb2c22ce8367 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051028 Nov 02 13:49:58.621564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1091/2083] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:58.883310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:58.894689 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b4187f01-8170-4576-bbd7-58a9429c7182 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.319837 Nov 02 13:49:58.895471 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 993/2084] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:58 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:58.901761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:58.904112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:58.915226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.915746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.916502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.917673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.918404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.919002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.008126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.017304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.019296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.020694 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dff670f2-bba3-49a7-860b-81af9d3c0b29 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1338 microversion: 2.47 time: 0.123094 Nov 02 13:49:59.035670 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 994/2085] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:58 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1338 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:59.270432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a182a84-0738-494a-806d-e469fa7ae002 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f825c8af0>, body: {"keypair": {"name": "tempest-keypair-608590417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIGy5iS0BUsbLxFFlMEb9S4k/q043npGhQxw5BcwGdYNtHHeyW9b35c3H2zfu0HDQFRY/+nbgLTIxvN2YVZETMd1FuDqAEq3X0+p9JJyhOvl4/XNM134s0pEfKOPecLCg=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.306818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9a182a84-0738-494a-806d-e469fa7ae002 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:59.316129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9a182a84-0738-494a-806d-e469fa7ae002 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:59.367043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a182a84-0738-494a-806d-e469fa7ae002 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.743869 Nov 02 13:49:59.368100 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1092/2086] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:49:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 746 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:49:59.379461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.380197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:59.387319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.387811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.388245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.388980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.389387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.389813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.410579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-753b08d6-3dd6-4a4e-a628-d23b34cd26f9 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f81e545e0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl0f30jZgH3q4aqs29uZI6weq1Ds8m2NVGdplBbk0gnSj9cWRKcGPqVPoRIPX1rBEqVH+NNBHF3rJY7wvVecNb2AUCaz7uwV+DHcEIjPrhNFqtigMnTsaT81/yu3193Nw=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-753b08d6-3dd6-4a4e-a628-d23b34cd26f9 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 257 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:59.429762 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl0f30jZgH3q4aqs29uZI6weq1Ds8m2NVGdplBbk0gnSj9cWRKcGPqVPoRIPX1rBEqVH+NNBHF3rJY7wvVecNb2AUCaz7uwV+DHcEIjPrhNFqtigMnTsaT81/yu3193Nw=="}} Nov 02 13:49:59.431480 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl0f30jZgH3q4aqs29uZI6weq1Ds8m2NVGdplBbk0gnSj9cWRKcGPqVPoRIPX1rBEqVH+NNBHF3rJY7wvVecNb2AUCaz7uwV+DHcEIjPrhNFqtigMnTsaT81/yu3193Nw=='}}} Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:49:59.432377 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:49:59.433769 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:49:59.436856 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:49:59.444601 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:49:59.444601 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.444601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-753b08d6-3dd6-4a4e-a628-d23b34cd26f9 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:59.445263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.445464 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-753b08d6-3dd6-4a4e-a628-d23b34cd26f9 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.396723 Nov 02 13:49:59.445713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.445713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.446135 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 995/2087] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:59.446352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lazy-loading 'fault' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:59.448137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b5ab89c8-3198-4534-8b9a-4d3e716c4681 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f818c0790>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.463163 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b5ab89c8-3198-4534-8b9a-4d3e716c4681 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-608590417" status: 200 len: 512 microversion: 2.2 time: 0.026288 Nov 02 13:49:59.473235 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 996/2088] 10.222.0.18 () {60 vars in 1255 bytes} [Wed Nov 2 13:49:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-608590417 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:59.481936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f81ec1d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-17232919", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.509971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.529558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:59.535060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.544264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.545567 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-081e16ac-548e-48ca-85ce-adf26a65fda8 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1352 microversion: 2.25 time: 0.176136 Nov 02 13:49:59.547300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1093/2089] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:59 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:59.549700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for user 54e5691742af4057905a4f12e5e2e1ba and project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:59.553921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:59.559727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.564339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:59.585666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.588391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.588391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.588391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.590267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.590267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.606704 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 2165 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-17232919", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:49:59.639139 n-d-858238-3 devstack@n-api.service[137558]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-17232919', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:59.642807 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.646844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:59.650672 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e10c95e5-63b0-4196-a8fe-f399f9805c97 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.179782 Nov 02 13:49:59.652209 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 997/2090] 10.222.0.18 () {60 vars in 1160 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:49:59.660732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da2f8f2c-288a-48c5-a7f9-8d602cd6c0b8 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81f31160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.699206 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-da2f8f2c-288a-48c5-a7f9-8d602cd6c0b8 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608590417" status: 204 len: 0 microversion: 2.2 time: 0.045511 Nov 02 13:49:59.701969 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 998/2091] 10.222.0.18 () {60 vars in 1258 bytes} [Wed Nov 2 13:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608590417 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:59.723250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a66879d0-abcf-40d4-a911-5b2321f46e7f tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f81ec1940>, body: {"keypair": {"name": "tempest-keypair-1921396042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPqWVmnsTppuDxeJ1lpCUfInsBnMKILBAiCElpAPtgV48EruTNDBLGuVM0aV5zKB7+9De46Wi+RYA+XdeIlCuOjf2UbaX9zIT+HMfS5XGJxGKzkUatVh+dM6qIgtkqgxw=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.723656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.735995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.737791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.745964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55dbd619-7ee6-42c3-bfa3-63efd30638af tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.192483 Nov 02 13:49:59.747070 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1094/2092] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:49:59 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:59.754070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02538ff7-7d2c-4910-89c1-3368f0088726 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f825c8ee0>, body: {"keypair": {"name": "tempest-keypair-1288357537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqwTPo5R10Dsg/ZB9yZT+cBu3JIHCvPBPGaDSfxuzEBsjtMSC9G/7vo1SZzbd85CXwsqR/Warmd1j867aSShcRwncpEUpfANvaovdVkz3p+KpJbE7QEo+0jzFmXeMcAnA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.754893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a66879d0-abcf-40d4-a911-5b2321f46e7f tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:59.765180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a66879d0-abcf-40d4-a911-5b2321f46e7f tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for user 54e5691742af4057905a4f12e5e2e1ba and project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:59.774859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-02538ff7-7d2c-4910-89c1-3368f0088726 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:59.780860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-02538ff7-7d2c-4910-89c1-3368f0088726 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:59.819211 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a66879d0-abcf-40d4-a911-5b2321f46e7f tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114520 Nov 02 13:49:59.822858 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02538ff7-7d2c-4910-89c1-3368f0088726 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.073948 Nov 02 13:49:59.824251 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1095/2093] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:49:59.828144 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 999/2094] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:59.845549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea988b74-44e4-4273-8d56-ee0fa5284fb2 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f8224e9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.853497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f823a2a60>, body: {"keypair": {"name": "tempest-keypair-1921396042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHC2Q/jYyzjRxBAkjB9atFZFsNP7jMQFGyp+CIe2CLGGB1tnL27SYVf4APAQT+fsCLGcFGMZK0saVDJIOXrg28inOcn9uJ3owoKQa8tP7QQZxTBKQMwNt16CXN/aP9O6Jw=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.877039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea988b74-44e4-4273-8d56-ee0fa5284fb2 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288357537" status: 204 len: 0 microversion: 2.2 time: 0.045341 Nov 02 13:49:59.878292 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1096/2095] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Nov 2 13:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288357537 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:49:59.885327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:59.888961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4f748ce-10f5-494b-820a-4ec93db73407 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f81f2f8b0>, body: {"keypair": {"name": "tempest-keypair-1046501630", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.893872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for user 54e5691742af4057905a4f12e5e2e1ba and project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:59.912594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b4f748ce-10f5-494b-820a-4ec93db73407 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:59.919745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b4f748ce-10f5-494b-820a-4ec93db73407 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:59.939182 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] HTTP exception thrown: Key pair 'tempest-keypair-1921396042' already exists. Nov 02 13:49:59.943134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:59.952836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4f748ce-10f5-494b-820a-4ec93db73407 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.068815 Nov 02 13:49:59.953764 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1097/2096] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 13:49:59.967067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.967909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:59.976754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 273 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: {"keypair": {"name": "tempest-keypair-1921396042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHC2Q/jYyzjRxBAkjB9atFZFsNP7jMQFGyp+CIe2CLGGB1tnL27SYVf4APAQT+fsCLGcFGMZK0saVDJIOXrg28inOcn9uJ3owoKQa8tP7QQZxTBKQMwNt16CXN/aP9O6Jw=="}} Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: exception: Key pair 'tempest-keypair-1921396042' already exists. Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1921396042', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHC2Q/jYyzjRxBAkjB9atFZFsNP7jMQFGyp+CIe2CLGGB1tnL27SYVf4APAQT+fsCLGcFGMZK0saVDJIOXrg28inOcn9uJ3owoKQa8tP7QQZxTBKQMwNt16CXN/aP9O6Jw=='}}} Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '54e5691742af4057905a4f12e5e2e1ba-tempest-keypair-1921396042' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 13:49:59.977110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:49:59.987219 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '54e5691742af4057905a4f12e5e2e1ba-tempest-keypair-1921396042' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 13, 49, 59, 922717), 'updated_at': None, 'name': 'tempest-keypair-1921396042', 'user_id': '54e5691742af4057905a4f12e5e2e1ba', 'fingerprint': '73:7e:3b:61:9a:75:9b:fc:da:b4:da:b8:1c:a7:f9:a0', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHC2Q/jYyzjRxBAkjB9atFZFsNP7jMQFGyp+CIe2CLGGB1tnL27SYVf4APAQT+fsCLGcFGMZK0saVDJIOXrg28inOcn9uJ3owoKQa8tP7QQZxTBKQMwNt16CXN/aP9O6Jw==', 'type': 'ssh'}] Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._create() Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1921396042' already exists. Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 13:50:00.004669 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1921396042' already exists. Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1921396042' already exists. Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.016233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 409 to user: Key pair 'tempest-keypair-1921396042' already exists. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:00.017480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.017678 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-695f9f56-02c9-48ba-97c8-386b81f2ad1d tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.132298 Nov 02 13:50:00.017678 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1000/2097] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:50:00.018037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.018037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.018380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34eb6f47-57d0-467a-ac6c-90fe5705eafe tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f825fcee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.018565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.018565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.020716 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-34eb6f47-57d0-467a-ac6c-90fe5705eafe tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046501630" status: 204 len: 0 microversion: 2.2 time: 0.037936 Nov 02 13:50:00.030397 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1001/2098] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Nov 2 13:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046501630 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:00.040910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8778f795-3331-4028-9623-d6b5082be425 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Calling method '.version_select at 0x7f6f827da3a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.091252 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8778f795-3331-4028-9623-d6b5082be425 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921396042" status: 202 len: 0 microversion: 2.1 time: 0.057719 Nov 02 13:50:00.094249 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1002/2099] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 13:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921396042 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:50:00.105339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-71e79fcc-25c4-491d-ae7b-597bb7bc46c0 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f820d9940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1949881587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBavSximUtChaOnqlDpbm4c2/+nNIfUY9qP45SRzCpJiAgKhaEppyRY6EMcerFN1L15IOw4L0APtnS+YYSNZb7hJ/2rzj0lJSpM0VFMSIOTVNVhRJhQR68IJDHbYJpHTFA=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.140783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-71e79fcc-25c4-491d-ae7b-597bb7bc46c0 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:00.149084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-71e79fcc-25c4-491d-ae7b-597bb7bc46c0 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:00.192435 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-71e79fcc-25c4-491d-ae7b-597bb7bc46c0 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.095981 Nov 02 13:50:00.193531 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1003/2100] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:50:00.206293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.207257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:00.217463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.219021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.220123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.221576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.222723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.223622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.292035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.320893 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9cbb57d6-5503-4d64-984c-ca262e35fe68 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.358699 Nov 02 13:50:00.323175 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1098/2101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:59 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:00.323458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.336899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d10bf9f-24b2-421d-8a64-d5c8b770eee8 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f820cfaf0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsSoRUMZVbk788lVLTrCl2Q7YJLicudFcT4crfYKyYOGa/2iszLETCf1uzL+g+432DZnUJjhJghsEfqzj5y36AjnGGSIR4c17Gst0KDn/o5CtV7iJif1FxXteXHtwixFw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.337647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.341912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.343170 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dcea83d3-9678-4f58-a88e-471d4183fd45 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1338 microversion: 2.47 time: 0.148157 Nov 02 13:50:00.344556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1004/2102] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:00 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1338 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d10bf9f-24b2-421d-8a64-d5c8b770eee8 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 247 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsSoRUMZVbk788lVLTrCl2Q7YJLicudFcT4crfYKyYOGa/2iszLETCf1uzL+g+432DZnUJjhJghsEfqzj5y36AjnGGSIR4c17Gst0KDn/o5CtV7iJif1FxXteXHtwixFw=="}} Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsSoRUMZVbk788lVLTrCl2Q7YJLicudFcT4crfYKyYOGa/2iszLETCf1uzL+g+432DZnUJjhJghsEfqzj5y36AjnGGSIR4c17Gst0KDn/o5CtV7iJif1FxXteXHtwixFw=='}}} Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:50:00.358677 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:50:00.363650 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.364800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d10bf9f-24b2-421d-8a64-d5c8b770eee8 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:00.367809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3825af08-f78b-4ac1-ac06-dcd0c4fe02e7 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f822a5ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-288210548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/iyjgQmzLrWWp6UidHwnp7ET48noeMbooW15yfbBf39LeHhVV2RvOVtx+ATUAvzlG8DMxYR8oIM7Wd+jqMl/11DxOachD0ryxjyVkSF2JqoB1YgEJm1rGMoMQ2ofAguQ=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.368928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d10bf9f-24b2-421d-8a64-d5c8b770eee8 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.040158 Nov 02 13:50:00.371374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1099/2103] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:00.389579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f81d103a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-592701311", "public_key": " "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.399422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3825af08-f78b-4ac1-ac06-dcd0c4fe02e7 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:00.408320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3825af08-f78b-4ac1-ac06-dcd0c4fe02e7 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:00.442277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:00.449807 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3825af08-f78b-4ac1-ac06-dcd0c4fe02e7 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.102851 Nov 02 13:50:00.452066 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1005/2104] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:50:00.455445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for user 54e5691742af4057905a4f12e5e2e1ba and project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:00.473520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20153fef-8b45-44c4-9f2a-f42db48a87df tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f820e5790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1733916536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQHdhsoXkG33kvOoPhchf1KJTaBZj8MX3PVXDEqbkqArYGvqMrTDrNRYadG/n/WoYUcfQBYXDsFSSXaOxbmLMN+yHaX7n4bc/QL7CV88WE1ovqeyz2YyFcpRtCGTSS0Cg=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.505096 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 94 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-592701311", "public_key": " "}} Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-592701311', 'public_key': ' '}}} Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.508168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.513398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.516003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-20153fef-8b45-44c4-9f2a-f42db48a87df tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:00.516992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:00.518074 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a5d24bd-e692-4f01-9c1b-3eab2a184076 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.137959 Nov 02 13:50:00.519221 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1100/2105] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:50:00.533411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-20153fef-8b45-44c4-9f2a-f42db48a87df tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:00.535339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c856418c-2544-4a74-8f5b-6a7afe726d05 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f8136bca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1RND2aQ6aXCB0yvinmO4yrdXCc4oVt7gRofYLGpBObtPoDBh7Xjt3AopLMwI2QCHgiCzcJCZiU3dLL6ryMDzrF53naE+QElb4+ZoZ6Q8kswqWm/e7k9QoZvsS1eOP/NA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c856418c-2544-4a74-8f5b-6a7afe726d05 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 507 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1RND2aQ6aXCB0yvinmO4yrdXCc4oVt7gRofYLGpBObtPoDBh7Xjt3AopLMwI2QCHgiCzcJCZiU3dLL6ryMDzrF53naE+QElb4+ZoZ6Q8kswqWm/e7k9QoZvsS1eOP/NA=="}} Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1RND2aQ6aXCB0yvinmO4yrdXCc4oVt7gRofYLGpBObtPoDBh7Xjt3AopLMwI2QCHgiCzcJCZiU3dLL6ryMDzrF53naE+QElb4+ZoZ6Q8kswqWm/e7k9QoZvsS1eOP/NA=='}}} Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 13:50:00.539711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:50:00.543961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.555850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c856418c-2544-4a74-8f5b-6a7afe726d05 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:00.557170 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c856418c-2544-4a74-8f5b-6a7afe726d05 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026852 Nov 02 13:50:00.557948 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1101/2106] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:00.569774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Action: 'create', calling method: .version_select at 0x7f6f81d10f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-887569548", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:00.609595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:00.610361 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20153fef-8b45-44c4-9f2a-f42db48a87df tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.142075 Nov 02 13:50:00.610840 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1006/2107] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:50:00.621871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.622498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:00.629647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Getting quotas for user 54e5691742af4057905a4f12e5e2e1ba and project d88851e6c5be417f92e5c8d4099df4e6. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:00.638044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.638847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.639750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.641375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.641988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.642432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.680236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 117 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-887569548", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-887569548', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 13:50:00.682212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:00.688258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45742487-8d02-474e-87f1-697f29e9192a tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.117923 Nov 02 13:50:00.699544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1102/2108] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 13:50:00.705368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f29556ea-89bb-439f-a7bd-de4912eefb4f tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81d10d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.718328 n-d-858238-3 devstack@n-api.service[137559]: WARNING oslo_db.sqlalchemy.utils [None req-f29556ea-89bb-439f-a7bd-de4912eefb4f tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:50:00.730860 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f29556ea-89bb-439f-a7bd-de4912eefb4f tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.029843 Nov 02 13:50:00.745566 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1103/2109] 10.222.0.18 () {60 vars in 1177 bytes} [Wed Nov 2 13:50:00 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:00.751657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57265e1d-3507-48ce-b035-1e109c2fdc38 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Calling method '.version_select at 0x7f6f8133d820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.763754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.764743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.766042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.771960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lazy-loading 'fault' on Instance uuid 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:00.774620 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-57265e1d-3507-48ce-b035-1e109c2fdc38 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-65354902 not found for user 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57265e1d-3507-48ce-b035-1e109c2fdc38 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Request method failure captured: Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-65354902 HTTP/1.1 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWGt0VJ-3uySylZq3YrsV65WxUlTXKl1tlCixiEZcBWQZR05PjJReby9Dd4tGNK8JCNfosbuNCiAMq8R4VIHTegEDJ6kHFTDR5qIEnE159uXseXgCdvQoDPR88GEpPUa83OyeY-6BrO4UmYKXauvd3dNKFLel2rBcDahVzwNGpev28 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d88851e6c5be417f92e5c8d4099df4e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d88851e6c5be417f92e5c8d4099df4e6"}]}] Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d88851e6c5be417f92e5c8d4099df4e6 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-18199384 Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-KeyPairsNegativeTestJSON-18199384-project Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: exception: Keypair tempest-keypair-non-existent-65354902 not found for user 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'tempest-keypair-non-existent-65354902'} Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-65354902 not found for user 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.776780 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-65354902 not found for user 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-65354902 not found for user 54e5691742af4057905a4f12e5e2e1ba Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57265e1d-3507-48ce-b035-1e109c2fdc38 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] Returning 404 to user: Keypair tempest-keypair-non-existent-65354902 not found for user 54e5691742af4057905a4f12e5e2e1ba {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:00.784668 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57265e1d-3507-48ce-b035-1e109c2fdc38 tempest-KeyPairsNegativeTestJSON-18199384 tempest-KeyPairsNegativeTestJSON-18199384-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-65354902" status: 404 len: 143 microversion: 2.1 time: 0.031534 Nov 02 13:50:00.794276 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1104/2110] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Nov 2 13:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-65354902 => generated 143 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:50:00.794276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc678f2b-dd7a-4e40-bfb5-773f2455f1e8 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81f8ddc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.837354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.849185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.849871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc678f2b-dd7a-4e40-bfb5-773f2455f1e8 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1733916536" status: 204 len: 0 microversion: 2.2 time: 0.059909 Nov 02 13:50:00.850835 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1105/2111] 10.222.0.18 () {60 vars in 1321 bytes} [Wed Nov 2 13:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1733916536 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:00.852400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.854141 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a30dfd67-66da-402f-a939-11dfb1c2d37c tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 200 len: 1352 microversion: 2.25 time: 0.242193 Nov 02 13:50:00.854945 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1007/2112] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:00 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 1352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:00.858653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.860879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:00.861858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aea4eaf8-98fd-412b-86a4-6540a0201d11 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f824343a0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.872115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.874009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.877014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.879433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.881129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.883794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.894210 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aea4eaf8-98fd-412b-86a4-6540a0201d11 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-288210548" status: 204 len: 0 microversion: 2.2 time: 0.037833 Nov 02 13:50:00.895189 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1008/2113] 10.222.0.18 () {60 vars in 1318 bytes} [Wed Nov 2 13:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-288210548 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:00.909827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e01f89fc-2942-4b9b-ba70-f7812a8aac6d tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f820e5280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.955438 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e01f89fc-2942-4b9b-ba70-f7812a8aac6d tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1949881587" status: 204 len: 0 microversion: 2.2 time: 0.055099 Nov 02 13:50:00.956128 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1009/2114] 10.222.0.18 () {60 vars in 1321 bytes} [Wed Nov 2 13:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1949881587 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:50:00.971117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-26f02288-39e5-475c-9df2-f9e97d06f459 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f818c0790>, body: {"keypair": {"name": "tempest-keypair-129195975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ5FYRHHfDoUr4jlyV8PJzZD8EZbzCgr8gV4g4gAp92849vXCrFSLM5Kw/zCXtf8YAV/zTycfmN/cQTsRb6pZHwjoQnMJ/KhxRIRFcv+RxzVD2SWK5+AmW9ccMqaOobdw=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:01.006040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-26f02288-39e5-475c-9df2-f9e97d06f459 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:01.006379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:01.032051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:01.034019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:01.040814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-26f02288-39e5-475c-9df2-f9e97d06f459 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:01.047309 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bbce7b72-a251-4a42-a97b-89cef27d767e tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.194219 Nov 02 13:50:01.050710 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1106/2115] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:00 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:01.102015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:01.132220 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-26f02288-39e5-475c-9df2-f9e97d06f459 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.165609 Nov 02 13:50:01.136695 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1010/2116] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Nov 2 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 13:50:01.148773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0750b80b-d8bb-4a11-8bf3-b2668d306e89 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81d10670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:01.164316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0750b80b-d8bb-4a11-8bf3-b2668d306e89 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-129195975" status: 200 len: 512 microversion: 2.2 time: 0.020344 Nov 02 13:50:01.165818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1107/2117] 10.222.0.18 () {60 vars in 1255 bytes} [Wed Nov 2 13:50:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-129195975 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:50:01.181392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3fcb2ec-44f0-40db-bcb5-d105548f4092 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81e54040>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:01.186800 n-d-858238-3 devstack@n-api.service[137558]: WARNING oslo_db.sqlalchemy.utils [None req-a3fcb2ec-44f0-40db-bcb5-d105548f4092 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:50:01.203827 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3fcb2ec-44f0-40db-bcb5-d105548f4092 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.029172 Nov 02 13:50:01.204965 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1011/2118] 10.222.0.18 () {60 vars in 1177 bytes} [Wed Nov 2 13:50:01 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:01.229018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d4a98a9-4d1e-4bbf-8695-215c73a665b4 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f8133dca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:01.293808 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d4a98a9-4d1e-4bbf-8695-215c73a665b4 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-129195975" status: 204 len: 0 microversion: 2.2 time: 0.079755 Nov 02 13:50:01.295585 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1108/2119] 10.222.0.18 () {60 vars in 1258 bytes} [Wed Nov 2 13:50:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-129195975 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:01.309466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Action: 'create', calling method: .version_select at 0x7f6f8247e3a0>, body: {"keypair": {"name": "tempest-keypair-158679677", "type": "x509"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:01.333412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:01.340634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:01.361362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:01.362131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:01.374587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:01.383079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:01.388283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:01.389863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:01.390807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:01.391519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:01.400862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.processutils [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmps1tou00m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps1tou00m/temp.key -subj /CN=c03640f149084466955ae593d386f8dc -extensions v3_req_client {{(pid=137558) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 13:50:01.707473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:01.725784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d10c943-3bc7-43d2-bdda-d44b6f11d51b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.366011 Nov 02 13:50:01.726883 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1109/2120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:01 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:01.739857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:01.740974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:01.757636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:01.758665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:01.759614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:01.760612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:01.761389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:01.762060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:01.871087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.processutils [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmps1tou00m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps1tou00m/temp.key -subj /CN=c03640f149084466955ae593d386f8dc -extensions v3_req_client" returned: 0 in 0.468s {{(pid=137558) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 13:50:01.873545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.processutils [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmps1tou00m/temp.key -password pass: {{(pid=137558) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 13:50:01.978629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.processutils [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] CMD "openssl pkcs12 -export -inkey /tmp/tmps1tou00m/temp.key -password pass:" returned: 0 in 0.105s {{(pid=137558) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 13:50:02.143591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:02.174219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Getting quotas for user c03640f149084466955ae593d386f8dc and project 23cda759b33447a39c7dc6de25c99a17. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:02.200362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.213252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.221987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.224708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b39af7d-8ade-4186-8a22-65660c7ee447 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1338 microversion: 2.47 time: 0.496620 Nov 02 13:50:02.229691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1110/2121] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:01 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1338 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:02.247172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.248232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:02.257769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.262268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.263035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.264059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.264929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.266608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.278491 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-847f68f3-85c0-4924-9843-31f181fe2e52 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.971325 Nov 02 13:50:02.280617 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1012/2122] 10.222.0.18 () {62 vars in 1198 bytes} [Wed Nov 2 13:50:01 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 980 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:02.287258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.289256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:02.299357 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] HTTP exception thrown: Instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 could not be found. Nov 02 13:50:02.299859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.300765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.301608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Request method failure captured: Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 HTTP/1.1 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnONizrRuvh9Qi3guAVicr5HCnpjUIE7xvDeQh4miwHJl3AJYCuGaslYLwjaV_Gnux9u3HNhVKhXVH62e-PP1QYB06YjKC9VMvsCGuCtTFRyF8kcMTsWOHgbzGMGysOCoerm2rOFuyJikFi97URrYK-4Z_eXn9GMmYeAyj8-F8lfAhc Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_21ac2eda404042c0871fc312f0b9f705"}]}] Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 55e26f05091944cb910f81488056c057 Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 could not be found. Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1'} Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 could not be found. Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 could not be found. Nov 02 13:50:02.303551 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 could not be found. Nov 02 13:50:02.308869 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.309606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.309606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.309606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.310910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Returning 404 to user: Instance 7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:02.312529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9227774a-fafe-4ae8-9cd3-941c1a177654 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1" status: 404 len: 111 microversion: 2.25 time: 0.081030 Nov 02 13:50:02.317379 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1111/2123] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/servers/7c2b684c-2d01-4e9d-9cf8-201a8e19e7a1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:02.325291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5109ad2a-66f6-438d-80bf-83f4565791f1 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81d105e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.369511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5109ad2a-66f6-438d-80bf-83f4565791f1 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-158679677" status: 200 len: 1533 microversion: 2.2 time: 0.047877 Nov 02 13:50:02.370116 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1112/2124] 10.222.0.18 () {60 vars in 1255 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-158679677 => generated 1533 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:02.381143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.381940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:02.396435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.397435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.398122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.399136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.400138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.429122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.472073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:02.531712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.550894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.563286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.571085 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5744b494-c0d7-4691-899c-c88b78ed0849 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.288869 Nov 02 13:50:02.578448 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1013/2125] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:02.595623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-426c0a2e-03dd-41d2-a4bd-5aef8e0da9f4 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81f2f160>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.605256 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-452ce4e7-5953-4c01-a680-75633296c26a tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 204 len: 0 microversion: 2.25 time: 0.233116 Nov 02 13:50:02.606761 n-d-858238-3 devstack@n-api.service[137558]: WARNING oslo_db.sqlalchemy.utils [None req-426c0a2e-03dd-41d2-a4bd-5aef8e0da9f4 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:50:02.611574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1113/2126] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:50:02 2022] DELETE /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:50:02.648223 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-426c0a2e-03dd-41d2-a4bd-5aef8e0da9f4 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.068241 Nov 02 13:50:02.655027 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1014/2127] 10.222.0.18 () {60 vars in 1177 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:02.666695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.667600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:02.679616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.681709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.682808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.684141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.689578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.690526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.900226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e4e1a18-7364-496f-8778-38aebebf83cb tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '.version_select at 0x7f6f81c9c0d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.992803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.005372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.006878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.008183 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1cd8319-e8f6-4578-bb4b-905209743564 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1564 microversion: 2.25 time: 0.350550 Nov 02 13:50:03.031482 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1015/2128] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1564 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:03.054811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0a694a48-467c-47cb-972b-cad955cc7449 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] Calling method '.version_select at 0x7f6f81f2fd30>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.105147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0a694a48-467c-47cb-972b-cad955cc7449 tempest-KeyPairsV22TestJSON-1012193288 tempest-KeyPairsV22TestJSON-1012193288-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158679677" status: 204 len: 0 microversion: 2.2 time: 0.060640 Nov 02 13:50:03.110472 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1016/2129] 10.222.0.18 () {60 vars in 1258 bytes} [Wed Nov 2 13:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158679677 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:03.113377 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e4e1a18-7364-496f-8778-38aebebf83cb tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517" status: 200 len: 371 microversion: 2.1 time: 0.500167 Nov 02 13:50:03.115993 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1114/2130] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517 => generated 371 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:03.119210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.120798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:03.137203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Action: 'update', calling method: .version_select at 0x7f6f820cf940>, body: {"quota_set": {"ram": "5120"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:03.158363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.161424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.161881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.162670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.163211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.163676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.424017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.443477 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-111c7b7b-6aa6-4a4e-8514-fd96968eefea tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.332840 Nov 02 13:50:03.444131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1017/2131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:03 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:03.452117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.453352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:03.469967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.471211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.472160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.472980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.473671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.474477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.645033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.660547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.666634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.668670 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aae0d968-da84-45df-9fa5-fd939467ee6c tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1359 microversion: 2.47 time: 0.222796 Nov 02 13:50:03.674759 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1018/2132] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:03 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:03.704956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.712354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:03.727746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.728625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.729572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.734413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.735278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.735971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.909652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.910323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.910870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.911814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.913608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.915470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.956658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.972933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.974946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.991914 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75278de6-41a3-4ffe-9f36-75a87dd6cac5 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.315459 Nov 02 13:50:03.992541 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1019/2133] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:03 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:04.043255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1421230999"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:04.052840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:04.081147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da794492-34ad-4e22-89e1-561847cd74d7 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517" status: 200 len: 328 microversion: 2.1 time: 0.952913 Nov 02 13:50:04.082332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.082903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.083466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.084785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1115/2134] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:50:03 2022] PUT /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517 => generated 328 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:04.085516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.087880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.088925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.105133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:04.107280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:04.135496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.137372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.138162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.141294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.146731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.147691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.549911 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a31a887d-4402-4198-b078-eadacc462061 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "POST /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197/action" status: 202 len: 52 microversion: 2.47 time: 0.511784 Nov 02 13:50:04.558676 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1020/2135] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:50:04 2022] POST /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197/action => generated 52 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:50:04.575383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-35be4996-9ea5-4058-be1f-a489aa3eea62 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:04.596476 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-35be4996-9ea5-4058-be1f-a489aa3eea62 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517" status: 202 len: 0 microversion: 2.1 time: 0.030058 Nov 02 13:50:04.603045 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1021/2136] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:50:04 2022] DELETE /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:50:04.609731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:04.610801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:04.628851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.629520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.630120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.631815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.636226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.637118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.690597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:04.915693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:04.929777 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5565134d-0a55-436c-9f50-7d5fa73aadad tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.325233 Nov 02 13:50:04.946681 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1022/2137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:04 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:04.946681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:04.946681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:04.957248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.957775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.958525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.959745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.960713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.961274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.991420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:04.992513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.002840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:05.010969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.012492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.013689 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-25018a33-d6a1-4c18-9f25-3eaea68cb1dc tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1564 microversion: 2.25 time: 0.927145 Nov 02 13:50:05.014457 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1116/2138] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:04 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1564 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:05.024247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2d997d6-0239-4d6b-8aa0-15dae0aee631 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '.version_select at 0x7f6f85f6c430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.159491 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e0b4a59c-366a-43dc-9b37-2b28e570508d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 204 len: 0 microversion: 2.47 time: 0.225404 Nov 02 13:50:05.161074 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1023/2139] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:50:04 2022] DELETE /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:50:05.168479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.169656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:05.183304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.184126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.185010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.185986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.186495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.187208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.420912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.441897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.449441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.489865 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0bb759d-fec8-4fb7-acca-13a167a3c8a6 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.325050 Nov 02 13:50:05.490786 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1024/2140] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:05.505477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.510758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:05.523183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.523681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.524178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.524906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.526172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.526172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.679627 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2d997d6-0239-4d6b-8aa0-15dae0aee631 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517" status: 200 len: 371 microversion: 2.1 time: 0.660238 Nov 02 13:50:05.689821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1117/2141] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/os-quota-sets/e76201e59f214c56b262f25944136517 => generated 371 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:05.702239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.714854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.725916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.727331 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7fea3f0f-4a32-42e2-9c9e-8e8934c035e6 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1365 microversion: 2.47 time: 0.234824 Nov 02 13:50:05.750833 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1025/2142] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:05.906638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91855cf9-4658-457a-8d68-fcba2b37fe90 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '.version_select at 0x7f6f81bc80d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.955381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.956341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:05.965513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.966262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.966846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.968751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.968751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.969297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.239143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.261162 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3605aaec-91fc-43aa-9bd4-cd67fba02ea8 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.305247 Nov 02 13:50:06.262696 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1026/2143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:06.278378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:06.279835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:06.297705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.301152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.307073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.308102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.312126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.313716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.505459 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91855cf9-4658-457a-8d68-fcba2b37fe90 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05/defaults" status: 200 len: 371 microversion: 2.1 time: 0.603117 Nov 02 13:50:06.512685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1118/2144] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05/defaults => generated 371 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:06.513721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.525234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f2b0ba4a-7ae7-4e61-8259-f48a51aa4416 req-98ab738f-38ec-4982-8d76-8f057219319b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c91ab6-d7c2-424b-aaaf-2b202a3090d5", "name": "network-vif-deleted", "tag": "1150df3c-744e-4d59-8bbb-94d550dfd3ba"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:06.529062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.535561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.536794 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b1e610e-4e04-4e7f-9739-43df5526873e tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1522 microversion: 2.25 time: 0.272311 Nov 02 13:50:06.545478 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1027/2145] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:06 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:06.553912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:06.556283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:06.558791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f2b0ba4a-7ae7-4e61-8259-f48a51aa4416 req-98ab738f-38ec-4982-8d76-8f057219319b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.561804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f2b0ba4a-7ae7-4e61-8259-f48a51aa4416 req-98ab738f-38ec-4982-8d76-8f057219319b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.562974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f2b0ba4a-7ae7-4e61-8259-f48a51aa4416 req-98ab738f-38ec-4982-8d76-8f057219319b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.577003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.580298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.581682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.585916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.588122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.590830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.591043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f2b0ba4a-7ae7-4e61-8259-f48a51aa4416 req-98ab738f-38ec-4982-8d76-8f057219319b service nova] Creating event network-vif-deleted:1150df3c-744e-4d59-8bbb-94d550dfd3ba for instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 on n-h2-858238-3 Nov 02 13:50:06.606916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f2b0ba4a-7ae7-4e61-8259-f48a51aa4416 req-98ab738f-38ec-4982-8d76-8f057219319b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091313 Nov 02 13:50:06.612840 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1119/2146] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:06.762940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:06.765879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:06.788366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.792147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.794049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.795262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.797241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.804726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.866313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.884309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.893379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.912066 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-96ed328d-df93-484f-b52c-1aba060be163 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.364367 Nov 02 13:50:06.915197 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1028/2147] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:06 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:06.934368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Action: 'update', calling method: .version_select at 0x7f6f82040430>, body: {"quota_set": {"ram": "5120"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:06.989849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.017764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.021197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.025105 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f8c10e4-5845-462b-b423-fecab470210d tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1365 microversion: 2.47 time: 0.271559 Nov 02 13:50:07.029179 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1120/2148] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:06 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:07.295848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:07.297846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:07.327375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.328202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.328914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.350396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.352093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.355791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.509994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.512289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.513470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.517118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.518818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.520299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.706583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.715623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3bc5765-a510-47c0-b7bf-4d793dc0b4e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.427483 Nov 02 13:50:07.719342 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1121/2149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:07 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:07.720633 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7384e24c-e6cd-4340-80f6-2bb40c842d1e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734" status: 200 len: 328 microversion: 2.1 time: 0.790096 Nov 02 13:50:07.724802 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1029/2150] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:50:06 2022] PUT /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734 => generated 328 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:07.729513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:07.731860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:07.745368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.745637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '.version_select at 0x7f6f81fce9d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:07.747805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.748763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.750092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.751215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.751959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.803203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.804116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.805385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.806180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lazy-loading 'fault' on Instance uuid 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:08.014641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.029158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.052864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e26f05091944cb910f81488056c057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ac2eda404042c0871fc312f0b9f705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.057455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71a2f45d-b450-445a-b7f6-c0bf54b152c2 tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 200 len: 1352 microversion: 2.25 time: 0.335166 Nov 02 13:50:08.060441 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1122/2151] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:07 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 1352 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:08.079275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:08.084824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:08.110503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.111137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.114494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.115554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.116188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.116778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.179280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.180162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.181067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.182040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.183489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.184450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.260087 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4216036b-19d6-485f-8676-e20ca7ceb06e tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734/detail" status: 200 len: 916 microversion: 2.1 time: 0.519914 Nov 02 13:50:08.278631 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1030/2152] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:50:07 2022] GET /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734/detail => generated 916 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:08.291947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:08.297089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:08.305778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.307063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.307931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.309275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.310001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.310614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.345502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.360553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.365266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.384870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6abef631-a551-4eda-b510-d3911244aae1 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.320441 Nov 02 13:50:08.389000 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1123/2153] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:08 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:08.543292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Action: 'update', calling method: .version_select at 0x7f6f81bc8d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:08.636188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.640107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.641891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.645616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.646665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.654349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.678250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:08.716879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.718267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.719030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.720209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.720950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.721904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.830677 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0494412f-be4b-494a-b150-4ab7f642ddba tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734?user_id=b60fbc5317574507b2674b8084b84da8" status: 200 len: 328 microversion: 2.1 time: 0.291411 Nov 02 13:50:08.833319 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1124/2154] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 13:50:08 2022] PUT /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734?user_id=b60fbc5317574507b2674b8084b84da8 => generated 328 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:50:08.841251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:08.842156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:08.851332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.852100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.852594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.853423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.853961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.854405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.973260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.998019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.003355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '40202cc920ce485f9aaec9a12a17ad5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20b8b5a5dd4b16b50b5a21e7404434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.014521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-37621982-3d0f-44e6-8ca6-5d237742110b tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 200 len: 1365 microversion: 2.47 time: 0.733845 Nov 02 13:50:09.042772 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1031/2155] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:08 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 1365 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:09.087502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79868ab1-c990-4e16-a4d3-a701def5edd8 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '.version_select at 0x7f6f81e44550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:09.324401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:09.326360 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79868ab1-c990-4e16-a4d3-a701def5edd8 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734?user_id=b60fbc5317574507b2674b8084b84da8" status: 200 len: 370 microversion: 2.1 time: 0.274414 Nov 02 13:50:09.327806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.337304 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1032/2156] 10.222.0.18 () {58 vars in 1323 bytes} [Wed Nov 2 13:50:09 2022] GET /compute/v2.1/os-quota-sets/99517d9070eb4eddafc6911b0adb9734?user_id=b60fbc5317574507b2674b8084b84da8 => generated 370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:09.344540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:09.345054 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b1ac879-4037-42fd-a268-a1a5b2312931 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.511868 Nov 02 13:50:09.345687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] [instance: 15c91ab6-d7c2-424b-aaaf-2b202a3090d5] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:09.349273 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1125/2157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:08 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:09.354251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:09.355598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:09.356795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:09.357748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:09.358229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:09.358700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:09.395337 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] HTTP exception thrown: Instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 could not be found. Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Request method failure captured: Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 HTTP/1.1 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnONizrRuvh9Qi3guAVicr5HCnpjUIE7xvDeQh4miwHJl3AJYCuGaslYLwjaV_Gnux9u3HNhVKhXVH62e-PP1QYB06YjKC9VMvsCGuCtTFRyF8kcMTsWOHgbzGMGysOCoerm2rOFuyJikFi97URrYK-4Z_eXn9GMmYeAyj8-F8lfAhc Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/21ac2eda404042c0871fc312f0b9f705"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_21ac2eda404042c0871fc312f0b9f705"}]}] Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 21ac2eda404042c0871fc312f0b9f705 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-640085701 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 55e26f05091944cb910f81488056c057 Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-640085701-project Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 could not be found. Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '15c91ab6-d7c2-424b-aaaf-2b202a3090d5'} Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 could not be found. Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 could not be found. Nov 02 13:50:09.400055 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 could not be found. Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] Returning 404 to user: Instance 15c91ab6-d7c2-424b-aaaf-2b202a3090d5 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:09.406865 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b8fb20ad-b3b4-403e-9d1c-0b216e9c7ecf tempest-LiveAutoBlockMigrationV225Test-640085701 tempest-LiveAutoBlockMigrationV225Test-640085701-project] 10.222.0.18 "GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5" status: 404 len: 111 microversion: 2.25 time: 0.064288 Nov 02 13:50:09.411530 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1033/2158] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:09 2022] GET /compute/v2.1/servers/15c91ab6-d7c2-424b-aaaf-2b202a3090d5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:09.431010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:09.431826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:09.439348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:09.439828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:09.440250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:09.441759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:09.442493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:09.443392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:09.571770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.585221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.588628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.607167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa6b57ba-8169-413b-93f0-c7f6a0b40dbd tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.183647 Nov 02 13:50:09.624996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1126/2159] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:09 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:10.059477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-745ecc37-7cde-45c1-a08d-953e3c70c909 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Calling method '.version_select at 0x7f6f8224e550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:10.060566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:10.061190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] [instance: 517cfda2-44dc-4b3c-b08a-4a0c45684197] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:10.075982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:10.076996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:10.078156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:10.079287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:10.079913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:10.081019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:10.127136 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] HTTP exception thrown: Instance 517cfda2-44dc-4b3c-b08a-4a0c45684197 could not be found. Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Request method failure captured: Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 HTTP/1.1 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnWDjKVELevQVUrvrbOq_RAH8XvvpGAOwTbTwjkIPU7SzxdDqirqUUifNE-o07Q-ICDAenHxBxURwMlnGSgDiXcUTACysxVLe0W-q72gN98kKJDhmto604KZkpE9uQfjXDhpHc-FP_zKNYBK1U7UqUVMDdTaswsjnQLqMYc2jZ835p4 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 0b20b8b5a5dd4b16b50b5a21e7404434 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersAaction247Test-190543245 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20b8b5a5dd4b16b50b5a21e7404434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20b8b5a5dd4b16b50b5a21e7404434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20b8b5a5dd4b16b50b5a21e7404434"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20b8b5a5dd4b16b50b5a21e7404434"}]}] Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersAaction247Test-190543245 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 0b20b8b5a5dd4b16b50b5a21e7404434 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersAaction247Test-190543245 Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersAaction247Test-190543245-project Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 40202cc920ce485f9aaec9a12a17ad5f Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersAaction247Test-190543245-project Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 517cfda2-44dc-4b3c-b08a-4a0c45684197 could not be found. Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '517cfda2-44dc-4b3c-b08a-4a0c45684197'} Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517cfda2-44dc-4b3c-b08a-4a0c45684197 could not be found. Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517cfda2-44dc-4b3c-b08a-4a0c45684197 could not be found. Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:10.128754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517cfda2-44dc-4b3c-b08a-4a0c45684197 could not be found. Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] Returning 404 to user: Instance 517cfda2-44dc-4b3c-b08a-4a0c45684197 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-115bd6d0-2228-4b3c-a311-fb83d4746835 tempest-ServersAaction247Test-190543245 tempest-ServersAaction247Test-190543245-project] 10.222.0.18 "GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197" status: 404 len: 111 microversion: 2.47 time: 0.078433 Nov 02 13:50:10.135054 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1034/2160] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:10 2022] GET /compute/v2.1/servers/517cfda2-44dc-4b3c-b08a-4a0c45684197 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:10.377962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:10.378588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:10.388877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:10.399895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:10.400608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:10.401557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:10.402203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:10.402858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:10.613101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-745ecc37-7cde-45c1-a08d-953e3c70c909 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05/defaults" status: 200 len: 371 microversion: 2.1 time: 0.559509 Nov 02 13:50:10.614400 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1127/2161] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:50:10 2022] GET /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05/defaults => generated 371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:10.634571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Action: 'update', calling method: .version_select at 0x7f6f8224e9d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:10.998124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.011163 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3ad44d11-a315-4e18-8953-4358530be62f tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.638648 Nov 02 13:50:11.016707 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1035/2162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:10 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:11.026807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:11.032318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:11.055604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.056562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.057351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.058349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.058989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.060556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.146270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.146872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.149355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.151302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.152923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.157590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.305054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.321999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.329376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.344171 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-771333cd-3582-4a98-bb5b-ee826ebab00c tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1447 microversion: 2.75 time: 0.325460 Nov 02 13:50:11.374054 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1036/2163] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:11 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:11.669031 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4d64247-65fb-4d9b-8a1a-e6bd2fb4e552 tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05" status: 200 len: 329 microversion: 2.1 time: 1.040560 Nov 02 13:50:11.672884 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1128/2164] 10.222.0.18 () {60 vars in 1263 bytes} [Wed Nov 2 13:50:10 2022] PUT /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05 => generated 329 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:11.687555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Action: 'update', calling method: .version_select at 0x7f6f828e5940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:11.842784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.843747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.844334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.845296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.845783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.846304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:12.046751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:12.055089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:12.069511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:12.075536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:12.076244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:12.077015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:12.078467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:12.079130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:12.496139 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5efb7301-5456-4dac-95a3-30176111748d tempest-QuotasAdminTestJSON-2021021870 tempest-QuotasAdminTestJSON-2021021870-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05" status: 200 len: 329 microversion: 2.1 time: 0.815274 Nov 02 13:50:12.509783 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1037/2165] 10.222.0.18 () {60 vars in 1263 bytes} [Wed Nov 2 13:50:11 2022] PUT /compute/v2.1/os-quota-sets/55325f70cb4042af88500e93c0e60b05 => generated 329 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:12.524278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:12.524925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:12.543669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:12.544179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:12.544620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:12.549108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:12.549633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:12.550085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:12.748355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:12.760979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:12.770077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:12.805720 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c2196fd-47d1-4ed2-a8ec-79b750eb97d8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1453 microversion: 2.75 time: 0.289731 Nov 02 13:50:12.820898 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1038/2166] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:12 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1453 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:12.987434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:13.003409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e97e990-53b3-44e0-95e6-2a93e143cc73 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.959765 Nov 02 13:50:13.004254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1129/2167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:12 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:13.836763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:13.837559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:13.857651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:13.858168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:13.859177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:13.859881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:13.860337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:13.866765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:14.028256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:14.028888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:14.042502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:14.043369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:14.047259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:14.048277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:14.048999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:14.049592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:14.648648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.662548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b70f16bc-93bb-4f7c-9d4d-d85b34a4f607 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1388 microversion: 2.1 time: 0.638095 Nov 02 13:50:14.665706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1130/2168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:14 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1388 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:14.767307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.792420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.794133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.820358 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cc33d091-02eb-42fb-b907-7896b338f808 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1453 microversion: 2.75 time: 0.983458 Nov 02 13:50:14.836021 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1039/2169] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:13 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1453 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:15.691149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:15.692775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:15.712184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:15.714804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:15.716870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:15.721099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:15.721861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:15.723235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:15.853474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:15.854761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:15.868844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:15.873215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:15.873968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:15.874931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:15.876107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:15.878791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:16.220917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:16.242472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:16.248617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e9ab3998cff4d61b862a285864e0a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d729b67e3dc4f5e8d038f6974e24426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:16.257157 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2c35e35-b157-4fe1-82b0-5f61358330c0 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1438 microversion: 2.75 time: 0.407799 Nov 02 13:50:16.275531 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1040/2170] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:15 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1438 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:16.631461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:16.635077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:16.654821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:16.656825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:16.660063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:16.663189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:16.666248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:16.666944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:16.816243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:16.842870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:50:16.846212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:50:16.846749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:50:16.847218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:50:16.848309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:50:17.011355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:17.019044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:17.020592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:17.021411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:17.025612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:17.028344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:17.031676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:17.389441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:17.434512 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-69d5e226-de1b-497c-9b7a-cb812e432519 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff/action" status: 202 len: 1942 microversion: 2.75 time: 1.129201 Nov 02 13:50:17.459543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1041/2171] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 13:50:16 2022] POST /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff/action => generated 1942 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:50:17.466718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:17.497771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:17.511572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:17.515944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:17.538060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:17.539074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:17.540083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:17.545839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:17.547561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:17.803058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:17.847996 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e98c005a-400e-4014-b847-3f6776457bf2 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.385288 Nov 02 13:50:17.860649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1042/2172] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:17 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:17.947798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:17.960613 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53b3fb73-eb7a-4c66-a20d-8141426bf12b tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1378 microversion: 2.1 time: 2.276693 Nov 02 13:50:17.990860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aa6e2cb1-2a11-4aa9-8b70-8af129315394 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '.version_select at 0x7f6f82040f70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:17.995479 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1131/2173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:15 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1378 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:17.996849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa6e2cb1-2a11-4aa9-8b70-8af129315394 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:17.997555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa6e2cb1-2a11-4aa9-8b70-8af129315394 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:17.998162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa6e2cb1-2a11-4aa9-8b70-8af129315394 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:18.020831 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aa6e2cb1-2a11-4aa9-8b70-8af129315394 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.035311 Nov 02 13:50:18.041138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:18.041758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:18.048634 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1043/2174] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:50:17 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:18.055189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:18.055685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:18.060292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:18.061823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:18.078731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:18.079122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:18.890576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:18.891321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:18.906150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:18.906150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:18.906540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:18.907035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:18.914050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:18.914050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.072405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-552e6bf3-4243-4c1a-a83b-c36f191143a3 tempest-LiveMigrationTest-442539264 tempest-LiveMigrationTest-442539264-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1529 microversion: 2.1 time: 1.035519 Nov 02 13:50:19.073726 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1132/2175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:18 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1529 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:19.111679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:19.112315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:19.124914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:19.131924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:19.133861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.137421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:19.139874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:19.140816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:19.142242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.193716 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6993f5d-e738-40cc-857e-52d4c41decb0 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.316159 Nov 02 13:50:19.194309 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1044/2176] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:18 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:19.231562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:19.408054 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8247c004-22a2-4cd6-9350-e08bbd7be9f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 204 len: 0 microversion: 2.1 time: 0.300261 Nov 02 13:50:19.418210 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1133/2177] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:50:19 2022] DELETE /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:19.428180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:19.429031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:19.440404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:19.441543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:19.442176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.443613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:19.444437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:19.445058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.959375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:19.979193 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-276522d8-4c65-467e-9298-91d5742c528c tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1384 microversion: 2.1 time: 0.554868 Nov 02 13:50:19.996664 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1045/2178] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:19 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1384 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:20.238225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:20.238955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:20.256559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:20.257056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:20.257495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:20.258232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:20.258680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:20.259179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:20.660084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:20.706281 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcb518ee-c698-4ddb-89a7-606f3b7b3670 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.473641 Nov 02 13:50:20.708068 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1134/2179] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:20 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:21.012701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:21.013870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:21.024084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:21.032324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:21.032791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:21.041086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:21.041945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:21.042387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:21.738794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:21.740197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:21.751561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=11 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:21.761321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=84 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:21.769547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:21.770516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:21.771710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:21.775642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:21.778515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:21.779165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:21.863158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:21.930269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:21.942777 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-abbd2695-8ce2-446c-b556-9cc00496d004 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1384 microversion: 2.1 time: 0.933708 Nov 02 13:50:21.943774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1046/2180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:21 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1384 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:22.362979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:22.367789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:22.409975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1497841371", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:22.431563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bdc72372-87eb-4d31-a45a-abbc7917d239 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.696835 Nov 02 13:50:22.432640 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1135/2181] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:21 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:22.478099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=86 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:22.527425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:50:22.970936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:22.972414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:22.987381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:22.988059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:22.988663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:22.989564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:22.997754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:22.998578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.150861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:50:23.151509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:50:23.152085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:50:23.152587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:50:23.153089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:50:23.173716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.174317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.174853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.175727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.182007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.182595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.222930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Getting quotas for project 70727044d5314b13bd03fb9998914886. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:23.228090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Getting quotas for user 4365b97ccc164db49191820f75700768 and project 70727044d5314b13bd03fb9998914886. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:23.241042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:50:23.243921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:50:23.269447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:23.287941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e37656f5-82cf-4fc4-a1cf-92ac13756feb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1342 microversion: 2.1 time: 0.313613 Nov 02 13:50:23.304770 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-39f3dd51-52d0-48d1-8817-e58fe73f9649 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161357 Nov 02 13:50:23.305442 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1047/2182] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:50:23.310867 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1136/2183] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:22 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1342 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:23.441238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-615935807", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:23.460698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:23.461664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:23.471319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.472291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.473028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.474358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.475258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.476406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.550230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:50:23.711541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:23.759545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ef458dd-a916-4317-8487-4d33d10b4178 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.303288 Nov 02 13:50:23.787821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1137/2184] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:23 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:23.801954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-90e17242-117a-4cf7-b931-8b0ebc37604f req-15f9be33-ac73-4d80-ac9f-fb4718cbeb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e488881-f0fd-4003-8123-191cb92828d2", "name": "network-vif-deleted", "tag": "6fed398e-5731-4b96-a8ff-6f32125ca657"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:23.823354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-90e17242-117a-4cf7-b931-8b0ebc37604f req-15f9be33-ac73-4d80-ac9f-fb4718cbeb8b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.826081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-90e17242-117a-4cf7-b931-8b0ebc37604f req-15f9be33-ac73-4d80-ac9f-fb4718cbeb8b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.826582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-90e17242-117a-4cf7-b931-8b0ebc37604f req-15f9be33-ac73-4d80-ac9f-fb4718cbeb8b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.855993 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-90e17242-117a-4cf7-b931-8b0ebc37604f req-15f9be33-ac73-4d80-ac9f-fb4718cbeb8b service nova] Creating event network-vif-deleted:6fed398e-5731-4b96-a8ff-6f32125ca657 for instance 6e488881-f0fd-4003-8123-191cb92828d2 on n-h1-858238-3 Nov 02 13:50:23.867524 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-90e17242-117a-4cf7-b931-8b0ebc37604f req-15f9be33-ac73-4d80-ac9f-fb4718cbeb8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068991 Nov 02 13:50:23.870453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1138/2185] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:24.317484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:24.324880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:24.328095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=15,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:24.364880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.382020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.383981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.387763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.393318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.394285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.711915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:24.737408 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7306a659-84c9-4374-81ad-986916489099 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1184 microversion: 2.1 time: 0.422232 Nov 02 13:50:24.740117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1139/2186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:24 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1184 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:24.802084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:24.803133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:24.820891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.821545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.823355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.829332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.831501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:50:24.832109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:50:24.832472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.832619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:50:24.833037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.833197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:50:24.833622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:50:24.856970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.857596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.858094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.862118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.864242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.866818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.899796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Getting quotas for project 70727044d5314b13bd03fb9998914886. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:24.906777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Getting quotas for user 4365b97ccc164db49191820f75700768 and project 70727044d5314b13bd03fb9998914886. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:24.954658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:50:24.963676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:50:25.168372 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-debd49ea-dd31-41c9-a0a0-d050620f88c5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732500 Nov 02 13:50:25.169652 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1048/2187] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:50:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:50:25.181633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7bdb79c2-43f8-46d6-8094-3a1fd665e826 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:25.183225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7bdb79c2-43f8-46d6-8094-3a1fd665e826 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:25.338774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:25.449484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11f7901c-6bdc-4585-bf59-ae92bc3b2d0b tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.650083 Nov 02 13:50:25.456658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1140/2188] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:24 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:25.565032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7bdb79c2-43f8-46d6-8094-3a1fd665e826 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:25.576730 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7bdb79c2-43f8-46d6-8094-3a1fd665e826 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1213 microversion: 2.1 time: 0.396377 Nov 02 13:50:25.578949 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1049/2189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:25 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1213 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:25.767547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:25.768212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:25.778385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:25.778893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:25.785435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:25.790801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:25.791366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:25.791814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:26.481733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:26.482340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:26.513016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:26.513859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:26.515509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:26.522253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:26.523916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:26.525536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.206933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:27.225372 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-194b769f-640f-42e1-ab66-b6f13fc3460e tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1184 microversion: 2.1 time: 1.460440 Nov 02 13:50:27.230216 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1141/2190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:25 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1184 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:27.240144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:27.240779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:27.262752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.263825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.266451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.267983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.270486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.271225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.600617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:27.627761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7132748-b843-4315-9fdf-f3f1d4f0ef51 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1265 microversion: 2.1 time: 0.395775 Nov 02 13:50:27.633051 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1142/2191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:27 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1265 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:27.704728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:27.757736 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9e5038a-9074-4e52-8f62-e3e33f4279d1 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 1.280230 Nov 02 13:50:27.763495 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1050/2192] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:26 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:50:28.254076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:28.255374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:28.275777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.276315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.276769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.277518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.277983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.278414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.584618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:28.596044 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-32477043-a8f2-4dbe-aaeb-1f5a945731df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1184 microversion: 2.1 time: 0.348019 Nov 02 13:50:28.597007 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1143/2193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:28 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1184 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:28.657237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:28.658329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:28.681366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.690289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.690289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.690289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.690289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.690289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.789630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:28.790632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:28.806585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.807527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.808222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.809211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.809924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.810575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.927928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:28.939843 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e7d2c989-60ac-41df-9a6a-28640243f3cf tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1271 microversion: 2.1 time: 0.289799 Nov 02 13:50:28.945846 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1051/2194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:28 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:29.099344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0aa974b3-e83f-45fd-b189-23895bdafe52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f81ec9310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1180174732", "description": "tempest-description-1024566153"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:29.710170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:29.772574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2f5a120-3677-47dc-b19d-6f349fa4f425 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.983503 Nov 02 13:50:29.774612 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1144/2195] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:28 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:29.794722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:29.796351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:29.808462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:29.809256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:29.810345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:29.814741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:29.816554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:29.817721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:30.093838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:30.103825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d69a3c65-5f51-4dbc-89b8-adcd1189b2dd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1184 microversion: 2.1 time: 0.327800 Nov 02 13:50:30.111431 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1145/2196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:29 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1184 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:30.116573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:30.119855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:30.137948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:30.149798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:30.150487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:30.151546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:30.152190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:30.152820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:30.720450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:30.741118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95830cd6-b29f-4e7f-9493-4088206f9099 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1271 microversion: 2.1 time: 0.626746 Nov 02 13:50:30.766022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1146/2197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:30 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1271 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:30.809153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:30.809773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:30.826756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:30.833552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:30.834147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:30.836025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:30.840235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:30.847396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.274409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:31.316547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b410d58d-ffd4-4db1-aded-129fc91f9ce3 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.511827 Nov 02 13:50:31.332009 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1147/2198] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:30 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:50:31.348072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0aa974b3-e83f-45fd-b189-23895bdafe52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.366652 Nov 02 13:50:31.350277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:31.354165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:31.359709 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1052/2199] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:50:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:50:31.367349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f85ea1160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1788360797", "description": "tempest-description-238708063"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:31.367971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.369931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.370617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.373126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.373842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.375608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.593082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:31.611040 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d65af41-bf87-4dbf-95d6-3512efd9e855 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1184 microversion: 2.1 time: 0.277480 Nov 02 13:50:31.615638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1148/2200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:31 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1184 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:31.767003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:31.768338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:31.781758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.782640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.783478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.793559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.794073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.794500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.988866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:32.000275 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d543dc11-0bac-4d94-8552-a6f4fac86dc5 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1271 microversion: 2.1 time: 0.237049 Nov 02 13:50:32.000776 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1149/2201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:31 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:32.348752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:32.349368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:32.372240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.377018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.377677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:32.378607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.379369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.379973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.300359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:33.340234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cbfe4d65-63e3-4734-8f92-551294dbd09d tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.996114 Nov 02 13:50:33.341072 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1150/2202] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:32 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:33.380432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:33.381278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:33.393253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:33.393961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:33.394583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.395496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:33.400530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:33.401181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.455822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:33.743207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:33.762593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-caf9f5a4-1b69-4c51-ae78-6f1f0ac8057d tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 200 len: 1184 microversion: 2.1 time: 0.414698 Nov 02 13:50:33.763685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1151/2203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:33 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 1184 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:33.771059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:33.772019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:33.806797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:33.808192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:33.811688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.812854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:33.813693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:33.814302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:34.727015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:34.735718 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0aec3bb0-c0ed-4078-8787-c4d3abd30441 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1313 microversion: 2.1 time: 0.969606 Nov 02 13:50:34.739239 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1152/2204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:33 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1313 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:34.888433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:35.059820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86e77814-4bc6-49d6-87c7-4c164f18a3bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Action: 'create', calling method: .version_select at 0x7f6f85e2f9d0>, body: {"keypair": {"name": "tempest-keypair-1996652892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ+za3d2fc+TwlsXyYfvAy0kwA3xNRRG/Zg6jPjjPLdwHXv+a44ND65cRA4v8vWJ+HoLx7ur/xXzW6jDSJ/cAmVhso1qeBO2r5X5JesorSNL5cDlhth2OqjokeGW+jbqw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:35.116493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-86e77814-4bc6-49d6-87c7-4c164f18a3bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Getting quotas for project 7a5ef8da09024e678c3fccd39cac0f35. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:35.137487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-86e77814-4bc6-49d6-87c7-4c164f18a3bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Getting quotas for user ab0feddb832f4d71a0e3e8dafa40e017 and project 7a5ef8da09024e678c3fccd39cac0f35. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:35.226760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86e77814-4bc6-49d6-87c7-4c164f18a3bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.484321 Nov 02 13:50:35.227827 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1153/2205] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:50:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:35.252645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:35.253262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:35.269941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.275081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.276822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.277811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.280354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.280958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.487629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:35.536213 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f253d4ad-fb65-44f6-8a3e-6c1be829d516 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.306844 Nov 02 13:50:35.537980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1154/2206] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:35 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:35.558011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:35.558643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 6e488881-f0fd-4003-8123-191cb92828d2] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:35.569357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.570296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.570898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.571986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.572760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.572956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:35.573535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.588917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] HTTP exception thrown: Instance 6e488881-f0fd-4003-8123-191cb92828d2 could not be found. Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Request method failure captured: Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 HTTP/1.1 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnO180Gtupr--bAjKfdBrbN8R4nLZUwQoXhAoTuod2oKHqhJhEpVCDbiBfj3teRJpMPSccd6DjvoohR3m7NaByJkCxRacgHhtU-hQJxehgEJTJXFyxRJfFwwPLBJjfQImLst8HzJ4Q9pc6-T6DPXLcsvvScgLT9lXAH_foGz9WsN6j0 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89354db644694189ac3ae9ec09e7e786"}]}] Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveMigrationTest-506995936 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveMigrationTest-506995936-project Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23d76f5c29444358864d0bc25c83b4b4 Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveMigrationTest-506995936-project Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 6e488881-f0fd-4003-8123-191cb92828d2 could not be found. Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6e488881-f0fd-4003-8123-191cb92828d2'} Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e488881-f0fd-4003-8123-191cb92828d2 could not be found. Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e488881-f0fd-4003-8123-191cb92828d2 could not be found. Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:35.591035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e488881-f0fd-4003-8123-191cb92828d2 could not be found. Nov 02 13:50:35.597129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:35.598680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Returning 404 to user: Instance 6e488881-f0fd-4003-8123-191cb92828d2 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:35.599737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45a32b26-4849-483e-a539-fc21d722fbcb tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2" status: 404 len: 111 microversion: 2.1 time: 0.060489 Nov 02 13:50:35.600932 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1155/2207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:35 2022] GET /compute/v2.1/servers/6e488881-f0fd-4003-8123-191cb92828d2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:50:35.606015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-988054882", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8bdf2f6c-1691-42e3-967b-e10950e4af07"}, {"uuid": "26afb1bd-33bd-4150-9635-4c1510e8c7ac"}, {"uuid": "8bdf2f6c-1691-42e3-967b-e10950e4af07"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:35.681923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] validate_networks() for [('8bdf2f6c-1691-42e3-967b-e10950e4af07', None, None, None, None, None), ('26afb1bd-33bd-4150-9635-4c1510e8c7ac', None, None, None, None, None), ('8bdf2f6c-1691-42e3-967b-e10950e4af07', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:50:38.678919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:38.934158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:40.430414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:50:40.432158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:50:40.433017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:50:40.433621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:50:40.434226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:50:40.454259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:40.454669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:40.455163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:40.455911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:40.456444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:40.456781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:40.505739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Getting quotas for project 31f12ed436694d52bc37ab8a6e1d8b32. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:40.514724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Getting quotas for user aabe2182d4fe4ada9626974416a2f92d and project 31f12ed436694d52bc37ab8a6e1d8b32. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:40.547614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:50:40.549953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:50:40.666100 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c32b045-8cab-4fda-a0eb-0fb5d4ba7e2f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.063880 Nov 02 13:50:40.667080 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1156/2208] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 5065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:50:40.678073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:40.678933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:40.692875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:40.693632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:40.694838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:40.700054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:40.705171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:40.705853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.200963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:41.212540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4ea9ff9-f107-44b3-88bc-25ff91965aa6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1313 microversion: 2.1 time: 0.541905 Nov 02 13:50:41.213822 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1157/2209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:40 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:41.237688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a58ad2a2-f5cd-436f-a2e0-040f69c534ba req-aec3fcdf-6e7b-483f-8118-3c0abdc97660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25af852c-129a-41f4-858d-7ad75a66729c", "tag": "fc6bab7b-002c-48b1-86ac-3d691872d7eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:41.272926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a58ad2a2-f5cd-436f-a2e0-040f69c534ba req-aec3fcdf-6e7b-483f-8118-3c0abdc97660 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:41.273422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a58ad2a2-f5cd-436f-a2e0-040f69c534ba req-aec3fcdf-6e7b-483f-8118-3c0abdc97660 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:41.273856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a58ad2a2-f5cd-436f-a2e0-040f69c534ba req-aec3fcdf-6e7b-483f-8118-3c0abdc97660 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.313545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a58ad2a2-f5cd-436f-a2e0-040f69c534ba req-aec3fcdf-6e7b-483f-8118-3c0abdc97660 service nova] Creating event network-changed:fc6bab7b-002c-48b1-86ac-3d691872d7eb for instance 25af852c-129a-41f4-858d-7ad75a66729c on n-h2-858238-3 Nov 02 13:50:41.332211 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a58ad2a2-f5cd-436f-a2e0-040f69c534ba req-aec3fcdf-6e7b-483f-8118-3c0abdc97660 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110971 Nov 02 13:50:41.362115 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1158/2210] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:41.382553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:41.384105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:41.414526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:41.415298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:41.417718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.418898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:41.425866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:41.426873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.610948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:41.694192 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b2ef043-6ae9-47f5-8f64-abfcaa3ca1bf tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.330328 Nov 02 13:50:41.697550 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1159/2211] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:41 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:41.728331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1db87576-2af4-4014-b58f-69910bb571d8 req-174a6fac-3c4d-42c7-8bd7-f513fd352118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6a104e0-ddd0-44e7-9126-78323a78fd75", "tag": "07a15f13-39ba-4415-b8bf-e6a87bf46a50"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:41.739583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1db87576-2af4-4014-b58f-69910bb571d8 req-174a6fac-3c4d-42c7-8bd7-f513fd352118 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:41.740363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1db87576-2af4-4014-b58f-69910bb571d8 req-174a6fac-3c4d-42c7-8bd7-f513fd352118 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:41.740983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1db87576-2af4-4014-b58f-69910bb571d8 req-174a6fac-3c4d-42c7-8bd7-f513fd352118 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.754691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1db87576-2af4-4014-b58f-69910bb571d8 req-174a6fac-3c4d-42c7-8bd7-f513fd352118 service nova] Creating event network-changed:07a15f13-39ba-4415-b8bf-e6a87bf46a50 for instance d6a104e0-ddd0-44e7-9126-78323a78fd75 on n-h2-858238-3 Nov 02 13:50:41.762219 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1db87576-2af4-4014-b58f-69910bb571d8 req-174a6fac-3c4d-42c7-8bd7-f513fd352118 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051966 Nov 02 13:50:41.766243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1160/2212] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:41.780945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:41.785492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:41.799545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:41.800283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:41.802651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.805626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:41.806367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:41.818395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:41.966687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:41.977007 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-272bf996-6bce-4b73-9184-114a00b4bfe4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1216 microversion: 2.1 time: 0.207640 Nov 02 13:50:41.981083 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1161/2213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:41 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:42.182731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-900baeff-5943-4588-b194-9c0845bfda1f tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Action: 'create', calling method: .version_select at 0x7f6f81b41c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:42.253414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-900baeff-5943-4588-b194-9c0845bfda1f tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Getting quotas for project 465cf377938444148190b9ec307d585a. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:42.285924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-900baeff-5943-4588-b194-9c0845bfda1f tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Getting quotas for user 12c6d8b0855b459e92e3124e9f347980 and project 465cf377938444148190b9ec307d585a. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:42.448651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:42.462837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-900baeff-5943-4588-b194-9c0845bfda1f tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Getting quotas for project 465cf377938444148190b9ec307d585a. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:42.471024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-900baeff-5943-4588-b194-9c0845bfda1f tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Getting quotas for user 12c6d8b0855b459e92e3124e9f347980 and project 465cf377938444148190b9ec307d585a. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:42.502492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-900baeff-5943-4588-b194-9c0845bfda1f tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.519751 Nov 02 13:50:42.507790 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1162/2214] 10.222.0.18 () {62 vars in 1214 bytes} [Wed Nov 2 13:50:41 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:50:42.513523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:42.515763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:42.524337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:42.525455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:42.526128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:42.527208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:42.528037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:42.528695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:43.831488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:43.858048 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a0ccbcbe-eb83-4c1e-947c-f85344bf127f tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1313 microversion: 2.1 time: 1.342298 Nov 02 13:50:43.863179 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1163/2215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:42 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1313 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:43.911246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d630c343-6c20-4d95-b1f9-de0b1449b316 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:44.053035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d630c343-6c20-4d95-b1f9-de0b1449b316 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.184623 Nov 02 13:50:44.059888 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1164/2216] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 13:50:43 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:50:44.102721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:44.110449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:44.151596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:44.153330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:44.154335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:44.161476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:44.166173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:44.168918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:44.472455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:44.540653 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8be69b3d-95f7-4fd5-aa9a-306f5abf61e9 tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1929 microversion: 2.75 time: 0.474606 Nov 02 13:50:44.567376 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1165/2217] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:44 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1929 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:44.579219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1177697535", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "a5e0a74f-8cf4-4909-80c3-e8050c0491fb"}], "security_groups": [{"name": "tempest-securitygroup--1966884804"}], "key_name": "tempest-keypair-1996652892", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:44.920707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] validate_networks() for [('a5e0a74f-8cf4-4909-80c3-e8050c0491fb', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:50:45.997887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:50:46.000301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:50:46.001305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:50:46.001912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:50:46.002532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:50:46.030636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.032445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.033190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.034210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.034912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.036794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.103088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Getting quotas for project 7a5ef8da09024e678c3fccd39cac0f35. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:46.122440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Getting quotas for user ab0feddb832f4d71a0e3e8dafa40e017 and project 7a5ef8da09024e678c3fccd39cac0f35. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:46.159879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:50:46.163170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:50:46.296083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf13642f-03d6-486c-9ac5-3c67f098a629 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.721185 Nov 02 13:50:46.297699 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1166/2218] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:50:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:50:46.303665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:46.304872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:46.337862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.339542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.340268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.343158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.343814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.344507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.488262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:46.510829 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78b1f231-f495-4b3f-9b35-c937839a631c tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1270 microversion: 2.1 time: 0.210277 Nov 02 13:50:46.511795 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1167/2219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:46 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:46.541674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8f3522e-1be5-4231-86b5-09c568510df3 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:46.578687 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8f3522e-1be5-4231-86b5-09c568510df3 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256" status: 200 len: 235 microversion: 2.64 time: 0.060580 Nov 02 13:50:46.585476 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1168/2220] 10.222.0.18 () {60 vars in 1304 bytes} [Wed Nov 2 13:50:46 2022] GET /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256 => generated 235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:50:46.595797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:46.596305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:46.624711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.631129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.633103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.635417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.638020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.640879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.722032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:46.944859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7d0fa405-eb18-4824-bd43-1f43c18477bd tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "DELETE /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 204 len: 0 microversion: 2.1 time: 0.354899 Nov 02 13:50:46.945595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1169/2221] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:50:46 2022] DELETE /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:46.961513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:46.963459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:46.980286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.980908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.982460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:46.984207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:46.985774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:46.989129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:47.727991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:47.745091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff99fe68-374b-4cd1-8e44-015bc1a10137 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1313 microversion: 2.1 time: 0.793076 Nov 02 13:50:47.745995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1170/2222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:46 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1313 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:47.762916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:47.766229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:47.782576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:47.785707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:47.787120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:47.787867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:47.788331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:47.788789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:48.044506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] Lazy-loading 'services' on Instance uuid 9ecb3c15-37c9-43f1-8708-20ce412fd6ff {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:48.103447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8405ba8b-8685-4bc5-aadc-eb9b1947bc1f tempest-ServersAdmin275Test-1685440806 tempest-ServersAdmin275Test-1685440806-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 200 len: 1920 microversion: 2.75 time: 0.338592 Nov 02 13:50:48.104827 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1171/2223] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:47 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 1920 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:48.113033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:48.115538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:48.137966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:48.139374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:48.140050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:48.141062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:48.141741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:48.142380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:48.166838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:48.376307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:48.394172 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a1769cee-a6a8-4e34-82e5-2c6d6f816237 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1294 microversion: 2.1 time: 0.287742 Nov 02 13:50:48.394831 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1172/2224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:48 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1294 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:48.401681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cc30b1b-19d8-41fe-8347-205e578413b1 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:48.476559 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6cc30b1b-19d8-41fe-8347-205e578413b1 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256" status: 204 len: 0 microversion: 2.64 time: 0.080280 Nov 02 13:50:48.481165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1173/2225] 10.222.0.18 () {60 vars in 1307 bytes} [Wed Nov 2 13:50:48 2022] DELETE /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:50:48.488654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:48.489270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:48.501710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:48.506728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:48.507195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:48.514792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:48.515483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:48.516196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:49.374145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:49.384329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21769804-091b-4688-b46c-f6b0894a0ea5 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 200 len: 1663 microversion: 2.1 time: 0.899895 Nov 02 13:50:49.385204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1174/2226] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:48 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 1663 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:49.393490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:49.395133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:49.413466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:49.414369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:49.415033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:49.416036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:49.417010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:49.418846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:49.847275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:49.861003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d61311e-b618-4fc8-bc9c-fc53d5f6ac14 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1312 microversion: 2.1 time: 0.472970 Nov 02 13:50:49.876830 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1175/2227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:49 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:49.881899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-70a6e709-4162-44ec-80b7-3f1b2d781917 req-84ab46fb-a72b-495e-8594-d4f89b4cccd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25af852c-129a-41f4-858d-7ad75a66729c", "name": "network-vif-plugged", "status": "completed", "tag": "fc6bab7b-002c-48b1-86ac-3d691872d7eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:49.914524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-70a6e709-4162-44ec-80b7-3f1b2d781917 req-84ab46fb-a72b-495e-8594-d4f89b4cccd3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:49.915403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-70a6e709-4162-44ec-80b7-3f1b2d781917 req-84ab46fb-a72b-495e-8594-d4f89b4cccd3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:49.916940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-70a6e709-4162-44ec-80b7-3f1b2d781917 req-84ab46fb-a72b-495e-8594-d4f89b4cccd3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:49.931182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-70a6e709-4162-44ec-80b7-3f1b2d781917 req-84ab46fb-a72b-495e-8594-d4f89b4cccd3 service nova] Creating event network-vif-plugged:fc6bab7b-002c-48b1-86ac-3d691872d7eb for instance 25af852c-129a-41f4-858d-7ad75a66729c on n-h2-858238-3 Nov 02 13:50:49.938939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-70a6e709-4162-44ec-80b7-3f1b2d781917 req-84ab46fb-a72b-495e-8594-d4f89b4cccd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060539 Nov 02 13:50:49.940873 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1176/2228] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:49.955819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:49.956472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:49.968588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:49.969395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:49.971643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:49.972590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:49.973253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:49.973877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:50.027423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:50.173695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92ba29f2-eced-44b7-94bf-dc0b4f962cc8 tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 204 len: 0 microversion: 2.75 time: 0.228773 Nov 02 13:50:50.179226 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1177/2229] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:50:49 2022] DELETE /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:50:50.203611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-735f3c28-684f-4369-9b5b-732adc8fdf80 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:50.212571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-735f3c28-684f-4369-9b5b-732adc8fdf80 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] HTTP exception thrown: Instance group 6819b490-7eac-4723-9962-b3daeb82e256 could not be found. Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-735f3c28-684f-4369-9b5b-732adc8fdf80 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Request method failure captured: Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256 HTTP/1.1 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWxdFCO7Zn5P6LY7tY3NKTji6Qbn-F6eZgeFpueFMrW6MEYxq8XC8zSHNW4aeT5FLoOQV4a86B-Ci9mvRbprBSP4etuIHtVEZ5As_mrJ2CfKc_MQR-u4UJRu7L7uEVjqryfWEoFw54qjZnLMY-rBRWE_VrXAhVUcKrUZQ3V9bEcXys Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 465cf377938444148190b9ec307d585a Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerGroup264TestJSON-54906799 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465cf377938444148190b9ec307d585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/465cf377938444148190b9ec307d585a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465cf377938444148190b9ec307d585a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_465cf377938444148190b9ec307d585a"}]}] Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerGroup264TestJSON-54906799 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 465cf377938444148190b9ec307d585a Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerGroup264TestJSON-54906799 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerGroup264TestJSON-54906799-project Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 12c6d8b0855b459e92e3124e9f347980 Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerGroup264TestJSON-54906799-project Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance group 6819b490-7eac-4723-9962-b3daeb82e256 could not be found. Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6819b490-7eac-4723-9962-b3daeb82e256'} Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6819b490-7eac-4723-9962-b3daeb82e256 could not be found. Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6819b490-7eac-4723-9962-b3daeb82e256 could not be found. Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:50.228373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:50.238738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:50.238738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:50.238738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:50.238738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:50.238738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6819b490-7eac-4723-9962-b3daeb82e256 could not be found. Nov 02 13:50:50.238738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:50.242281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-735f3c28-684f-4369-9b5b-732adc8fdf80 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] Returning 404 to user: Instance group 6819b490-7eac-4723-9962-b3daeb82e256 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:50.246139 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-735f3c28-684f-4369-9b5b-732adc8fdf80 tempest-ServerGroup264TestJSON-54906799 tempest-ServerGroup264TestJSON-54906799-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256" status: 404 len: 117 microversion: 2.64 time: 0.064175 Nov 02 13:50:50.259662 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1178/2230] 10.222.0.18 () {60 vars in 1307 bytes} [Wed Nov 2 13:50:50 2022] DELETE /compute/v2.1/os-server-groups/6819b490-7eac-4723-9962-b3daeb82e256 => generated 117 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:50.578298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-702fc552-5973-48f0-ac2d-a63b05fc55bc tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] Action: 'create', calling method: .version_select at 0x7f6f81af11f0>, body: {"security_group": {"name": "tempest-securitygroup-1647977331", "description": "tempest-description-32396925"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:52.175702 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-702fc552-5973-48f0-ac2d-a63b05fc55bc tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.913627 Nov 02 13:50:52.176614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1179/2231] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:50:50 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:52.182118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:52.183223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:52.193264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:52.193522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:52.193827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:52.194890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:52.195575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:52.196301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:52.757953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:52.767395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d31b92b3-f465-4327-8492-9acc7ee86792 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1313 microversion: 2.1 time: 0.589725 Nov 02 13:50:52.767991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1180/2232] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:52 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:52.778709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:52.779348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:52.789435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:52.789961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:52.790587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:52.795518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:52.796714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:52.798066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.235966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:53.243636 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5e85d35-dc90-42a2-940b-f1fed765f70d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1368 microversion: 2.1 time: 0.474651 Nov 02 13:50:53.244216 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1181/2233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:52 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1368 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:53.249282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:53.249884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] [instance: 9ecb3c15-37c9-43f1-8708-20ce412fd6ff] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:53.265589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.266074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.266504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.267290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.267736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.268361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.282955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] HTTP exception thrown: Instance 9ecb3c15-37c9-43f1-8708-20ce412fd6ff could not be found. Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Request method failure captured: Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff HTTP/1.1 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnVnvPmLP-8F72GRf7kHYgGGuMtExwhIkMfWDnJqvBM10HDHqjeXGuAQtFSTIOXvih1nyLsFiZ4diJqyaihbVL52j-6U2yW5hw9Hy-jE9uPouemJ1NUkI2gYPlCO8CpfUO5aSRokLs0TyLATXOnM-b9txywbSlA_ergakwQxZHuBokE Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0d729b67e3dc4f5e8d038f6974e24426 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdmin275Test-163572744 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d729b67e3dc4f5e8d038f6974e24426"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d729b67e3dc4f5e8d038f6974e24426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d729b67e3dc4f5e8d038f6974e24426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d729b67e3dc4f5e8d038f6974e24426"}]}] Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdmin275Test-163572744 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0d729b67e3dc4f5e8d038f6974e24426 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdmin275Test-163572744 Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdmin275Test-163572744-project Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 2e9ab3998cff4d61b862a285864e0a0d Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdmin275Test-163572744-project Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9ecb3c15-37c9-43f1-8708-20ce412fd6ff could not be found. Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9ecb3c15-37c9-43f1-8708-20ce412fd6ff'} Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ecb3c15-37c9-43f1-8708-20ce412fd6ff could not be found. Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ecb3c15-37c9-43f1-8708-20ce412fd6ff could not be found. Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:53.284704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ecb3c15-37c9-43f1-8708-20ce412fd6ff could not be found. Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] Returning 404 to user: Instance 9ecb3c15-37c9-43f1-8708-20ce412fd6ff could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-479262c4-8a7b-4242-9dd4-6da500e5e7ca tempest-ServersAdmin275Test-163572744 tempest-ServersAdmin275Test-163572744-project] 10.222.0.18 "GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff" status: 404 len: 111 microversion: 2.75 time: 0.040957 Nov 02 13:50:53.290816 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1182/2234] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:50:53 2022] GET /compute/v2.1/servers/9ecb3c15-37c9-43f1-8708-20ce412fd6ff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:53.294256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:53.294858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: 380fd169-b6bb-4da9-bac7-37950d8f2428] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:53.303454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.303943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.304887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.306101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.306559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.306984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.322971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] HTTP exception thrown: Instance 380fd169-b6bb-4da9-bac7-37950d8f2428 could not be found. Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Request method failure captured: Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 HTTP/1.1 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnO180Gtupr--bAjKfdBrbN8R4nLZUwQoXhAoTuod2oKHqhJhEpVCDbiBfj3teRJpMPSccd6DjvoohR3m7NaByJkCxRacgHhtU-hQJxehgEJTJXFyxRJfFwwPLBJjfQImLst8HzJ4Q9pc6-T6DPXLcsvvScgLT9lXAH_foGz9WsN6j0 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89354db644694189ac3ae9ec09e7e786"}]}] Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveMigrationTest-506995936 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveMigrationTest-506995936-project Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23d76f5c29444358864d0bc25c83b4b4 Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveMigrationTest-506995936-project Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 380fd169-b6bb-4da9-bac7-37950d8f2428 could not be found. Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '380fd169-b6bb-4da9-bac7-37950d8f2428'} Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380fd169-b6bb-4da9-bac7-37950d8f2428 could not be found. Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380fd169-b6bb-4da9-bac7-37950d8f2428 could not be found. Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:53.324570 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380fd169-b6bb-4da9-bac7-37950d8f2428 could not be found. Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Returning 404 to user: Instance 380fd169-b6bb-4da9-bac7-37950d8f2428 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce2cd4d7-d284-441d-86c9-44656ea6e1e4 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428" status: 404 len: 111 microversion: 2.1 time: 0.036491 Nov 02 13:50:53.330884 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1183/2235] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:53 2022] GET /compute/v2.1/servers/380fd169-b6bb-4da9-bac7-37950d8f2428 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:50:53.335729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:53.336339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:53.342814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.343342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.343990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.344707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.345166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.345994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.739713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:53.749700 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2c8f73e-5ae3-4f12-8812-330773b35112 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.417357 Nov 02 13:50:53.751082 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1184/2236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:53 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:53.757025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-23180f9e-51a7-4151-82c7-78616ccf1c5c req-05992ca5-eb97-4763-bfdf-cddfdcc93e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380fd169-b6bb-4da9-bac7-37950d8f2428", "name": "network-vif-deleted", "tag": "223fc1ee-7c85-4aa3-8257-614ae0ade6e5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:53.769323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-23180f9e-51a7-4151-82c7-78616ccf1c5c req-05992ca5-eb97-4763-bfdf-cddfdcc93e73 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.769933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-23180f9e-51a7-4151-82c7-78616ccf1c5c req-05992ca5-eb97-4763-bfdf-cddfdcc93e73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.770494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-23180f9e-51a7-4151-82c7-78616ccf1c5c req-05992ca5-eb97-4763-bfdf-cddfdcc93e73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.783626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-23180f9e-51a7-4151-82c7-78616ccf1c5c req-05992ca5-eb97-4763-bfdf-cddfdcc93e73 service nova] Creating event network-vif-deleted:223fc1ee-7c85-4aa3-8257-614ae0ade6e5 for instance 380fd169-b6bb-4da9-bac7-37950d8f2428 on n-h1-858238-3 Nov 02 13:50:53.797100 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-23180f9e-51a7-4151-82c7-78616ccf1c5c req-05992ca5-eb97-4763-bfdf-cddfdcc93e73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043375 Nov 02 13:50:53.798024 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1185/2237] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:53.804422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-35ad0f56-5821-4e26-9e45-31b9c63adbff req-389339f9-d6c8-4460-bf9d-6d896fce32c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6a104e0-ddd0-44e7-9126-78323a78fd75", "name": "network-vif-plugged", "status": "completed", "tag": "07a15f13-39ba-4415-b8bf-e6a87bf46a50"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:53.822341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-35ad0f56-5821-4e26-9e45-31b9c63adbff req-389339f9-d6c8-4460-bf9d-6d896fce32c2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:53.823064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-35ad0f56-5821-4e26-9e45-31b9c63adbff req-389339f9-d6c8-4460-bf9d-6d896fce32c2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:53.823709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-35ad0f56-5821-4e26-9e45-31b9c63adbff req-389339f9-d6c8-4460-bf9d-6d896fce32c2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:53.837938 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-35ad0f56-5821-4e26-9e45-31b9c63adbff req-389339f9-d6c8-4460-bf9d-6d896fce32c2 service nova] Creating event network-vif-plugged:07a15f13-39ba-4415-b8bf-e6a87bf46a50 for instance d6a104e0-ddd0-44e7-9126-78323a78fd75 on n-h2-858238-3 Nov 02 13:50:53.847387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-35ad0f56-5821-4e26-9e45-31b9c63adbff req-389339f9-d6c8-4460-bf9d-6d896fce32c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047402 Nov 02 13:50:53.848651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1186/2238] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:53.856089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42032601-143e-41a9-9ced-7cdd6fa0d99f tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] Action: 'create', calling method: .version_select at 0x7f6f820cfc10>, body: {"security_group": {"name": "tempest-securitygroup-1055568409", "description": "tempest-description-880578759"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:54.870044 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42032601-143e-41a9-9ced-7cdd6fa0d99f tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.018699 Nov 02 13:50:54.873406 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1187/2239] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:50:53 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:54.879634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aff33f98-8295-4e7b-b8d8-3175acb09755 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '.version_select at 0x7f6f81365940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:54.915513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aff33f98-8295-4e7b-b8d8-3175acb09755 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-733637231" status: 202 len: 0 microversion: 2.1 time: 0.040376 Nov 02 13:50:54.916868 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1188/2240] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-733637231 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:50:54.928229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:54.932911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:54.940900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:54.941518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:54.942943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:54.944088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:54.944774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:54.945426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.460484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:55.503122 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-09fe777c-1e42-4f75-a912-34b4aac9dba8 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1313 microversion: 2.1 time: 0.569164 Nov 02 13:50:55.519127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1189/2241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:54 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:55.520582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:55.524998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:55.530575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:55.537963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.538463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.538904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:55.539707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:55.540168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:55.540591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:56.065600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:56.136411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:56.143801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=24 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:56.147467 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba74ffbd-1576-4fb0-8107-fff25bb35fba tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1368 microversion: 2.1 time: 0.638350 Nov 02 13:50:56.160271 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1190/2242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:55 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1368 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:56.166235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:56.166914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:56.179333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:56.179968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:56.180932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:56.181952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:56.183004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:56.184093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:56.608334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:56.630902 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56341f63-a42c-4765-965e-54c1fb89ba41 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.481437 Nov 02 13:50:56.632669 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1191/2243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:56 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:57.136517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec31e85f-ec7b-4030-b042-2cc14aac10fb tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] Action: 'create', calling method: .version_select at 0x7f6f8199d310>, body: {"security_group": {"name": "tempest-securitygroup-1676203161", "description": "tempest-description-2092887788"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:58.220301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec31e85f-ec7b-4030-b042-2cc14aac10fb tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.583887 Nov 02 13:50:58.221311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1192/2244] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:50:56 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:58.231338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b902d64-9d83-4e25-a97d-2b0d4d18f55a", "tag": "2e0259a1-15e1-4364-9957-55f03aac23ed"}, {"name": "network-changed", "server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "tag": "1986686c-be54-4236-9125-6eda28e2cec8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:58.271383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.275990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.276834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.302195 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] Creating event network-changed:2e0259a1-15e1-4364-9957-55f03aac23ed for instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a on n-h2-858238-3 Nov 02 13:50:58.302890 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] Creating event network-changed:1986686c-be54-4236-9125-6eda28e2cec8 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:50:58.313411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7334ac86-f0ba-4271-bbe3-1f65f22135ef req-191836ba-1c77-482d-b45f-b175edb1c093 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089985 Nov 02 13:50:58.314580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1193/2245] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:58.334542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:58.335148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:58.349741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.351177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.351602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.352330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.355130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.355734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.385720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:58.518499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fddd375a-79c6-4c18-a871-4c5daa6d69f7 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 204 len: 0 microversion: 2.1 time: 0.193805 Nov 02 13:50:58.519296 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1194/2246] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:50:58 2022] DELETE /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:58.526552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:58.527512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:58.537184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.537770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.538212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.538928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:58.539408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:58.539837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:58.558530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:59.462108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:59.472524 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf16928e-249c-4df5-9930-ee6eee321ef0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1463 microversion: 2.1 time: 0.951440 Nov 02 13:50:59.473388 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1195/2247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:58 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1463 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:59.478227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:59.479452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:59.486166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:59.487131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:59.487871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:59.488771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:59.490230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:59.490876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:59.826227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:59.834282 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-761ca798-138b-4593-a71d-e7a5c2ff3cfa tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1368 microversion: 2.1 time: 0.359596 Nov 02 13:50:59.834873 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1196/2248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:50:59 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:00.156338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:00.160173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.160661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.161297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.162028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.162719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.163244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.188997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf241fdc-7933-454c-8a2b-b6fa4bec2ec8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.344779 Nov 02 13:51:00.197629 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1197/2249] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:50:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:00.203040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:00.203687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:00.209904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.211313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.211313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.211807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.212266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.212974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.538215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:00.548328 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a65701b0-a135-46cd-bea3-31a02b8eea26 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.349390 Nov 02 13:51:00.549786 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1198/2250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:00 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:00.558331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cfd51b14-05b7-44c9-ba2d-83d85880d135 tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] Action: 'create', calling method: .version_select at 0x7f6f825368b0>, body: {"security_group": {"name": "tempest-securitygroup-540540531", "description": "tempest-description-119434742"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:01.009820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cfd51b14-05b7-44c9-ba2d-83d85880d135 tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.458132 Nov 02 13:51:01.010610 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1199/2251] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:51:00 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:01.020014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:01.021564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: ebe77b17-d974-49f8-9b09-3aa8866fc56e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:01.032542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.033239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.033885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.034948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.035489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.035970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.054508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] HTTP exception thrown: Instance ebe77b17-d974-49f8-9b09-3aa8866fc56e could not be found. Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Request method failure captured: Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e HTTP/1.1 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnO180Gtupr--bAjKfdBrbN8R4nLZUwQoXhAoTuod2oKHqhJhEpVCDbiBfj3teRJpMPSccd6DjvoohR3m7NaByJkCxRacgHhtU-hQJxehgEJTJXFyxRJfFwwPLBJjfQImLst8HzJ4Q9pc6-T6DPXLcsvvScgLT9lXAH_foGz9WsN6j0 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89354db644694189ac3ae9ec09e7e786"}]}] Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveMigrationTest-506995936 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveMigrationTest-506995936-project Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23d76f5c29444358864d0bc25c83b4b4 Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveMigrationTest-506995936-project Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance ebe77b17-d974-49f8-9b09-3aa8866fc56e could not be found. Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ebe77b17-d974-49f8-9b09-3aa8866fc56e'} Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe77b17-d974-49f8-9b09-3aa8866fc56e could not be found. Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe77b17-d974-49f8-9b09-3aa8866fc56e could not be found. Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:01.056330 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe77b17-d974-49f8-9b09-3aa8866fc56e could not be found. Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Returning 404 to user: Instance ebe77b17-d974-49f8-9b09-3aa8866fc56e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:01.059915 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4379a1d3-b7b1-425f-ada7-3f947eb38e33 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e" status: 404 len: 111 microversion: 2.1 time: 0.045975 Nov 02 13:51:01.062044 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1200/2252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/servers/ebe77b17-d974-49f8-9b09-3aa8866fc56e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:01.067148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:01.068184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:01.074540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.075707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.076259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.077139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.077606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.078013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.437044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:01.451329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ce166a6-1b39-41c3-a2c8-1c887d24709c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1464 microversion: 2.1 time: 0.387055 Nov 02 13:51:01.452977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1201/2253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:01.460968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6a2925c8-1cb3-4115-94d0-6e98339884b9 req-e44be952-d6de-443f-b140-dc2515667112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe77b17-d974-49f8-9b09-3aa8866fc56e", "name": "network-vif-deleted", "tag": "3b0d7cb7-22f9-48b0-9f29-0906adc65935"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:01.471917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6a2925c8-1cb3-4115-94d0-6e98339884b9 req-e44be952-d6de-443f-b140-dc2515667112 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.472529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6a2925c8-1cb3-4115-94d0-6e98339884b9 req-e44be952-d6de-443f-b140-dc2515667112 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.473052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6a2925c8-1cb3-4115-94d0-6e98339884b9 req-e44be952-d6de-443f-b140-dc2515667112 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.500142 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6a2925c8-1cb3-4115-94d0-6e98339884b9 req-e44be952-d6de-443f-b140-dc2515667112 service nova] Creating event network-vif-deleted:3b0d7cb7-22f9-48b0-9f29-0906adc65935 for instance ebe77b17-d974-49f8-9b09-3aa8866fc56e on n-h1-858238-3 Nov 02 13:51:01.514710 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6a2925c8-1cb3-4115-94d0-6e98339884b9 req-e44be952-d6de-443f-b140-dc2515667112 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058263 Nov 02 13:51:01.517501 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1202/2254] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:01.529500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:01.533399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.533872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.534305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.535363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.535999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.536552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.574954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f40fb23-0653-43a6-a545-3394f0e005d1 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-858238-3" status: 200 len: 578 microversion: 2.1 time: 0.055857 Nov 02 13:51:01.577888 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1203/2255] 10.222.0.18 () {58 vars in 1172 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/os-services?host=n-d-858238-3 => generated 578 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:01.588482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "tag": "df016ba5-8847-4225-b37b-62a53270c9c1"}, {"name": "network-changed", "server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "tag": "c7c02697-f279-446e-a34f-b2b225f92553"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:01.607391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.608101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.609196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.627148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] Creating event network-changed:df016ba5-8847-4225-b37b-62a53270c9c1 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:01.627872 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] Creating event network-changed:c7c02697-f279-446e-a34f-b2b225f92553 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:01.634224 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-07dd3949-0d4d-4c3a-b4fc-8cc0dcb117a5 req-cc4fdd8e-70e9-4f07-ad16-0d6831b2581e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052194 Nov 02 13:51:01.635131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1204/2256] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:01.642232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:01.643794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:01.652549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.653283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.653742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.654740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.655667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.657150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.889386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:01.910670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91ce4520-c510-4be7-a8f8-e3d971f10ea0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1368 microversion: 2.1 time: 0.273784 Nov 02 13:51:01.912235 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1205/2257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:01.924124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03579a08-8f68-406e-9bc2-c2b805d91609 tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] Calling method '.version_select at 0x7f6f81b99f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:04.355760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03579a08-8f68-406e-9bc2-c2b805d91609 tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10594 microversion: 2.1 time: 2.439976 Nov 02 13:51:04.356890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1206/2258] 10.222.0.18 () {58 vars in 1191 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10594 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:04.363869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:04.364536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:04.378665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.379494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.379977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.380842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.381542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.382111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.426059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:51:04.529780 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f55c3a1a-c8c6-4f18-bc22-c55c9ee69fc6 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 204 len: 0 microversion: 2.1 time: 0.171178 Nov 02 13:51:04.532241 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1207/2259] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:51:04 2022] DELETE /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:51:04.538522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:04.539761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:04.548791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.548946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.549450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.550927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.551910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.552541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.850974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:04.868455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b451a57-207a-4bc4-8020-48b3085028d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.334882 Nov 02 13:51:04.869228 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1208/2260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:04 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:04.892800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:04.899722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.900814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.901436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.903263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.906585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.907660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.971595 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d89c75f9-c6c4-48f5-a605-e6daadc88cf5 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.100842 Nov 02 13:51:04.974182 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1209/2261] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 13:51:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:04.981811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1979918782", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "25af852c-129a-41f4-858d-7ad75a66729c"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:05.052773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:05.665637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:05.671802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:05.671802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:05.671802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:05.671802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:05.688004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.688657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.689095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.689873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.690511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.691146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.717683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Getting quotas for project 70727044d5314b13bd03fb9998914886. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:05.728294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Getting quotas for user 4365b97ccc164db49191820f75700768 and project 70727044d5314b13bd03fb9998914886. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:05.743371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:05.746188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:05.804902 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-780cc813-a540-419b-a71d-f535c42b3113 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829144 Nov 02 13:51:05.805727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1210/2262] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:05.816252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9d37dc68-6f11-45ee-8fa7-fca3bcc602ed req-3ed97ef4-93c2-4457-b17c-cafe2932c80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b902d64-9d83-4e25-a97d-2b0d4d18f55a", "name": "network-vif-plugged", "status": "completed", "tag": "2e0259a1-15e1-4364-9957-55f03aac23ed"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:05.829897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9d37dc68-6f11-45ee-8fa7-fca3bcc602ed req-3ed97ef4-93c2-4457-b17c-cafe2932c80f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.831699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9d37dc68-6f11-45ee-8fa7-fca3bcc602ed req-3ed97ef4-93c2-4457-b17c-cafe2932c80f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.832150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9d37dc68-6f11-45ee-8fa7-fca3bcc602ed req-3ed97ef4-93c2-4457-b17c-cafe2932c80f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.850407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9d37dc68-6f11-45ee-8fa7-fca3bcc602ed req-3ed97ef4-93c2-4457-b17c-cafe2932c80f service nova] Creating event network-vif-plugged:2e0259a1-15e1-4364-9957-55f03aac23ed for instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a on n-h2-858238-3 Nov 02 13:51:05.856634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9d37dc68-6f11-45ee-8fa7-fca3bcc602ed req-3ed97ef4-93c2-4457-b17c-cafe2932c80f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048729 Nov 02 13:51:05.860067 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1211/2263] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:05.873196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:05.874036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:05.881462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.882153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.883209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.884523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.889565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.890642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.126649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:06.141744 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-682bf5fe-800f-43ad-a6b8-5e330571306d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1368 microversion: 2.1 time: 0.279130 Nov 02 13:51:06.160060 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1212/2264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:05 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:06.160060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1729e077-467b-4645-827b-5619e4f13a97 tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] Calling method '.version_select at 0x7f6f81995c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:06.600209 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1729e077-467b-4645-827b-5619e4f13a97 tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.450106 Nov 02 13:51:06.601011 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1213/2265] 10.222.0.18 () {58 vars in 1191 bytes} [Wed Nov 2 13:51:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:06.606151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:06.607551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:06.626305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.631719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.633572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.640330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.640944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.643599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.713883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.715159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.716350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.717002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lazy-loading 'fault' on Instance uuid a944552c-b24f-4bf8-bffa-b24a0816b48b {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:51:06.787582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d76f5c29444358864d0bc25c83b4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89354db644694189ac3ae9ec09e7e786', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:06.800164 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f30367fb-556c-4ec2-834f-73b4a76083df tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 200 len: 1300 microversion: 2.1 time: 0.197833 Nov 02 13:51:06.801616 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1214/2266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:06 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 1300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:06.808419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:06.814152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.815090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.815704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.816617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.817211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.817935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.852491 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1619a4c6-9361-4d41-b323-cae09b7738a8 tempest-ServicesAdminTestJSON-510165513 tempest-ServicesAdminTestJSON-510165513-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048599 Nov 02 13:51:06.853985 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1215/2267] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:51:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:06.862134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:06.879058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:06.901016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.901794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.902408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.904683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.905124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.905607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.025947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:07.036551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-547b30fe-158c-4c31-b5f2-081d6928600b tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1210 microversion: 2.1 time: 0.179018 Nov 02 13:51:07.037234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1216/2268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:06 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:07.058286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:07.059309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:07.069558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.070589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.071401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.074668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.076058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.076713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.312757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:07.323733 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45f7033b-7935-4742-bc52-8f3560070b08 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.270802 Nov 02 13:51:07.339520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1217/2269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:07 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:07.352938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5ed421cf-ffd2-4900-a5ac-de18b3e4b243 req-4555c783-26af-408a-952a-7a827064601e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a944552c-b24f-4bf8-bffa-b24a0816b48b", "name": "network-vif-deleted", "tag": "81c1e916-e331-4ec8-bd6d-bb2cc1c715ad"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:07.364719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5ed421cf-ffd2-4900-a5ac-de18b3e4b243 req-4555c783-26af-408a-952a-7a827064601e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.365292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5ed421cf-ffd2-4900-a5ac-de18b3e4b243 req-4555c783-26af-408a-952a-7a827064601e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.365797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5ed421cf-ffd2-4900-a5ac-de18b3e4b243 req-4555c783-26af-408a-952a-7a827064601e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.381664 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5ed421cf-ffd2-4900-a5ac-de18b3e4b243 req-4555c783-26af-408a-952a-7a827064601e service nova] Creating event network-vif-deleted:81c1e916-e331-4ec8-bd6d-bb2cc1c715ad for instance a944552c-b24f-4bf8-bffa-b24a0816b48b on n-h1-858238-3 Nov 02 13:51:07.396248 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5ed421cf-ffd2-4900-a5ac-de18b3e4b243 req-4555c783-26af-408a-952a-7a827064601e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054114 Nov 02 13:51:07.397010 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1218/2270] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:07.403058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2029dad-74a4-4e4c-a85e-2623f9910eb8 tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] Calling method '.version_select at 0x7f6f822a3f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:07.812326 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2029dad-74a4-4e4c-a85e-2623f9910eb8 tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/550bc6e2-d66a-4e7d-a85a-880a80754db8" status: 202 len: 0 microversion: 2.1 time: 0.413816 Nov 02 13:51:07.813302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1219/2271] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:07 2022] DELETE /compute/v2.1/os-security-groups/550bc6e2-d66a-4e7d-a85a-880a80754db8 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:07.824428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:07.827959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:07.844750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.845231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.847255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.848918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.850442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.852210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:08.178462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:08.183578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:08.190576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3489cae9-836c-48c9-8eef-48cf8ed38210 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1368 microversion: 2.1 time: 0.375970 Nov 02 13:51:08.191454 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1220/2272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:07 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:08.377953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1905840696", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:08.480933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] validate_networks() for [('e2499577-43af-450c-8f01-5915ab4944ec', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:09.211899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:09.211899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:09.211899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:09.211899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:09.211899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:09.229582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:09.230237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:09.231887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:09.232923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:09.233398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:09.233824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:09.260544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Getting quotas for project 748df3d8b6a94b40ab6485773004af9a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:09.287553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Getting quotas for user 7c39b0225f0f4321a131fa6fc991aaa6 and project 748df3d8b6a94b40ab6485773004af9a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:09.305895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:09.309981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:09.330160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:09.400990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1fee7df1-a68a-4918-950d-9f398e1d84ef tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.205672 Nov 02 13:51:09.410516 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1221/2273] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:09.445653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b0da42c4-1614-49fb-b0ee-44f57ff261ab tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] Calling method '.version_select at 0x7f6f81b0fe50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:10.019392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b0da42c4-1614-49fb-b0ee-44f57ff261ab tempest-SecurityGroupsTestAdminJSON-1011651955 tempest-SecurityGroupsTestAdminJSON-1011651955-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c6b3fa07-1e4d-4e4c-9a50-19365b1152ea" status: 202 len: 0 microversion: 2.1 time: 0.606346 Nov 02 13:51:10.020432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1222/2274] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:09 2022] DELETE /compute/v2.1/os-security-groups/c6b3fa07-1e4d-4e4c-9a50-19365b1152ea => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:10.045539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:10.046693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] [instance: a944552c-b24f-4bf8-bffa-b24a0816b48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:10.074263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.074805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.078432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.079230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.083169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.083520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.110015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] HTTP exception thrown: Instance a944552c-b24f-4bf8-bffa-b24a0816b48b could not be found. Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Request method failure captured: Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b HTTP/1.1 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnO180Gtupr--bAjKfdBrbN8R4nLZUwQoXhAoTuod2oKHqhJhEpVCDbiBfj3teRJpMPSccd6DjvoohR3m7NaByJkCxRacgHhtU-hQJxehgEJTJXFyxRJfFwwPLBJjfQImLst8HzJ4Q9pc6-T6DPXLcsvvScgLT9lXAH_foGz9WsN6j0 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89354db644694189ac3ae9ec09e7e786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89354db644694189ac3ae9ec09e7e786"}]}] Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-LiveMigrationTest-506995936 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 89354db644694189ac3ae9ec09e7e786 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-LiveMigrationTest-506995936 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-LiveMigrationTest-506995936-project Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 23d76f5c29444358864d0bc25c83b4b4 Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-LiveMigrationTest-506995936-project Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a944552c-b24f-4bf8-bffa-b24a0816b48b could not be found. Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a944552c-b24f-4bf8-bffa-b24a0816b48b'} Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a944552c-b24f-4bf8-bffa-b24a0816b48b could not be found. Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a944552c-b24f-4bf8-bffa-b24a0816b48b could not be found. Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:10.125333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a944552c-b24f-4bf8-bffa-b24a0816b48b could not be found. Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] Returning 404 to user: Instance a944552c-b24f-4bf8-bffa-b24a0816b48b could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:10.130171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b436be8b-a34c-4e09-b657-bee46d281065 tempest-LiveMigrationTest-506995936 tempest-LiveMigrationTest-506995936-project] 10.222.0.18 "GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b" status: 404 len: 111 microversion: 2.1 time: 0.104189 Nov 02 13:51:10.131725 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1223/2275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:10 2022] GET /compute/v2.1/servers/a944552c-b24f-4bf8-bffa-b24a0816b48b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:10.137050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:10.148090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:10.155075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.155617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.156060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.156786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.157247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.157674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.673368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:10.689906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba41ee50-3611-4920-8906-9837d3084809 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1314 microversion: 2.1 time: 0.554051 Nov 02 13:51:10.690781 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1224/2276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:10 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:10.712080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:10.717000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:10.728719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.729891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.730516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.732137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.733167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.733733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.188844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.198114 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a02a8dba-770b-4400-93a2-b2f86dcbe060 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.505249 Nov 02 13:51:11.215916 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1225/2277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:10 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:11.233126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:11.235490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:11.255831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.256879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.257620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.258499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.259117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.259673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.650290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.678930 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54955133-fdba-40a9-90e5-482fe86654bb tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1557 microversion: 2.1 time: 0.458682 Nov 02 13:51:11.683042 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1226/2278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:11 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1557 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:11.689633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:11.691796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:11.707530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.709593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.713584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.723655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.723655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.723655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.890929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.906562 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e380111-bec9-4739-922d-5efad77288dc tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1272 microversion: 2.1 time: 0.222039 Nov 02 13:51:11.907614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1227/2279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:11 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:11.923178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba88da7a-5263-4079-807b-33850305ff2d tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] Calling method '.version_select at 0x7f6f812a04c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.504575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba88da7a-5263-4079-807b-33850305ff2d tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3bca9faa-812d-4df0-970e-4ea57513a80a" status: 202 len: 0 microversion: 2.1 time: 0.594518 Nov 02 13:51:12.505266 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1228/2280] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:11 2022] DELETE /compute/v2.1/os-security-groups/3bca9faa-812d-4df0-970e-4ea57513a80a => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:12.519789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2d658155-2237-4acb-a3c5-a6370c71f544 req-6d09ee56-7400-4c49-8be2-82701b4b2656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-plugged", "status": "completed", "tag": "1986686c-be54-4236-9125-6eda28e2cec8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:12.556533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2d658155-2237-4acb-a3c5-a6370c71f544 req-6d09ee56-7400-4c49-8be2-82701b4b2656 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.562390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2d658155-2237-4acb-a3c5-a6370c71f544 req-6d09ee56-7400-4c49-8be2-82701b4b2656 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.563879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2d658155-2237-4acb-a3c5-a6370c71f544 req-6d09ee56-7400-4c49-8be2-82701b4b2656 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.614641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2d658155-2237-4acb-a3c5-a6370c71f544 req-6d09ee56-7400-4c49-8be2-82701b4b2656 service nova] Creating event network-vif-plugged:1986686c-be54-4236-9125-6eda28e2cec8 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:12.622744 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2d658155-2237-4acb-a3c5-a6370c71f544 req-6d09ee56-7400-4c49-8be2-82701b4b2656 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115891 Nov 02 13:51:12.626176 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1229/2281] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:12.638184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.639666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.649759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.654299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.656658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.658160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.660917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.663121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.924432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76a2a010-7371-4007-927f-efb5e2031b61 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295150 Nov 02 13:51:12.924432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1230/2282] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:12.940259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.942199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.956281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.956897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.957629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.959251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.960178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.961267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.756986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.782440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cee64467-6fe3-4bf5-b54c-d5b48e37b0eb tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1314 microversion: 2.1 time: 0.856091 Nov 02 13:51:13.795320 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1231/2283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:13.806176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-995d7e8f-7c70-47de-8a9c-529b54639230 req-a55bc960-afb7-409a-8714-e683f94dc9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46", "tag": "c576477d-124e-47e6-90ed-9d7b45fd9a30"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:13.840534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-995d7e8f-7c70-47de-8a9c-529b54639230 req-a55bc960-afb7-409a-8714-e683f94dc9a6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.841750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-995d7e8f-7c70-47de-8a9c-529b54639230 req-a55bc960-afb7-409a-8714-e683f94dc9a6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.844031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-995d7e8f-7c70-47de-8a9c-529b54639230 req-a55bc960-afb7-409a-8714-e683f94dc9a6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.864043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-995d7e8f-7c70-47de-8a9c-529b54639230 req-a55bc960-afb7-409a-8714-e683f94dc9a6 service nova] Creating event network-changed:c576477d-124e-47e6-90ed-9d7b45fd9a30 for instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 on n-h2-858238-3 Nov 02 13:51:13.869587 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-995d7e8f-7c70-47de-8a9c-529b54639230 req-a55bc960-afb7-409a-8714-e683f94dc9a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072352 Nov 02 13:51:13.870521 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1232/2284] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:13.877160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:13.878531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:13.889743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.890477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.892227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.893376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.894000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.894770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.540459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.561422 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0306eabd-81d5-424f-935b-4006ec419acd tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.688539 Nov 02 13:51:14.594561 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1233/2285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:13 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:14.609442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cc376b8-28d0-4fa7-a6cb-a30470ac892a tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] Calling method '.version_select at 0x7f6f81c29dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.817645 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cc376b8-28d0-4fa7-a6cb-a30470ac892a tempest-SecurityGroupsTestAdminJSON-1874674284 tempest-SecurityGroupsTestAdminJSON-1874674284-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/347f2fbd-3c4c-41b3-8a54-68384cbcc651" status: 202 len: 0 microversion: 2.1 time: 1.220410 Nov 02 13:51:15.820638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1234/2286] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:14 2022] DELETE /compute/v2.1/os-security-groups/347f2fbd-3c4c-41b3-8a54-68384cbcc651 => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:15.834854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.835902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:15.849359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.850573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.851376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.852473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.853722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.854154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:16.512469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:16.548936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b420f978-6aa4-4d8e-a2c0-935058d240b7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1314 microversion: 2.1 time: 0.725331 Nov 02 13:51:16.551591 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1235/2287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:15 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:16.559390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-plugged", "status": "completed", "tag": "c7c02697-f279-446e-a34f-b2b225f92553"}, {"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-plugged", "status": "completed", "tag": "df016ba5-8847-4225-b37b-62a53270c9c1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:16.601687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.602839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.603556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:16.630356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] Creating event network-vif-plugged:c7c02697-f279-446e-a34f-b2b225f92553 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:16.631030 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] Creating event network-vif-plugged:df016ba5-8847-4225-b37b-62a53270c9c1 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:16.637838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-23eba2e8-c044-4161-ab75-b95cef684860 req-6fd80bf7-e075-4415-9940-25f3cda7fa31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084086 Nov 02 13:51:16.639050 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1236/2288] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:16.646914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:16.648131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:16.691728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.693134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.697420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:16.702462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.705395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.709018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.678109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:17.690397 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f537113e-c683-41c0-9cd0-c9a10c6717b2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1314 microversion: 2.1 time: 1.049817 Nov 02 13:51:17.691014 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1237/2289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:16 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:17.728912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2e3f02e0-b67c-44c9-8bff-4774bda9836a req-91f261e2-2d85-440c-a298-3ec48611d954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee", "tag": "94ece405-8a09-4e25-a2db-63a08dbc9ea2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:17.775276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e3f02e0-b67c-44c9-8bff-4774bda9836a req-91f261e2-2d85-440c-a298-3ec48611d954 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.780495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e3f02e0-b67c-44c9-8bff-4774bda9836a req-91f261e2-2d85-440c-a298-3ec48611d954 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.781661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e3f02e0-b67c-44c9-8bff-4774bda9836a req-91f261e2-2d85-440c-a298-3ec48611d954 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.852705 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2e3f02e0-b67c-44c9-8bff-4774bda9836a req-91f261e2-2d85-440c-a298-3ec48611d954 service nova] Creating event network-changed:94ece405-8a09-4e25-a2db-63a08dbc9ea2 for instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee on n-h1-858238-3 Nov 02 13:51:17.875510 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2e3f02e0-b67c-44c9-8bff-4774bda9836a req-91f261e2-2d85-440c-a298-3ec48611d954 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168300 Nov 02 13:51:17.878518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1238/2290] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:17.901782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:17.903198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:17.918861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.919684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.920343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.921750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.922572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.923218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.228588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:18.245583 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5490bb29-80b2-4da7-bd6c-43594e3e43e6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1354 microversion: 2.1 time: 0.352925 Nov 02 13:51:18.246559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1239/2291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:17 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1354 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:18.253443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:18.254946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.265391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.267139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.267767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.268649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.269256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.269903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.858701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:18.893793 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-937712ba-18be-4cd1-a383-51b12434a0b3 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1314 microversion: 2.1 time: 0.645204 Nov 02 13:51:18.900460 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1240/2292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:18 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:18.927467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-21f4ea9d-f122-4cb4-ad42-4af4ddc0d498 req-dc567d8b-c49f-40ce-bc62-2653a390c386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b902d64-9d83-4e25-a97d-2b0d4d18f55a", "tag": "2e0259a1-15e1-4364-9957-55f03aac23ed"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:18.961764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-21f4ea9d-f122-4cb4-ad42-4af4ddc0d498 req-dc567d8b-c49f-40ce-bc62-2653a390c386 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.962235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-21f4ea9d-f122-4cb4-ad42-4af4ddc0d498 req-dc567d8b-c49f-40ce-bc62-2653a390c386 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.968977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-21f4ea9d-f122-4cb4-ad42-4af4ddc0d498 req-dc567d8b-c49f-40ce-bc62-2653a390c386 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.011869 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-21f4ea9d-f122-4cb4-ad42-4af4ddc0d498 req-dc567d8b-c49f-40ce-bc62-2653a390c386 service nova] Creating event network-changed:2e0259a1-15e1-4364-9957-55f03aac23ed for instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a on n-h2-858238-3 Nov 02 13:51:19.034804 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-21f4ea9d-f122-4cb4-ad42-4af4ddc0d498 req-dc567d8b-c49f-40ce-bc62-2653a390c386 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129496 Nov 02 13:51:19.038980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1241/2293] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:19.065813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:19.069780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:19.097004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.098046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.098893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.100390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.101778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.104022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.251420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:19.308392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:19.948603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:19.961379 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b99cf16-c1e2-4501-9f63-fb94336cf0ea tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1314 microversion: 2.1 time: 0.919066 Nov 02 13:51:19.963038 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1242/2294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:19 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:19.969061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:19.969867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:19.976196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.976877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.977493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.978404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.979006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.979616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.713651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:20.722906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-203306b9-93b9-4509-b5af-0025a30f8773 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1804 microversion: 2.1 time: 0.758488 Nov 02 13:51:20.728211 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1243/2295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:19 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1804 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:20.748709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4d593ab1-fb56-48c0-a8d3-83997e7fe405 req-e075b1e7-c20b-40e5-90a5-999b3fed0c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46", "name": "network-vif-plugged", "status": "completed", "tag": "c576477d-124e-47e6-90ed-9d7b45fd9a30"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:20.769192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4d593ab1-fb56-48c0-a8d3-83997e7fe405 req-e075b1e7-c20b-40e5-90a5-999b3fed0c81 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.770830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4d593ab1-fb56-48c0-a8d3-83997e7fe405 req-e075b1e7-c20b-40e5-90a5-999b3fed0c81 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.771421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4d593ab1-fb56-48c0-a8d3-83997e7fe405 req-e075b1e7-c20b-40e5-90a5-999b3fed0c81 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.801536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4d593ab1-fb56-48c0-a8d3-83997e7fe405 req-e075b1e7-c20b-40e5-90a5-999b3fed0c81 service nova] Creating event network-vif-plugged:c576477d-124e-47e6-90ed-9d7b45fd9a30 for instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 on n-h2-858238-3 Nov 02 13:51:20.819459 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4d593ab1-fb56-48c0-a8d3-83997e7fe405 req-e075b1e7-c20b-40e5-90a5-999b3fed0c81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087803 Nov 02 13:51:20.821379 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1244/2296] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:20.838872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:20.841745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:20.867138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.868489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.870010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.871753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.872720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.874136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.484758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:21.499618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca4bac61-35e0-40c8-aabd-e1d9704a0c34 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1314 microversion: 2.1 time: 0.672380 Nov 02 13:51:21.515141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1245/2297] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:20 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:21.515141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:21.515141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:21.549118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.550293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.550754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.551810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.559914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.560738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.563926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:21.614929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e3bdaa9-dc17-4de5-bb3c-39e7cf6d57d7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38/ips" status: 200 len: 218 microversion: 2.1 time: 0.107709 Nov 02 13:51:21.624205 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1246/2298] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:51:21 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38/ips => generated 218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:21.659893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:21.661416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:21.700185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.701718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.704222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.708110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.712037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.712600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.495678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:22.526817 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aadf5070-e1cd-42f6-9b19-d49ec630b37a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1314 microversion: 2.1 time: 0.894888 Nov 02 13:51:22.549129 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1247/2299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:21 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:22.563245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:22.564014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:22.576516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.577792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.578382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.579329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.579940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.580514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.620549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:51:22.859738 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e55bb9f0-01ef-4f85-8cc3-007593739a0b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 204 len: 0 microversion: 2.1 time: 0.306808 Nov 02 13:51:22.870564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1248/2300] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:51:22 2022] DELETE /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:51:22.878186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:22.878914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:22.897688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.901012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.902705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.904016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.905448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.906222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.828821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:23.878585 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-438df9ef-984f-4ca5-b0f8-cb087792c0f8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1314 microversion: 2.1 time: 1.007212 Nov 02 13:51:23.884287 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1249/2301] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:22 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:23.905006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:23.908900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:23.920504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.921295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.921875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.922744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.924891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.925840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:24.275186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:24.285851 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77489c10-da2c-41ef-a6cf-036fd728dfb6 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1810 microversion: 2.1 time: 0.399067 Nov 02 13:51:24.287134 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1250/2302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:23 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1810 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:24.596427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1732317568", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:24.748306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:25.441295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:25.442392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:25.443141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:25.443701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:25.444313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:25.461017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:25.461704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:25.462143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:25.463207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:25.463740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:25.465417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:25.533092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Getting quotas for project 62df681fa5ed464baa58344b82087eba. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:25.545866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Getting quotas for user 7e8614a6255f475dac0b02dc0e0c65a6 and project 62df681fa5ed464baa58344b82087eba. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:25.580440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:25.608210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:25.691723 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d91e92cc-9cf1-4a99-8eb5-53da6ddb1887 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402457 Nov 02 13:51:25.704043 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1251/2303] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:25.712472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-863e62fc-a031-41c0-8c82-93ec4fc0cd4f req-a8155acf-6280-46b3-ae6c-dd2490403044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee", "name": "network-vif-plugged", "status": "completed", "tag": "94ece405-8a09-4e25-a2db-63a08dbc9ea2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:25.754420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-863e62fc-a031-41c0-8c82-93ec4fc0cd4f req-a8155acf-6280-46b3-ae6c-dd2490403044 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:25.755308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-863e62fc-a031-41c0-8c82-93ec4fc0cd4f req-a8155acf-6280-46b3-ae6c-dd2490403044 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:25.758561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-863e62fc-a031-41c0-8c82-93ec4fc0cd4f req-a8155acf-6280-46b3-ae6c-dd2490403044 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:25.833768 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-863e62fc-a031-41c0-8c82-93ec4fc0cd4f req-a8155acf-6280-46b3-ae6c-dd2490403044 service nova] Creating event network-vif-plugged:94ece405-8a09-4e25-a2db-63a08dbc9ea2 for instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee on n-h1-858238-3 Nov 02 13:51:25.856279 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-863e62fc-a031-41c0-8c82-93ec4fc0cd4f req-a8155acf-6280-46b3-ae6c-dd2490403044 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150208 Nov 02 13:51:25.858089 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1252/2304] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:25.892690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:25.895677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:25.917277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:25.918425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:25.919136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:25.920711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:25.923077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:25.923786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:26.530775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:26.544672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4b2e186-5eb2-4279-b6ce-4c1fdb7d4613 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1464 microversion: 2.1 time: 0.684522 Nov 02 13:51:26.546761 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1253/2305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:25 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1464 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:26.597139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:26.606241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:26.638818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:26.639346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:26.639789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:26.640507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:26.641138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:26.641380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:27.358152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:27.367922 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df87f407-16c0-472e-b8f9-8d1fc7e31c26 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1314 microversion: 2.1 time: 0.819767 Nov 02 13:51:27.374255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1254/2306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:26 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:27.386116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:27.389747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:27.412463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:27.412998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:27.413434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:27.414452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:27.418242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:27.418242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.027518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:28.048506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e61412ff-cb26-40d8-b462-02385eae3a1b tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 200 len: 1789 microversion: 2.1 time: 0.669847 Nov 02 13:51:28.065913 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1255/2307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:27 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 1789 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:28.088180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:28.092387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:28.126727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.127483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.128407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.129654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.130726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.131406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.330472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:28.348637 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5c5f685-2fa6-4e88-97d2-db6dface7e64 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1218 microversion: 2.1 time: 0.276078 Nov 02 13:51:28.350368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1256/2308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:28 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1218 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:28.361575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c9b6cd33-2a73-4ab2-b576-3234993f31a5 req-687313e0-04d9-41c6-a80d-c527a2fc4888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-deleted", "tag": "1986686c-be54-4236-9125-6eda28e2cec8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:28.388086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c9b6cd33-2a73-4ab2-b576-3234993f31a5 req-687313e0-04d9-41c6-a80d-c527a2fc4888 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.388909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c9b6cd33-2a73-4ab2-b576-3234993f31a5 req-687313e0-04d9-41c6-a80d-c527a2fc4888 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.389617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c9b6cd33-2a73-4ab2-b576-3234993f31a5 req-687313e0-04d9-41c6-a80d-c527a2fc4888 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.468842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c9b6cd33-2a73-4ab2-b576-3234993f31a5 req-687313e0-04d9-41c6-a80d-c527a2fc4888 service nova] Creating event network-vif-deleted:1986686c-be54-4236-9125-6eda28e2cec8 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:28.479684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c9b6cd33-2a73-4ab2-b576-3234993f31a5 req-687313e0-04d9-41c6-a80d-c527a2fc4888 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126635 Nov 02 13:51:28.489577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1257/2309] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:28.838041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:28.843828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'deleted': False, 'project_id': 'b0a1cdbb68414dcebbfb68bf67be5f97'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:28.850606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.851319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.851896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.852767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.853382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.854149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.889696 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d49a8e9c-8f79-4df6-8609-95df034502a6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.397278 Nov 02 13:51:28.891030 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1258/2310] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:51:28 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:28.896157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2209c67d-af9f-470b-a13f-9d85c66684ed req-4ea44c0a-8b42-4c79-888b-a1845a09d582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-unplugged", "status": "completed", "tag": "df016ba5-8847-4225-b37b-62a53270c9c1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:28.906917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2209c67d-af9f-470b-a13f-9d85c66684ed req-4ea44c0a-8b42-4c79-888b-a1845a09d582 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.907802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2209c67d-af9f-470b-a13f-9d85c66684ed req-4ea44c0a-8b42-4c79-888b-a1845a09d582 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.908557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2209c67d-af9f-470b-a13f-9d85c66684ed req-4ea44c0a-8b42-4c79-888b-a1845a09d582 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.922204 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2209c67d-af9f-470b-a13f-9d85c66684ed req-4ea44c0a-8b42-4c79-888b-a1845a09d582 service nova] Creating event network-vif-unplugged:df016ba5-8847-4225-b37b-62a53270c9c1 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:28.929002 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2209c67d-af9f-470b-a13f-9d85c66684ed req-4ea44c0a-8b42-4c79-888b-a1845a09d582 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035787 Nov 02 13:51:28.930437 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1259/2311] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:28.936588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:28.937612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:28.945350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.947088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.948050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:28.949042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:28.949700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:28.951010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:29.572851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:29.587931 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-68fdc99c-fc4a-4d82-afd0-527faaa42096 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1500 microversion: 2.1 time: 0.655673 Nov 02 13:51:29.589117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1260/2312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:28 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1500 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:29.682979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd66c709-7d2e-4a6d-85a1-d1f8a01de9ca tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Calling method '.version_select at 0x7f6f81b99f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:29.802263 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd66c709-7d2e-4a6d-85a1-d1f8a01de9ca tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.209842 Nov 02 13:51:29.804321 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1261/2313] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:51:29 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:29.815950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:29.831183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'deleted': False} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:29.844439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:29.845715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:29.846543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:29.847896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:29.849046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:29.849988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:30.116988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:51:30.287452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:30.310136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:30.311129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:30.311884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.053547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-757b6891-7873-49ae-a46e-bd30fdc7e6dc tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11148 microversion: 2.1 time: 1.246378 Nov 02 13:51:31.054515 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1262/2314] 10.222.0.18 () {58 vars in 1171 bytes} [Wed Nov 2 13:51:29 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11148 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:31.065929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:31.067859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:31.108367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.108367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.109510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.115163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.115779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.116230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.146092 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] HTTP exception thrown: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Request method failure captured: Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 HTTP/1.1 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWhY41auNoUu4FUB3mGNz5JUQxaLnDv6DtgcA57fusF43oPneeJQ8PCNywYRupUhhdO5Qw4x8PgkbsnAOkaxeDIgBhlO8iyfwkf7-QwFG9cH3HOqiThSXeYAiVgwBFQplQbP6gGNziZLGI70qmUc3vgem6rIpprVMP_1y3kCvx4eLA Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31f12ed436694d52bc37ab8a6e1d8b32"}]}] Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestMultiNic-1977448872 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: aabe2182d4fe4ada9626974416a2f92d Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '06d48450-c044-486e-ae55-6d08745d5b38'} Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:31.148615 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:51:31.154537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:31.158230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Returning 404 to user: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:31.159681 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1db13dd3-ea76-43e6-aac3-c6211482b590 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 404 len: 111 microversion: 2.1 time: 0.102670 Nov 02 13:51:31.161098 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1263/2315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:31 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:31.170800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:31.172175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:31.183226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.184179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.185164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.186493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.189064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.190181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.777618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:31.808087 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83b93ad7-5f33-4243-be89-0b94fde8db84 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1322 microversion: 2.1 time: 0.645529 Nov 02 13:51:31.809249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1264/2316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:31 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:31.830678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:31.833670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:31.874161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.874656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.875338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.877468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.878841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.879315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.966158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lazy-loading 'flavor' on Instance uuid f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:51:31.983503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:32.167435 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a037b105-97a9-4c03-aab1-43d02a1d0690 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "POST /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee/action" status: 200 len: 32 microversion: 2.1 time: 0.343339 Nov 02 13:51:32.171809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1265/2317] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:31 2022] POST /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:32.178460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c1290b9d-c361-4aa3-bfc6-22252d68d3b0 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Action: 'create', calling method: .version_select at 0x7f6f821829d0>, body: {"pool": "non_exist_pool"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:32.332405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c1290b9d-c361-4aa3-bfc6-22252d68d3b0 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] HTTP exception thrown: Floating IP pool not found. Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c1290b9d-c361-4aa3-bfc6-22252d68d3b0 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Request method failure captured: Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 26 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXgos8pUnAPxs-VfPL62Mphmrcr6y4Wv1HKwG6-hKjXtGOipTzZpUYnDnuPJdKOJL55P6h-h_TZE6V_lpgt6R8i9Of_WzPFFYhMVx2O9aiMgrwDiKvt20vGuJpVgwxkHagWbj5burqoTfebt-Zg5kHeKmSC9uPewwkqli5XkJFdVL0 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 3ccf44cc7b1048a09ff34fae201143db Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1814924745 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ccf44cc7b1048a09ff34fae201143db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ccf44cc7b1048a09ff34fae201143db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ccf44cc7b1048a09ff34fae201143db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ccf44cc7b1048a09ff34fae201143db"}]}] Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1814924745 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 3ccf44cc7b1048a09ff34fae201143db Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1814924745 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsNegativeTestJSON-1814924745-project Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 9d982c429fd447b48e5cabd38e67e966 Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1814924745-project Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: {"pool": "non_exist_pool"} Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: exception: Floating IP pool not found. Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:32.344071 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:32.350891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 13:51:32.350891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:32.353277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c1290b9d-c361-4aa3-bfc6-22252d68d3b0 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Returning 404 to user: Floating IP pool not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:32.358094 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c1290b9d-c361-4aa3-bfc6-22252d68d3b0 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.181690 Nov 02 13:51:32.359453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1266/2318] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:51:32 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:51:32.367638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-deleted", "tag": "c7c02697-f279-446e-a34f-b2b225f92553"}, {"server_uuid": "06d48450-c044-486e-ae55-6d08745d5b38", "name": "network-vif-deleted", "tag": "df016ba5-8847-4225-b37b-62a53270c9c1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:32.385350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:32.386123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:32.388825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:32.429458 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] Creating event network-vif-deleted:c7c02697-f279-446e-a34f-b2b225f92553 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:32.431661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] Creating event network-vif-deleted:df016ba5-8847-4225-b37b-62a53270c9c1 for instance 06d48450-c044-486e-ae55-6d08745d5b38 on n-h1-858238-3 Nov 02 13:51:32.438121 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ada5db3e-cc9d-45fa-b829-b0e7376da630 req-a01ae6cc-4c91-4205-b2c9-04e32fe522cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077163 Nov 02 13:51:32.439421 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1267/2319] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:32.445521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:32.453795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'deleted': False, 'project_id': 'b0a1cdbb68414dcebbfb68bf67be5f97'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:32.461792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:32.462394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:32.462836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:32.463636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:32.464096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:32.465078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:32.500670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-436f1510-d263-4b9b-b2af-c312acc05cc6 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?tenant_id=70727044d5314b13bd03fb9998914886" status: 200 len: 15 microversion: 2.1 time: 0.059167 Nov 02 13:51:32.519242 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1268/2320] 10.222.0.18 () {58 vars in 1231 bytes} [Wed Nov 2 13:51:32 2022] GET /compute/v2.1/servers/detail?tenant_id=70727044d5314b13bd03fb9998914886 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:32.529698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-858d937f-2908-4624-bdfd-a0f465b4db5b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f819e1820>, body: {"security_group": {"name": " tempest-securitygroup -812607610 ", "description": "tempest-description-319230602"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:32.948495 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-858d937f-2908-4624-bdfd-a0f465b4db5b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.427972 Nov 02 13:51:32.959272 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1269/2321] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:51:32 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:32.965077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:32.966095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:32.979586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:32.981324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:32.983921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:32.984855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:32.987544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:32.988949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:33.496400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:33.514315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-932e1467-5c40-4757-905f-9b932dc6e393 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.553666 Nov 02 13:51:33.515283 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1270/2322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:32 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:33.521008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d7a3bdb-0bb3-442f-a31f-4d5490c06503 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Calling method '.version_select at 0x7f6f81d2c820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:33.981540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-5d7a3bdb-0bb3-442f-a31f-4d5490c06503 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d847ee76-0a21-48c1-ae30-1979e1de6c5e could not be found", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:51:33.982096 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-5d7a3bdb-0bb3-442f-a31f-4d5490c06503 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] HTTP exception thrown: Floating IP not found for ID d847ee76-0a21-48c1-ae30-1979e1de6c5e Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d7a3bdb-0bb3-442f-a31f-4d5490c06503 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Request method failure captured: Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-floating-ips/d847ee76-0a21-48c1-ae30-1979e1de6c5e HTTP/1.1 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXgos8pUnAPxs-VfPL62Mphmrcr6y4Wv1HKwG6-hKjXtGOipTzZpUYnDnuPJdKOJL55P6h-h_TZE6V_lpgt6R8i9Of_WzPFFYhMVx2O9aiMgrwDiKvt20vGuJpVgwxkHagWbj5burqoTfebt-Zg5kHeKmSC9uPewwkqli5XkJFdVL0 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 3ccf44cc7b1048a09ff34fae201143db Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1814924745 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ccf44cc7b1048a09ff34fae201143db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ccf44cc7b1048a09ff34fae201143db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ccf44cc7b1048a09ff34fae201143db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ccf44cc7b1048a09ff34fae201143db"}]}] Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1814924745 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 3ccf44cc7b1048a09ff34fae201143db Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1814924745 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsNegativeTestJSON-1814924745-project Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 9d982c429fd447b48e5cabd38e67e966 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1814924745-project Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: exception: Floating IP not found for ID d847ee76-0a21-48c1-ae30-1979e1de6c5e Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd847ee76-0a21-48c1-ae30-1979e1de6c5e'} Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d847ee76-0a21-48c1-ae30-1979e1de6c5e could not be found Nov 02 13:51:33.985609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b52c8b69-9f2c-44da-b7b1-a368f902a549'] Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d847ee76-0a21-48c1-ae30-1979e1de6c5e. Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d847ee76-0a21-48c1-ae30-1979e1de6c5e Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d847ee76-0a21-48c1-ae30-1979e1de6c5e Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d7a3bdb-0bb3-442f-a31f-4d5490c06503 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] Returning 404 to user: Floating IP not found for ID d847ee76-0a21-48c1-ae30-1979e1de6c5e {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d7a3bdb-0bb3-442f-a31f-4d5490c06503 tempest-FloatingIPsNegativeTestJSON-1814924745 tempest-FloatingIPsNegativeTestJSON-1814924745-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/d847ee76-0a21-48c1-ae30-1979e1de6c5e" status: 404 len: 111 microversion: 2.1 time: 0.470335 Nov 02 13:51:33.994793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1271/2323] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:51:33 2022] DELETE /compute/v2.1/os-floating-ips/d847ee76-0a21-48c1-ae30-1979e1de6c5e => generated 111 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:34.000265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:34.013460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'tenant_id': '70727044d5314b13bd03fb9998914886', 'deleted': False} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:34.026275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.031906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.032866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.036285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.039303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.043007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.144601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:51:34.259462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.260544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.261187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.554293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48b6e53f-6c81-4587-ab3d-31b8b46cff0b tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=70727044d5314b13bd03fb9998914886" status: 200 len: 4827 microversion: 2.1 time: 0.559665 Nov 02 13:51:34.556516 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1272/2324] 10.222.0.18 () {58 vars in 1257 bytes} [Wed Nov 2 13:51:33 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=70727044d5314b13bd03fb9998914886 => generated 4827 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:34.601503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:34.602052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:34.611947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.612928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.613884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.615461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.616549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.617770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.895014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:34.913513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7048002-b2d1-4ff2-8007-efe95cc8bc01 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1322 microversion: 2.1 time: 0.339459 Nov 02 13:51:34.914523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1273/2325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:34 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:34.922038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-760a3999-fb09-4cd7-bb57-cf8a2c53cda4 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f812a0d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:35.062805 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-760a3999-fb09-4cd7-bb57-cf8a2c53cda4 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e" status: 200 len: 222 microversion: 2.1 time: 0.147024 Nov 02 13:51:35.063746 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1274/2326] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:51:34 2022] GET /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e => generated 222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:35.069305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-44f3d6f3-422f-423c-8d2b-6393d8875471 req-c7c6dd83-bbbd-401f-b83c-de0c1010d7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10df762-001b-4942-92fa-bd35e2fdb684", "tag": "434021e8-593d-4f7e-814a-6f2e60332274"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:35.090642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-44f3d6f3-422f-423c-8d2b-6393d8875471 req-c7c6dd83-bbbd-401f-b83c-de0c1010d7f1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:35.096533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-44f3d6f3-422f-423c-8d2b-6393d8875471 req-c7c6dd83-bbbd-401f-b83c-de0c1010d7f1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:35.097351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-44f3d6f3-422f-423c-8d2b-6393d8875471 req-c7c6dd83-bbbd-401f-b83c-de0c1010d7f1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:35.118505 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-44f3d6f3-422f-423c-8d2b-6393d8875471 req-c7c6dd83-bbbd-401f-b83c-de0c1010d7f1 service nova] Creating event network-changed:434021e8-593d-4f7e-814a-6f2e60332274 for instance d10df762-001b-4942-92fa-bd35e2fdb684 on n-h1-858238-3 Nov 02 13:51:35.135573 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-44f3d6f3-422f-423c-8d2b-6393d8875471 req-c7c6dd83-bbbd-401f-b83c-de0c1010d7f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065788 Nov 02 13:51:35.136894 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1275/2327] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:35.148957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:35.150084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:35.159819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:35.160916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:35.161963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:35.165381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:35.166061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:35.166690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:35.447863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:35.458402 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e9fdb8b-0099-4e7d-b6ed-66ce6906ee90 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.314931 Nov 02 13:51:35.459300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1276/2328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:35 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:35.467996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:35.482338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'tenant_id': 'b0a1cdbb68414dcebbfb68bf67be5f97', 'deleted': False} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:35.492757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:35.493247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:35.493682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:35.494401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:35.494844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:35.495283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:35.541107 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3fa8e35-2788-4af5-8fbb-78051ff54cc1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b0a1cdbb68414dcebbfb68bf67be5f97" status: 200 len: 15 microversion: 2.1 time: 0.080693 Nov 02 13:51:35.541985 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1277/2329] 10.222.0.18 () {58 vars in 1257 bytes} [Wed Nov 2 13:51:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b0a1cdbb68414dcebbfb68bf67be5f97 => generated 15 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:35.552410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-36686c9a-9043-412d-8edb-cd60d8a79398 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f826b0b80>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:35.833558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-36686c9a-9043-412d-8edb-cd60d8a79398 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e" status: 202 len: 0 microversion: 2.1 time: 0.289891 Nov 02 13:51:35.837887 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1278/2330] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:35 2022] DELETE /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:36.059899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-696acd9c-522a-4e65-b421-a3d01ff1a0c4 tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] Calling method '.version_select at 0x7f6f80f091f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.080135 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-696acd9c-522a-4e65-b421-a3d01ff1a0c4 tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.241079 Nov 02 13:51:36.081017 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1279/2331] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 13:51:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:36.086524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7dc64e3-cb1e-4230-b43b-5dfd951e7421 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.099365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7dc64e3-cb1e-4230-b43b-5dfd951e7421 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.016882 Nov 02 13:51:36.099959 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1280/2332] 10.222.0.18 () {58 vars in 1189 bytes} [Wed Nov 2 13:51:36 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:36.107043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80fe9dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.155813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:51:36.157468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group fa0680d9-4457-4bbd-84a5-f91f24736f1e not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:51:36.158396 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.158396 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e HTTP/1.1 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fa0680d9-4457-4bbd-84a5-f91f24736f1e'} Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:51:36.177256 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] Nov 02 13:51:36.184143 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:36.190802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:51:36.190802 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-e8c25842-14c0-428b-8cec-32e45a90a41b'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:36.190802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e653051-ca27-4d90-a85f-40ae9acf62a9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e" status: 404 len: 194 microversion: 2.1 time: 0.084680 Nov 02 13:51:36.196909 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1281/2333] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:51:36 2022] GET /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:36.209074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.210381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:36.221079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:36.222014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:36.222662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:36.223679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:36.224448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:36.225278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:36.574676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:36.602967 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7fca16bb-539a-4c2f-aa0d-c473ab234a6f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1322 microversion: 2.1 time: 0.403798 Nov 02 13:51:36.604619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1282/2334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:36 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:36.611797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55e77b15-faa9-45d6-8927-fcf9131ebbab tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] Action: 'update', calling method: .version_select at 0x7f6f80fe7430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:37.041109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55e77b15-faa9-45d6-8927-fcf9131ebbab tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.433784 Nov 02 13:51:37.042804 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1283/2335] 10.222.0.18 () {60 vars in 1206 bytes} [Wed Nov 2 13:51:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:37.047732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:37.051775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:37.066932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:37.068034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:37.068863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:37.070308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:37.071389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:37.072258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:37.249530 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc68d42f-b1f4-4e6c-b6ec-a16da54cb6a7 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 0 microversion: 2.1 time: 0.205154 Nov 02 13:51:37.250805 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1284/2336] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:37 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:37.260022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c7f5c8b-f177-425f-80ba-b8bab54dc373 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f80e711f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1712814970", "description": "tempest-description-61697461"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:37.643992 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c7f5c8b-f177-425f-80ba-b8bab54dc373 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.391378 Nov 02 13:51:37.644908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1285/2337] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:51:37 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:37.655735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:37.655735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:37.670036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:37.670531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:37.670962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:37.671701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:37.674122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:37.675767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:37.954698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:37.983313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0de16c35-6105-44f3-92f6-dc3911aafe93 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.337199 Nov 02 13:51:37.992898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1286/2338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:37 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:37.999254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38f25232-3a24-455c-8531-05f69185a4af tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] Calling method '.version_select at 0x7f6f80fe73a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:38.044385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38f25232-3a24-455c-8531-05f69185a4af tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.049642 Nov 02 13:51:38.051255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1287/2339] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 13:51:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:38.058949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:38.076681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:38.078824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '70727044d5314b13bd03fb9998914886'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:38.091696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:38.092620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:38.093799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:38.096767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:38.097884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:38.098778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:38.280324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:51:38.378481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f2228f0-9367-49b7-8cbd-b1dd665c72f9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.324322 Nov 02 13:51:38.383441 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1288/2340] 10.222.0.18 () {58 vars in 1150 bytes} [Wed Nov 2 13:51:38 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:38.396109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:38.398447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:38.420085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:38.420583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:38.421023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:38.421742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:38.422192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:38.422614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:38.739673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:38.747829 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a479372a-9184-4f78-93cf-a5267dfd7f56 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1322 microversion: 2.1 time: 0.363180 Nov 02 13:51:38.751810 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1289/2341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:38 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:38.757481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e1cd074-54b6-4827-999b-18f2c1128636 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f81d083a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1004839728", "description": "tempest-description-317038626"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:39.221492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e1cd074-54b6-4827-999b-18f2c1128636 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.467488 Nov 02 13:51:39.230342 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1290/2342] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:51:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:39.242630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0df5264-f9e4-43a9-85d6-d918cdcae887 tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] Action: 'update', calling method: .version_select at 0x7f6f80e80c10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:39.371903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=17,nova_api:INSERT=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:39.488499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0df5264-f9e4-43a9-85d6-d918cdcae887 tempest-QuotaClassesAdminTestJSON-1179147819 tempest-QuotaClassesAdminTestJSON-1179147819-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.254242 Nov 02 13:51:39.493799 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1291/2343] 10.222.0.18 () {60 vars in 1206 bytes} [Wed Nov 2 13:51:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:39.523030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:39.530910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:39.550206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.556654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.557185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.559026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.559563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.559996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.639235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:39.725200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc9e8dd7-f9af-474f-b8a7-7e4f61a21253 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 0 microversion: 2.1 time: 0.228904 Nov 02 13:51:39.729409 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1292/2344] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:39 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:39.742353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:39.743578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:39.758424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.759403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.760605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.762247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.763203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.764853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:40.189343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:40.228247 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19d0ed3b-d60c-4072-a623-0fca0aaa6a9a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.496583 Nov 02 13:51:40.233757 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1293/2345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:39 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:40.242794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a5e8de0-20f0-4d2a-a5f3-4f1e77594ebf tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f80d9b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-424469981", "description": "tempest-description-68431985"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:40.725932 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a5e8de0-20f0-4d2a-a5f3-4f1e77594ebf tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.490355 Nov 02 13:51:40.726858 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1294/2346] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:51:40 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:40.735023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-91348922", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "c545005f-247b-4818-aab7-8fce2ed01826"}, {"uuid": "8256a257-ebc8-476b-af23-a497427d0f73"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:40.864818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] validate_networks() for [('c545005f-247b-4818-aab7-8fce2ed01826', None, None, None, None, None), ('8256a257-ebc8-476b-af23-a497427d0f73', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:42.233250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:42.234334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:42.234922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:42.238303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:42.239444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:42.263585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:42.266237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:42.270424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:42.272147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:42.273021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:42.273759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:42.315280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Getting quotas for project 31f12ed436694d52bc37ab8a6e1d8b32. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:42.330734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Getting quotas for user aabe2182d4fe4ada9626974416a2f92d and project 31f12ed436694d52bc37ab8a6e1d8b32. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:42.367533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:42.373456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:42.466638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd4a0e9a-a607-449d-8899-b57d13eddd7a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737744 Nov 02 13:51:42.475556 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1295/2347] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:42.483016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:42.485881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:42.495253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:42.496151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:42.496781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:42.497685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:42.498325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:42.499176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:42.760246 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7d0d1ae-72d9-417f-80a3-542885ab6c90 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1615 microversion: 2.1 time: 0.283005 Nov 02 13:51:42.763674 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1296/2348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:42 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1615 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:42.773287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:42.774795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:42.797226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:42.804201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:42.806987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:42.812949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:42.819164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:42.820039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:43.315960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:43.365575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-669043a5-e6db-4b45-85f5-4488d50a0c74 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1322 microversion: 2.1 time: 0.599760 Nov 02 13:51:43.367306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1297/2349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:42 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:43.390000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ea07b858-0ab4-40de-9ff8-0774f015cac6 req-d653e8bd-6529-4089-9a99-e843ebc1485a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10df762-001b-4942-92fa-bd35e2fdb684", "name": "network-vif-plugged", "status": "completed", "tag": "434021e8-593d-4f7e-814a-6f2e60332274"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:43.440041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ea07b858-0ab4-40de-9ff8-0774f015cac6 req-d653e8bd-6529-4089-9a99-e843ebc1485a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:43.441967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ea07b858-0ab4-40de-9ff8-0774f015cac6 req-d653e8bd-6529-4089-9a99-e843ebc1485a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:43.444659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ea07b858-0ab4-40de-9ff8-0774f015cac6 req-d653e8bd-6529-4089-9a99-e843ebc1485a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:43.535417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ea07b858-0ab4-40de-9ff8-0774f015cac6 req-d653e8bd-6529-4089-9a99-e843ebc1485a service nova] Creating event network-vif-plugged:434021e8-593d-4f7e-814a-6f2e60332274 for instance d10df762-001b-4942-92fa-bd35e2fdb684 on n-h1-858238-3 Nov 02 13:51:43.544800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ea07b858-0ab4-40de-9ff8-0774f015cac6 req-d653e8bd-6529-4089-9a99-e843ebc1485a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173704 Nov 02 13:51:43.547290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1298/2350] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:43.585409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae10eb16-d5ce-469f-9b59-b721934c65fb tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80d9b700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:44.336178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae10eb16-d5ce-469f-9b59-b721934c65fb tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1605 microversion: 2.1 time: 0.785875 Nov 02 13:51:44.337130 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1299/2351] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:51:43 2022] GET /compute/v2.1/os-security-groups => generated 1605 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:44.354019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:44.371876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:44.383485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:44.383980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:44.384472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:44.388498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:44.388990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:44.389423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:44.593495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:44.609405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9dae4312-cfc7-476a-93c2-6828c5509ec2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.263435 Nov 02 13:51:44.612117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1300/2352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:44 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:44.621584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:44.623261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:44.640271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:44.640909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:44.641336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:44.642208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:44.642960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:44.643664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:44.739041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:44.762179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23dba76d-1f01-4375-bb47-c9931547b1f7 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1263 microversion: 2.1 time: 0.147384 Nov 02 13:51:44.771427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1301/2353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:44 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:44.778869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:44.779445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:44.811352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:44.812114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:44.812927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:44.816839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:44.817290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:44.817812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:45.115928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-836ff0e2-5e7b-48d7-b572-cf954a55d0b1 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1615 microversion: 2.1 time: 0.348007 Nov 02 13:51:45.116871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1302/2354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:44 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1615 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:45.121602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4aca87e-a3ba-4ba1-a243-ca9f6edf40c6 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80e80430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:45.692790 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4aca87e-a3ba-4ba1-a243-ca9f6edf40c6 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e" status: 202 len: 0 microversion: 2.1 time: 0.574802 Nov 02 13:51:45.697063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1303/2355] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:45 2022] DELETE /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:45.704507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:45.705624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:45.715008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:45.716048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:45.716365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:45.717294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:45.718196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:45.719127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:46.048933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:46.074677 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3bc4370b-97e9-4d52-ab73-7b3c1594a550 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1471 microversion: 2.1 time: 0.374365 Nov 02 13:51:46.075864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1304/2356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:45 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1471 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:46.103725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:46.137079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'host': 'n-h2-858238-3', 'deleted': False} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:46.169411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:46.170247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:46.171022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:46.176888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:46.177886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:46.178664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:46.402013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:51:46.562516 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2d5d5de-0776-42e5-be6a-c9e700faf4bd tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=n-h2-858238-3&all_tenants=1" status: 200 len: 1320 microversion: 2.1 time: 0.484839 Nov 02 13:51:46.563872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1305/2357] 10.222.0.18 () {58 vars in 1190 bytes} [Wed Nov 2 13:51:46 2022] GET /compute/v2.1/servers?host=n-h2-858238-3&all_tenants=1 => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:46.573105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:46.577002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:46.588362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:46.589751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:46.590531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:46.591791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:46.592590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:46.593338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:47.049421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:47.069515 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a23a8d7-8db6-46e4-b3d7-41f12610682e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.503812 Nov 02 13:51:47.070586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1306/2358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:46 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:47.077213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80f09550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:47.126777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:51:47.127941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 5f8d8285-79af-4707-888e-9335c7dba57e not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:51:47.128681 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.128681 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e HTTP/1.1 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5f8d8285-79af-4707-888e-9335c7dba57e'} Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:51:47.131280 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] Nov 02 13:51:47.134508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.139345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:51:47.139345 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-5c38b213-c3e7-4a8b-b058-1f30d3d8602a'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:47.142328 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e443e452-87bf-4f2e-aa79-190701c9240b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e" status: 404 len: 194 microversion: 2.1 time: 0.070019 Nov 02 13:51:47.146778 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1307/2359] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:51:47 2022] GET /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:47.155886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:47.156422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:47.166520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:47.167194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:47.174731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:47.175527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:47.176602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:47.177036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:47.752570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:47.768743 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da23ce48-5899-4ec4-ad66-70d88e4c66d4 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1311 microversion: 2.1 time: 0.623919 Nov 02 13:51:47.769803 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1308/2360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:47 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1311 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:48.014566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e0f7229-011d-44b2-ab84-8661d87d211f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:48.015436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e0f7229-011d-44b2-ab84-8661d87d211f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] [instance: 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:48.021763 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3e0f7229-011d-44b2-ab84-8661d87d211f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] HTTP exception thrown: Instance 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc could not be found. Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e0f7229-011d-44b2-ab84-8661d87d211f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Request method failure captured: Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc/action HTTP/1.1 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 15 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXaTT3A5986yTKxlVImJm2P-cIdTtxa8uW-e3QzrjzLZuhHhYi1-6i8KiT3g6rWGRwBVCrQBx5b0mf6SKBPIM-fe2YwIiv1-shbDb_vUiKI21nDs7cwV-VUHQ_Sn_lb7wON39ngY8yAvPqu1u66oYmvSUhtkUdamb-TOSmTOU9C4m4 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b712bc386fe44a98f3874d610d551b0"}]}] Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a965a3aa9524e398eb5100bdd1d202a Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: {"migrate": {}} Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc could not be found. Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc', 'body': {'migrate': {}}} Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc could not be found. Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc could not be found. Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:48.024265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:48.028942 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:48.028942 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:48.028942 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:48.028942 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:48.028942 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc could not be found. Nov 02 13:51:48.028942 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:48.031020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e0f7229-011d-44b2-ab84-8661d87d211f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Returning 404 to user: Instance 9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:48.032070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e0f7229-011d-44b2-ab84-8661d87d211f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc/action" status: 404 len: 111 microversion: 2.1 time: 0.260885 Nov 02 13:51:48.033279 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1309/2361] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:47 2022] POST /compute/v2.1/servers/9bc393e4-509d-4ad5-ad8a-d9c4dbe36ccc/action => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:48.179780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Action: 'update', calling method: .version_select at 0x7f6f80d61f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:48.333259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:48.334389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:48.335513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:48.336502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:48.337215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:48.337998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:48.442289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d83eba8c-0ad1-49bf-b2e1-fc57d6d3771a tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc" status: 200 len: 148 microversion: 2.57 time: 0.407255 Nov 02 13:51:48.443880 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1310/2362] 10.222.0.18 () {62 vars in 1303 bytes} [Wed Nov 2 13:51:48 2022] PUT /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc => generated 148 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:48.453787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:48.469129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:51:48.478988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:48.486928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:48.487937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:48.488919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:48.489562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:48.490140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:48.533323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4327f798-39bc-4a32-aab5-b3b770432aff tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.087950 Nov 02 13:51:48.534559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1311/2363] 10.222.0.18 () {58 vars in 1196 bytes} [Wed Nov 2 13:51:48 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:51:48.548359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0a9a853-f6eb-42ea-ba90-c86e9db54a42 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80c7f430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:49.160619 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0a9a853-f6eb-42ea-ba90-c86e9db54a42 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680" status: 202 len: 0 microversion: 2.1 time: 0.624470 Nov 02 13:51:49.161609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1312/2364] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:48 2022] DELETE /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:49.167225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:49.167850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:49.182483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:49.183482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:49.183482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:49.184146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:49.184610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:49.185034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:49.500123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:49.509338 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10d0dd14-98dc-423d-81de-0c7d2f576eba tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.346603 Nov 02 13:51:49.509957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1313/2365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:49 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:49.524188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1618156776", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:49.625596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:50.171527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:50.172892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:50.173564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:50.174487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:50.175181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:50.195903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=54,nova_cell0:UPDATE=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:50.197402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.198218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.198726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.199530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.200120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.200552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.220626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=23 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:50.254926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Getting quotas for project 62df681fa5ed464baa58344b82087eba. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:50.265765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Getting quotas for user 7e8614a6255f475dac0b02dc0e0c65a6 and project 62df681fa5ed464baa58344b82087eba. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:50.287247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:50.291063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:50.383663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22c014d7-915f-42ab-9d70-332a294c6cd3 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872036 Nov 02 13:51:50.384994 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1314/2366] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:50.404524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Calling method '.version_select at 0x7f6f80c89430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:50.525145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.525628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.526059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.527454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.527906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.528379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.577233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2235126-4af2-4f13-82c6-c15447886557 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc/detail" status: 200 len: 463 microversion: 2.57 time: 0.189979 Nov 02 13:51:50.579110 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1315/2367] 10.222.0.18 () {60 vars in 1304 bytes} [Wed Nov 2 13:51:50 2022] GET /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc/detail => generated 463 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:50.588401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:50.597076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:50.626783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.631060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.633037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.640258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.640886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.641401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.817754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:50.824124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-24c68f48-07d8-40fa-9afe-159a4c02c146 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 0 microversion: 2.1 time: 0.242852 Nov 02 13:51:50.834076 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1316/2368] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:50 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:50.840945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:50.841865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:50.844468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:UPDATE=7,nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:50.853907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.854900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.856118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:50.857075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:50.857917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:50.858542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:51.165095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:51.174072 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4171a0e7-3581-4b5b-bac1-455f9df363ee tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1332 microversion: 2.1 time: 0.338127 Nov 02 13:51:51.174683 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1317/2369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:50 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1332 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:51.185464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80c89940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:51.270290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:51:51.271829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 941b6f91-cbad-40c7-aabd-215f676d7680 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:51:51.273543 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.273543 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680 HTTP/1.1 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '941b6f91-cbad-40c7-aabd-215f676d7680'} Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:51:51.276106 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] Nov 02 13:51:51.279576 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:51.288083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:51:51.288083 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-b80880c3-1ebd-4012-be7e-3a66ec5c76e4'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:51.288855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-767e7949-25c4-4c20-9e3c-b83fffa104ce tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680" status: 404 len: 194 microversion: 2.1 time: 0.107187 Nov 02 13:51:51.290451 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1318/2370] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:51:51 2022] GET /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680 => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:51.298372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-333a1478-0b6a-4fab-b1e0-67f855cd27c3 req-b5910b03-a716-4aaa-8ead-8023017d9295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237575f5-a72a-4587-b849-73833215cc6f", "tag": "2c0da40f-1bd3-422d-b4f0-cf352a899661"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:51.327273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-333a1478-0b6a-4fab-b1e0-67f855cd27c3 req-b5910b03-a716-4aaa-8ead-8023017d9295 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:51.327765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-333a1478-0b6a-4fab-b1e0-67f855cd27c3 req-b5910b03-a716-4aaa-8ead-8023017d9295 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:51.328172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-333a1478-0b6a-4fab-b1e0-67f855cd27c3 req-b5910b03-a716-4aaa-8ead-8023017d9295 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:51.345791 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-333a1478-0b6a-4fab-b1e0-67f855cd27c3 req-b5910b03-a716-4aaa-8ead-8023017d9295 service nova] Creating event network-changed:2c0da40f-1bd3-422d-b4f0-cf352a899661 for instance 237575f5-a72a-4587-b849-73833215cc6f on n-h1-858238-3 Nov 02 13:51:51.356472 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-333a1478-0b6a-4fab-b1e0-67f855cd27c3 req-b5910b03-a716-4aaa-8ead-8023017d9295 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064072 Nov 02 13:51:51.357613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1319/2371] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:51.367596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:51.368396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:51.381480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:51.381970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:51.382427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:51.383301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:51.383648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:51.384095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:51.626326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:51.655462 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b24f2454-acfe-4303-8b51-5be42d65263e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1226 microversion: 2.1 time: 0.296455 Nov 02 13:51:51.668658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1320/2372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:51 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1226 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:51.681130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:51.682158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:51.692060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:51.692978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:51.693843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:51.694898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:51.695569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:51.696238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.090570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:52.102022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82fa47fc-669b-42ae-b6b5-37e2f19f4a0a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.431661 Nov 02 13:51:52.102998 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1321/2373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:51 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:52.109934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Action: 'update', calling method: .version_select at 0x7f6f80e71160>, body: {"quota_set": {"ram": "2048"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:52.183915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.185127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.185564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.186316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.186763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.187208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.234882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.235400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.235832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.236559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.237040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.237462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.306010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fea5d94-956e-4327-ba42-55ad9c7e6dc8 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc?user_id=c2754d55d910430786a5714cf329ca7c" status: 200 len: 148 microversion: 2.57 time: 0.201169 Nov 02 13:51:52.319641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1322/2374] 10.222.0.18 () {62 vars in 1384 bytes} [Wed Nov 2 13:51:52 2022] PUT /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc?user_id=c2754d55d910430786a5714cf329ca7c => generated 148 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:52.319641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:52.324936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:52.337823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.338491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.342765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.346107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.346832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.347773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.476097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:52.476873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:52.477688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:52.478521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:52.479202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:52.619709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:52.640125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.640835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.642498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.643675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.646094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.647875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.722593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8a63ef6a-1a82-471d-8f85-83b2bf9ef9f4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 1068 microversion: 2.1 time: 0.412655 Nov 02 13:51:52.724472 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1323/2375] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:52 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 1068 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:51:52.736661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fec56d6-9540-47fa-bb48-1a387b33abf9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80fe9dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:53.391124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fec56d6-9540-47fa-bb48-1a387b33abf9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb" status: 202 len: 0 microversion: 2.1 time: 0.664798 Nov 02 13:51:53.394835 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1324/2376] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:51:52 2022] DELETE /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:53.494026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-630324260", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "33c42995-5a65-4daa-b956-d8895d884cd6"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:53.568388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] validate_networks() for [('33c42995-5a65-4daa-b956-d8895d884cd6', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:54.953198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:54.955150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:54.956033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:54.956988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:54.958692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:54.976436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:54.977262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:54.978201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:54.980045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:54.980859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:54.981814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:55.014625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Getting quotas for project 708743f0f3134a5e9444fed3dcad5ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:55.026435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Getting quotas for user fa9f0bc1c07c412fb4c6cc59e9a08efa and project 708743f0f3134a5e9444fed3dcad5ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:55.052206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:55.056494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:55.153391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dc7582ef-6480-42cf-9741-77f1fbbcad6e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759244 Nov 02 13:51:55.155219 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1325/2377] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:51:55.164516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:55.167962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:55.196670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:55.197595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:55.198647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:55.200249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:55.201204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:55.202069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:55.747235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:55.764652 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96d58397-e52c-4b83-9c54-76730377be05 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1332 microversion: 2.1 time: 0.607405 Nov 02 13:51:55.766569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1326/2378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:55 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1332 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:55.775860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14bd8718-d068-48a1-b6ec-fe8b8ed6e436 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] Calling method '.version_select at 0x7f6f80fe7550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:55.913124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14bd8718-d068-48a1-b6ec-fe8b8ed6e436 tempest-QuotasAdminTestV257-54640778 tempest-QuotasAdminTestV257-54640778-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc?user_id=c2754d55d910430786a5714cf329ca7c" status: 200 len: 190 microversion: 2.57 time: 0.144546 Nov 02 13:51:55.914639 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1327/2379] 10.222.0.18 () {60 vars in 1364 bytes} [Wed Nov 2 13:51:55 2022] GET /compute/v2.1/os-quota-sets/00479e1ccf61416ca692fa5e5b12c7cc?user_id=c2754d55d910430786a5714cf329ca7c => generated 190 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:55.920259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:55.921202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:55.929357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:55.930780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:55.931527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:55.932561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:55.933436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:55.934462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.306631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:56.333188 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49f28843-abc0-4af5-9c95-dfd36e907f62 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1322 microversion: 2.1 time: 0.417145 Nov 02 13:51:56.347213 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1328/2380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:55 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:56.348171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:56.348833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:56.358829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.359385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.359826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.360713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.377054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.379031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.759860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:56.771463 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf931115-9f49-406b-ab80-f1ac07bb9755 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1472 microversion: 2.1 time: 0.435993 Nov 02 13:51:56.774004 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1329/2381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:56 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:56.782293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:56.783155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:56.799085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.799891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.800495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.801620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.802220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.802793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.322002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:57.340070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-973037d2-9404-45e7-b8de-bfaa76241edd tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.564809 Nov 02 13:51:57.356476 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1330/2382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:56 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:57.361643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0e712932-7a1e-437e-9f9c-6d6f922dbaa4 req-25e78eab-b88c-45bc-8927-597b1605f4ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237575f5-a72a-4587-b849-73833215cc6f", "tag": "9c217dc5-102d-4c85-a3be-7f4269e8c385"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:57.386441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e712932-7a1e-437e-9f9c-6d6f922dbaa4 req-25e78eab-b88c-45bc-8927-597b1605f4ad service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.387240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e712932-7a1e-437e-9f9c-6d6f922dbaa4 req-25e78eab-b88c-45bc-8927-597b1605f4ad service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.387839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e712932-7a1e-437e-9f9c-6d6f922dbaa4 req-25e78eab-b88c-45bc-8927-597b1605f4ad service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.409928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0e712932-7a1e-437e-9f9c-6d6f922dbaa4 req-25e78eab-b88c-45bc-8927-597b1605f4ad service nova] Creating event network-changed:9c217dc5-102d-4c85-a3be-7f4269e8c385 for instance 237575f5-a72a-4587-b849-73833215cc6f on n-h1-858238-3 Nov 02 13:51:57.422703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0e712932-7a1e-437e-9f9c-6d6f922dbaa4 req-25e78eab-b88c-45bc-8927-597b1605f4ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078876 Nov 02 13:51:57.424146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1331/2383] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:57.438585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80da1670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.562210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:51:57.562803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:51:57.563363 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.563363 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb HTTP/1.1 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb'} Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:51:57.565314 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-04ac4930-031c-479b-b4a9-22f6f7beb53f'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-414eed11-13d6-481a-b143-05c188208403 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb" status: 404 len: 194 microversion: 2.1 time: 0.141610 Nov 02 13:51:57.569507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1332/2384] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:57.582904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.583778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:57.595141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.595678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.596115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.597019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.597365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.597793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.714519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:57.735772 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-299442dc-2a70-4d69-aa4f-3b826dfed294 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1275 microversion: 2.1 time: 0.165943 Nov 02 13:51:57.737441 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1333/2385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:57.747147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.748511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:57.760033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.761164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.761280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.765513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.766086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.767833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:58.101475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:58.136553 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8024012b-06d9-4a17-b189-a774d1f84e10 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1332 microversion: 2.1 time: 0.395061 Nov 02 13:51:58.158504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1334/2386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1332 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:58.176793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:58.183883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:58.193118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:58.193966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:58.200908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:58.202976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:58.204255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:58.205269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:58.600368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:58.615344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b525fc8-2ee9-4165-b914-7f86ba31a603 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1322 microversion: 2.1 time: 0.454513 Nov 02 13:51:58.616484 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1335/2387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:58 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:58.628488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-618d8d15-f602-4273-b4c6-a4f153e95fae tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80df81f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:59.169191 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-618d8d15-f602-4273-b4c6-a4f153e95fae tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 933 microversion: 2.1 time: 0.548921 Nov 02 13:51:59.172048 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1336/2388] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:51:58 2022] GET /compute/v2.1/os-security-groups => generated 933 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:59.205545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:59.207256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:59.221165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.222303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.223454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.224887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.225789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.227384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.509725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:59.519546 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-459cd504-2b5f-4f4b-8b79-90adfb0c7b20 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1472 microversion: 2.1 time: 0.344686 Nov 02 13:51:59.520081 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1337/2389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:59 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:59.526387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:59.527699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:59.536508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.537001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.537421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.538131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.538579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.538994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.792767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:59.795473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:59.805345 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7703940b-59b7-4e18-9e4e-9f61ed5ecca9 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.284036 Nov 02 13:51:59.806099 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1338/2390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:59 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:59.828565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:59.829191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:59.835987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.836471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.836897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.837668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.840378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.840819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.057752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:00.083842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d175803b-0226-432b-a908-f286a37f9402 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1317 microversion: 2.1 time: 0.262951 Nov 02 13:52:00.084497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1339/2391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:59 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:00.089909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:00.090529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:00.100546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:00.101103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:00.101806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.102790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:00.104898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:00.105580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.570558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:00.585490 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf1b433a-e986-4317-bb98-b5f23569c29e tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1332 microversion: 2.1 time: 0.498803 Nov 02 13:52:00.588121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1340/2392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:00 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1332 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:00.599289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6372be98-de85-4e9c-9561-2dab730877f0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f80c89310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1116734660", "description": "tempest-description-2094817817"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:01.488135 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6372be98-de85-4e9c-9561-2dab730877f0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.896613 Nov 02 13:52:01.489287 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1341/2393] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:01.494401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5af0d44e-332d-4008-9163-7413a86ba331 req-2c3c3acc-7ad5-456e-af1c-8435d80e8d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e073b02f-8fa7-4440-856a-252917006fa8", "tag": "9d69dabb-620e-4efa-a3ed-a1bbfa670c7e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:01.516796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5af0d44e-332d-4008-9163-7413a86ba331 req-2c3c3acc-7ad5-456e-af1c-8435d80e8d5a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.517688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5af0d44e-332d-4008-9163-7413a86ba331 req-2c3c3acc-7ad5-456e-af1c-8435d80e8d5a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.518538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5af0d44e-332d-4008-9163-7413a86ba331 req-2c3c3acc-7ad5-456e-af1c-8435d80e8d5a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:01.533236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5af0d44e-332d-4008-9163-7413a86ba331 req-2c3c3acc-7ad5-456e-af1c-8435d80e8d5a service nova] Creating event network-changed:9d69dabb-620e-4efa-a3ed-a1bbfa670c7e for instance e073b02f-8fa7-4440-856a-252917006fa8 on n-h2-858238-3 Nov 02 13:52:01.545301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5af0d44e-332d-4008-9163-7413a86ba331 req-2c3c3acc-7ad5-456e-af1c-8435d80e8d5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054546 Nov 02 13:52:01.546899 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1342/2394] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:01.559679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:01.560880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:01.572335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.573154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.573973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:01.575043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.575696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.576283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:01.921388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:01.932001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d787a533-57cb-49c6-82b2-8d5cbaf6a049 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1322 microversion: 2.1 time: 0.381642 Nov 02 13:52:01.932997 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1343/2395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:01 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:02.109397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-df752a0f-2475-4e81-9ccd-558a39077b53 req-e67f7e82-f180-4140-bf41-b987a9882df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237575f5-a72a-4587-b849-73833215cc6f", "name": "network-vif-plugged", "status": "completed", "tag": "2c0da40f-1bd3-422d-b4f0-cf352a899661"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:02.125208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-df752a0f-2475-4e81-9ccd-558a39077b53 req-e67f7e82-f180-4140-bf41-b987a9882df2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.125885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-df752a0f-2475-4e81-9ccd-558a39077b53 req-e67f7e82-f180-4140-bf41-b987a9882df2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.126608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-df752a0f-2475-4e81-9ccd-558a39077b53 req-e67f7e82-f180-4140-bf41-b987a9882df2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.145286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-df752a0f-2475-4e81-9ccd-558a39077b53 req-e67f7e82-f180-4140-bf41-b987a9882df2 service nova] Creating event network-vif-plugged:2c0da40f-1bd3-422d-b4f0-cf352a899661 for instance 237575f5-a72a-4587-b849-73833215cc6f on n-h1-858238-3 Nov 02 13:52:02.152194 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-df752a0f-2475-4e81-9ccd-558a39077b53 req-e67f7e82-f180-4140-bf41-b987a9882df2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217389 Nov 02 13:52:02.153057 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1344/2396] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:02.158847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:02.159588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:02.166368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.166940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.167405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.168114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.168577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.168996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.332216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:02.349213 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-845943e0-f027-43b3-9d50-cd5e4c0ef886 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1472 microversion: 2.1 time: 0.193962 Nov 02 13:52:02.364269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1345/2397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:02 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1472 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:02.393974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:02.395081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:02.407702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.408500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.409290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.411976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.412717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.413612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.764661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:02.778749 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f5c7edb6-d4ed-4bd3-bc1e-9b273a8598e4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.412370 Nov 02 13:52:02.785992 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1346/2398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:02 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:02.796584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:02.797945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:02.810741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.812033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.813437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.815300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.816431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.817486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.029399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:03.039909 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80b5cf69-411a-45a3-96d5-d09855742eb9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1317 microversion: 2.1 time: 0.252064 Nov 02 13:52:03.040411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1347/2399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:02 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:03.046091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2346e2eb-bb31-4658-bf97-48950cf519bc tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f80c3ae50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-642386495", "description": "tempest-description-1443684948"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:03.222677 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2346e2eb-bb31-4658-bf97-48950cf519bc tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.180983 Nov 02 13:52:03.223628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1348/2400] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:03.239227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:03.240210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:03.248614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.249507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.250012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.250742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.251376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.252009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.426572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:03.434741 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2f112ce-8b28-4d3a-92a0-084d3c080cf1 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1332 microversion: 2.1 time: 0.200195 Nov 02 13:52:03.435404 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1349/2401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:03 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1332 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:03.499456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a5723bf-3f2a-4856-80f2-052d71f1962d tempest-TenantUsagesNegativeTestJSON-465723490 tempest-TenantUsagesNegativeTestJSON-465723490-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T13%3A52%3A01.892939&end=2022-11-03T13%3A52%3A01.892939" status: 404 len: 112 microversion: - time: 0.062932 Nov 02 13:52:03.500008 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1350/2402] 10.222.0.18 () {58 vars in 1316 bytes} [Wed Nov 2 13:52:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T13%3A52%3A01.892939&end=2022-11-03T13%3A52%3A01.892939 => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:52:03.511660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:03.512463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:03.519531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.520062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.520494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.521198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.521651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.522275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.714504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:03.723531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b248b4f0-acaf-4607-8dde-ba3527766d36 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1322 microversion: 2.1 time: 0.221884 Nov 02 13:52:03.729595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1351/2403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:03 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:03.736677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1652340733", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e2e6f37e-ed91-4d52-bf99-0a140b2da0e5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:03.770031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:03.828116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] validate_networks() for [('e2e6f37e-ed91-4d52-bf99-0a140b2da0e5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:52:04.257910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:52:04.258316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:52:04.258952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:52:04.259365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:52:04.259774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:52:04.269178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.269663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.270087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.271132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.271580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.271996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.292730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Getting quotas for project a26cb2eee50a4cbaa2cb4e93216b4b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:52:04.298886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Getting quotas for user 01a50d7ce0af495781869c6f0f6534cf and project a26cb2eee50a4cbaa2cb4e93216b4b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:52:04.313643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:52:04.316165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:52:04.373026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e871d9a-f259-4039-831c-3f8fe9ec8b16 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642359 Nov 02 13:52:04.373692 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1352/2404] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:52:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:52:04.378422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:04.379285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:04.386791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.387338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.387773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.388476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.388933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.389358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.546972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:04.558875 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6428f4b6-2bd8-4064-bf41-ac00162f69e3 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1472 microversion: 2.1 time: 0.183727 Nov 02 13:52:04.559977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1353/2405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:04 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:04.567916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad4d8dbf-fb5c-4d35-8569-54490cc08ded tempest-TenantUsagesNegativeTestJSON-465723490 tempest-TenantUsagesNegativeTestJSON-465723490-project-admin] Calling method '.version_select at 0x7f6f80e80c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:04.573965 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ad4d8dbf-fb5c-4d35-8569-54490cc08ded tempest-TenantUsagesNegativeTestJSON-465723490 tempest-TenantUsagesNegativeTestJSON-465723490-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad4d8dbf-fb5c-4d35-8569-54490cc08ded tempest-TenantUsagesNegativeTestJSON-465723490 tempest-TenantUsagesNegativeTestJSON-465723490-project-admin] Request method failure captured: Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-simple-tenant-usage/f3b22a2170444e96be7ec63b907e5d44?start=2022-11-03T13%3A52%3A01.892939&end=2022-11-01T13%3A52%3A01.892939 HTTP/1.1 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYB7D639TlV06XipWvwBcuVa6upwbJn9J5M9Aj5Tu2TX406JBPb-pQSq5WgY99E5sQiZ-HIJVYosj9Y_ixIuWERoUDemtNXKUrcXVLb-PknFVSD4V32rL73TcHxSsk-owTQyzhCq0sbhGf6FXGlP51jEtM2_yeaX3JndL8tQKkPbTo Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0f5ef161aa1146ddbd5c411e793ad4e4 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-465723490 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f5ef161aa1146ddbd5c411e793ad4e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f5ef161aa1146ddbd5c411e793ad4e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f5ef161aa1146ddbd5c411e793ad4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f5ef161aa1146ddbd5c411e793ad4e4"}]}] Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-465723490 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0f5ef161aa1146ddbd5c411e793ad4e4 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-465723490 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TenantUsagesNegativeTestJSON-465723490-project-admin Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 933a86f7ad704a17a4c901a412d65ac1 Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-465723490-project-admin Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f3b22a2170444e96be7ec63b907e5d44'} Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 13:52:04.583941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:04.595529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad4d8dbf-fb5c-4d35-8569-54490cc08ded tempest-TenantUsagesNegativeTestJSON-465723490 tempest-TenantUsagesNegativeTestJSON-465723490-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:04.595529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad4d8dbf-fb5c-4d35-8569-54490cc08ded tempest-TenantUsagesNegativeTestJSON-465723490 tempest-TenantUsagesNegativeTestJSON-465723490-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/f3b22a2170444e96be7ec63b907e5d44?start=2022-11-03T13%3A52%3A01.892939&end=2022-11-01T13%3A52%3A01.892939" status: 400 len: 111 microversion: 2.1 time: 0.032281 Nov 02 13:52:04.595529 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1354/2406] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Nov 2 13:52:04 2022] GET /compute/v2.1/os-simple-tenant-usage/f3b22a2170444e96be7ec63b907e5d44?start=2022-11-03T13%3A52%3A01.892939&end=2022-11-01T13%3A52%3A01.892939 => generated 111 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:52:04.606893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e7cce02b-9d98-4c82-b1ba-c10709c6ce27 req-b1314a57-f8da-49c3-89e0-52bbc9b0aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fbdd6a-c37c-4e4a-867e-c66728467c2d", "tag": "20357963-a90e-490e-b1e0-4c8b244138a0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:04.620053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e7cce02b-9d98-4c82-b1ba-c10709c6ce27 req-b1314a57-f8da-49c3-89e0-52bbc9b0aa06 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.622190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e7cce02b-9d98-4c82-b1ba-c10709c6ce27 req-b1314a57-f8da-49c3-89e0-52bbc9b0aa06 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.622630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e7cce02b-9d98-4c82-b1ba-c10709c6ce27 req-b1314a57-f8da-49c3-89e0-52bbc9b0aa06 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.635891 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e7cce02b-9d98-4c82-b1ba-c10709c6ce27 req-b1314a57-f8da-49c3-89e0-52bbc9b0aa06 service nova] Creating event network-changed:20357963-a90e-490e-b1e0-4c8b244138a0 for instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d on n-h1-858238-3 Nov 02 13:52:04.642434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e7cce02b-9d98-4c82-b1ba-c10709c6ce27 req-b1314a57-f8da-49c3-89e0-52bbc9b0aa06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046938 Nov 02 13:52:04.643055 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1355/2407] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:04.652186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:04.652807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:04.659878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.660366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.660802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.661537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.661990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.662496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.877290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:04.892825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f6a75a7-819c-425e-8ea8-d6edc28dc838 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.245325 Nov 02 13:52:04.894009 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1356/2408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:04 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:04.902919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:04.903909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:04.913975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.914623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.915359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.916598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.917211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.917969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.096102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:05.107544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ee5ffcf-4fdd-4c94-9eff-0a1737cc42e6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1317 microversion: 2.1 time: 0.212151 Nov 02 13:52:05.108143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1357/2409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:04 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:05.113250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237575f5-a72a-4587-b849-73833215cc6f", "name": "network-vif-plugged", "status": "completed", "tag": "9c217dc5-102d-4c85-a3be-7f4269e8c385"}, {"server_uuid": "e073b02f-8fa7-4440-856a-252917006fa8", "name": "network-vif-plugged", "status": "completed", "tag": "9d69dabb-620e-4efa-a3ed-a1bbfa670c7e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:05.124926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.125439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.125831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.143346 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] Creating event network-vif-plugged:9c217dc5-102d-4c85-a3be-7f4269e8c385 for instance 237575f5-a72a-4587-b849-73833215cc6f on n-h1-858238-3 Nov 02 13:52:05.144113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] Creating event network-vif-plugged:9d69dabb-620e-4efa-a3ed-a1bbfa670c7e for instance e073b02f-8fa7-4440-856a-252917006fa8 on n-h2-858238-3 Nov 02 13:52:05.153563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-39b506f9-e6af-4ee1-823a-af896e8ac4fb req-aef61749-8525-4d65-9a0f-7cd7dfca3719 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044141 Nov 02 13:52:05.154083 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1358/2410] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:05.159535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:05.160237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:05.168634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.169100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.170766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.170766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.170766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.171358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.267766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:05.278478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75c57af4-c65a-4e8f-aa18-c40f32089604 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1212 microversion: 2.1 time: 0.123166 Nov 02 13:52:05.279298 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1359/2411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:05 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1212 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:05.284631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:05.285279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:05.293645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.294199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.294589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.295344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.295846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.296440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.491589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:05.505403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb2f3296-d3f6-4329-897b-ed6c7081db0f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1332 microversion: 2.1 time: 0.224784 Nov 02 13:52:05.506380 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1360/2412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:05 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1332 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:05.648635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf662c9b-54fd-46c3-9985-112d3f10f650 tempest-TenantUsagesNegativeTestJSON-1306205236 tempest-TenantUsagesNegativeTestJSON-1306205236-project] Calling method '.version_select at 0x7f6f80c903a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:05.652421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cf662c9b-54fd-46c3-9985-112d3f10f650 tempest-TenantUsagesNegativeTestJSON-1306205236 tempest-TenantUsagesNegativeTestJSON-1306205236-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '16973cb9675343e282460b37db723f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b22a2170444e96be7ec63b907e5d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf662c9b-54fd-46c3-9985-112d3f10f650 tempest-TenantUsagesNegativeTestJSON-1306205236 tempest-TenantUsagesNegativeTestJSON-1306205236-project] Request method failure captured: Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A52%3A01.892939&end=2022-11-03T13%3A52%3A01.892939&detailed=1 HTTP/1.1 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYA6ZMeemxEV3vrL-y5BvC27mkHj2BxWYk-pV69mUdrNOSeP5ahx1jI4gf_aSKYAOwsLvrO5r6HTlFHCTOQobs4sr_KOK8rKrOn1zLFUXE8ykcoEWy1NI6WSRcBpsaLsx8sCo3ichbzQCBGOSLQWeDXO8X3heAwvhGciG2Pf0tSI3A Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f3b22a2170444e96be7ec63b907e5d44 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1306205236 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3b22a2170444e96be7ec63b907e5d44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3b22a2170444e96be7ec63b907e5d44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3b22a2170444e96be7ec63b907e5d44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3b22a2170444e96be7ec63b907e5d44"}]}] Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1306205236 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f3b22a2170444e96be7ec63b907e5d44 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1306205236 Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TenantUsagesNegativeTestJSON-1306205236-project Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 16973cb9675343e282460b37db723f1f Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1306205236-project Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: action_args: {} Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:52:05.654223 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf662c9b-54fd-46c3-9985-112d3f10f650 tempest-TenantUsagesNegativeTestJSON-1306205236 tempest-TenantUsagesNegativeTestJSON-1306205236-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf662c9b-54fd-46c3-9985-112d3f10f650 tempest-TenantUsagesNegativeTestJSON-1306205236 tempest-TenantUsagesNegativeTestJSON-1306205236-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A52%3A01.892939&end=2022-11-03T13%3A52%3A01.892939&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.147926 Nov 02 13:52:05.662512 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1361/2413] 10.222.0.18 () {58 vars in 1335 bytes} [Wed Nov 2 13:52:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A52%3A01.892939&end=2022-11-03T13%3A52%3A01.892939&detailed=1 => generated 123 bytes in 154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:05.669018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:05.669018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:05.676059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.676469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.676912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.677643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.678108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.678540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.146354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:06.155135 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56a5c700-a7dc-474b-b0f3-c75d9389baa4 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1322 microversion: 2.1 time: 0.493091 Nov 02 13:52:06.155705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1362/2414] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:05 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:06.160237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeda553a-f878-40e1-83f8-5ebbeb5192a7"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:06.162843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:06.170582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.171069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.171514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.172200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.172642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.173055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.253989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:07.000184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b85faa10-da2a-4f28-a60e-e9ed76617498 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "POST /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843051 Nov 02 13:52:07.001372 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1363/2415] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 13:52:06 2022] POST /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:07.006985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:07.007999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:07.016841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.017546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.018167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.019064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.019679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.020461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.277267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:07.293087 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3da5c9d8-3e0c-4aa3-b1a0-a25717b620b6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1472 microversion: 2.1 time: 0.290286 Nov 02 13:52:07.294277 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1364/2416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:07 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:07.299116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:07.299885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:07.309906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.314189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.314748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.315611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.316148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.317867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.536341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:07.546888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57f55c95-03b2-4a16-aee4-bcf7bda2319a tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1506 microversion: 2.1 time: 0.251325 Nov 02 13:52:07.564578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1365/2417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:07 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:07.571444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:07.572290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:07.579865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.580567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.581173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.582078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.582672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.583291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.780251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:07.789822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a2a3c76-3ade-47f0-b559-603311ce68ea tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1317 microversion: 2.1 time: 0.223694 Nov 02 13:52:07.792225 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1366/2418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:07 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:07.810652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:07.811557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:07.818959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.820980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.821601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.822475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.823606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.824170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.958658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:07.967822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9ce3992-38e7-46e6-af97-fc4a4b9059c3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1274 microversion: 2.1 time: 0.174368 Nov 02 13:52:07.968398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1367/2419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:07 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:07.973134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:07.973900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:07.996697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.997453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.998044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.998906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.001160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.001785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.244651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:08.259348 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e570272-3577-40ee-a096-6cab2ee6b762 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1665 microversion: 2.1 time: 0.289413 Nov 02 13:52:08.260469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1368/2420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:07 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1665 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:08.267465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-26a658f3-0f9f-4858-a0c1-ec06fe6d5919 req-d281c978-47fd-4cd6-8606-6a540cc71c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fbdd6a-c37c-4e4a-867e-c66728467c2d", "name": "network-vif-plugged", "status": "completed", "tag": "20357963-a90e-490e-b1e0-4c8b244138a0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:08.281384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-26a658f3-0f9f-4858-a0c1-ec06fe6d5919 req-d281c978-47fd-4cd6-8606-6a540cc71c52 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.282403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-26a658f3-0f9f-4858-a0c1-ec06fe6d5919 req-d281c978-47fd-4cd6-8606-6a540cc71c52 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.282582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-26a658f3-0f9f-4858-a0c1-ec06fe6d5919 req-d281c978-47fd-4cd6-8606-6a540cc71c52 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.296905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-26a658f3-0f9f-4858-a0c1-ec06fe6d5919 req-d281c978-47fd-4cd6-8606-6a540cc71c52 service nova] Creating event network-vif-plugged:20357963-a90e-490e-b1e0-4c8b244138a0 for instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d on n-h1-858238-3 Nov 02 13:52:08.308460 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-26a658f3-0f9f-4858-a0c1-ec06fe6d5919 req-d281c978-47fd-4cd6-8606-6a540cc71c52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046574 Nov 02 13:52:08.328166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1369/2421] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:08.328166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:08.328166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:08.355655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.357361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.358473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.360272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.360913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.361421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.678007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:08.692490 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e67df48-7d31-4749-85dc-3f7eb9ab751e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1472 microversion: 2.1 time: 0.376686 Nov 02 13:52:08.693718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1370/2422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:08 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:08.734473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:08.735359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:08.748334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.748334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.748334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.749389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.750334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.751112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.808398 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-586c0d06-bd06-450b-9a5f-9f66e6719e55 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f/ips" status: 200 len: 177 microversion: 2.1 time: 0.098485 Nov 02 13:52:08.811168 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1371/2423] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:52:08 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f/ips => generated 177 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:08.825937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:08.827281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:08.835194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.835690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.836121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.836861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:08.837319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:08.837827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.013807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:09.023609 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2cd562f2-8e19-493b-8e7e-c6d9c0ab3c9c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1472 microversion: 2.1 time: 0.202748 Nov 02 13:52:09.024621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1372/2424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:08 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1472 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:09.038392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:09.039087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:09.046928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.047456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.048356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.048587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.049039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.049578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.233589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:09.246455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e579cbfe-d818-4c6c-b86e-2db9e821b0b8 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1486 microversion: 2.1 time: 0.213459 Nov 02 13:52:09.248137 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1373/2425] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:09 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1486 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:09.256978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:09.257821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:09.266474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.266966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.267422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.268152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.268663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.269086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.313285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lazy-loading 'flavor' on Instance uuid e073b02f-8fa7-4440-856a-252917006fa8 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:52:09.439431 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5df6679f-2f7e-4c15-ae20-f73feff2d885 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8/action" status: 202 len: 0 microversion: 2.1 time: 0.189649 Nov 02 13:52:09.440436 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1374/2426] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:09 2022] POST /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:09.445805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:09.446657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:09.454899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.455515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.456010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.456713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.457162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.457580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.601984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:09.611281 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-545b13c5-e112-4379-946a-747856beff23 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1317 microversion: 2.1 time: 0.169537 Nov 02 13:52:09.611870 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1375/2427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:09 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:09.616528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:09.616916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:09.623672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.624154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.625234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.625935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.626388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.626808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.654132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:52:09.714090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:09.746232 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e1f753f-6eb9-4ec9-a50b-910c4dd34a19 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "DELETE /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 204 len: 0 microversion: 2.1 time: 0.133096 Nov 02 13:52:09.746811 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1376/2428] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:52:09 2022] DELETE /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:52:09.755252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:09.755943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:09.763884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.764470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.764929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.765680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.766113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.766579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.937059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:09.946402 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91e6a03d-b313-4022-9e9c-d9597a76fb7c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.195293 Nov 02 13:52:09.948326 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1377/2429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:09 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:10.209256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77be5df9-6866-4643-b0bb-772136785b88 tempest-ListImagesTestJSON-854418795 tempest-ListImagesTestJSON-854418795-project] Calling method '.version_select at 0x7f6f80c0de50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:10.277133 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77be5df9-6866-4643-b0bb-772136785b88 tempest-ListImagesTestJSON-854418795 tempest-ListImagesTestJSON-854418795-project] 10.222.0.18 "GET /compute/v2.1/images/48ddc6ee-c34b-4aba-b773-45942271b1d5" status: 200 len: 784 microversion: 2.1 time: 0.326822 Nov 02 13:52:10.278414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1378/2430] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:52:09 2022] GET /compute/v2.1/images/48ddc6ee-c34b-4aba-b773-45942271b1d5 => generated 784 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:10.305855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:10.306629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:10.325115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:10.327021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:10.327951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:10.328948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:10.329607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:10.330240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:10.643152 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de659728-1fc5-40bc-8965-019d45cb973c tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1631 microversion: 2.1 time: 0.349231 Nov 02 13:52:10.644649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1379/2431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:10 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1631 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:10.653004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1031012317", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:10.712243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] validate_networks() for [('e2499577-43af-450c-8f01-5915ab4944ec', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:52:11.150967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:52:11.151894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:52:11.152713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:52:11.153452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:52:11.154092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:52:11.163525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.164009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.164442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.165160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.165605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.166028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.190541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Getting quotas for project 748df3d8b6a94b40ab6485773004af9a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:52:11.200346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Getting quotas for user 7c39b0225f0f4321a131fa6fc991aaa6 and project 748df3d8b6a94b40ab6485773004af9a. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:52:11.218586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:52:11.221127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:52:11.276860 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2cc1091f-7f9a-4d9e-af41-7870b73e8c58 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.631032 Nov 02 13:52:11.277690 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1380/2432] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:52:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:52:11.282231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:11.282832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:11.294794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.295443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.295869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.296630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.297107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.297601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.505918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:11.520739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14c3aa13-6203-4fd0-a3ad-6c47096baac9 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1671 microversion: 2.1 time: 0.241457 Nov 02 13:52:11.522087 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1381/2433] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:11 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:11.527570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:11.528104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:11.537585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.538080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.539210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.540144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.541926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.542552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.751584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:11.761564 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9170c45c-ed7a-46e9-b0ed-157c8363c18e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1478 microversion: 2.1 time: 0.238209 Nov 02 13:52:11.776155 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1382/2434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:11 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:11.781131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d21ca46b-29ff-47cc-90b7-140fc6446ed9 tempest-ListImagesTestJSON-854418795 tempest-ListImagesTestJSON-854418795-project] Calling method '.version_select at 0x7f6f80c053a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:11.874277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d21ca46b-29ff-47cc-90b7-140fc6446ed9 tempest-ListImagesTestJSON-854418795 tempest-ListImagesTestJSON-854418795-project] 10.222.0.18 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.096940 Nov 02 13:52:11.879953 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1383/2435] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Nov 2 13:52:11 2022] GET /compute/v2.1/images => generated 445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:11.891511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:11.892454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:11.901898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.902725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.903497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.904441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.905101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.905962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.186069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:12.196689 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-68a5f5cb-7e08-47f9-893e-badb8c4f8ec4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1506 microversion: 2.1 time: 0.314516 Nov 02 13:52:12.198821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1384/2436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:11 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:12.311002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6649fe98-10bd-4ef6-ae4d-1c350fb2b914 req-744c45f6-71a7-460f-afc3-e86d6256b681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bc3501-5c03-48c4-bf31-fa11683e1815", "tag": "d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:12.321534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6649fe98-10bd-4ef6-ae4d-1c350fb2b914 req-744c45f6-71a7-460f-afc3-e86d6256b681 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.322334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6649fe98-10bd-4ef6-ae4d-1c350fb2b914 req-744c45f6-71a7-460f-afc3-e86d6256b681 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.323132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6649fe98-10bd-4ef6-ae4d-1c350fb2b914 req-744c45f6-71a7-460f-afc3-e86d6256b681 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.337767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6649fe98-10bd-4ef6-ae4d-1c350fb2b914 req-744c45f6-71a7-460f-afc3-e86d6256b681 service nova] Creating event network-changed:d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 for instance 85bc3501-5c03-48c4-bf31-fa11683e1815 on n-h2-858238-3 Nov 02 13:52:12.344820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6649fe98-10bd-4ef6-ae4d-1c350fb2b914 req-744c45f6-71a7-460f-afc3-e86d6256b681 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143728 Nov 02 13:52:12.346254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1385/2437] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:12.356195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:12.357313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:12.371722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.371722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.371722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.371722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.371722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.371722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.722724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:12.734769 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f152048f-16be-4550-87e3-2c1ced172e60 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.386402 Nov 02 13:52:12.740908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1386/2438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:12 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:12.758256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:12.760421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:12.769718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.770229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.770833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.776493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.777369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.778243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.874460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:12.884694 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e52d785-9882-48de-8f38-812c7ec65ba7 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1266 microversion: 2.1 time: 0.140237 Nov 02 13:52:12.888785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1387/2439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:12 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:12.901757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:12.902736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:12.913233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.913744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.914176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.914872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.915361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.915769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:13.225838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cc9ec21-15ac-4396-b1ca-d320ce009ac8 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1614 microversion: 2.1 time: 0.331393 Nov 02 13:52:13.226685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1388/2440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:12 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1614 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:13.231943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f76642fb-3b56-4b96-9a04-f69e0cfd14ff tempest-ListImagesTestJSON-854418795 tempest-ListImagesTestJSON-854418795-project] Calling method '.version_select at 0x7f6f80c16280>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:13.310977 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f76642fb-3b56-4b96-9a04-f69e0cfd14ff tempest-ListImagesTestJSON-854418795 tempest-ListImagesTestJSON-854418795-project] 10.222.0.18 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.082909 Nov 02 13:52:13.330252 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1389/2441] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 13:52:13 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:13.338681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:13.339813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:13.347502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:13.350399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:13.351653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:13.352554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:13.353949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:13.354865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:13.355934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:13.716577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:13.733356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b628767-65f0-4365-bca3-614ca9c06ca5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1506 microversion: 2.1 time: 0.400887 Nov 02 13:52:13.736341 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1390/2442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:13 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:13.743230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:13.744882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:13.754642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:13.755677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:13.756448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:13.757520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:13.758243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:13.759173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:14.401258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabe2182d4fe4ada9626974416a2f92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f12ed436694d52bc37ab8a6e1d8b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:14.427584 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4da9f967-6512-471a-9ebf-bebc2301f01f tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 200 len: 1650 microversion: 2.1 time: 0.689790 Nov 02 13:52:14.444282 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1391/2443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:13 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 1650 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:14.835325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c9d4f28a-768d-4a59-b2d3-6ae24d985581 req-82c6c4b5-56f4-4554-84db-797a5cdf1aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237575f5-a72a-4587-b849-73833215cc6f", "name": "network-vif-deleted", "tag": "9c217dc5-102d-4c85-a3be-7f4269e8c385"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:14.890229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c9d4f28a-768d-4a59-b2d3-6ae24d985581 req-82c6c4b5-56f4-4554-84db-797a5cdf1aab service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:14.890950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c9d4f28a-768d-4a59-b2d3-6ae24d985581 req-82c6c4b5-56f4-4554-84db-797a5cdf1aab service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:14.891406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c9d4f28a-768d-4a59-b2d3-6ae24d985581 req-82c6c4b5-56f4-4554-84db-797a5cdf1aab service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:14.959873 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c9d4f28a-768d-4a59-b2d3-6ae24d985581 req-82c6c4b5-56f4-4554-84db-797a5cdf1aab service nova] Creating event network-vif-deleted:9c217dc5-102d-4c85-a3be-7f4269e8c385 for instance 237575f5-a72a-4587-b849-73833215cc6f on n-h1-858238-3 Nov 02 13:52:14.971008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c9d4f28a-768d-4a59-b2d3-6ae24d985581 req-82c6c4b5-56f4-4554-84db-797a5cdf1aab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.525065 Nov 02 13:52:14.975756 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1392/2444] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:14.983673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:14.984391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:14.996051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:14.996532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:14.997130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:14.998080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:14.998804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:14.999431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.250844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:15.269966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d0384aaf-63c8-4b4f-a9e7-9b9e6fdf960c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1478 microversion: 2.1 time: 0.291703 Nov 02 13:52:15.270564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1393/2445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:14 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1478 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:15.283191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:15.284043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:15.294639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.295677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.296607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.298157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.298768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.299298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.393830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] HTTP exception thrown: Cannot 'migrate' instance e073b02f-8fa7-4440-856a-252917006fa8 while it is in vm_state suspended Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Request method failure captured: Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8/action HTTP/1.1 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 15 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXaTT3A5986yTKxlVImJm2P-cIdTtxa8uW-e3QzrjzLZuhHhYi1-6i8KiT3g6rWGRwBVCrQBx5b0mf6SKBPIM-fe2YwIiv1-shbDb_vUiKI21nDs7cwV-VUHQ_Sn_lb7wON39ngY8yAvPqu1u66oYmvSUhtkUdamb-TOSmTOU9C4m4 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b712bc386fe44a98f3874d610d551b0"}]}] Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a965a3aa9524e398eb5100bdd1d202a Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: {"migrate": {}} Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'migrate' instance e073b02f-8fa7-4440-856a-252917006fa8 while it is in vm_state suspended Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e073b02f-8fa7-4440-856a-252917006fa8', 'body': {'migrate': {}}} Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e073b02f-8fa7-4440-856a-252917006fa8 in vm_state suspended. Cannot resize while the instance is in this state. Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:52:15.395649 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e073b02f-8fa7-4440-856a-252917006fa8 while it is in vm_state suspended Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e073b02f-8fa7-4440-856a-252917006fa8 while it is in vm_state suspended Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Returning 409 to user: Cannot 'migrate' instance e073b02f-8fa7-4440-856a-252917006fa8 while it is in vm_state suspended {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b80e72e-5356-478c-af6e-8bf10940071f tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8/action" status: 409 len: 148 microversion: 2.1 time: 0.118730 Nov 02 13:52:15.400709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1394/2446] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:15 2022] POST /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8/action => generated 148 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:52:15.403550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:15.403550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:15.428654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.429954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.431074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.432488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.432951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.434128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.709159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:15.718136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2752c7d-d74a-4b18-ba73-bef3ab981d09 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.319208 Nov 02 13:52:15.734351 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1395/2447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:15 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:15.740198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:15.743316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:15.751396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.752231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.752857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.753627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.754140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.754764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.844217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:52:15.844920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:52:15.845103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:52:15.845516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:52:15.845934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:52:15.913964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:15.923055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.923306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.923737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.924645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.925052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.925625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.943405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:15.958187 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4e9e503-b13d-4350-b6ae-cc3c493d3151 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "POST /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d/action" status: 202 len: 1108 microversion: 2.1 time: 0.222275 Nov 02 13:52:15.967380 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1396/2448] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:15 2022] POST /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d/action => generated 1108 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:52:15.983653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:15.984930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:15.994792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.996040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.996611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.997885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.998675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.999285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.212484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:16.221767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fdaaa6c-41c3-481b-886f-9f7a14637851 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1314 microversion: 2.1 time: 0.252566 Nov 02 13:52:16.229997 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1397/2449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:15 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:16.237820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-121d8821-5029-4e9a-9b9f-44b84ff29afd req-17baa511-f981-4745-801f-e07d35cb59ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25af852c-129a-41f4-858d-7ad75a66729c", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6bab7b-002c-48b1-86ac-3d691872d7eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:16.248544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-121d8821-5029-4e9a-9b9f-44b84ff29afd req-17baa511-f981-4745-801f-e07d35cb59ed service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.249021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-121d8821-5029-4e9a-9b9f-44b84ff29afd req-17baa511-f981-4745-801f-e07d35cb59ed service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.249524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-121d8821-5029-4e9a-9b9f-44b84ff29afd req-17baa511-f981-4745-801f-e07d35cb59ed service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.265032 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-121d8821-5029-4e9a-9b9f-44b84ff29afd req-17baa511-f981-4745-801f-e07d35cb59ed service nova] Creating event network-vif-unplugged:fc6bab7b-002c-48b1-86ac-3d691872d7eb for instance 25af852c-129a-41f4-858d-7ad75a66729c on n-h2-858238-3 Nov 02 13:52:16.273739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-121d8821-5029-4e9a-9b9f-44b84ff29afd req-17baa511-f981-4745-801f-e07d35cb59ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041098 Nov 02 13:52:16.274672 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1398/2450] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:16.284120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-594c893c-cd08-4151-830d-43fe19a255b1 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-594c893c-cd08-4151-830d-43fe19a255b1 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Request method failure captured: Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684/action HTTP/1.1 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 39 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXaTT3A5986yTKxlVImJm2P-cIdTtxa8uW-e3QzrjzLZuhHhYi1-6i8KiT3g6rWGRwBVCrQBx5b0mf6SKBPIM-fe2YwIiv1-shbDb_vUiKI21nDs7cwV-VUHQ_Sn_lb7wON39ngY8yAvPqu1u66oYmvSUhtkUdamb-TOSmTOU9C4m4 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b712bc386fe44a98f3874d610d551b0"}]}] Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a965a3aa9524e398eb5100bdd1d202a Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: {"os-resetState": {"state": "invalid"}} Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd10df762-001b-4942-92fa-bd35e2fdb684', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:52:16.290188 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-594c893c-cd08-4151-830d-43fe19a255b1 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:16.298446 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-594c893c-cd08-4151-830d-43fe19a255b1 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684/action" status: 400 len: 144 microversion: 2.1 time: 0.014856 Nov 02 13:52:16.300474 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1399/2451] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:16 2022] POST /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:52:16.304791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:16.305780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:16.314745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.315561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.315996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.316696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.317289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.317854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.335314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] HTTP exception thrown: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Request method failure captured: Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f HTTP/1.1 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWhY41auNoUu4FUB3mGNz5JUQxaLnDv6DtgcA57fusF43oPneeJQ8PCNywYRupUhhdO5Qw4x8PgkbsnAOkaxeDIgBhlO8iyfwkf7-QwFG9cH3HOqiThSXeYAiVgwBFQplQbP6gGNziZLGI70qmUc3vgem6rIpprVMP_1y3kCvx4eLA Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31f12ed436694d52bc37ab8a6e1d8b32"}]}] Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: aabe2182d4fe4ada9626974416a2f92d Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '237575f5-a72a-4587-b849-73833215cc6f'} Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:16.336875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Returning 404 to user: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3553950-22b5-4a69-b8b6-96ddd82f7368 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 404 len: 111 microversion: 2.1 time: 0.037611 Nov 02 13:52:16.342812 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1400/2452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:16 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:16.499499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Calling method '.version_select at 0x7f6f80c05790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:16.513463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.513947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.515026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.515785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.516784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.516784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.537759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c435bb8c-ceaa-44b5-81c4-8999abf3a51d tempest-AbsoluteLimitsTestJSON-1097845083 tempest-AbsoluteLimitsTestJSON-1097845083-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.197041 Nov 02 13:52:16.538370 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1401/2453] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Nov 2 13:52:16 2022] GET /compute/v2.1/limits => generated 511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:16.543739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:16.544623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:16.552167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.553540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.554107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.555048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.555669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.557170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.739020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:16.752684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-914da517-df35-4a7e-9b55-407dfbff8cfc tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.213076 Nov 02 13:52:16.753703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1402/2454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:16 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:16.759999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5808a07-80fd-4ac1-a74f-537d8acf612a tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5808a07-80fd-4ac1-a74f-537d8acf612a tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Request method failure captured: Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684/action HTTP/1.1 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 31 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXaTT3A5986yTKxlVImJm2P-cIdTtxa8uW-e3QzrjzLZuhHhYi1-6i8KiT3g6rWGRwBVCrQBx5b0mf6SKBPIM-fe2YwIiv1-shbDb_vUiKI21nDs7cwV-VUHQ_Sn_lb7wON39ngY8yAvPqu1u66oYmvSUhtkUdamb-TOSmTOU9C4m4 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b712bc386fe44a98f3874d610d551b0"}]}] Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a965a3aa9524e398eb5100bdd1d202a Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: {"os-resetState": {"state": 1}} Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd10df762-001b-4942-92fa-bd35e2fdb684', 'body': {'os-resetState': {'state': 1}}} Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 1 Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 13:52:16.764889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 13:52:16.768512 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:16.771282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5808a07-80fd-4ac1-a74f-537d8acf612a tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:16.773118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5808a07-80fd-4ac1-a74f-537d8acf612a tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684/action" status: 400 len: 120 microversion: 2.1 time: 0.018014 Nov 02 13:52:16.780865 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1403/2455] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:16 2022] POST /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684/action => generated 120 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:52:16.788506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:16.789378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:17.103280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.103280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.119419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.120557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.121096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.121626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.454260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:17.467651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7d2c0ff-ef6e-46d0-b565-047a3f687f08 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1478 microversion: 2.1 time: 0.684708 Nov 02 13:52:17.479121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1404/2456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:16 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1478 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:17.479121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:17.479121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:17.488121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.488724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.489358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.490505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.490967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.491437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.779857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:17.790528 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4327442b-be7e-4785-80d7-73ea78cd07f5 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.319822 Nov 02 13:52:17.806627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1405/2457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:17 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:17.812355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a18f1824-b817-433d-a182-5a92c0ec29d9 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:17.816003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a18f1824-b817-433d-a182-5a92c0ec29d9 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Failed to fetch instance by id 999 {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:52:17.816821 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a18f1824-b817-433d-a182-5a92c0ec29d9 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a18f1824-b817-433d-a182-5a92c0ec29d9 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Request method failure captured: Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 37 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXaTT3A5986yTKxlVImJm2P-cIdTtxa8uW-e3QzrjzLZuhHhYi1-6i8KiT3g6rWGRwBVCrQBx5b0mf6SKBPIM-fe2YwIiv1-shbDb_vUiKI21nDs7cwV-VUHQ_Sn_lb7wON39ngY8yAvPqu1u66oYmvSUhtkUdamb-TOSmTOU9C4m4 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9b712bc386fe44a98f3874d610d551b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9b712bc386fe44a98f3874d610d551b0"}]}] Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 9b712bc386fe44a98f3874d610d551b0 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-414021709 Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a965a3aa9524e398eb5100bdd1d202a Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-414021709-project-admin Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: {"os-resetState": {"state": "error"}} Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 999 could not be found. Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:17.824603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:17.829089 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:17.829089 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 13:52:17.829089 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:17.837146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a18f1824-b817-433d-a182-5a92c0ec29d9 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:17.839412 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a18f1824-b817-433d-a182-5a92c0ec29d9 tempest-ServersAdminNegativeTestJSON-414021709 tempest-ServersAdminNegativeTestJSON-414021709-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031306 Nov 02 13:52:17.840342 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1406/2458] 10.222.0.18 () {60 vars in 1179 bytes} [Wed Nov 2 13:52:17 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:52:17.846038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237575f5-a72a-4587-b849-73833215cc6f", "name": "network-vif-deleted", "tag": "2c0da40f-1bd3-422d-b4f0-cf352a899661"}, {"name": "network-changed", "server_uuid": "e10dac4d-1a3c-4a92-aba3-ffdf8632eca3", "tag": "ff1a79d2-4dc8-4542-9830-5373299e2ce7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:17.860463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.861124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.861620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.876797 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] Creating event network-vif-deleted:2c0da40f-1bd3-422d-b4f0-cf352a899661 for instance 237575f5-a72a-4587-b849-73833215cc6f on n-h1-858238-3 Nov 02 13:52:17.877799 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] Creating event network-changed:ff1a79d2-4dc8-4542-9830-5373299e2ce7 for instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 on n-h1-858238-3 Nov 02 13:52:17.886596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e33bfba6-e412-41e0-b6ba-97f5a1add6fd req-6690bcdb-ea7a-46bb-b609-8061b7b57fd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044399 Nov 02 13:52:17.887525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1407/2459] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:17.892827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:17.894277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:17.902064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.902896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.907344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.908303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:17.908790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:17.909228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.285875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:18.310230 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7b12add-6046-47f4-b39f-d2d0d6300b60 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1314 microversion: 2.1 time: 0.412734 Nov 02 13:52:18.311318 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1408/2460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:17 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:18.317410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:18.318386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:18.324852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.325599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.326204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.327081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.327752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.328331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.619337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:18.630407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a286d70a-1307-438d-8427-d468b7cc86aa tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.317712 Nov 02 13:52:18.634382 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1409/2461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:18 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:18.641129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:18.641977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:18.666701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.667902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.668689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.671692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.671692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.674060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.738057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:52:18.880508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2887b338-1a8d-4e07-97fe-6076b1acd5a7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 204 len: 0 microversion: 2.1 time: 0.244530 Nov 02 13:52:18.881112 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1410/2462] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:52:18 2022] DELETE /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:52:18.888956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6bb12e0d-1e2c-46cc-a64f-dc5aafdb71ff req-a59b9bdf-7fbc-4dc6-b9cd-2c58c5580bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25af852c-129a-41f4-858d-7ad75a66729c", "name": "network-vif-plugged", "status": "completed", "tag": "fc6bab7b-002c-48b1-86ac-3d691872d7eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:18.900062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6bb12e0d-1e2c-46cc-a64f-dc5aafdb71ff req-a59b9bdf-7fbc-4dc6-b9cd-2c58c5580bd1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.901077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6bb12e0d-1e2c-46cc-a64f-dc5aafdb71ff req-a59b9bdf-7fbc-4dc6-b9cd-2c58c5580bd1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.901498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6bb12e0d-1e2c-46cc-a64f-dc5aafdb71ff req-a59b9bdf-7fbc-4dc6-b9cd-2c58c5580bd1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.918195 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6bb12e0d-1e2c-46cc-a64f-dc5aafdb71ff req-a59b9bdf-7fbc-4dc6-b9cd-2c58c5580bd1 service nova] Creating event network-vif-plugged:fc6bab7b-002c-48b1-86ac-3d691872d7eb for instance 25af852c-129a-41f4-858d-7ad75a66729c on n-h2-858238-3 Nov 02 13:52:18.925286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6bb12e0d-1e2c-46cc-a64f-dc5aafdb71ff req-a59b9bdf-7fbc-4dc6-b9cd-2c58c5580bd1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040117 Nov 02 13:52:18.926969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1411/2463] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:18.935339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:18.936229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:18.943379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.943879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.944317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.945016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.945471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.945891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.190662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:19.223842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-29602a66-eecc-4f7f-83c0-0544846953c4 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1478 microversion: 2.1 time: 0.292697 Nov 02 13:52:19.235254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1412/2464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:18 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1478 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:19.235254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:19.235254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:19.243634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.244170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.244708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.245549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.245790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.246218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.548809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:19.564360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de26e59b-dff0-415c-94ca-f41e82c2287e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.338247 Nov 02 13:52:19.566154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1413/2465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:19 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:19.571843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:19.573713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:19.583311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.584140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.584861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.585847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.586537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.587941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.880547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:19.893508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-afbe2c74-b9c2-4253-9634-706fb76c7d73 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1469 microversion: 2.1 time: 0.325923 Nov 02 13:52:19.910952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1414/2466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:19 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:19.915003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:19.915668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:19.935952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.936467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.937086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.937953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.938539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.939021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.188489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:20.202386 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2408b7e2-9e75-4f5e-9cd6-e4640b44815f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1314 microversion: 2.1 time: 0.301785 Nov 02 13:52:20.203371 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1415/2467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:19 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:20.210401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:20.211564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:20.225833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.226338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.226812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.227640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.228501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.229590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.438485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:20.449385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c70c7c8-83f8-46eb-a489-a00acafe258c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.244613 Nov 02 13:52:20.459952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1416/2468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:20 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:20.466286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:20.468016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:20.488478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.489010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.489453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.490198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.490653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.495714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.526010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] HTTP exception thrown: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Request method failure captured: Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f HTTP/1.1 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWhY41auNoUu4FUB3mGNz5JUQxaLnDv6DtgcA57fusF43oPneeJQ8PCNywYRupUhhdO5Qw4x8PgkbsnAOkaxeDIgBhlO8iyfwkf7-QwFG9cH3HOqiThSXeYAiVgwBFQplQbP6gGNziZLGI70qmUc3vgem6rIpprVMP_1y3kCvx4eLA Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31f12ed436694d52bc37ab8a6e1d8b32"}]}] Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: aabe2182d4fe4ada9626974416a2f92d Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '237575f5-a72a-4587-b849-73833215cc6f'} Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:20.527843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Returning 404 to user: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a679c76-13f6-45f7-a540-c0fd4e2745e2 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "DELETE /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 404 len: 111 microversion: 2.1 time: 0.077690 Nov 02 13:52:20.532293 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1417/2469] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:52:20 2022] DELETE /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:20.539425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:20.542814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:20.558470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.559110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.559427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.562945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.565200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.565685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.841356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:20.844513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:20.857857 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28a02f89-49d4-4867-905e-e4f2527eeeda tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1478 microversion: 2.1 time: 0.326574 Nov 02 13:52:20.858455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1418/2470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:20 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1478 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:20.874727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:20.875423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 237575f5-a72a-4587-b849-73833215cc6f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:20.897588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.899812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.903456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.907047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.908352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.913352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.959530 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] HTTP exception thrown: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Request method failure captured: Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f HTTP/1.1 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWhY41auNoUu4FUB3mGNz5JUQxaLnDv6DtgcA57fusF43oPneeJQ8PCNywYRupUhhdO5Qw4x8PgkbsnAOkaxeDIgBhlO8iyfwkf7-QwFG9cH3HOqiThSXeYAiVgwBFQplQbP6gGNziZLGI70qmUc3vgem6rIpprVMP_1y3kCvx4eLA Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31f12ed436694d52bc37ab8a6e1d8b32"}]}] Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: aabe2182d4fe4ada9626974416a2f92d Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '237575f5-a72a-4587-b849-73833215cc6f'} Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:20.961219 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Returning 404 to user: Instance 237575f5-a72a-4587-b849-73833215cc6f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4cdae74-f519-4f7b-84d2-1fbb745326d8 tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f" status: 404 len: 111 microversion: 2.1 time: 0.098481 Nov 02 13:52:20.967229 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1419/2471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:20 2022] GET /compute/v2.1/servers/237575f5-a72a-4587-b849-73833215cc6f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:20.969573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:20.970520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:20.977972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.979533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.980186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.981204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.982559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.983293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.266341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:21.289844 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-275996e2-4666-46ca-90db-1a0e81cc687b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.324808 Nov 02 13:52:21.290487 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1420/2472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:20 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:21.304566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:21.306281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:21.313743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.314442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.315035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.316070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.316820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.317613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.625284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:21.637752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa5e20e3-e916-4ecd-b109-6886068a65ff tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1469 microversion: 2.1 time: 0.346052 Nov 02 13:52:21.641971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1421/2473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:21 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:21.657228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a2a4d24e-2a6c-4b28-ba41-7f83dee72f2b req-8a15235f-6ef1-4d9d-aab4-789b4bd3486e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bc3501-5c03-48c4-bf31-fa11683e1815", "name": "network-vif-plugged", "status": "completed", "tag": "d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:21.678214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a2a4d24e-2a6c-4b28-ba41-7f83dee72f2b req-8a15235f-6ef1-4d9d-aab4-789b4bd3486e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.678966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a2a4d24e-2a6c-4b28-ba41-7f83dee72f2b req-8a15235f-6ef1-4d9d-aab4-789b4bd3486e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.680657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a2a4d24e-2a6c-4b28-ba41-7f83dee72f2b req-8a15235f-6ef1-4d9d-aab4-789b4bd3486e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.710503 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a2a4d24e-2a6c-4b28-ba41-7f83dee72f2b req-8a15235f-6ef1-4d9d-aab4-789b4bd3486e service nova] Creating event network-vif-plugged:d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 for instance 85bc3501-5c03-48c4-bf31-fa11683e1815 on n-h2-858238-3 Nov 02 13:52:21.725635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a2a4d24e-2a6c-4b28-ba41-7f83dee72f2b req-8a15235f-6ef1-4d9d-aab4-789b4bd3486e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082060 Nov 02 13:52:21.726720 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1422/2474] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:21.751574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:21.753131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:21.776369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.777897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.778796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.779921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.780612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.781468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.827590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] HTTP exception thrown: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Request method failure captured: Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 HTTP/1.1 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWhY41auNoUu4FUB3mGNz5JUQxaLnDv6DtgcA57fusF43oPneeJQ8PCNywYRupUhhdO5Qw4x8PgkbsnAOkaxeDIgBhlO8iyfwkf7-QwFG9cH3HOqiThSXeYAiVgwBFQplQbP6gGNziZLGI70qmUc3vgem6rIpprVMP_1y3kCvx4eLA Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31f12ed436694d52bc37ab8a6e1d8b32"}]}] Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: aabe2182d4fe4ada9626974416a2f92d Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '06d48450-c044-486e-ae55-6d08745d5b38'} Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:21.829933 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:21.837554 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:21.841392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Returning 404 to user: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:21.842572 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4bbdcc0c-0067-48e2-9e6f-8a22f12a5f3a tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 404 len: 111 microversion: 2.1 time: 0.112582 Nov 02 13:52:21.846632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1423/2475] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:52:21 2022] DELETE /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:21.857130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:21.858147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:21.875808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.877220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.877888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.878841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.879545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.880589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:22.202590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:22.214400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff1977fc-9ff5-4e09-85a4-a065f3742869 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1314 microversion: 2.1 time: 0.365901 Nov 02 13:52:22.221437 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1424/2476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:21 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:22.227320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:22.229006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:22.248808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:22.250811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:22.251868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:22.252812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:22.253883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:22.254532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:22.491968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:22.503353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f0659d5-e190-4f38-bd95-091bd3938e83 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.280378 Nov 02 13:52:22.515199 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1425/2477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:22 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:22.886338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "77b20bc6-91ee-4673-9d1c-584dc861dd21"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:22.894015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:22.902886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:22.903414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:22.904068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:22.904776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:22.905425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:22.906042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.025778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] HTTP exception thrown: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Request method failure captured: Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments/eeda553a-f878-40e1-83f8-5ebbeb5192a7 HTTP/1.1 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 74 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWqBZtYHYM2CTSbl2uES_vn1qHKWbppAz53z13W_gEwpBuEtidkucN-yMCWeKlgIUZ3rruGyeW1cepB080qGBCx4qKEB0LvBVe4VW7hpKVii5mZuBqQqYkoz_ztqqZY6M6VwhpU-EaEfmJ_CkljEIZ8Bsb4CeYE_vgNaz2FFiAqnIs Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 24032e14f9844c5ab445f98147d5a5e4 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesAdminNegativeTest-2029943897 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24032e14f9844c5ab445f98147d5a5e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24032e14f9844c5ab445f98147d5a5e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24032e14f9844c5ab445f98147d5a5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24032e14f9844c5ab445f98147d5a5e4"}]}] Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesAdminNegativeTest-2029943897 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 24032e14f9844c5ab445f98147d5a5e4 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2029943897 Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesAdminNegativeTest-2029943897-project-admin Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c02028d0a844917a01ba1f939783d1f Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesAdminNegativeTest-2029943897-project-admin Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: {"volumeAttachment": {"volumeId": "77b20bc6-91ee-4673-9d1c-584dc861dd21"}} Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': '8b902d64-9d83-4e25-a97d-2b0d4d18f55a', 'id': 'eeda553a-f878-40e1-83f8-5ebbeb5192a7', 'body': {'volumeAttachment': {'volumeId': '77b20bc6-91ee-4673-9d1c-584dc861dd21'}}} Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. (HTTP 404) (Request-ID: req-484ed679-716a-4d83-8dd3-d81f110f011f) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:52:23.063806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Returning 400 to user: Volume 77b20bc6-91ee-4673-9d1c-584dc861dd21 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4d663d7-b9b2-4f88-aaf9-d87135086f2d tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments/eeda553a-f878-40e1-83f8-5ebbeb5192a7" status: 400 len: 107 microversion: 2.1 time: 0.560139 Nov 02 13:52:23.068013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1426/2478] 10.222.0.18 () {60 vars in 1433 bytes} [Wed Nov 2 13:52:22 2022] PUT /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments/eeda553a-f878-40e1-83f8-5ebbeb5192a7 => generated 107 bytes in 561 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:52:23.077981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:23.077981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] [instance: 06d48450-c044-486e-ae55-6d08745d5b38] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:23.084026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.084546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.084986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.085719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.086342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.086781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.102573 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] HTTP exception thrown: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Request method failure captured: Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 HTTP/1.1 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWhY41auNoUu4FUB3mGNz5JUQxaLnDv6DtgcA57fusF43oPneeJQ8PCNywYRupUhhdO5Qw4x8PgkbsnAOkaxeDIgBhlO8iyfwkf7-QwFG9cH3HOqiThSXeYAiVgwBFQplQbP6gGNziZLGI70qmUc3vgem6rIpprVMP_1y3kCvx4eLA Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/31f12ed436694d52bc37ab8a6e1d8b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_31f12ed436694d52bc37ab8a6e1d8b32"}]}] Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 31f12ed436694d52bc37ab8a6e1d8b32 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestMultiNic-1977448872 Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: aabe2182d4fe4ada9626974416a2f92d Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestMultiNic-1977448872-project Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '06d48450-c044-486e-ae55-6d08745d5b38'} Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:23.104259 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] Returning 404 to user: Instance 06d48450-c044-486e-ae55-6d08745d5b38 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:23.109478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8026980-ea91-4c1f-8521-0cf401b654ef tempest-ServersTestMultiNic-1977448872 tempest-ServersTestMultiNic-1977448872-project] 10.222.0.18 "GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38" status: 404 len: 111 microversion: 2.1 time: 0.034768 Nov 02 13:52:23.113418 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1427/2479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:23 2022] GET /compute/v2.1/servers/06d48450-c044-486e-ae55-6d08745d5b38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:23.116013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:23.117772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:23.130934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.131565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.132077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.133224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.134474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.135357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.557419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:23.575259 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-160a7a1c-938f-4911-94be-45921e71a605 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1464 microversion: 2.1 time: 0.463278 Nov 02 13:52:23.579041 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1428/2480] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:23 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1464 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:23.584363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-41d4f1e5-9d32-4f92-8f2c-094ab8638bb9 req-5b7f99be-78b8-4774-a640-5f6f6a66e742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e073b02f-8fa7-4440-856a-252917006fa8", "name": "network-vif-deleted", "tag": "9d69dabb-620e-4efa-a3ed-a1bbfa670c7e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:23.624234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-41d4f1e5-9d32-4f92-8f2c-094ab8638bb9 req-5b7f99be-78b8-4774-a640-5f6f6a66e742 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.625014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-41d4f1e5-9d32-4f92-8f2c-094ab8638bb9 req-5b7f99be-78b8-4774-a640-5f6f6a66e742 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.625584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-41d4f1e5-9d32-4f92-8f2c-094ab8638bb9 req-5b7f99be-78b8-4774-a640-5f6f6a66e742 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.645508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-41d4f1e5-9d32-4f92-8f2c-094ab8638bb9 req-5b7f99be-78b8-4774-a640-5f6f6a66e742 service nova] Creating event network-vif-deleted:9d69dabb-620e-4efa-a3ed-a1bbfa670c7e for instance e073b02f-8fa7-4440-856a-252917006fa8 on n-h2-858238-3 Nov 02 13:52:23.664252 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-41d4f1e5-9d32-4f92-8f2c-094ab8638bb9 req-5b7f99be-78b8-4774-a640-5f6f6a66e742 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083110 Nov 02 13:52:23.670726 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1429/2481] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:23.678560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:23.686071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:23.698092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.698596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.701065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.701835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.702311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.706977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.031775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:24.050905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2854706-a64b-4f95-b148-ef0283c5f73d tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1316 microversion: 2.1 time: 0.375212 Nov 02 13:52:24.063333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1430/2482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:23 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:24.085097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:24.088884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:24.096616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.098155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.099221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.100154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.101103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.101835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.178446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.179396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.180093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.180947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lazy-loading 'fault' on Instance uuid e073b02f-8fa7-4440-856a-252917006fa8 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:52:24.254777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:24.270713 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ff24b72-f925-4295-af08-ef790cdf75e7 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 200 len: 1312 microversion: 2.1 time: 0.205059 Nov 02 13:52:24.273903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1431/2483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:24 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:24.282726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:24.291596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:24.317038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.317592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.318125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.319735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.321524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.324783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.495156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lazy-loading 'services' on Instance uuid 8b902d64-9d83-4e25-a97d-2b0d4d18f55a {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:52:24.691557 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ddf9232-5b77-4c39-91d9-2a3a2cbfb5f1 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments/eeda553a-f878-40e1-83f8-5ebbeb5192a7" status: 202 len: 0 microversion: 2.1 time: 0.415521 Nov 02 13:52:24.695820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1432/2484] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 13:52:24 2022] DELETE /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments/eeda553a-f878-40e1-83f8-5ebbeb5192a7 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:24.707319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:24.710966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:24.719725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.720588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.721483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.722432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:24.723486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:24.724182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:25.134016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:25.145325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a72ea14-d7e8-4611-9721-656d91cbef36 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1314 microversion: 2.1 time: 0.445338 Nov 02 13:52:25.147769 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1433/2485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:24 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:25.158495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:25.163670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:25.181127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:25.182201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:25.182642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:25.183420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:25.183878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:25.184299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:25.614447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:25.633427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1503eefa-27ea-442d-b5c1-d7f306900604 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.484111 Nov 02 13:52:25.641301 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1434/2486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:25 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:25.641301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:25.641301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:25.649876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:25.661838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:25.662349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:25.662810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:25.663722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:25.664067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:25.664494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.175231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:26.200726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7fcdb5ae-6ba6-4797-b2cc-351e97512f79 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1464 microversion: 2.1 time: 0.564698 Nov 02 13:52:26.215739 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1435/2487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:25 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1464 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:26.235278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-30d2a8d6-7323-4cdd-a512-38059cafc33b req-9929e6e8-ca6c-44f9-8b3c-53d0dca22aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10dac4d-1a3c-4a92-aba3-ffdf8632eca3", "name": "network-vif-plugged", "status": "completed", "tag": "ff1a79d2-4dc8-4542-9830-5373299e2ce7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:26.272889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-30d2a8d6-7323-4cdd-a512-38059cafc33b req-9929e6e8-ca6c-44f9-8b3c-53d0dca22aec service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.273388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-30d2a8d6-7323-4cdd-a512-38059cafc33b req-9929e6e8-ca6c-44f9-8b3c-53d0dca22aec service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.273828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-30d2a8d6-7323-4cdd-a512-38059cafc33b req-9929e6e8-ca6c-44f9-8b3c-53d0dca22aec service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.322938 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-30d2a8d6-7323-4cdd-a512-38059cafc33b req-9929e6e8-ca6c-44f9-8b3c-53d0dca22aec service nova] Creating event network-vif-plugged:ff1a79d2-4dc8-4542-9830-5373299e2ce7 for instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 on n-h1-858238-3 Nov 02 13:52:26.341467 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-30d2a8d6-7323-4cdd-a512-38059cafc33b req-9929e6e8-ca6c-44f9-8b3c-53d0dca22aec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121012 Nov 02 13:52:26.344210 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1436/2488] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:26.370970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:26.373808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:26.381022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.382567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.385537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.386865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.387891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.395923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.519110 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dbfe2390-0f8e-4e55-8f60-ea190fdb3fac tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168067 Nov 02 13:52:26.520944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1437/2489] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:52:26 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:26.535837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:26.536470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:26.543184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=43 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:26.544732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:26.553965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.554804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.555668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.556868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.559316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.560513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.056150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:27.060527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:27.084910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e3757b7-fa4c-440f-ba0c-8156ccf4ff52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1505 microversion: 2.1 time: 0.559945 Nov 02 13:52:27.086796 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1438/2490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:26 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:27.096429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:27.097860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: e073b02f-8fa7-4440-856a-252917006fa8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:27.114077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.114937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.115784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.117038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.117843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.118880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.146366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] HTTP exception thrown: Instance e073b02f-8fa7-4440-856a-252917006fa8 could not be found. Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Request method failure captured: Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 HTTP/1.1 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXZi_X13ak92APEP2jv80pGxiXvaPcCc2Y5TKwCJSVxxqXNA9nGjEQDIf_Vb5cyNUa1xSsFZp5eO6rN4xjGgjOy5WDqf8hte6B23JG1VmRZqHx3dacym4nlgEtZijY2M4R2Af1hywajmbpkvO3arhsIqI1OTjSlBJpkxY_SXljtq5I Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 62df681fa5ed464baa58344b82087eba Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2025439743 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62df681fa5ed464baa58344b82087eba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62df681fa5ed464baa58344b82087eba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62df681fa5ed464baa58344b82087eba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62df681fa5ed464baa58344b82087eba"}]}] Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2025439743 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 62df681fa5ed464baa58344b82087eba Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2025439743 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-2025439743-project Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7e8614a6255f475dac0b02dc0e0c65a6 Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2025439743-project Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e073b02f-8fa7-4440-856a-252917006fa8 could not be found. Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e073b02f-8fa7-4440-856a-252917006fa8'} Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e073b02f-8fa7-4440-856a-252917006fa8 could not be found. Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e073b02f-8fa7-4440-856a-252917006fa8 could not be found. Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:27.148088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e073b02f-8fa7-4440-856a-252917006fa8 could not be found. Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Returning 404 to user: Instance e073b02f-8fa7-4440-856a-252917006fa8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-656a174d-f573-4d97-b0b1-85ecb50505d1 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8" status: 404 len: 111 microversion: 2.1 time: 0.060552 Nov 02 13:52:27.153174 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1439/2491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:27 2022] GET /compute/v2.1/servers/e073b02f-8fa7-4440-856a-252917006fa8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:27.156213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:27.156831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:27.170650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.171268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.171709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.172437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.172901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.173329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.540285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:27.556553 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d6893c1-038e-4903-a5d7-53751f5603a4 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1314 microversion: 2.1 time: 0.404395 Nov 02 13:52:27.557364 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1440/2492] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:27 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:27.567361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:27.570381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:27.580373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.581056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.581656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.582223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.582683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.583200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.669520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:52:27.669946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:52:27.670424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:52:27.670836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:52:27.671289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:52:27.767300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:27.787790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.790490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.791116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.793654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.794248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.795474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.858889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-81384cb4-4ea2-47e6-9476-17ddcef5953a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 1068 microversion: 2.1 time: 0.300631 Nov 02 13:52:27.860322 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1441/2493] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:27 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 1068 bytes in 302 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:52:27.874834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:27.877325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:27.889977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.890765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.891547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.896359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.897247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.898060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:28.214832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:28.254937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e6f7322-60bf-4d64-a052-837597ff8c78 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.392108 Nov 02 13:52:28.255861 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1442/2494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:27 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:28.270490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1116734660"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:28.271506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:28.295078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:28.295877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:28.296482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:28.297344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:28.298163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:28.299672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:28.563291 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Adding security group 78cfc386-c1d8-47e7-82a3-78db217da59f to port d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 Nov 02 13:52:29.560746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15dffb8e-561b-4540-ae8f-ed2c07a7f8a3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815/action" status: 202 len: 0 microversion: 2.1 time: 1.301660 Nov 02 13:52:29.562727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1443/2495] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:28 2022] POST /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815/action => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:29.570166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:29.572631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:29.584293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.585487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.586701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:29.587755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.588512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.589164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:29.660443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:52:29.859070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96535dcb-48d9-4388-856c-a719010a828f tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 204 len: 0 microversion: 2.1 time: 0.293646 Nov 02 13:52:29.860545 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1444/2496] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:52:29 2022] DELETE /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:52:29.867703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:29.870919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:29.880728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.881875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.882395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:29.883203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.883855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.884300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:29.939250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64678a3a-93c5-40d0-aeae-2f53b24c6419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069722 Nov 02 13:52:29.939250 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1445/2497] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:52:29 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:29.939250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:29.939706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:29.946136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.946559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.947087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:29.948444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.948921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.949356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:30.261722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:30.277114 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b74baea-1e76-49f1-ae6c-edf3fde0a3a6 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.343139 Nov 02 13:52:30.295411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1446/2498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:29 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:30.350274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ddc9c7c-e784-449f-ad4e-0ae12b98f92b tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80e71af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-61065371", "description": "tempest-description-1692716444"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:30.695136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ddc9c7c-e784-449f-ad4e-0ae12b98f92b tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.405428 Nov 02 13:52:30.699507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1447/2499] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:30.703085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:30.703933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:30.719565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:30.720681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:30.722240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:30.724657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:30.725714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:30.726744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:30.975453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:30.991949 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd38c592-4402-4c0c-9079-e4ab67f65c04 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1500 microversion: 2.1 time: 0.294992 Nov 02 13:52:30.994455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1448/2500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:30 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1500 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:31.001860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:31.002819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:31.009873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.010830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.011673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.014736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.016121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.016592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.257094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:31.266771 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41486315-4ce7-478d-8a67-44de3b49ce93 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.270767 Nov 02 13:52:31.276735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1449/2501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:30 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:31.283755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9041e70-b1aa-4a71-a028-3d4ef35f7854 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80c44ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:31.474779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-d9041e70-b1aa-4a71-a028-3d4ef35f7854 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use.", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:52:31.477125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d9041e70-b1aa-4a71-a028-3d4ef35f7854 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.477125 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9041e70-b1aa-4a71-a028-3d4ef35f7854 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f HTTP/1.1 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: exception: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '78cfc386-c1d8-47e7-82a3-78db217da59f'} Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:52:31.482209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] Nov 02 13:52:31.486516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:31.489221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9041e70-b1aa-4a71-a028-3d4ef35f7854 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 400 to user: Security Group 78cfc386-c1d8-47e7-82a3-78db217da59f in use. Nov 02 13:52:31.489221 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a29a5609-c3f3-4480-a81a-6371db5148f7'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:31.491551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9041e70-b1aa-4a71-a028-3d4ef35f7854 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f" status: 400 len: 185 microversion: 2.1 time: 0.212099 Nov 02 13:52:31.492829 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1450/2502] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:52:31 2022] DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f => generated 185 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:52:31.515647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-476444aa-d737-4ddd-a1be-9228e4599508 req-815f4695-12c2-447c-afc3-640ab2cccd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bc3501-5c03-48c4-bf31-fa11683e1815", "tag": "d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:31.530882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-476444aa-d737-4ddd-a1be-9228e4599508 req-815f4695-12c2-447c-afc3-640ab2cccd21 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.531704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-476444aa-d737-4ddd-a1be-9228e4599508 req-815f4695-12c2-447c-afc3-640ab2cccd21 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.532317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-476444aa-d737-4ddd-a1be-9228e4599508 req-815f4695-12c2-447c-afc3-640ab2cccd21 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.545811 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-476444aa-d737-4ddd-a1be-9228e4599508 req-815f4695-12c2-447c-afc3-640ab2cccd21 service nova] Creating event network-changed:d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 for instance 85bc3501-5c03-48c4-bf31-fa11683e1815 on n-h2-858238-3 Nov 02 13:52:31.551794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-476444aa-d737-4ddd-a1be-9228e4599508 req-815f4695-12c2-447c-afc3-640ab2cccd21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057022 Nov 02 13:52:31.552734 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1451/2503] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:31.558175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:31.558880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:31.565765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.566443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.566890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.567772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.568225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.569035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.788199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e8614a6255f475dac0b02dc0e0c65a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62df681fa5ed464baa58344b82087eba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:31.801053 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa26bf90-3958-45c5-a544-61c7a7a4ae7e tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 200 len: 1477 microversion: 2.1 time: 0.246558 Nov 02 13:52:31.827977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1452/2504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:31 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:31.833001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79fe40dd-bc9b-4ccb-9c40-d963ec8c4851 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80df88b0>, body: {"security_group_rule": {"parent_group_id": "29b30edc-d84c-4ca0-9b7d-926f90505210", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:32.329049 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79fe40dd-bc9b-4ccb-9c40-d963ec8c4851 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.499836 Nov 02 13:52:32.329988 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1453/2505] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:52:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:32.334725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:32.341101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:32.362726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.363261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.363815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.364549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.365002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.374606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.454649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-20287e84-504d-4626-bcc7-2dddc7b591e4 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122135 Nov 02 13:52:32.461065 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1454/2506] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:52:32 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:52:32.468064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:32.473275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:32.485717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.487299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.488491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.491028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.493427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.495342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.583486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lazy-loading 'flavor' on Instance uuid e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:52:32.653812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:32.812721 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08536e5b-769e-47fa-b323-1dbf3c5911d6 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "POST /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3/action" status: 200 len: 32 microversion: 2.1 time: 0.353711 Nov 02 13:52:32.813768 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1455/2507] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:32 2022] POST /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:52:32.832470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:32.833815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:32.846107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.846981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.848156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.850920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.851726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.852435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.167017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:33.175917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-112b1213-fa20-4171-8b7c-17666703f4ca tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.360192 Nov 02 13:52:33.187577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1456/2508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:32 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:33.199862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:33.202217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:33.208975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:33.209472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:33.209910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.210622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:33.215485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:33.215939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.336835 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48b443b1-ece9-4c54-847f-a54a0add0199 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815/action" status: 202 len: 0 microversion: 2.1 time: 0.147833 Nov 02 13:52:33.337716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1457/2509] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:33 2022] POST /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:33.345552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:33.346274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:33.354030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:33.354754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:33.355226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.355943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:33.356396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:33.356838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.598832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:33.612082 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87355a72-68e6-41fd-a95c-da846003def9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.273204 Nov 02 13:52:33.623123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1458/2510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:33 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:33.623123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3021194d-0f16-4cae-8c1b-d5afbdd18c61 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80ee64c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1287862718", "description": "tempest-description-1511556136"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:34.139185 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3021194d-0f16-4cae-8c1b-d5afbdd18c61 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.525326 Nov 02 13:52:34.140402 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1459/2511] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:34.148251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:34.149096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:34.157743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.158242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.158676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.159425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.159885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.160373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.399650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:34.424108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3adae081-0130-4a9a-b5f7-8e83be268570 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.282389 Nov 02 13:52:34.425505 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1460/2512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:34 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:34.431979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:34.432657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] [instance: d10df762-001b-4942-92fa-bd35e2fdb684] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:34.439849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.440465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.440996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.441901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.442466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.442987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.459999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] HTTP exception thrown: Instance d10df762-001b-4942-92fa-bd35e2fdb684 could not be found. Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Request method failure captured: Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 HTTP/1.1 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXZi_X13ak92APEP2jv80pGxiXvaPcCc2Y5TKwCJSVxxqXNA9nGjEQDIf_Vb5cyNUa1xSsFZp5eO6rN4xjGgjOy5WDqf8hte6B23JG1VmRZqHx3dacym4nlgEtZijY2M4R2Af1hywajmbpkvO3arhsIqI1OTjSlBJpkxY_SXljtq5I Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 62df681fa5ed464baa58344b82087eba Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2025439743 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62df681fa5ed464baa58344b82087eba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62df681fa5ed464baa58344b82087eba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62df681fa5ed464baa58344b82087eba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62df681fa5ed464baa58344b82087eba"}]}] Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2025439743 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 62df681fa5ed464baa58344b82087eba Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2025439743 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-2025439743-project Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7e8614a6255f475dac0b02dc0e0c65a6 Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2025439743-project Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d10df762-001b-4942-92fa-bd35e2fdb684 could not be found. Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd10df762-001b-4942-92fa-bd35e2fdb684'} Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10df762-001b-4942-92fa-bd35e2fdb684 could not be found. Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10df762-001b-4942-92fa-bd35e2fdb684 could not be found. Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:34.461774 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10df762-001b-4942-92fa-bd35e2fdb684 could not be found. Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] Returning 404 to user: Instance d10df762-001b-4942-92fa-bd35e2fdb684 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e6d32c3-faef-4c7c-8f27-3d2d90562234 tempest-ServersAdminNegativeTestJSON-2025439743 tempest-ServersAdminNegativeTestJSON-2025439743-project] 10.222.0.18 "GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684" status: 404 len: 111 microversion: 2.1 time: 0.036220 Nov 02 13:52:34.469360 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1461/2513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:34 2022] GET /compute/v2.1/servers/d10df762-001b-4942-92fa-bd35e2fdb684 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:34.475646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1696287239", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "a5e0a74f-8cf4-4909-80c3-e8050c0491fb"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:34.557434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] validate_networks() for [('a5e0a74f-8cf4-4909-80c3-e8050c0491fb', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:52:35.156291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:52:35.157412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:52:35.157412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:52:35.157412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:52:35.157834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:52:35.169050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:35.169827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:35.170438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:35.171609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:35.172217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:35.172809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:35.194626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Getting quotas for project 7a5ef8da09024e678c3fccd39cac0f35. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:52:35.201598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Getting quotas for user ab0feddb832f4d71a0e3e8dafa40e017 and project 7a5ef8da09024e678c3fccd39cac0f35. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:52:35.223754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:52:35.227024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:52:35.293674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3223770c-9597-49f6-99dc-081918503419 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825249 Nov 02 13:52:35.294898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1462/2514] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:52:35.300326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:35.301623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:35.310142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:35.310525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:35.311341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:35.312221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:35.313467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:35.314059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:35.683751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:35.696673 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d3cfac5-23fe-45ee-a8db-4df0db6c3b57 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1574 microversion: 2.1 time: 0.399966 Nov 02 13:52:35.698136 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1463/2515] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:35 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1574 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:35.706837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3a45f123-c960-4546-8280-2f8d73ef9300 req-0ee470ef-3739-4417-ab4c-380267459e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10df762-001b-4942-92fa-bd35e2fdb684", "name": "network-vif-deleted", "tag": "434021e8-593d-4f7e-814a-6f2e60332274"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:35.730275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3a45f123-c960-4546-8280-2f8d73ef9300 req-0ee470ef-3739-4417-ab4c-380267459e04 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:35.731352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3a45f123-c960-4546-8280-2f8d73ef9300 req-0ee470ef-3739-4417-ab4c-380267459e04 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:35.732166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3a45f123-c960-4546-8280-2f8d73ef9300 req-0ee470ef-3739-4417-ab4c-380267459e04 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:35.751884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3a45f123-c960-4546-8280-2f8d73ef9300 req-0ee470ef-3739-4417-ab4c-380267459e04 service nova] Creating event network-vif-deleted:434021e8-593d-4f7e-814a-6f2e60332274 for instance d10df762-001b-4942-92fa-bd35e2fdb684 on n-h1-858238-3 Nov 02 13:52:35.757799 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3a45f123-c960-4546-8280-2f8d73ef9300 req-0ee470ef-3739-4417-ab4c-380267459e04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057974 Nov 02 13:52:35.763509 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1464/2516] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:35.770691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6c76761-ef73-4dbd-89f5-b71373f04e67 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80c44160>, body: {"security_group_rule": {"parent_group_id": "7cd844de-9c53-424c-9ce2-df999dc5f145", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:36.054927 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6c76761-ef73-4dbd-89f5-b71373f04e67 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.289601 Nov 02 13:52:36.063523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1465/2517] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:52:35 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:36.063523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:36.063523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:36.068872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.069372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.069811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.070529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.070985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.071446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.263049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:36.286203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a70db949-a315-4a25-80ba-27f5cfa0211c tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.229261 Nov 02 13:52:36.287481 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1466/2518] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:36 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:36.292286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:36.293397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:36.308095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.308815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.309430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.310285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.315970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.316419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.702057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:36.718704 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fd21f35-adcd-4a63-b869-4225fb3510ae tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.429372 Nov 02 13:52:36.725331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1467/2519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:36 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:36.737947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:36.739159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:36.764217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.767960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.768804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.769974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:36.772731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:36.773469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:36.974778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:36.990387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d18e87a5-9e45-4714-aa00-398dfee38c8a tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1270 microversion: 2.1 time: 0.263426 Nov 02 13:52:37.004608 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1468/2520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:36 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:37.015404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:37.042073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:37.061973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.063646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.064923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.066463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.069084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.069740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.393902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:37.412230 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b6c3215f-d544-4a6c-8a9b-571f6e8256bb tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.406079 Nov 02 13:52:37.423156 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1469/2521] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:37 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:37.430455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-642386495"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:37.431447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:37.442657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.443509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.444158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.446049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.446763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.447482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.732994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Adding security group c7398be8-4906-43af-a8ca-b2adf6033ca4 to port d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 Nov 02 13:52:38.320962 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-afdf5ceb-081e-428f-91eb-d1112e215ca7 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815/action" status: 202 len: 0 microversion: 2.1 time: 0.896421 Nov 02 13:52:38.321643 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1470/2522] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:37 2022] POST /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:38.332337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef375d21-8a9e-4bea-89de-ee7e83e6655a tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f81cdc700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-550633295", "description": "tempest-description-1246336614"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:38.835114 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef375d21-8a9e-4bea-89de-ee7e83e6655a tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.508413 Nov 02 13:52:38.836541 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1471/2523] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:38.842876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:38.843837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:38.855781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:38.862648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:38.863634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:38.867270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:38.869706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:38.870353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.177647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:39.193698 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ce4af20-5334-4ac1-8688-7fe3ffd2babc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.355092 Nov 02 13:52:39.198345 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1472/2524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:38 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:39.209292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:39.210580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:39.226924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.228293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.229703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.230637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.231435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.232048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.644905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:39.663855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4277a4b-9165-4e8e-89a9-678d04d19230 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.464047 Nov 02 13:52:39.673395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1473/2525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:39 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:39.691582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:39.692208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:39.716079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.718250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.719495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.720666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.721343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.721976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.039897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.050961 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-adea988b-9d14-4c1d-91b4-a7e6ac4efa69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1318 microversion: 2.1 time: 0.376031 Nov 02 13:52:40.057297 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1474/2526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:39 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:40.067522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f39f0955-0100-4d62-9c1a-f76b8e8e9fee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80fe70d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:40.256400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-f39f0955-0100-4d62-9c1a-f76b8e8e9fee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use.", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:52:40.257163 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f39f0955-0100-4d62-9c1a-f76b8e8e9fee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.257163 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f39f0955-0100-4d62-9c1a-f76b8e8e9fee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4 HTTP/1.1 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: exception: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c7398be8-4906-43af-a8ca-b2adf6033ca4'} Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:52:40.259923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f39f0955-0100-4d62-9c1a-f76b8e8e9fee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 400 to user: Security Group c7398be8-4906-43af-a8ca-b2adf6033ca4 in use. Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-ce127b11-396b-44ec-a3c7-85e78ddddc95'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:40.264589 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f39f0955-0100-4d62-9c1a-f76b8e8e9fee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4" status: 400 len: 185 microversion: 2.1 time: 0.204753 Nov 02 13:52:40.267049 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1475/2527] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:52:40 2022] DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4 => generated 185 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:52:40.269488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7c809862-3221-4a66-a19c-7c471a5f7313 req-bec052e2-4585-4044-add6-7c9970f0f71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bc3501-5c03-48c4-bf31-fa11683e1815", "tag": "d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:40.282857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7c809862-3221-4a66-a19c-7c471a5f7313 req-bec052e2-4585-4044-add6-7c9970f0f71d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.283373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7c809862-3221-4a66-a19c-7c471a5f7313 req-bec052e2-4585-4044-add6-7c9970f0f71d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.283800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7c809862-3221-4a66-a19c-7c471a5f7313 req-bec052e2-4585-4044-add6-7c9970f0f71d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.301600 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7c809862-3221-4a66-a19c-7c471a5f7313 req-bec052e2-4585-4044-add6-7c9970f0f71d service nova] Creating event network-changed:d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 for instance 85bc3501-5c03-48c4-bf31-fa11683e1815 on n-h2-858238-3 Nov 02 13:52:40.307318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7c809862-3221-4a66-a19c-7c471a5f7313 req-bec052e2-4585-4044-add6-7c9970f0f71d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041096 Nov 02 13:52:40.308504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1476/2528] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:40.314607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:40.315569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:40.323226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.323919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.324479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.325349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.325933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.326487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.333207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:40.610717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.620413 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7d9f9e6-5c4f-4747-ab78-705315dd5337 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.310535 Nov 02 13:52:40.624166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1477/2529] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:40 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:40.633030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86c61ed6-bc7e-4d50-9a09-cb3705067c3b tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80c401f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-764497228", "description": "tempest-description-1930225669"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:41.211523 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86c61ed6-bc7e-4d50-9a09-cb3705067c3b tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.583998 Nov 02 13:52:41.219798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1478/2530] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:41.237476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.239792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.257599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.259740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.261556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.264158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.265896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.266719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.579145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.595200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8ea9056-23f8-4c0a-bdd8-9051c0723eb0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.371452 Nov 02 13:52:41.595766 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1479/2531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:41.601045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.601877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.619229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.627330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.630883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.631783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.632570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.633296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.664695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:52:41.763845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:41.782864 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-36b95afc-d5ca-44d4-bbe2-2f0dc56b90e3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 204 len: 0 microversion: 2.1 time: 0.185273 Nov 02 13:52:41.784141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1480/2532] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:52:41 2022] DELETE /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:52:41.790255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.791288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.800204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.800964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.801389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.802089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.802538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.802955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.967704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.975892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f63c846-9caa-436c-a715-24bb46cea22d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.190316 Nov 02 13:52:41.976578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1481/2533] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:41.981535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.982436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.989068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.989814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.990447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.991361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.992113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.992732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.221347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:42.235487 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e041aa5-8719-44b9-abf1-5b8e7cbb7832 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1318 microversion: 2.1 time: 0.257410 Nov 02 13:52:42.240658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1482/2534] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:42.247635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86ba9320-064b-4e4e-9292-9dbd6f5578a6 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80c44160>, body: {"security_group_rule": {"parent_group_id": "ea34c5fd-9857-427e-ad97-029fd2af331f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3dce0762-6ca3-470e-bdc7-6dd559854946"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:42.769143 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86ba9320-064b-4e4e-9292-9dbd6f5578a6 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.527021 Nov 02 13:52:42.780435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1483/2535] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:52:42 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:42.785216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:42.785924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:42.806518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.808368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.810662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.813085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.813913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.815658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.041021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.050319 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcbc9896-ad48-45f4-963d-ddacacffb5a1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.269020 Nov 02 13:52:43.051482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1484/2536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:42 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:43.058511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:43.059461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:43.070721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.072353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.073147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.075353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.076069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.076845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.757823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a50d7ce0af495781869c6f0f6534cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cb2eee50a4cbaa2cb4e93216b4b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.782388 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-65313dfc-2f9a-4842-b1ca-81f8a4abbc0c tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 200 len: 1648 microversion: 2.1 time: 0.729176 Nov 02 13:52:43.784312 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1485/2537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:43 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 1648 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:43.790367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9b8c9831-c130-4dd3-8ee6-613d6e90726f req-b8266bad-400e-4e07-a7f4-93ac4b6d1e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08a79e5-493c-4820-b2d3-260d93c4b622", "tag": "f55c71e7-2560-4580-b983-94f8162bd000"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:43.818068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9b8c9831-c130-4dd3-8ee6-613d6e90726f req-b8266bad-400e-4e07-a7f4-93ac4b6d1e07 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.824219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9b8c9831-c130-4dd3-8ee6-613d6e90726f req-b8266bad-400e-4e07-a7f4-93ac4b6d1e07 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.825115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9b8c9831-c130-4dd3-8ee6-613d6e90726f req-b8266bad-400e-4e07-a7f4-93ac4b6d1e07 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.852018 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9b8c9831-c130-4dd3-8ee6-613d6e90726f req-b8266bad-400e-4e07-a7f4-93ac4b6d1e07 service nova] Creating event network-changed:f55c71e7-2560-4580-b983-94f8162bd000 for instance e08a79e5-493c-4820-b2d3-260d93c4b622 on n-h2-858238-3 Nov 02 13:52:43.859759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9b8c9831-c130-4dd3-8ee6-613d6e90726f req-b8266bad-400e-4e07-a7f4-93ac4b6d1e07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073909 Nov 02 13:52:43.861328 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1486/2538] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:43.877843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:43.879502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:43.890507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.891825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.892122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.893118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.893754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.894245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.234287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:44.253278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80658f29-a4de-4590-a08d-d902f1360ef2 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.389982 Nov 02 13:52:44.271791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1487/2539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:43 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:44.277964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74c6960a-25c2-4c1c-85c6-a05c611cf1a9 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80df8a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1548582060", "description": "tempest-description-831674156"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:44.798387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74c6960a-25c2-4c1c-85c6-a05c611cf1a9 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.525252 Nov 02 13:52:44.809571 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1488/2540] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:44.815187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:44.815967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:44.837434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.838592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.839299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.840181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.840792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.841555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.184458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:45.217024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:45.432138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:45.440465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c518d343-3031-412a-a0c4-c9f53ce43793 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.629438 Nov 02 13:52:45.441667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1489/2541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:44 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:45.460970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:45.462008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:45.473712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.487367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.488100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.489527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.490061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.490497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.863540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:45.881757 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ae60e78-71d9-43d0-98a0-3d7c62d542e7 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1318 microversion: 2.1 time: 0.436524 Nov 02 13:52:45.885051 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1490/2542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:45 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:45.896905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:45.900295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:45.932752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.937433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.938989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.940574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.942479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.943603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:46.381009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:46.395576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d159b80-2342-4265-a651-e8d02cd73f4e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.508854 Nov 02 13:52:46.408889 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1491/2543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:45 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:46.430243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb465d1b-41f1-462d-a6f1-5041b18499d2 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f81359940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-101127123", "description": "tempest-description-434381475"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:47.018663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb465d1b-41f1-462d-a6f1-5041b18499d2 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.608283 Nov 02 13:52:47.029507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1492/2544] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:47.035337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:47.040972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:47.048486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.049066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.049547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.050377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.051033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.051488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.083469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 HTTP/1.1 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '85bc3501-5c03-48c4-bf31-fa11683e1815'} Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:47.085211 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:47.090486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11cd9570-10c9-4b45-8b82-a1ec416bbd88 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 404 len: 111 microversion: 2.1 time: 0.057027 Nov 02 13:52:47.092137 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1493/2545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:47 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:47.105804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:47.106497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:47.113002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.113487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.113920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.114629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.115080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.115589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.589103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:47.605003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3978f805-a641-402b-841e-72e98851ec9d tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.511296 Nov 02 13:52:47.605418 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1494/2546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:47 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:47.625244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-abc3defb-af42-4a5b-8926-ed9bd2000f4c req-c7d60205-a55a-4c0f-97a5-3c12f4d850f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bc3501-5c03-48c4-bf31-fa11683e1815", "name": "network-vif-deleted", "tag": "d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:47.657493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-abc3defb-af42-4a5b-8926-ed9bd2000f4c req-c7d60205-a55a-4c0f-97a5-3c12f4d850f7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.657990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-abc3defb-af42-4a5b-8926-ed9bd2000f4c req-c7d60205-a55a-4c0f-97a5-3c12f4d850f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.658421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-abc3defb-af42-4a5b-8926-ed9bd2000f4c req-c7d60205-a55a-4c0f-97a5-3c12f4d850f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.683889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-abc3defb-af42-4a5b-8926-ed9bd2000f4c req-c7d60205-a55a-4c0f-97a5-3c12f4d850f7 service nova] Creating event network-vif-deleted:d1e28e33-1c76-4cb3-b7ab-36e38fc7ad96 for instance 85bc3501-5c03-48c4-bf31-fa11683e1815 on n-h2-858238-3 Nov 02 13:52:47.696572 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-abc3defb-af42-4a5b-8926-ed9bd2000f4c req-c7d60205-a55a-4c0f-97a5-3c12f4d850f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071578 Nov 02 13:52:47.698259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1495/2547] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:47.708288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:47.723372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:47.732356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.732850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.733288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.734005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.734462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.734891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.229098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:48.248336 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26db61dc-0986-4c19-9200-dea45178b095 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1513 microversion: 2.1 time: 0.547881 Nov 02 13:52:48.248960 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1496/2548] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:47 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1513 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:48.273267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:48.279923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:48.295128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.295901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.296536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.297441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.298157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.298883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.718767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:48.737789 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-394fefcf-2cdf-4cd1-9327-61401244687e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1318 microversion: 2.1 time: 0.485458 Nov 02 13:52:48.752961 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1497/2549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:48 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:48.760778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d716f61-fe1a-48f1-9a25-531a1e4d9762 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80ff23a0>, body: {"security_group_rule": {"parent_group_id": "8ad57838-3ec4-4091-95f2-9d756c25842f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "57e5c454-ca02-49dc-8d07-7ec41e25e500"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:49.374192 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d716f61-fe1a-48f1-9a25-531a1e4d9762 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.619443 Nov 02 13:52:49.375150 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1498/2550] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:52:48 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:49.380052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8c5cfeb-0528-40b3-b863-ab36658f7223 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f81358790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:49.809537 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8c5cfeb-0528-40b3-b863-ab36658f7223 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f" status: 202 len: 0 microversion: 2.1 time: 0.428312 Nov 02 13:52:49.810920 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1499/2551] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:52:49 2022] DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:49.816720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:49.817776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:49.836637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:49.837718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:49.838171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:49.840660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:49.841131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:49.841561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:49.857540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:50.293947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.312158 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79649177-d8fc-41c3-b0ee-016ce9bcfb97 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.499872 Nov 02 13:52:50.327285 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1500/2552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:49 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:50.334293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:50.335619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:50.343384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.344500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.345295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.346332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.347037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.347718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.614507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.629401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76c0d28d-f016-492d-aa28-2bb88a772358 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.297996 Nov 02 13:52:50.630551 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1501/2553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:50 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:50.647672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:50.649143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:50.659785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.661767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.662538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.663732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.664450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.665881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.848897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.861905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5707ea3-54bc-447d-afb5-d8b634487c0f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1519 microversion: 2.1 time: 0.229937 Nov 02 13:52:50.864113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1502/2554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:50 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:50.872020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b76aee6-fbfa-46e8-b864-a7e0310a606c tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f81359700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.148043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5b76aee6-fbfa-46e8-b864-a7e0310a606c tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/57e5c454-ca02-49dc-8d07-7ec41e25e500" status: 202 len: 0 microversion: 2.1 time: 0.281068 Nov 02 13:52:51.149082 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1503/2555] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:52:50 2022] DELETE /compute/v2.1/os-security-groups/57e5c454-ca02-49dc-8d07-7ec41e25e500 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:51.155705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.156590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:51.173725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.176543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.177242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.180337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.182364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.183812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.408092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:51.427481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5952a7b8-df8c-465a-977b-bcc4f87c07a8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1318 microversion: 2.1 time: 0.276123 Nov 02 13:52:51.428776 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1504/2556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:51 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:51.441332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-700f550b-36d9-4b7a-ba1c-47a7cebb1ebb tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80c40d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.803401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-700f550b-36d9-4b7a-ba1c-47a7cebb1ebb tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4" status: 202 len: 0 microversion: 2.1 time: 0.371829 Nov 02 13:52:51.808819 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1505/2557] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:52:51 2022] DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:52.109177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30582b75-4733-4a40-b6ff-fe1802d1fb4f tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Action: 'create', calling method: .version_select at 0x7f6f81358c10>, body: {"pool": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:54.664246 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30582b75-4733-4a40-b6ff-fe1802d1fb4f tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.853241 Nov 02 13:52:54.666074 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1506/2558] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:52:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:54.671605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35a2744e-2edf-48f1-ad32-e2f861349d7b tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f80fe9040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:54.738079 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35a2744e-2edf-48f1-ad32-e2f861349d7b tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/8ad57838-3ec4-4091-95f2-9d756c25842f" status: 200 len: 247 microversion: 2.1 time: 0.070507 Nov 02 13:52:54.738881 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1507/2559] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:52:54 2022] GET /compute/v2.1/os-security-groups/8ad57838-3ec4-4091-95f2-9d756c25842f => generated 247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:54.747159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:54.747790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:54.755153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:54.755689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:54.756137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:54.756842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:54.757301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:54.758662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:54.908324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:54.918133 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d6e43ad-9baa-4927-80fd-d9189814ad3f tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.178363 Nov 02 13:52:54.918701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1508/2560] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:54 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:54.923852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:54.924747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:54.931610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:54.932099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:54.932533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:54.933238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:54.933690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:54.934110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.141297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:55.152585 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8c0886d3-48d0-41a6-91d3-c0e7673da87a tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.232481 Nov 02 13:52:55.153719 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1509/2561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:54 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:55.161529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23510158-f0da-41d9-9d89-f14aaaa02b12 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'create', calling method: .version_select at 0x7f6f81337ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1613376458", "description": "tempest-description-355203880"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:55.380437 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23510158-f0da-41d9-9d89-f14aaaa02b12 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.225053 Nov 02 13:52:55.381164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1510/2562] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:55.386479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:55.387350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:55.400173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.405051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.405750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.406685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.407778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.408435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.584132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:55.593095 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e3edeb3-99f5-46b3-a3e1-c4fe8325ad94 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1519 microversion: 2.1 time: 0.210299 Nov 02 13:52:55.608419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1511/2563] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:55 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:55.619153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:55.619808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:55.630949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.631835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.632496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.633413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.634525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.635214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.836392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:55.845814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cdeaf11-fe84-4fc1-8bee-52d690fd7917 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1318 microversion: 2.1 time: 0.236133 Nov 02 13:52:55.847234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1512/2564] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:55 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:55.852177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-12647e92-cce2-4ea1-ab50-8325cc33014f req-912c945f-69f8-4eba-b403-1001e87a4dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a79e5-493c-4820-b2d3-260d93c4b622", "name": "network-vif-plugged", "status": "completed", "tag": "f55c71e7-2560-4580-b983-94f8162bd000"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:55.862623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-12647e92-cce2-4ea1-ab50-8325cc33014f req-912c945f-69f8-4eba-b403-1001e87a4dba service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.863272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-12647e92-cce2-4ea1-ab50-8325cc33014f req-912c945f-69f8-4eba-b403-1001e87a4dba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.863793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-12647e92-cce2-4ea1-ab50-8325cc33014f req-912c945f-69f8-4eba-b403-1001e87a4dba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.877526 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-12647e92-cce2-4ea1-ab50-8325cc33014f req-912c945f-69f8-4eba-b403-1001e87a4dba service nova] Creating event network-vif-plugged:f55c71e7-2560-4580-b983-94f8162bd000 for instance e08a79e5-493c-4820-b2d3-260d93c4b622 on n-h2-858238-3 Nov 02 13:52:55.883023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-12647e92-cce2-4ea1-ab50-8325cc33014f req-912c945f-69f8-4eba-b403-1001e87a4dba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 Nov 02 13:52:55.884453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1513/2565] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:55.891453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94ff6d2e-c432-46dd-af34-eb7e47f27b50 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Calling method '.version_select at 0x7f6f81364310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:56.154027 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94ff6d2e-c432-46dd-af34-eb7e47f27b50 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/4bb30ad7-95c2-4087-8263-e6a91e9a49ab" status: 200 len: 142 microversion: 2.1 time: 0.266555 Nov 02 13:52:56.154027 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1514/2566] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:52:55 2022] GET /compute/v2.1/os-floating-ips/4bb30ad7-95c2-4087-8263-e6a91e9a49ab => generated 142 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:56.158415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92aa762a-6251-4572-a4ba-65cb40c90042 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f81364430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1238539160", "description": "tempest-description-1364929079"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:56.343527 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92aa762a-6251-4572-a4ba-65cb40c90042 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.189354 Nov 02 13:52:56.344374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1515/2567] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:52:56 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:56.349465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7ff8b25-a1e1-4620-9e59-b373d3dadb52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Action: 'update', calling method: .version_select at 0x7f6f80fe95e0>, body: {"security_group": {"name": "tempest-sg-hth-1211333985", "description": "tempest-description-hth-764934860"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:56.530678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7ff8b25-a1e1-4620-9e59-b373d3dadb52 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/0e272db1-8db7-4ccf-ad6e-c7e1bf77c303" status: 200 len: 217 microversion: 2.1 time: 0.184962 Nov 02 13:52:56.531430 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1516/2568] 10.222.0.18 () {60 vars in 1290 bytes} [Wed Nov 2 13:52:56 2022] PUT /compute/v2.1/os-security-groups/0e272db1-8db7-4ccf-ad6e-c7e1bf77c303 => generated 217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:56.536624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:56.537441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:56.545764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:56.546264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:56.546874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:56.547588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:56.548070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:56.548492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:56.691076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:56.700236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4172a4a4-8267-473a-bb81-1b034e1226ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.167382 Nov 02 13:52:56.700826 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1517/2569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:56 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:56.705641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a1779d1-2dbb-4bef-a37b-d3d875d7578c tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Calling method '.version_select at 0x7f6f813648b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:56.912427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a1779d1-2dbb-4bef-a37b-d3d875d7578c tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.210522 Nov 02 13:52:56.913384 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1518/2570] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:52:56 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:56.918083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:56.921131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:56.928675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:56.929170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:56.929596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:56.930844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:56.931335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:56.931757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.138773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:57.151663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-33566d68-b984-43cc-a13b-effc89a5ed82 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.237141 Nov 02 13:52:57.152567 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1519/2571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:56 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:57.157746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab5e1575-a396-4383-9beb-18322986bd61 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f81364dc0>, body: {"security_group_rule": {"parent_group_id": "375d4ab3-9416-4de5-98c3-89f44ea76848", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:57.668072 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab5e1575-a396-4383-9beb-18322986bd61 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.514143 Nov 02 13:52:57.676133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1520/2572] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:52:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:57.676133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a040eb08-3bd1-4174-916d-3475e5a6d1ee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80ff24c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:57.767911 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a040eb08-3bd1-4174-916d-3475e5a6d1ee tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/0e272db1-8db7-4ccf-ad6e-c7e1bf77c303" status: 200 len: 217 microversion: 2.1 time: 0.097306 Nov 02 13:52:57.768946 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1521/2573] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:52:57 2022] GET /compute/v2.1/os-security-groups/0e272db1-8db7-4ccf-ad6e-c7e1bf77c303 => generated 217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:57.776396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:57.777329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:57.785667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.786668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.787329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.788260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.789111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.790698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.971405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:57.980590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c21c3070-fbcf-403c-812a-45b7fa14c2b8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1519 microversion: 2.1 time: 0.209579 Nov 02 13:52:57.982334 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1522/2574] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:57 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:57.987051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:57.987708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:57.994845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.995585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.996026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.996738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.997195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.997620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:58.134763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:58.142887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7be33ff7-6c9d-472c-9c75-2fa99fb3f533 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1508 microversion: 2.1 time: 0.159329 Nov 02 13:52:58.143501 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1523/2575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:57 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:58.148101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8d23fe0-7868-4495-be31-65873e6839df tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Calling method '.version_select at 0x7f6f81a98a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:58.324183 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:52:58.325198 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:52:59.036233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8d23fe0-7868-4495-be31-65873e6839df tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4bb30ad7-95c2-4087-8263-e6a91e9a49ab" status: 202 len: 0 microversion: 2.1 time: 0.891657 Nov 02 13:52:59.036995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1524/2576] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:52:58 2022] DELETE /compute/v2.1/os-floating-ips/4bb30ad7-95c2-4087-8263-e6a91e9a49ab => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:59.043248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-587cb4aa-51e4-47b0-938b-edab5bf8bef4 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Action: 'create', calling method: .version_select at 0x7f6f80fd2940>, body: {"security_group_rule": {"parent_group_id": "375d4ab3-9416-4de5-98c3-89f44ea76848", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:59.296699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-587cb4aa-51e4-47b0-938b-edab5bf8bef4 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.258065 Nov 02 13:52:59.297814 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1525/2577] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:52:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:59.303047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:59.303897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:59.322699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.323214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.323665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:59.324383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.324830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.325255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:59.526445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:59.535023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4648afc-f143-441a-9342-fbb4b3ca16ce tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.235987 Nov 02 13:52:59.536026 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1526/2578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:59 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:59.542242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06d89b69-8cc7-4868-876b-c701ac2a0509 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80c05280>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:59.812579 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06d89b69-8cc7-4868-876b-c701ac2a0509 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0e272db1-8db7-4ccf-ad6e-c7e1bf77c303" status: 202 len: 0 microversion: 2.1 time: 0.274961 Nov 02 13:52:59.813783 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1527/2579] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:52:59 2022] DELETE /compute/v2.1/os-security-groups/0e272db1-8db7-4ccf-ad6e-c7e1bf77c303 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:59.821380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bf61960e-69cd-43ba-b0d8-7224a5702dbb req-c8634167-c930-4fa7-bafa-9a3296ebbf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fbdd6a-c37c-4e4a-867e-c66728467c2d", "name": "network-vif-plugged", "status": "completed", "tag": "20357963-a90e-490e-b1e0-4c8b244138a0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:59.852041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bf61960e-69cd-43ba-b0d8-7224a5702dbb req-c8634167-c930-4fa7-bafa-9a3296ebbf30 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.853499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bf61960e-69cd-43ba-b0d8-7224a5702dbb req-c8634167-c930-4fa7-bafa-9a3296ebbf30 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.854451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bf61960e-69cd-43ba-b0d8-7224a5702dbb req-c8634167-c930-4fa7-bafa-9a3296ebbf30 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:59.882802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bf61960e-69cd-43ba-b0d8-7224a5702dbb req-c8634167-c930-4fa7-bafa-9a3296ebbf30 service nova] Creating event network-vif-plugged:20357963-a90e-490e-b1e0-4c8b244138a0 for instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d on n-h1-858238-3 Nov 02 13:52:59.893030 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bf61960e-69cd-43ba-b0d8-7224a5702dbb req-c8634167-c930-4fa7-bafa-9a3296ebbf30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076993 Nov 02 13:52:59.899673 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1528/2580] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:59.918903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:59.919660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:59.928216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.928709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.929144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:59.930042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.930679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.931282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:00.162143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:00.190739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c088bb91-4f83-43df-933e-204534670f05 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1473 microversion: 2.1 time: 0.275904 Nov 02 13:53:00.211365 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1529/2581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:59 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:00.211365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:00.211365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:00.219425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:00.220340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:00.220963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:00.223154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:00.223154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:00.223526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:00.439141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:00.451115 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd13522d-ba82-46ee-b8da-876833e8bd7f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1519 microversion: 2.1 time: 0.250551 Nov 02 13:53:00.455147 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1530/2582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:00 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:00.457238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-594bb6f5-a07a-4356-8ed4-35e4a11536ad tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Action: 'create', calling method: .version_select at 0x7f6f80fe9040>, body: {"pool": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:02.329604 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-594bb6f5-a07a-4356-8ed4-35e4a11536ad tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.876414 Nov 02 13:53:02.330538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1531/2583] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:53:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:02.335185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3455c543-b3bd-403e-9274-84bc73e6df61 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f819951f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:02.391497 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3455c543-b3bd-403e-9274-84bc73e6df61 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/375d4ab3-9416-4de5-98c3-89f44ea76848" status: 200 len: 665 microversion: 2.1 time: 0.059693 Nov 02 13:53:02.392514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1532/2584] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:53:02 2022] GET /compute/v2.1/os-security-groups/375d4ab3-9416-4de5-98c3-89f44ea76848 => generated 665 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:02.401226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b7d15d9b-02bc-48c3-9cc4-09e0cbaafa6d"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:02.406031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:02.412835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.413600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.414249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.415743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.416390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.417005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.483549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] HTTP exception thrown: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Request method failure captured: Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622/os-volume_attachments/c615dc46-d4b2-4d95-ac44-b0efbe058bfb HTTP/1.1 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 74 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWqBZtYHYM2CTSbl2uES_vn1qHKWbppAz53z13W_gEwpBuEtidkucN-yMCWeKlgIUZ3rruGyeW1cepB080qGBCx4qKEB0LvBVe4VW7hpKVii5mZuBqQqYkoz_ztqqZY6M6VwhpU-EaEfmJ_CkljEIZ8Bsb4CeYE_vgNaz2FFiAqnIs Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 24032e14f9844c5ab445f98147d5a5e4 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesAdminNegativeTest-2029943897 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24032e14f9844c5ab445f98147d5a5e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24032e14f9844c5ab445f98147d5a5e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24032e14f9844c5ab445f98147d5a5e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24032e14f9844c5ab445f98147d5a5e4"}]}] Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesAdminNegativeTest-2029943897 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 24032e14f9844c5ab445f98147d5a5e4 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2029943897 Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesAdminNegativeTest-2029943897-project-admin Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c02028d0a844917a01ba1f939783d1f Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesAdminNegativeTest-2029943897-project-admin Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: {"volumeAttachment": {"volumeId": "b7d15d9b-02bc-48c3-9cc4-09e0cbaafa6d"}} Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': 'e08a79e5-493c-4820-b2d3-260d93c4b622', 'id': 'c615dc46-d4b2-4d95-ac44-b0efbe058bfb', 'body': {'volumeAttachment': {'volumeId': 'b7d15d9b-02bc-48c3-9cc4-09e0cbaafa6d'}}} Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. (HTTP 404) (Request-ID: req-0cdfc5f9-87ad-4be6-95eb-ae92d2eb01e6) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:53:02.485732 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] Returning 404 to user: Volume c615dc46-d4b2-4d95-ac44-b0efbe058bfb could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01027406-db44-448f-a148-b238840ece41 tempest-VolumesAdminNegativeTest-2029943897 tempest-VolumesAdminNegativeTest-2029943897-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622/os-volume_attachments/c615dc46-d4b2-4d95-ac44-b0efbe058bfb" status: 404 len: 109 microversion: 2.1 time: 0.092953 Nov 02 13:53:02.490172 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1533/2585] 10.222.0.18 () {60 vars in 1433 bytes} [Wed Nov 2 13:53:02 2022] PUT /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622/os-volume_attachments/c615dc46-d4b2-4d95-ac44-b0efbe058bfb => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:02.507652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:02.508147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:02.515638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.516119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.516549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.517240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.517687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.518198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.534916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 HTTP/1.1 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '85bc3501-5c03-48c4-bf31-fa11683e1815'} Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:02.536556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a0055de-059e-4e7e-9686-ce31e0bde06e tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 404 len: 111 microversion: 2.1 time: 0.035831 Nov 02 13:53:02.540127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1534/2586] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:02 2022] DELETE /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:02.543073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:02.544414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:02.552462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.553225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.553871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.554722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.555339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.555771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.558826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:02.889350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:02.898814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df2ea8b8-78b1-4de5-a591-4069bde2df8e tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.359290 Nov 02 13:53:02.900712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1535/2587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:02 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:02.908041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:02.909277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:02.918826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.919648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.920427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.921550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.922557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.923239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:03.178959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:03.201214 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-add9fc1d-607d-4f0e-9647-136f95fb99fd tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1479 microversion: 2.1 time: 0.298979 Nov 02 13:53:03.205385 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1536/2588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:02 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1479 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:03.217535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:03.221671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:03.240676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:03.242161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:03.244705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:03.246970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:03.247579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:03.248105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:03.640758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:03.684261 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfc9b2c0-681c-47a7-8ba7-2f5dbf805711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1504 microversion: 2.1 time: 0.476702 Nov 02 13:53:03.685857 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1537/2589] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:03 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:03.699916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53201ec9-ff25-440a-9f93-26a33e76180b tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Calling method '.version_select at 0x7f6f81337430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:04.899671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53201ec9-ff25-440a-9f93-26a33e76180b tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6" status: 202 len: 0 microversion: 2.1 time: 1.212111 Nov 02 13:53:04.905051 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1538/2590] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:53:03 2022] DELETE /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6 => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:04.912351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b73588ec-5611-47d7-b74c-84514961c4cd tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f813645e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.125592 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b73588ec-5611-47d7-b74c-84514961c4cd tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/a51b482c-14e4-4a85-98de-ac2f6670af75" status: 202 len: 0 microversion: 2.1 time: 0.219038 Nov 02 13:53:05.126592 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1539/2591] 10.222.0.18 () {58 vars in 1287 bytes} [Wed Nov 2 13:53:04 2022] DELETE /compute/v2.1/os-security-group-rules/a51b482c-14e4-4a85-98de-ac2f6670af75 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:05.135574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.136554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] [instance: 85bc3501-5c03-48c4-bf31-fa11683e1815] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:05.150522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.150522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.150522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.153902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.154518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.155156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.179908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 HTTP/1.1 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '85bc3501-5c03-48c4-bf31-fa11683e1815'} Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:05.182078 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Instance 85bc3501-5c03-48c4-bf31-fa11683e1815 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4984048d-64f9-4ed6-977c-aed86f12c6d9 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815" status: 404 len: 111 microversion: 2.1 time: 0.055441 Nov 02 13:53:05.185656 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1540/2592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:05 2022] GET /compute/v2.1/servers/85bc3501-5c03-48c4-bf31-fa11683e1815 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:05.189295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.189937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:05.196848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.197352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.197778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.198468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.199057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.199698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.349126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:05.367290 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c4316fe-1532-49b4-8994-77f8571c3b2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 200 len: 1504 microversion: 2.1 time: 0.175051 Nov 02 13:53:05.369412 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1541/2593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:05 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:05.375686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.376302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:05.387861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.388821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.394201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.394979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.395748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.396206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.616642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:05.628500 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6f356a13-92d9-4670-8997-7eff03a53962 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.257957 Nov 02 13:53:05.637679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1542/2594] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:05 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:05.637679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.637679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:05.641514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.642083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.642528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.643305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.643761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.644268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.818826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:05.827502 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05ba3adb-8730-4ea3-9ff1-fbb2d10c7d7e tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1464 microversion: 2.1 time: 0.197250 Nov 02 13:53:05.828427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1543/2595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:05 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:05.832972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-993cee59-0231-4568-a6af-16ed8ed186c6 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Calling method '.version_select at 0x7f6f81337ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.885478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-993cee59-0231-4568-a6af-16ed8ed186c6 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7da7564f-a71e-4e73-849d-7650248c0db6 could not be found", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:05.886195 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-993cee59-0231-4568-a6af-16ed8ed186c6 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] HTTP exception thrown: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-993cee59-0231-4568-a6af-16ed8ed186c6 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Request method failure captured: Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6 HTTP/1.1 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYyAP7PBMYpNJrgoKL2thH71-P1EkjgFHVfSq69J1l6xyg2NVU4JySzUapw4uFG7bBjgj0fZ4xXpiKpqAkgbWvRaaLg7uoLxaygM2LI6O-Bz7j7lOlt7YxGV5HEMr0iysUHki29BecMVU_XgS11ElRfR0uNXS0eMlvSzrdM92kGjcA Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0d5ee0cf3e5c4c92848e8ea7f57ace70 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsTestJSON-995577291 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}] Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsTestJSON-995577291 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0d5ee0cf3e5c4c92848e8ea7f57ace70 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsTestJSON-995577291 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsTestJSON-995577291-project Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e1337e04120b4a29a615eb041fc2d82a Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsTestJSON-995577291-project Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: exception: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7da7564f-a71e-4e73-849d-7650248c0db6'} Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7da7564f-a71e-4e73-849d-7650248c0db6 could not be found Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40d5a554-f37d-4590-a7a5-0907029a9ce1'] Nov 02 13:53:05.888777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6. Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-993cee59-0231-4568-a6af-16ed8ed186c6 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Returning 404 to user: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:05.892598 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-993cee59-0231-4568-a6af-16ed8ed186c6 tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6" status: 404 len: 111 microversion: 2.1 time: 0.060930 Nov 02 13:53:05.895171 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1544/2596] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:53:05 2022] GET /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:05.901104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-08d949db-091e-43cb-9896-87eb23d1d569 req-a63f4862-28c9-4cf7-8f2b-57669dc9b842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25af852c-129a-41f4-858d-7ad75a66729c", "name": "network-vif-plugged", "status": "completed", "tag": "fc6bab7b-002c-48b1-86ac-3d691872d7eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:05.914076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-08d949db-091e-43cb-9896-87eb23d1d569 req-a63f4862-28c9-4cf7-8f2b-57669dc9b842 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.914727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-08d949db-091e-43cb-9896-87eb23d1d569 req-a63f4862-28c9-4cf7-8f2b-57669dc9b842 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.915469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-08d949db-091e-43cb-9896-87eb23d1d569 req-a63f4862-28c9-4cf7-8f2b-57669dc9b842 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.927849 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-08d949db-091e-43cb-9896-87eb23d1d569 req-a63f4862-28c9-4cf7-8f2b-57669dc9b842 service nova] Creating event network-vif-plugged:fc6bab7b-002c-48b1-86ac-3d691872d7eb for instance 25af852c-129a-41f4-858d-7ad75a66729c on n-h2-858238-3 Nov 02 13:53:05.933736 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-08d949db-091e-43cb-9896-87eb23d1d569 req-a63f4862-28c9-4cf7-8f2b-57669dc9b842 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036855 Nov 02 13:53:05.935400 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1545/2597] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:05.943165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1556815-2d20-4f48-a4cf-8ab3eed3775c tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f80d9b160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.168621 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1556815-2d20-4f48-a4cf-8ab3eed3775c tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/375d4ab3-9416-4de5-98c3-89f44ea76848" status: 202 len: 0 microversion: 2.1 time: 0.229395 Nov 02 13:53:06.169713 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1546/2598] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:05 2022] DELETE /compute/v2.1/os-security-groups/375d4ab3-9416-4de5-98c3-89f44ea76848 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:06.175961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f81364700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.226824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:06.229051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group c7398be8-4906-43af-a8ca-b2adf6033ca4 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:06.230467 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.230467 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4 HTTP/1.1 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c7398be8-4906-43af-a8ca-b2adf6033ca4'} Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:06.238682 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] Nov 02 13:53:06.246846 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.255382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group c7398be8-4906-43af-a8ca-b2adf6033ca4 does not exist Nov 02 13:53:06.255382 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-6a9fd5c1-eb9a-49fa-ac80-4dc2a057d4b4'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:06.268381 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b954a9e3-3dc2-4172-b1fb-8c54a0fbcdf0 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4" status: 404 len: 194 microversion: 2.1 time: 0.086270 Nov 02 13:53:06.269775 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1547/2599] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:06 2022] DELETE /compute/v2.1/os-security-groups/c7398be8-4906-43af-a8ca-b2adf6033ca4 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:06.282370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.284216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:06.297508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:06.298776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:06.299381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.300378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:06.301366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:06.302169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.338903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:06.454476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f98fcf00-c314-4f1a-8250-0658298b04df tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 204 len: 0 microversion: 2.1 time: 0.181975 Nov 02 13:53:06.456812 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1548/2600] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:06 2022] DELETE /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:06.465137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:06.468704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:06.479787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:06.480374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:06.481304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.482089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:06.482916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:06.483403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.621635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1bbbd206-a9bb-47cd-9c02-36cc7b9be8d0 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 0 microversion: 2.1 time: 0.162826 Nov 02 13:53:06.622697 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1549/2601] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:53:06 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:06.630758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.631488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:06.639586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:06.640076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:06.640525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.641263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:06.641730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:06.642230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.672727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:06.742376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:06.770874 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e91bf97-dec4-43db-bfff-26770b620204 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 204 len: 0 microversion: 2.1 time: 0.146033 Nov 02 13:53:06.771684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1550/2602] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:06 2022] DELETE /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:06.778795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b6e337-fa37-448b-85e2-e7218bc4c3ca tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Calling method '.version_select at 0x7f6f81af11f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.831045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-62b6e337-fa37-448b-85e2-e7218bc4c3ca tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7da7564f-a71e-4e73-849d-7650248c0db6 could not be found", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:06.832500 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-62b6e337-fa37-448b-85e2-e7218bc4c3ca tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] HTTP exception thrown: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b6e337-fa37-448b-85e2-e7218bc4c3ca tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Request method failure captured: Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6 HTTP/1.1 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYyAP7PBMYpNJrgoKL2thH71-P1EkjgFHVfSq69J1l6xyg2NVU4JySzUapw4uFG7bBjgj0fZ4xXpiKpqAkgbWvRaaLg7uoLxaygM2LI6O-Bz7j7lOlt7YxGV5HEMr0iysUHki29BecMVU_XgS11ElRfR0uNXS0eMlvSzrdM92kGjcA Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0d5ee0cf3e5c4c92848e8ea7f57ace70 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsTestJSON-995577291 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d5ee0cf3e5c4c92848e8ea7f57ace70"}]}] Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsTestJSON-995577291 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0d5ee0cf3e5c4c92848e8ea7f57ace70 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsTestJSON-995577291 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsTestJSON-995577291-project Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e1337e04120b4a29a615eb041fc2d82a Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsTestJSON-995577291-project Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: exception: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7da7564f-a71e-4e73-849d-7650248c0db6'} Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7da7564f-a71e-4e73-849d-7650248c0db6 could not be found Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-877b8079-317c-4426-b419-1c04cd35b07f'] Nov 02 13:53:06.837179 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6. Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b6e337-fa37-448b-85e2-e7218bc4c3ca tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] Returning 404 to user: Floating IP not found for ID 7da7564f-a71e-4e73-849d-7650248c0db6 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62b6e337-fa37-448b-85e2-e7218bc4c3ca tempest-FloatingIPsTestJSON-995577291 tempest-FloatingIPsTestJSON-995577291-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6" status: 404 len: 111 microversion: 2.1 time: 0.066607 Nov 02 13:53:06.846370 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1551/2603] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:53:06 2022] DELETE /compute/v2.1/os-floating-ips/7da7564f-a71e-4e73-849d-7650248c0db6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:06.852670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f80d9bca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.887820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:06.889541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Neutron security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:06.889913 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] HTTP exception thrown: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.889913 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Request method failure captured: Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/57e5c454-ca02-49dc-8d07-7ec41e25e500 HTTP/1.1 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYcrK3kONkseOPUhjlINTau2PAXxEU-9JBNa_QK1d0p6AWy2zsB03VVUJ2KaUaqIo4Uh_c2_GBaZjPnh25gjwOBhxy3fAzWtOLHaorVcFGOHVI1l_tTgtSRPXM4CS9-8jzyXHV7AAhSNoYXFdyYpmHD615oWRFXaBGgdqtcKh0Al8w Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 87a35defb1fb4be49c9414bb7334989a Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1203615996 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/87a35defb1fb4be49c9414bb7334989a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/87a35defb1fb4be49c9414bb7334989a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/87a35defb1fb4be49c9414bb7334989a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_87a35defb1fb4be49c9414bb7334989a"}]}] Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1203615996 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 87a35defb1fb4be49c9414bb7334989a Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1203615996 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesTestJSON-1203615996-project Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 145ebb98e6bc423e9afd65476670e6e3 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1203615996-project Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '57e5c454-ca02-49dc-8d07-7ec41e25e500'} Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:06.894724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Returning 404 to user: Security group 57e5c454-ca02-49dc-8d07-7ec41e25e500 does not exist Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-d1159d6c-985b-4081-9adc-37785e344183'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8bcdab55-3da8-4ee4-a8ac-ceddd99f0ddf tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/57e5c454-ca02-49dc-8d07-7ec41e25e500" status: 404 len: 194 microversion: 2.1 time: 0.054884 Nov 02 13:53:06.904200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1552/2604] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:06 2022] DELETE /compute/v2.1/os-security-groups/57e5c454-ca02-49dc-8d07-7ec41e25e500 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:06.909000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f813373a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:06.949230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:06.950372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 78cfc386-c1d8-47e7-82a3-78db217da59f not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:06.951377 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.951377 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f HTTP/1.1 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '78cfc386-c1d8-47e7-82a3-78db217da59f'} Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:06.955154 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 78cfc386-c1d8-47e7-82a3-78db217da59f does not exist Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-7334acde-b432-4bb3-a607-caf4605ced84'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40649918-d903-4833-8f2f-b0c918263958 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f" status: 404 len: 194 microversion: 2.1 time: 0.056826 Nov 02 13:53:06.962984 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1553/2605] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:06 2022] DELETE /compute/v2.1/os-security-groups/78cfc386-c1d8-47e7-82a3-78db217da59f => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:06.968688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-768629218", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "33c42995-5a65-4daa-b956-d8895d884cd6"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:07.054003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] validate_networks() for [('33c42995-5a65-4daa-b956-d8895d884cd6', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:53:07.622406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:53:07.622906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:53:07.624380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:53:07.625106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:53:07.625838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:53:07.647955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.648808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.649567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.651294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.651424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.652112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.678991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Getting quotas for project 708743f0f3134a5e9444fed3dcad5ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:07.689326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Getting quotas for user fa9f0bc1c07c412fb4c6cc59e9a08efa and project 708743f0f3134a5e9444fed3dcad5ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:07.713557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:53:07.717679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:53:07.801953 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60f7ba8d-0435-41ec-aa54-b4805327f0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842470 Nov 02 13:53:07.802945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1554/2606] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:53:07.809061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:07.810001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:07.819477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.820520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.821333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.822246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.822880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.823631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.901775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.903235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.903886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.904938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lazy-loading 'fault' on Instance uuid 25af852c-129a-41f4-858d-7ad75a66729c {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:53:08.198781 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f4ba66e-f749-4d91-aba1-570c3a3c21aa tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1598 microversion: 2.1 time: 0.393502 Nov 02 13:53:08.220591 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1555/2607] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:07 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1598 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:08.226733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:08.228459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:08.262644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:08.266890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:08.267684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:08.268649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:08.269505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:08.270380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:08.320029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:08.635980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:08.652062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9be7575f-e401-4745-a006-6c210891c3b2 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1486 microversion: 2.1 time: 0.429809 Nov 02 13:53:08.653003 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1556/2608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:08 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1486 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:08.658278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:08.658901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:08.707484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:08.710948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:08.716462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:08.718882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:08.719389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:08.719822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:09.375888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:09.396002 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3646cbd5-360b-4c05-8753-aa5ed7a052ef tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 200 len: 1514 microversion: 2.1 time: 0.741633 Nov 02 13:53:09.397640 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1557/2609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:08 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 1514 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:09.415914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92cb057e-0038-43cc-b00a-bb1a88a410eb tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f81995dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:10.066841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92cb057e-0038-43cc-b00a-bb1a88a410eb tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8ad57838-3ec4-4091-95f2-9d756c25842f" status: 202 len: 0 microversion: 2.1 time: 0.667607 Nov 02 13:53:10.071178 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1558/2610] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:09 2022] DELETE /compute/v2.1/os-security-groups/8ad57838-3ec4-4091-95f2-9d756c25842f => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:10.074367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f81337790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:10.115345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:10.116261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:10.116892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.116892 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb HTTP/1.1 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb'} Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:10.118915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb does not exist Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-917639cd-9942-452c-a43f-2250f9daefe3'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c25e4508-fd95-47cb-a54b-3e1506bfb114 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb" status: 404 len: 194 microversion: 2.1 time: 0.051460 Nov 02 13:53:10.126077 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1559/2611] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:10 2022] DELETE /compute/v2.1/os-security-groups/5b59e01d-4f98-4df6-a2f4-2d503cb6d3eb => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:10.137466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:10.138084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:10.165130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:10.166869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:10.169304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:10.183116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:10.183942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:10.184667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:10.803047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:10.823853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a3068fd0-df53-4a06-ab1d-ceac510e1bb2 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1277 microversion: 2.1 time: 0.701715 Nov 02 13:53:10.825087 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1560/2612] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:10 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1277 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:10.848477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:10.848477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:10.855113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:10.855903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:10.858243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:10.860369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:10.861051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:10.861684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:10.997794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e997d69d-29e7-493d-8ee7-0a64eabaa226 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action" status: 202 len: 0 microversion: 2.1 time: 0.171254 Nov 02 13:53:10.998798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1561/2613] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:53:10 2022] POST /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:11.021141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:11.023242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:11.033620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:11.040024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:11.041960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:11.042902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:11.043549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:11.044117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:11.250707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3216b333-d056-47f5-a0ce-9e3bb03e1779 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "POST /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3/action" status: 202 len: 0 microversion: 2.1 time: 0.242389 Nov 02 13:53:11.261512 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1562/2614] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:53:11 2022] POST /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:11.269980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b2378ba5-1b07-4461-9b0c-22280d937cad req-ec329c3a-e647-4454-8916-9046368bf202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fbdd6a-c37c-4e4a-867e-c66728467c2d", "name": "network-vif-deleted", "tag": "20357963-a90e-490e-b1e0-4c8b244138a0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:11.283781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b2378ba5-1b07-4461-9b0c-22280d937cad req-ec329c3a-e647-4454-8916-9046368bf202 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:11.284625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b2378ba5-1b07-4461-9b0c-22280d937cad req-ec329c3a-e647-4454-8916-9046368bf202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:11.285256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b2378ba5-1b07-4461-9b0c-22280d937cad req-ec329c3a-e647-4454-8916-9046368bf202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:11.303656 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b2378ba5-1b07-4461-9b0c-22280d937cad req-ec329c3a-e647-4454-8916-9046368bf202 service nova] Creating event network-vif-deleted:20357963-a90e-490e-b1e0-4c8b244138a0 for instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d on n-h1-858238-3 Nov 02 13:53:11.318501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b2378ba5-1b07-4461-9b0c-22280d937cad req-ec329c3a-e647-4454-8916-9046368bf202 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051853 Nov 02 13:53:11.319650 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1563/2615] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:11.332503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a50b9d20-f148-4c9c-8286-c6dfd8f740c0 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f81358790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:12.436805 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a50b9d20-f148-4c9c-8286-c6dfd8f740c0 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3dce0762-6ca3-470e-bdc7-6dd559854946" status: 202 len: 0 microversion: 2.1 time: 1.115445 Nov 02 13:53:12.437738 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1564/2616] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:11 2022] DELETE /compute/v2.1/os-security-groups/3dce0762-6ca3-470e-bdc7-6dd559854946 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:12.443071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f819e1ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:12.512407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:12.513006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 941b6f91-cbad-40c7-aabd-215f676d7680 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:12.513533 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.513533 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680 HTTP/1.1 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '941b6f91-cbad-40c7-aabd-215f676d7680'} Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:12.515577 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 941b6f91-cbad-40c7-aabd-215f676d7680 does not exist Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-d39a83e4-2641-4008-b1ed-dfb534e8a8ba'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eaa1844e-b413-40dc-a2f6-25a09a48bab3 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680" status: 404 len: 194 microversion: 2.1 time: 0.078292 Nov 02 13:53:12.519373 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1565/2617] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:12 2022] DELETE /compute/v2.1/os-security-groups/941b6f91-cbad-40c7-aabd-215f676d7680 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:12.523257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:12.524026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: e08a79e5-493c-4820-b2d3-260d93c4b622] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:12.560384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:12.562824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:12.564006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:12.565515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:12.566706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:12.568210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:12.596901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] HTTP exception thrown: Instance e08a79e5-493c-4820-b2d3-260d93c4b622 could not be found. Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Request method failure captured: Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 HTTP/1.1 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWUBBgr6AY5w00fkd1ML8Ohw9yPw5PpJTuh7eyzlilYKaFrkr2YEEL07MnjXLgMlEFQtJfKVJqbqjXml_CL3Tk8E9ky-aRAeLV8yak6XeR5l6wYeCrnrW8NQdDNApyDSJZp7cYzcvhGtRzFNmxjCsu18E-l0A5hC1Z142iiRI9X1u4 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7a5ef8da09024e678c3fccd39cac0f35 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesAdminNegativeTest-597891330 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a5ef8da09024e678c3fccd39cac0f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a5ef8da09024e678c3fccd39cac0f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a5ef8da09024e678c3fccd39cac0f35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a5ef8da09024e678c3fccd39cac0f35"}]}] Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesAdminNegativeTest-597891330 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7a5ef8da09024e678c3fccd39cac0f35 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-597891330 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesAdminNegativeTest-597891330-project Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ab0feddb832f4d71a0e3e8dafa40e017 Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesAdminNegativeTest-597891330-project Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e08a79e5-493c-4820-b2d3-260d93c4b622 could not be found. Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e08a79e5-493c-4820-b2d3-260d93c4b622'} Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08a79e5-493c-4820-b2d3-260d93c4b622 could not be found. Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08a79e5-493c-4820-b2d3-260d93c4b622 could not be found. Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:12.599133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08a79e5-493c-4820-b2d3-260d93c4b622 could not be found. Nov 02 13:53:12.604844 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:12.606728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Returning 404 to user: Instance e08a79e5-493c-4820-b2d3-260d93c4b622 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:12.607871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30a0c915-44a7-4b26-b30f-91762d20c4dc tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622" status: 404 len: 111 microversion: 2.1 time: 0.089014 Nov 02 13:53:12.609028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1566/2618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:12 2022] GET /compute/v2.1/servers/e08a79e5-493c-4820-b2d3-260d93c4b622 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:12.618428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:12.620340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:12.631830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:12.632328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:12.634042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:12.643858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:12.644364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:12.649690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.080925 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-190665ce-095e-4738-9f0f-cd25f270cf57 tempest-ServersAdminTestJSON-1455353866 tempest-ServersAdminTestJSON-1455353866-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 200 len: 1615 microversion: 2.1 time: 0.470573 Nov 02 13:53:13.087450 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1567/2619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:12 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 1615 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:13.106907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:13.107959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:13.130753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:13.136822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:13.137387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.138250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:13.138762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:13.139178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.482662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:13.494643 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa433711-76cb-4293-ab42-e7cc36d2a762 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1494 microversion: 2.1 time: 0.405629 Nov 02 13:53:13.508676 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1568/2620] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:13 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1494 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:13.519818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:13.520822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:13.528666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:13.529745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:13.530334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.531293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:13.531900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:13.532475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.753090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:13.762192 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48ae5a0b-21e9-449e-ad67-30c6ee2431be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1317 microversion: 2.1 time: 0.250922 Nov 02 13:53:13.766628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1569/2621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:13 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:13.782616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-580a3f4b-8097-4718-93da-d10ed68e153e tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f81995ee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.058919 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-580a3f4b-8097-4718-93da-d10ed68e153e tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/ea34c5fd-9857-427e-ad97-029fd2af331f" status: 202 len: 0 microversion: 2.1 time: 0.290751 Nov 02 13:53:14.060443 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1570/2622] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:13 2022] DELETE /compute/v2.1/os-security-groups/ea34c5fd-9857-427e-ad97-029fd2af331f => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:14.090408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f821828b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.140025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:14.140717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group 5f8d8285-79af-4707-888e-9335c7dba57e not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:14.141327 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.141327 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e HTTP/1.1 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5f8d8285-79af-4707-888e-9335c7dba57e'} Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:14.143454 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] Nov 02 13:53:14.146964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.151323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group 5f8d8285-79af-4707-888e-9335c7dba57e does not exist Nov 02 13:53:14.151323 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a656414f-29ec-450d-8975-2b6f84a6e4ee'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:14.152665 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-446f4afa-59ae-4cef-bb54-39c42b1f0af1 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e" status: 404 len: 194 microversion: 2.1 time: 0.084558 Nov 02 13:53:14.156992 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1571/2623] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:14 2022] DELETE /compute/v2.1/os-security-groups/5f8d8285-79af-4707-888e-9335c7dba57e => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:14.162192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.165040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:14.173703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.174494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.175161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.177021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.177690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.178327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.208277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:14.344315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aeb4f35f-f78e-4622-9ba5-eeecea586336 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 204 len: 0 microversion: 2.1 time: 0.185586 Nov 02 13:53:14.348457 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1572/2624] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:14 2022] DELETE /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:14.354393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7af7514d-a3de-489f-8e7e-686571c8bf97 req-bfc52b9b-a40a-47ac-9403-de3769e6ca12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c69f7b-9be3-4d3c-8450-33cd24a4bf94", "tag": "2430de1d-66f2-479a-a957-73361c2e5202"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:14.391464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7af7514d-a3de-489f-8e7e-686571c8bf97 req-bfc52b9b-a40a-47ac-9403-de3769e6ca12 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.392219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7af7514d-a3de-489f-8e7e-686571c8bf97 req-bfc52b9b-a40a-47ac-9403-de3769e6ca12 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.393071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7af7514d-a3de-489f-8e7e-686571c8bf97 req-bfc52b9b-a40a-47ac-9403-de3769e6ca12 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.424113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7af7514d-a3de-489f-8e7e-686571c8bf97 req-bfc52b9b-a40a-47ac-9403-de3769e6ca12 service nova] Creating event network-changed:2430de1d-66f2-479a-a957-73361c2e5202 for instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 on n-h2-858238-3 Nov 02 13:53:14.430867 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7af7514d-a3de-489f-8e7e-686571c8bf97 req-bfc52b9b-a40a-47ac-9403-de3769e6ca12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083665 Nov 02 13:53:14.431800 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1573/2625] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:14.438241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-379f73fc-0648-478a-98e8-496c26f19f4d req-964c501b-2173-4dff-9e53-28fc2669ebd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08a79e5-493c-4820-b2d3-260d93c4b622", "name": "network-vif-deleted", "tag": "f55c71e7-2560-4580-b983-94f8162bd000"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:14.455137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-379f73fc-0648-478a-98e8-496c26f19f4d req-964c501b-2173-4dff-9e53-28fc2669ebd0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.456006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-379f73fc-0648-478a-98e8-496c26f19f4d req-964c501b-2173-4dff-9e53-28fc2669ebd0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.456661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-379f73fc-0648-478a-98e8-496c26f19f4d req-964c501b-2173-4dff-9e53-28fc2669ebd0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.473333 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-379f73fc-0648-478a-98e8-496c26f19f4d req-964c501b-2173-4dff-9e53-28fc2669ebd0 service nova] Creating event network-vif-deleted:f55c71e7-2560-4580-b983-94f8162bd000 for instance e08a79e5-493c-4820-b2d3-260d93c4b622 on n-h2-858238-3 Nov 02 13:53:14.479757 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-379f73fc-0648-478a-98e8-496c26f19f4d req-964c501b-2173-4dff-9e53-28fc2669ebd0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045703 Nov 02 13:53:14.480701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1574/2626] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:14.487968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f255979-4b5d-47ed-92de-e39c1d8e0318 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f81b72f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.819065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f255979-4b5d-47ed-92de-e39c1d8e0318 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/7cd844de-9c53-424c-9ce2-df999dc5f145" status: 202 len: 0 microversion: 2.1 time: 0.336864 Nov 02 13:53:14.820353 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1575/2627] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:14 2022] DELETE /compute/v2.1/os-security-groups/7cd844de-9c53-424c-9ce2-df999dc5f145 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:14.829858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80fe7040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.877817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:53:14.879027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Neutron security group fa0680d9-4457-4bbd-84a5-f91f24736f1e not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:53:14.879739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] HTTP exception thrown: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.879739 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Request method failure captured: Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e HTTP/1.1 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWk-0LzYaRLadJ45eQ9Gpl4LTjuA6QhSeGx7mC6hQ17Rn-zNlKD7hpKrRTu5JOoTbTtnz7WCRsXHCZ-iHkvpW4sfJhVLubPziB6CBxyJuQabfPa7FnKS1KpCQZlhz2Jpl4GpKJER6Mse-qE_rdC12jLBsK5SiAi6NIWGKvqpjQ-2kY Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a26cb2eee50a4cbaa2cb4e93216b4b4d"}]}] Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a26cb2eee50a4cbaa2cb4e93216b4b4d Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-361849226 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 01a50d7ce0af495781869c6f0f6534cf Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsTestJSON-361849226-project Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fa0680d9-4457-4bbd-84a5-f91f24736f1e'} Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:53:14.882190 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] Nov 02 13:53:14.887177 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:14.892256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 404 to user: Security group fa0680d9-4457-4bbd-84a5-f91f24736f1e does not exist Nov 02 13:53:14.892256 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-16dc024a-a62e-401a-a2ba-67d44f72d50b'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:14.895601 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a1548379-2d56-4c94-aa06-10192a14aa0b tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e" status: 404 len: 194 microversion: 2.1 time: 0.073532 Nov 02 13:53:14.896626 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1576/2628] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:14 2022] DELETE /compute/v2.1/os-security-groups/fa0680d9-4457-4bbd-84a5-f91f24736f1e => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:14.903547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.906582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:14.926910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.928300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.929484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.931985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.932966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.933472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:15.275140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:15.280201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-879a0d65-aa01-4374-a5fb-c7fef7514b44 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1470 microversion: 2.1 time: 0.379024 Nov 02 13:53:15.280201 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1577/2629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:14 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:15.300377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:15.301271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:15.309117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:15.309612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:15.310051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:15.310763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:15.311256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:15.311688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:15.519732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:15.529507 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a988fd3-a5ca-461e-aff1-b5c207a9ebf1 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1500 microversion: 2.1 time: 0.236273 Nov 02 13:53:15.540821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1578/2630] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:15 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1500 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:15.559324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:15.561163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:15.569668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:15.570176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:15.571133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:15.571903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:15.572368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:15.572803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:15.768912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:15.771774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:15.781069 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-331e0366-66cf-48f7-be95-9a27e4111c2c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1317 microversion: 2.1 time: 0.238155 Nov 02 13:53:15.782609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1579/2631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:15 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:15.790522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-562ee28f-125b-43a0-b77c-425f9fda9626 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] Calling method '.version_select at 0x7f6f81b72670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:16.235354 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-562ee28f-125b-43a0-b77c-425f9fda9626 tempest-SecurityGroupRulesTestJSON-1203615996 tempest-SecurityGroupRulesTestJSON-1203615996-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/29b30edc-d84c-4ca0-9b7d-926f90505210" status: 202 len: 0 microversion: 2.1 time: 0.450940 Nov 02 13:53:16.240550 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1580/2632] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:15 2022] DELETE /compute/v2.1/os-security-groups/29b30edc-d84c-4ca0-9b7d-926f90505210 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:16.241746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28252c1e-d97e-4261-aab4-aa44571f654f tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Calling method '.version_select at 0x7f6f80fe7040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:16.860185 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28252c1e-d97e-4261-aab4-aa44571f654f tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9d056fa5-4c0f-4cdb-b902-3825997a1560" status: 202 len: 0 microversion: 2.1 time: 0.623014 Nov 02 13:53:16.861837 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1581/2633] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:53:16 2022] DELETE /compute/v2.1/os-security-groups/9d056fa5-4c0f-4cdb-b902-3825997a1560 => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:16.871437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:16.872161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:16.884296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:16.890247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:16.893565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:16.894607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:16.897602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:16.898361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:16.982942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:17.231610 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf4a572e-6020-43b1-bd2a-076d362f4154 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 204 len: 0 microversion: 2.1 time: 0.368225 Nov 02 13:53:17.242578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1582/2634] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:16 2022] DELETE /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:17.250625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:17.252780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:17.262437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:17.263631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:17.264520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:17.267265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:17.267953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:17.268543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:17.662909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:17.702454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:18.362699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:18.378781 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-612e30a4-12b7-421d-b85d-800bc40bda27 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1470 microversion: 2.1 time: 1.131256 Nov 02 13:53:18.413968 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1583/2635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:17 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1470 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:18.428860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:18.429742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:18.443384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:18.443881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:18.444328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:18.445212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:18.451189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:18.451830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:18.868806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:18.894482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2a9f2c6-2371-4839-8099-4d7bb14bf019 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1317 microversion: 2.1 time: 0.470387 Nov 02 13:53:18.911249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1584/2636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:18 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:18.924087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:18.927666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:18.950593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:18.951819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:18.952433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:18.953201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:18.953717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:18.954197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:19.029913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:19.346036 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-63753969-b336-4e4d-b9c5-4d3f7b5f960c tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 204 len: 0 microversion: 2.1 time: 0.433339 Nov 02 13:53:19.348209 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1585/2637] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:18 2022] DELETE /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:19.362121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:19.367655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:19.381680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:19.392441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:19.393490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:19.394836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:19.395799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:19.396642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.007178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.019198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90445d90-b07f-4152-8fe5-1be09b350016 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 0.665652 Nov 02 13:53:20.020990 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1586/2638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:19 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:20.046675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:20.050339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:20.067888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.068382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.068812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.069527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.069978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.070444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.315685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.325962 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df1ee3c2-ef3d-4915-8f48-39a75dadadc0 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1681 microversion: 2.1 time: 0.303663 Nov 02 13:53:20.332376 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1587/2639] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:20 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1681 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:20.338827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-996024c9-dc87-4069-8aac-ec7b732c40be req-2fff4ff6-413f-4934-9b6b-d27d2a3686df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46", "name": "network-vif-deleted", "tag": "c576477d-124e-47e6-90ed-9d7b45fd9a30"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:20.371422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-996024c9-dc87-4069-8aac-ec7b732c40be req-2fff4ff6-413f-4934-9b6b-d27d2a3686df service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.375202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-996024c9-dc87-4069-8aac-ec7b732c40be req-2fff4ff6-413f-4934-9b6b-d27d2a3686df service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.380003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-996024c9-dc87-4069-8aac-ec7b732c40be req-2fff4ff6-413f-4934-9b6b-d27d2a3686df service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.424283 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-996024c9-dc87-4069-8aac-ec7b732c40be req-2fff4ff6-413f-4934-9b6b-d27d2a3686df service nova] Creating event network-vif-deleted:c576477d-124e-47e6-90ed-9d7b45fd9a30 for instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 on n-h2-858238-3 Nov 02 13:53:20.430802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-996024c9-dc87-4069-8aac-ec7b732c40be req-2fff4ff6-413f-4934-9b6b-d27d2a3686df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096657 Nov 02 13:53:20.432153 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1588/2640] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:20.438360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:20.439641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:20.448018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.448769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.449392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.450456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.451085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.451693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.549211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.582841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a581071a-13ff-4966-95c7-b23b16011ac7 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 200 len: 1428 microversion: 2.1 time: 0.142137 Nov 02 13:53:20.585287 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1589/2641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:20 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 1428 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:20.599293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:20.602367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:20.624839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.630006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.632508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.635277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:20.636120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:20.644929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:21.141418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:21.152429 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28b13475-1f68-44f8-881a-aac61899d28f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1317 microversion: 2.1 time: 0.563445 Nov 02 13:53:21.153605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1590/2642] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:20 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:21.158692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:21.159531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:21.169286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:21.179039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:21.180468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:21.182769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:21.183565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:21.184398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:22.723459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:22.736489 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7fcb98d7-a14a-4e41-88be-966bd9ac1e6c tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 200 len: 1506 microversion: 2.1 time: 1.581621 Nov 02 13:53:22.739269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1591/2643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:21 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 1506 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:22.753673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:22.760430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:22.778968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:22.784372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:22.787272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:22.791474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:22.794046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:22.797927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.243825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:23.253315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe236a49-bbd2-4d2d-b124-75bb398b6b1e tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1681 microversion: 2.1 time: 0.512412 Nov 02 13:53:23.293586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1592/2644] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:22 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1681 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:23.300041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:23.316727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:23.340050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.344931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.348897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.350402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.352987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.354282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.381256 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] HTTP exception thrown: Instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 could not be found. Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Request method failure captured: Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 HTTP/1.1 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWcnxR38jw-oIz4RoAwDZUQrqDC3lqB8miCEA8xmB3bMhV6mYBPLJx07Z9O8_chHzHQRJ4arfBew-Eu0VoJBsB3VwWht9kr9mliIeVXjJB_La6eLOwaar62Rigu5blqdgYjVRj3W8URbcbqDPoPSmgIxW-dVQEAaeqKnr6XfWBXpb0 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 70727044d5314b13bd03fb9998914886 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70727044d5314b13bd03fb9998914886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70727044d5314b13bd03fb9998914886"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70727044d5314b13bd03fb9998914886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70727044d5314b13bd03fb9998914886"}]}] Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 70727044d5314b13bd03fb9998914886 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminTestJSON-1647094519-project Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 4365b97ccc164db49191820f75700768 Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminTestJSON-1647094519-project Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 could not be found. Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46'} Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 could not be found. Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 could not be found. Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:23.383297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 could not be found. Nov 02 13:53:23.387151 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:23.391409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Returning 404 to user: Instance 4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:23.392547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a392d15f-fd63-4846-a9d3-b0ac40656537 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46" status: 404 len: 111 microversion: 2.1 time: 0.096902 Nov 02 13:53:23.393662 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1593/2645] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:23 2022] GET /compute/v2.1/servers/4d26a5c2-a9c0-4c84-8d8d-6a26152a7c46 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:23.399637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:23.400574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:23.406398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:23.408589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.409305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.409957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.410931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.411685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.413464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.902723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:23.919662 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae17ec12-134f-4646-8005-f5652c62ee4e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1317 microversion: 2.1 time: 0.522174 Nov 02 13:53:23.920993 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1594/2646] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:23 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:23.930131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b5c1ff91-4b03-44c5-acac-a5242c7e451b req-0fe9327d-5fd6-49f0-834f-e60cbc9edf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10dac4d-1a3c-4a92-aba3-ffdf8632eca3", "name": "network-vif-deleted", "tag": "ff1a79d2-4dc8-4542-9830-5373299e2ce7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:23.971780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b5c1ff91-4b03-44c5-acac-a5242c7e451b req-0fe9327d-5fd6-49f0-834f-e60cbc9edf7b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.972280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b5c1ff91-4b03-44c5-acac-a5242c7e451b req-0fe9327d-5fd6-49f0-834f-e60cbc9edf7b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.972717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b5c1ff91-4b03-44c5-acac-a5242c7e451b req-0fe9327d-5fd6-49f0-834f-e60cbc9edf7b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.011258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b5c1ff91-4b03-44c5-acac-a5242c7e451b req-0fe9327d-5fd6-49f0-834f-e60cbc9edf7b service nova] Creating event network-vif-deleted:ff1a79d2-4dc8-4542-9830-5373299e2ce7 for instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 on n-h1-858238-3 Nov 02 13:53:24.042745 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b5c1ff91-4b03-44c5-acac-a5242c7e451b req-0fe9327d-5fd6-49f0-834f-e60cbc9edf7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111474 Nov 02 13:53:24.043680 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1595/2647] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:24.049653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:24.055744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:24.066873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.069646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.073033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.078093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.079071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.082341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.161249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:24.192105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:24.363776 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a145576e-f585-4995-a22f-242557a7eebc tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 204 len: 0 microversion: 2.1 time: 0.318310 Nov 02 13:53:24.368272 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1596/2648] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:24 2022] DELETE /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:24.371228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:24.382563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: e10dac4d-1a3c-4a92-aba3-ffdf8632eca3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:24.411362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.412085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.423010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.424753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.425471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.426381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.457501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] HTTP exception thrown: Instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 could not be found. Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Request method failure captured: Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 HTTP/1.1 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXLWFwpjc_oMxfRXCE0bbjDETjH2WHQrLb24ADZg0EccU3j-qjXkIYIbDn202DWjXmFaN3wsk9aMBl7c1v9BXJZ8w-2LNV_daO2DrAI8QA-RjhyLzabufI0-HT2v33vd4L4QW9CxZ1ZiHAkkpjTjgxmjQsKAxdj5OhNyfq9VLzVWwI Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 748df3d8b6a94b40ab6485773004af9a Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerRescueTestJSON-1137343004 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/748df3d8b6a94b40ab6485773004af9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/748df3d8b6a94b40ab6485773004af9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/748df3d8b6a94b40ab6485773004af9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_748df3d8b6a94b40ab6485773004af9a"}]}] Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerRescueTestJSON-1137343004 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 748df3d8b6a94b40ab6485773004af9a Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerRescueTestJSON-1137343004 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerRescueTestJSON-1137343004-project Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7c39b0225f0f4321a131fa6fc991aaa6 Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerRescueTestJSON-1137343004-project Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 could not be found. Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e10dac4d-1a3c-4a92-aba3-ffdf8632eca3'} Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 could not be found. Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 could not be found. Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:24.465446 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 could not be found. Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:24.469588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Returning 404 to user: Instance e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:24.475160 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1968ba70-493a-41b8-a972-e16653743c80 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3" status: 404 len: 111 microversion: 2.1 time: 0.107894 Nov 02 13:53:24.479662 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1597/2649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:24 2022] GET /compute/v2.1/servers/e10dac4d-1a3c-4a92-aba3-ffdf8632eca3 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:24.491299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:24.500319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:24.511998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.512880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.513533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.515116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.518587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.519215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.698109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:24.713591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d88e84ab-d5c2-4cdd-8f24-422a0c482e58 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1613 microversion: 2.1 time: 0.234541 Nov 02 13:53:24.714836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1598/2650] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:24 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1613 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:24.733683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:24.734561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:24.749394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.750123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.750714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.751654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.752460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.753051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:25.531470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:25.547912 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abd2759d-2b11-40e3-b97d-13a0039e8164 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1469 microversion: 2.1 time: 0.829074 Nov 02 13:53:25.564465 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1599/2651] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:24 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1469 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:25.579564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:25.581572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:25.598050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:25.601177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:25.605365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:25.608051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:25.609670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:25.614012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:25.714112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:25.944605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c98f1102-bff3-43f5-82df-82d1f42a96ff tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 204 len: 0 microversion: 2.1 time: 0.375924 Nov 02 13:53:25.951033 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1600/2652] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:25 2022] DELETE /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:25.962755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-826c085a-1a09-4294-a15e-236a52a7fafd req-ff949b4e-7834-4f53-89fa-6a92bce16334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c69f7b-9be3-4d3c-8450-33cd24a4bf94", "name": "network-vif-plugged", "status": "completed", "tag": "2430de1d-66f2-479a-a957-73361c2e5202"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:25.977137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-826c085a-1a09-4294-a15e-236a52a7fafd req-ff949b4e-7834-4f53-89fa-6a92bce16334 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:25.978056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-826c085a-1a09-4294-a15e-236a52a7fafd req-ff949b4e-7834-4f53-89fa-6a92bce16334 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:25.979258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-826c085a-1a09-4294-a15e-236a52a7fafd req-ff949b4e-7834-4f53-89fa-6a92bce16334 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:26.000253 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-826c085a-1a09-4294-a15e-236a52a7fafd req-ff949b4e-7834-4f53-89fa-6a92bce16334 service nova] Creating event network-vif-plugged:2430de1d-66f2-479a-a957-73361c2e5202 for instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 on n-h2-858238-3 Nov 02 13:53:26.007487 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-826c085a-1a09-4294-a15e-236a52a7fafd req-ff949b4e-7834-4f53-89fa-6a92bce16334 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051023 Nov 02 13:53:26.009443 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1601/2653] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:26.015764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:26.016804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:26.026038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:26.026864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:26.027709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:26.029545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:26.030772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:26.031633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.382097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:27.396024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc2d3cb7-b0c7-413f-9a07-0e74698df6a5 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1317 microversion: 2.1 time: 1.385101 Nov 02 13:53:27.416569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1602/2654] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:26 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1317 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:27.431472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:27.433138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:27.452483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.453380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.454040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.456838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.459310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.460279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.552932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.553831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.554783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.555652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lazy-loading 'fault' on Instance uuid 8b902d64-9d83-4e25-a97d-2b0d4d18f55a {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:53:27.815629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0feddb832f4d71a0e3e8dafa40e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5ef8da09024e678c3fccd39cac0f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:27.826468 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffd1a08f-932f-4705-9702-06c0e0296e69 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 200 len: 1332 microversion: 2.1 time: 0.406682 Nov 02 13:53:27.829574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1603/2655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:27 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 1332 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:27.847886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:27.848991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:27.869475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.870441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.871079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.872086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.872704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.873384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.464166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c39b0225f0f4321a131fa6fc991aaa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748df3d8b6a94b40ab6485773004af9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:29.480065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c60c9eb-0334-458b-934f-b04c65268c07 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 200 len: 1492 microversion: 2.1 time: 1.647817 Nov 02 13:53:29.480660 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1604/2656] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:27 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 1492 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:29.499656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3f0b4aaa-f116-4484-b08c-de66b9166a4f req-62eb26f5-601b-4e17-befd-fcc9750b3e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b902d64-9d83-4e25-a97d-2b0d4d18f55a", "name": "network-vif-deleted", "tag": "2e0259a1-15e1-4364-9957-55f03aac23ed"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:29.513951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3f0b4aaa-f116-4484-b08c-de66b9166a4f req-62eb26f5-601b-4e17-befd-fcc9750b3e45 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.514732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3f0b4aaa-f116-4484-b08c-de66b9166a4f req-62eb26f5-601b-4e17-befd-fcc9750b3e45 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.515502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3f0b4aaa-f116-4484-b08c-de66b9166a4f req-62eb26f5-601b-4e17-befd-fcc9750b3e45 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.534513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3f0b4aaa-f116-4484-b08c-de66b9166a4f req-62eb26f5-601b-4e17-befd-fcc9750b3e45 service nova] Creating event network-vif-deleted:2e0259a1-15e1-4364-9957-55f03aac23ed for instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a on n-h2-858238-3 Nov 02 13:53:29.543376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3f0b4aaa-f116-4484-b08c-de66b9166a4f req-62eb26f5-601b-4e17-befd-fcc9750b3e45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055295 Nov 02 13:53:29.546246 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1605/2657] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:29.556017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:29.559948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:29.581126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.582057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.582715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.583812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.584555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.585507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.057811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4365b97ccc164db49191820f75700768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70727044d5314b13bd03fb9998914886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:30.077307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed77939c-b445-4fee-9f5a-e1d76127b529 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 200 len: 1469 microversion: 2.1 time: 0.525092 Nov 02 13:53:30.079872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1606/2658] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:29 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 1469 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:30.097476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:30.100595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:30.144616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.145580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.149203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.150290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.151081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.151747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.717418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:30.731815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05f8f61e-9166-40e3-b4fb-be78e0d1bd97 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1507 microversion: 2.1 time: 0.650522 Nov 02 13:53:30.732532 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1607/2659] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:30 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1507 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:30.745416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:30.747249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] [instance: 8b902d64-9d83-4e25-a97d-2b0d4d18f55a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:30.765082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.766060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.767150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.768332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.775759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.776934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.815841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] HTTP exception thrown: Instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a could not be found. Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Request method failure captured: Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a HTTP/1.1 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWUBBgr6AY5w00fkd1ML8Ohw9yPw5PpJTuh7eyzlilYKaFrkr2YEEL07MnjXLgMlEFQtJfKVJqbqjXml_CL3Tk8E9ky-aRAeLV8yak6XeR5l6wYeCrnrW8NQdDNApyDSJZp7cYzcvhGtRzFNmxjCsu18E-l0A5hC1Z142iiRI9X1u4 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7a5ef8da09024e678c3fccd39cac0f35 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesAdminNegativeTest-597891330 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a5ef8da09024e678c3fccd39cac0f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a5ef8da09024e678c3fccd39cac0f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a5ef8da09024e678c3fccd39cac0f35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a5ef8da09024e678c3fccd39cac0f35"}]}] Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesAdminNegativeTest-597891330 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7a5ef8da09024e678c3fccd39cac0f35 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-597891330 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesAdminNegativeTest-597891330-project Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ab0feddb832f4d71a0e3e8dafa40e017 Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesAdminNegativeTest-597891330-project Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a could not be found. Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8b902d64-9d83-4e25-a97d-2b0d4d18f55a'} Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a could not be found. Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a could not be found. Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:30.818138 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a could not be found. Nov 02 13:53:30.822760 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:30.824818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Returning 404 to user: Instance 8b902d64-9d83-4e25-a97d-2b0d4d18f55a could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:30.826214 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6f3753d8-6d22-47d1-a836-20fe8231d46d tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a" status: 404 len: 111 microversion: 2.1 time: 0.091784 Nov 02 13:53:30.827120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1608/2660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:30 2022] GET /compute/v2.1/servers/8b902d64-9d83-4e25-a97d-2b0d4d18f55a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:31.121023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48f88e3f-5d39-400a-a8f6-ca4e771a8d23 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Action: 'create', calling method: .version_select at 0x7f6f81d18c10>, body: {"pool": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:34.118099 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48f88e3f-5d39-400a-a8f6-ca4e771a8d23 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.289341 Nov 02 13:53:34.128290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1609/2661] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:53:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:34.135971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:34.139598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] [instance: f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:34.147763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.148585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.149252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.150530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.151540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.152167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.176910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] HTTP exception thrown: Instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee could not be found. Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Request method failure captured: Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee HTTP/1.1 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnXLWFwpjc_oMxfRXCE0bbjDETjH2WHQrLb24ADZg0EccU3j-qjXkIYIbDn202DWjXmFaN3wsk9aMBl7c1v9BXJZ8w-2LNV_daO2DrAI8QA-RjhyLzabufI0-HT2v33vd4L4QW9CxZ1ZiHAkkpjTjgxmjQsKAxdj5OhNyfq9VLzVWwI Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 748df3d8b6a94b40ab6485773004af9a Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerRescueTestJSON-1137343004 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/748df3d8b6a94b40ab6485773004af9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/748df3d8b6a94b40ab6485773004af9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/748df3d8b6a94b40ab6485773004af9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_748df3d8b6a94b40ab6485773004af9a"}]}] Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerRescueTestJSON-1137343004 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 748df3d8b6a94b40ab6485773004af9a Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerRescueTestJSON-1137343004 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerRescueTestJSON-1137343004-project Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7c39b0225f0f4321a131fa6fc991aaa6 Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerRescueTestJSON-1137343004-project Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee could not be found. Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee'} Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee could not be found. Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee could not be found. Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:34.178923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee could not be found. Nov 02 13:53:34.183510 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.186565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] Returning 404 to user: Instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:34.187824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b2d9b21-461e-41d0-a9f2-4c0b41596543 tempest-ServerRescueTestJSON-1137343004 tempest-ServerRescueTestJSON-1137343004-project] 10.222.0.18 "GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee" status: 404 len: 111 microversion: 2.1 time: 0.057140 Nov 02 13:53:34.188607 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1610/2662] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:34 2022] GET /compute/v2.1/servers/f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:34.195196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-811e3d7c-d4d8-4211-b4b4-dde78353e85e req-f0004e0a-20fd-4383-b791-e070a5ddc5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6a104e0-ddd0-44e7-9126-78323a78fd75", "name": "network-vif-deleted", "tag": "07a15f13-39ba-4415-b8bf-e6a87bf46a50"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:34.206926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-811e3d7c-d4d8-4211-b4b4-dde78353e85e req-f0004e0a-20fd-4383-b791-e070a5ddc5be service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.207644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-811e3d7c-d4d8-4211-b4b4-dde78353e85e req-f0004e0a-20fd-4383-b791-e070a5ddc5be service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.208286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-811e3d7c-d4d8-4211-b4b4-dde78353e85e req-f0004e0a-20fd-4383-b791-e070a5ddc5be service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.222877 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-811e3d7c-d4d8-4211-b4b4-dde78353e85e req-f0004e0a-20fd-4383-b791-e070a5ddc5be service nova] Creating event network-vif-deleted:07a15f13-39ba-4415-b8bf-e6a87bf46a50 for instance d6a104e0-ddd0-44e7-9126-78323a78fd75 on n-h2-858238-3 Nov 02 13:53:34.232457 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-811e3d7c-d4d8-4211-b4b4-dde78353e85e req-f0004e0a-20fd-4383-b791-e070a5ddc5be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041749 Nov 02 13:53:34.234818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1611/2663] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:34.244619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:34.245690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:34.259713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.260553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.261277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.262226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.262880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.263543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.824160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:34.845319 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c56d07dc-b4f3-4173-9ae5-d2185389297b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1507 microversion: 2.1 time: 0.603106 Nov 02 13:53:34.845993 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1612/2664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:34 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:34.860397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f911eb79-90f1-4cd8-8ba4-8c55882806f8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] Calling method '.version_select at 0x7f6f81f8ddc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:34.900014 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f911eb79-90f1-4cd8-8ba4-8c55882806f8 tempest-VolumesAdminNegativeTest-597891330 tempest-VolumesAdminNegativeTest-597891330-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996652892" status: 202 len: 0 microversion: 2.1 time: 0.050201 Nov 02 13:53:34.903456 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1613/2665] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 13:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996652892 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:53:34.916816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:34.917707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: d6a104e0-ddd0-44e7-9126-78323a78fd75] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:34.930122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.930624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.931065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.931813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.932278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.932728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.969777 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] HTTP exception thrown: Instance d6a104e0-ddd0-44e7-9126-78323a78fd75 could not be found. Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Request method failure captured: Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 HTTP/1.1 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWcnxR38jw-oIz4RoAwDZUQrqDC3lqB8miCEA8xmB3bMhV6mYBPLJx07Z9O8_chHzHQRJ4arfBew-Eu0VoJBsB3VwWht9kr9mliIeVXjJB_La6eLOwaar62Rigu5blqdgYjVRj3W8URbcbqDPoPSmgIxW-dVQEAaeqKnr6XfWBXpb0 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 70727044d5314b13bd03fb9998914886 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70727044d5314b13bd03fb9998914886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70727044d5314b13bd03fb9998914886"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70727044d5314b13bd03fb9998914886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70727044d5314b13bd03fb9998914886"}]}] Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 70727044d5314b13bd03fb9998914886 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminTestJSON-1647094519-project Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 4365b97ccc164db49191820f75700768 Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminTestJSON-1647094519-project Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d6a104e0-ddd0-44e7-9126-78323a78fd75 could not be found. Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd6a104e0-ddd0-44e7-9126-78323a78fd75'} Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6a104e0-ddd0-44e7-9126-78323a78fd75 could not be found. Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6a104e0-ddd0-44e7-9126-78323a78fd75 could not be found. Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:34.978333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6a104e0-ddd0-44e7-9126-78323a78fd75 could not be found. Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Returning 404 to user: Instance d6a104e0-ddd0-44e7-9126-78323a78fd75 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17afab87-87cd-4f4d-ae18-eb90052257aa tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75" status: 404 len: 111 microversion: 2.1 time: 0.075807 Nov 02 13:53:34.982209 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1614/2666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:34 2022] GET /compute/v2.1/servers/d6a104e0-ddd0-44e7-9126-78323a78fd75 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:34.988042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d93c49cd-b9e8-465d-a889-afe5141de698 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Action: 'create', calling method: .version_select at 0x7f6f81b41a60>, body: {"pool": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:38.760551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d93c49cd-b9e8-465d-a889-afe5141de698 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.777308 Nov 02 13:53:38.762264 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1615/2667] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:53:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:38.768914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:38.772387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:38.780389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:38.781228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:38.781837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:38.782695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:38.783332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:38.784786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:38.948949 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-657beffd-b7bd-43e4-9c0e-36ad7550162d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "PUT /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1079 microversion: 2.1 time: 0.184340 Nov 02 13:53:38.950435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1616/2668] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 13:53:38 2022] PUT /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1079 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:38.979279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:38.980446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:38.995423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:38.997060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:38.998830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:39.000354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:39.001422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:39.002313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:39.072975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:39.079898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:39.251565 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c04efc37-b76e-43bc-acd6-24fe71fc54a9 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "DELETE /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 204 len: 0 microversion: 2.1 time: 0.298690 Nov 02 13:53:39.257897 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1617/2669] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:53:38 2022] DELETE /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:39.287889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6540cd49-d75d-4947-9a1b-43148ac456a7 req-150044fc-88a3-4e32-a209-2b41fe53884c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee", "name": "network-vif-deleted", "tag": "94ece405-8a09-4e25-a2db-63a08dbc9ea2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:39.320127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6540cd49-d75d-4947-9a1b-43148ac456a7 req-150044fc-88a3-4e32-a209-2b41fe53884c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:39.323565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6540cd49-d75d-4947-9a1b-43148ac456a7 req-150044fc-88a3-4e32-a209-2b41fe53884c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:39.323813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6540cd49-d75d-4947-9a1b-43148ac456a7 req-150044fc-88a3-4e32-a209-2b41fe53884c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:39.354957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6540cd49-d75d-4947-9a1b-43148ac456a7 req-150044fc-88a3-4e32-a209-2b41fe53884c service nova] Creating event network-vif-deleted:94ece405-8a09-4e25-a2db-63a08dbc9ea2 for instance f3cd5fc8-4796-49e1-ad1b-14c6f1ae1bee on n-h1-858238-3 Nov 02 13:53:39.360567 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6540cd49-d75d-4947-9a1b-43148ac456a7 req-150044fc-88a3-4e32-a209-2b41fe53884c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100372 Nov 02 13:53:39.361432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1618/2670] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:39.368319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6489567d-c993-4190-89dd-77f4980cc03a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Action: 'create', calling method: .version_select at 0x7f6f819e1820>, body: {"keypair": {"name": "tempest-keypair-1169287765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5EDoUN9+WsXIwi10bHkA8be3Q5O/6CYEUNjznA6VA1kXm4kpgIBITd8QjQy2HzEVZMk3pvNpY16kYi9DcFiJsAzX/Uqrgn8bWsKSQPVyVMipLeV77TftDVGQUgs0RjWQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:39.400368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6489567d-c993-4190-89dd-77f4980cc03a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Getting quotas for project a061e7652b484d27aaf87a4292d768b3. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:39.407628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6489567d-c993-4190-89dd-77f4980cc03a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Getting quotas for user 68a2110734234d558e003a528ee60652 and project a061e7652b484d27aaf87a4292d768b3. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:39.459891 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6489567d-c993-4190-89dd-77f4980cc03a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.096781 Nov 02 13:53:39.477088 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1619/2671] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 13:53:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:53:39.488854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b16b36f3-1a40-4aa2-9b57-fec5692e727b tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Action: 'create', calling method: .version_select at 0x7f6f81af1700>, body: {"pool": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:46.470551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b16b36f3-1a40-4aa2-9b57-fec5692e727b tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.992310 Nov 02 13:53:46.471200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1620/2672] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:53:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:46.484737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:46.485833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:46.494582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:46.495603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:46.496265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:46.497210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:46.497741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:46.498396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:46.912858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:46.939933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4934aae-7ad2-4a86-9c48-44c056af879f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1505 microversion: 2.1 time: 0.459078 Nov 02 13:53:46.941096 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1621/2673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:46 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:46.965542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:46.967235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] [instance: 25af852c-129a-41f4-858d-7ad75a66729c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:46.974848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:46.975713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:46.977076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:46.977979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:46.978743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:46.979775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:47.010484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] HTTP exception thrown: Instance 25af852c-129a-41f4-858d-7ad75a66729c could not be found. Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Request method failure captured: Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c HTTP/1.1 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnWcnxR38jw-oIz4RoAwDZUQrqDC3lqB8miCEA8xmB3bMhV6mYBPLJx07Z9O8_chHzHQRJ4arfBew-Eu0VoJBsB3VwWht9kr9mliIeVXjJB_La6eLOwaar62Rigu5blqdgYjVRj3W8URbcbqDPoPSmgIxW-dVQEAaeqKnr6XfWBXpb0 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 70727044d5314b13bd03fb9998914886 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70727044d5314b13bd03fb9998914886"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70727044d5314b13bd03fb9998914886"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70727044d5314b13bd03fb9998914886"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70727044d5314b13bd03fb9998914886"}]}] Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 70727044d5314b13bd03fb9998914886 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminTestJSON-1647094519 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminTestJSON-1647094519-project Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 4365b97ccc164db49191820f75700768 Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminTestJSON-1647094519-project Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 25af852c-129a-41f4-858d-7ad75a66729c could not be found. Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '25af852c-129a-41f4-858d-7ad75a66729c'} Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25af852c-129a-41f4-858d-7ad75a66729c could not be found. Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25af852c-129a-41f4-858d-7ad75a66729c could not be found. Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:53:47.012628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25af852c-129a-41f4-858d-7ad75a66729c could not be found. Nov 02 13:53:47.017301 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:53:47.020490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] Returning 404 to user: Instance 25af852c-129a-41f4-858d-7ad75a66729c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:53:47.021638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f48f75d7-e11c-41ed-8bf0-006855296ae0 tempest-ServersAdminTestJSON-1647094519 tempest-ServersAdminTestJSON-1647094519-project] 10.222.0.18 "GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c" status: 404 len: 111 microversion: 2.1 time: 0.079020 Nov 02 13:53:47.022768 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1622/2674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:46 2022] GET /compute/v2.1/servers/25af852c-129a-41f4-858d-7ad75a66729c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:53:47.029100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25af852c-129a-41f4-858d-7ad75a66729c", "name": "network-vif-deleted", "tag": "fc6bab7b-002c-48b1-86ac-3d691872d7eb"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:47.058510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:47.059739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:47.060626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:47.082539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] Creating event network-vif-deleted:fc6bab7b-002c-48b1-86ac-3d691872d7eb for instance 25af852c-129a-41f4-858d-7ad75a66729c on n-h2-858238-3 Nov 02 13:53:47.091388 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065791 Nov 02 13:53:47.093860 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1623/2675] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:47.099782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:47.102652 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2a354185-d3fd-45bf-a23d-7ec3a82e0c91 req-1bc5ed5c-2a88-46f1-9304-b9085e62cbf8 service nova] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003331 Nov 02 13:53:47.112552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1624/2676] 10.222.0.18 () {56 vars in 886 bytes} [Wed Nov 2 13:53:47 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:53:47.124329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-196dec26-6628-45bc-be2d-8bc05e873065 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Action: 'create', calling method: .version_select at 0x7f6f85d9eca0>, body: {"pool": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:49.422254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:50.648407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-196dec26-6628-45bc-be2d-8bc05e873065 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.533917 Nov 02 13:53:50.650229 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1625/2677] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:53:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:50.656742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:50.658771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:50.670427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:50.678827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:50.678827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:50.678827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:50.678827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:50.678827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:51.019171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:51.039409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-32ffdcad-f8cb-4eef-93e4-55eebf093d2b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1505 microversion: 2.1 time: 0.386245 Nov 02 13:53:51.040412 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1626/2678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:53:50 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:51.066893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-965899328", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f8135a3a-b826-4441-bd2b-18d07d7cd73e"}, {"port": "e628c554-a424-42a4-a210-e83675fa84e3", "tag": "port-1"}, {"port": "e0acb975-a97c-4b3a-946a-e5affc445ac5", "tag": "port-2"}, {"uuid": "04de15da-f208-4b62-ab37-94fceb48ee45", "tag": "net-1"}, {"uuid": "04de15da-f208-4b62-ab37-94fceb48ee45"}, {"uuid": "f0b7e163-152a-492a-a39e-064bf1adf444", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f0b7e163-152a-492a-a39e-064bf1adf444", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9a05efad-4539-4b6e-84ef-549bdb5fcad8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "540c3b1c-10c8-4d93-9033-c274daea86c1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3c727072-b08e-42e7-a96b-cb6d52d29eb2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1549451656"}], "key_name": "tempest-keypair-1169287765", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:51.311480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] validate_networks() for [('f8135a3a-b826-4441-bd2b-18d07d7cd73e', None, None, None, None, None), (None, None, 'e628c554-a424-42a4-a210-e83675fa84e3', None, None, None), (None, None, 'e0acb975-a97c-4b3a-946a-e5affc445ac5', None, None, None), ('04de15da-f208-4b62-ab37-94fceb48ee45', None, None, None, None, None), ('04de15da-f208-4b62-ab37-94fceb48ee45', None, None, None, None, None), ('f0b7e163-152a-492a-a39e-064bf1adf444', '10.2.2.100', None, None, None, None), ('f0b7e163-152a-492a-a39e-064bf1adf444', '10.2.2.200', None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:53:55.946425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:53:55.947010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:53:55.947767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:53:55.948896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:53:55.949535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:53:55.952529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:55.970113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.971544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.972360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.977000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.978582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.979908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.010391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Getting quotas for project a061e7652b484d27aaf87a4292d768b3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:56.022836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Getting quotas for user 68a2110734234d558e003a528ee60652 and project a061e7652b484d27aaf87a4292d768b3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:56.275004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:53:56.277843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9a05efad-4539-4b6e-84ef-549bdb5fcad8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='540c3b1c-10c8-4d93-9033-c274daea86c1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c727072-b08e-42e7-a96b-cb6d52d29eb2',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:53:56.851722 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60af66d4-50cb-4779-a7f4-0133d61e713b tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.808885 Nov 02 13:53:56.852680 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1627/2679] 10.222.0.18 () {62 vars in 1189 bytes} [Wed Nov 2 13:53:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 5811 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:53:57.344290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1842204185", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:57.486597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:53:58.638238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:53:58.639225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:53:58.639485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:53:58.640142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:53:58.640795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:53:58.674319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.675175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.678132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:58.679726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.683344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.686967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:58.747782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:58.781330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:58.844530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:53:58.849980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:53:58.961859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0d7a583-4ffb-4760-bab6-a0c9a881e3ae tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107848 Nov 02 13:53:58.973859 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1628/2680] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:53:58.980068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45d9b717-7cd8-43b9-9085-02bfdc03ab08 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f81d5a430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:59.740679 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45d9b717-7cd8-43b9-9085-02bfdc03ab08 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/b7244eab-f202-4dfe-9793-0f8845d5c55a" status: 200 len: 142 microversion: 2.1 time: 0.764994 Nov 02 13:53:59.741930 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1629/2681] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:53:58 2022] GET /compute/v2.1/os-floating-ips/b7244eab-f202-4dfe-9793-0f8845d5c55a => generated 142 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:59.746998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:59.759415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:59.772605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:59.773764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:59.774552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.775494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:59.776125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:59.776729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.908635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:53:59.909659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:53:59.911182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:53:59.926665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:53:59.930372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:00.158952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:00.168334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:00.169078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:00.169665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:00.170595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:00.171794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:00.172411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:00.221672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a43d475d-a192-490e-b088-fa2973fcca1b tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "POST /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94/action" status: 202 len: 1111 microversion: 2.1 time: 0.478537 Nov 02 13:54:00.222718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1630/2682] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:53:59 2022] POST /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94/action => generated 1111 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:54:00.725616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05b8d4ee-32f9-4b40-ba75-7c8fdad985ee tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] Calling method '.version_select at 0x7f6f821463a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:01.011682 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05b8d4ee-32f9-4b40-ba75-7c8fdad985ee tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.787740 Nov 02 13:54:01.012988 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1631/2683] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:54:00 2022] GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2/defaults => generated 371 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:01.333306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1568743480", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:01.462535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:03.820945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:03.822055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:03.822709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:03.823576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:03.824639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:03.836836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.838482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.839833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.840925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.841671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.842337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.862802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:03.868952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:03.888116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:03.890866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:03.943025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a42f565c-18a0-4b51-9281-a2e441856957 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.920912 Nov 02 13:54:03.944797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1632/2684] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:03.949979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:03.950848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:03.957377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.958331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.958928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.959855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.960463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.961038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.138142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.167124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.171792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.173222 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7dd3fd46-5b41-438d-9134-6e7c363b52e3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1593 microversion: 2.42 time: 0.227256 Nov 02 13:54:04.174289 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1633/2685] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:03 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1593 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:04.180064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:04.181009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:04.197655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.198153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.198598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.199374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.199831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.200257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.310580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.320651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8bb35811-07a6-43fd-bd83-21a7bebb17fc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1251 microversion: 2.1 time: 0.145050 Nov 02 13:54:04.336743 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1634/2686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:04 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1251 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:04.345929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-617ef341-714e-445f-8879-75c975a878b4 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f8241bee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:08.049945 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-617ef341-714e-445f-8879-75c975a878b4 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/b7244eab-f202-4dfe-9793-0f8845d5c55a" status: 202 len: 0 microversion: 2.1 time: 3.711967 Nov 02 13:54:08.051678 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1635/2687] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:54:04 2022] DELETE /compute/v2.1/os-floating-ips/b7244eab-f202-4dfe-9793-0f8845d5c55a => generated 0 bytes in 3714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:08.063378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:08.064113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:08.087953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:08.089677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:08.090653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:08.092931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:08.094383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:08.095917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:08.700460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:08.713951 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a708fff6-fb18-461e-8cc3-6d967b152204 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1516 microversion: 2.1 time: 0.654238 Nov 02 13:54:08.715313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1636/2688] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:08 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1516 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:08.723040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1085fce-ad92-4adc-857e-6080c1c4e6db tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] Calling method '.version_select at 0x7f6f81d2c8b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:09.125570 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a1085fce-ad92-4adc-857e-6080c1c4e6db tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2" status: 200 len: 371 microversion: 2.1 time: 0.401407 Nov 02 13:54:09.126908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1637/2689] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:54:08 2022] GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2 => generated 371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:09.340944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e19dc39f-7296-4e1e-a5a0-8cdde5662c30 tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:09.369884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e19dc39f-7296-4e1e-a5a0-8cdde5662c30 tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.238521 Nov 02 13:54:09.372575 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1638/2690] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:09.415182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:09.415821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:09.449366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.451248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.451855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.452825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.463134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.463924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.467265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:10.116191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:10.126891 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-922efd2c-9817-48d4-98d2-21024749439d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1315 microversion: 2.1 time: 0.751941 Nov 02 13:54:10.132152 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1639/2691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:09 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:10.151875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:10.152619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:10.167439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:10.168312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:10.179287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:10.180714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:10.181797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:10.182434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.015958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.033830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.036281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.040296 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7775ce92-0a0d-4b90-9895-6cd42ee91cdd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1708 microversion: 2.42 time: 0.905970 Nov 02 13:54:11.044907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1640/2692] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:10 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1708 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:11.056454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:11.059559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:11.075847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:11.079883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:11.084375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.086005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:11.088174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:11.089761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.675196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.686716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2061195b-d116-4a9e-9296-ef7449ba01b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1293 microversion: 2.1 time: 0.640017 Nov 02 13:54:11.692093 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1641/2693] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:11 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1293 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:11.698908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e03b0859-7364-49af-b5e9-dae651fe08a9 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f82257820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:12.186041 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e03b0859-7364-49af-b5e9-dae651fe08a9 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.492409 Nov 02 13:54:12.186951 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1642/2694] 10.222.0.18 () {58 vars in 1164 bytes} [Wed Nov 2 13:54:11 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:54:12.193189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae1ea445-da69-4c1b-8bb6-e7a59de0d26d tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] Calling method '.version_select at 0x7f6f81b72c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:12.349197 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae1ea445-da69-4c1b-8bb6-e7a59de0d26d tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.160579 Nov 02 13:54:12.350649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1643/2695] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:54:12 2022] GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2/defaults => generated 371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:12.360446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4bf97ec9-f795-46d9-be0d-3b7d62a33504 req-1a728bfe-161b-4f63-ad91-299a189f9133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2484fac4-a923-4c3a-870c-0acfc7e9f715", "tag": "036fa077-dddc-42a0-b34a-402097028dce"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:12.380356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4bf97ec9-f795-46d9-be0d-3b7d62a33504 req-1a728bfe-161b-4f63-ad91-299a189f9133 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.381956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4bf97ec9-f795-46d9-be0d-3b7d62a33504 req-1a728bfe-161b-4f63-ad91-299a189f9133 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.382719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4bf97ec9-f795-46d9-be0d-3b7d62a33504 req-1a728bfe-161b-4f63-ad91-299a189f9133 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:12.424850 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4bf97ec9-f795-46d9-be0d-3b7d62a33504 req-1a728bfe-161b-4f63-ad91-299a189f9133 service nova] Creating event network-changed:036fa077-dddc-42a0-b34a-402097028dce for instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 on n-h1-858238-3 Nov 02 13:54:12.438087 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4bf97ec9-f795-46d9-be0d-3b7d62a33504 req-1a728bfe-161b-4f63-ad91-299a189f9133 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085795 Nov 02 13:54:12.440139 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1644/2696] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:12.452682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:12.454811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:12.463254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.464089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.464742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:12.465669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.466320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.466955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:13.485954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:13.495625 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46fbb56c-8074-4ba6-a771-b320ec65a26c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1516 microversion: 2.1 time: 1.053908 Nov 02 13:54:13.496634 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1645/2697] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:12 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1516 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:13.504549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebadf014-d36e-4420-9281-93f311cd65cd tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1344580369", "imageRef": "c845f9fe-240b-4e20-ae4e-b8e196a80014", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:13.572387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-ebadf014-d36e-4420-9281-93f311cd65cd tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:13.852744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:15.072419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ebadf014-d36e-4420-9281-93f311cd65cd tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebadf014-d36e-4420-9281-93f311cd65cd tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] Request method failure captured: Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 143 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZ7sRSaN9UEfOKiD7RhNo5JuMFbjzE5OPUv4sK_xS--PYwdSLDYdWR_h1FkM9Az9J1oja46aAx8VrWyZRGlG-XUbNBRMJGh9MlECgquQrGPjyug_b9oWrnIkIJn8z1kSRtN42pq8c-3rjuFzbLgtzR0QpnkkzlB2h5JeAcV496KZWY Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2fd5beaa124142d19018f80165796613 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FlavorsV2NegativeTest-793520921 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2fd5beaa124142d19018f80165796613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2fd5beaa124142d19018f80165796613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2fd5beaa124142d19018f80165796613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2fd5beaa124142d19018f80165796613"}]}] Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FlavorsV2NegativeTest-793520921 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2fd5beaa124142d19018f80165796613 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-793520921 Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FlavorsV2NegativeTest-793520921-project Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3d64718ad8ee4de6b7ce9cc62fa55e8e Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FlavorsV2NegativeTest-793520921-project Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1344580369", "imageRef": "c845f9fe-240b-4e20-ae4e-b8e196a80014", "flavorRef": "452"}} Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: exception: Flavor's memory is too small for requested image. Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1344580369', 'imageRef': 'c845f9fe-240b-4e20-ae4e-b8e196a80014', 'flavorRef': '452'}}} Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:54:15.075547 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 13:54:15.080367 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:15.085221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebadf014-d36e-4420-9281-93f311cd65cd tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:15.086695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ebadf014-d36e-4420-9281-93f311cd65cd tempest-FlavorsV2NegativeTest-793520921 tempest-FlavorsV2NegativeTest-793520921-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.588537 Nov 02 13:54:15.087504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1646/2698] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:13 2022] POST /compute/v2.1/servers => generated 93 bytes in 1590 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:54:15.118146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:15.119532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:15.148834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:15.150337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:15.152550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:15.156479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:15.157122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:15.157558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:15.860680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:15.912667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d7a71fa-8f46-4ecf-aed3-0d30c613bdf3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1315 microversion: 2.1 time: 0.821753 Nov 02 13:54:15.920866 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1647/2699] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:15 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:15.935501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:15.936648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:15.978527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:15.979775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:15.982853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:15.984198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:15.985046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:15.988028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:16.729535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:16.750852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:16.762164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:16.764471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e96419f-7e97-4941-b9d4-af6abba786f3 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1802 microversion: 2.42 time: 0.842203 Nov 02 13:54:16.766605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1648/2700] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:15 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1802 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:16.799889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-401a045e-5f45-4895-9f0c-3a3e7d35a7a5 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f823b9160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:18.109025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-401a045e-5f45-4895-9f0c-3a3e7d35a7a5 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.327065 Nov 02 13:54:18.111587 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1649/2701] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 13:54:16 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:18.121712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d03d0e3-8fdd-497b-8547-1c2856a2773a tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] Calling method '.version_select at 0x7f6f81be2430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:18.777272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d03d0e3-8fdd-497b-8547-1c2856a2773a tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2" status: 200 len: 371 microversion: 2.1 time: 0.664294 Nov 02 13:54:18.789545 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1650/2702] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 13:54:18 2022] GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2 => generated 371 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:18.794568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:18.809928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:18.837978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:18.838640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:18.839129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:18.839893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:18.840357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:18.840791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:19.181085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:19.205671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e939c79-26bf-4b86-be69-2ef61e85fc05 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1293 microversion: 2.1 time: 0.414843 Nov 02 13:54:19.206219 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1651/2703] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:18 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:19.211138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:19.217710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:19.246610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:19.247386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:19.248179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:19.249202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:19.250942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:19.254258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:19.768049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:19.785782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55b32f01-c0dc-4e40-9da0-c801ca06fef7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1522 microversion: 2.1 time: 0.578213 Nov 02 13:54:19.787349 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1652/2704] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:19 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:19.799541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-10f3c2a7-5bc4-4288-967c-5211f3e5ebe4 req-e7cdd15c-e1a1-4a0e-b160-943170f66505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135c9b2c-85e9-4a6e-b482-859be2c3201e", "tag": "80e0e160-ac89-4a84-8fa9-ebb6b875c3a8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:19.818582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-10f3c2a7-5bc4-4288-967c-5211f3e5ebe4 req-e7cdd15c-e1a1-4a0e-b160-943170f66505 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:19.819363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-10f3c2a7-5bc4-4288-967c-5211f3e5ebe4 req-e7cdd15c-e1a1-4a0e-b160-943170f66505 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:19.819977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-10f3c2a7-5bc4-4288-967c-5211f3e5ebe4 req-e7cdd15c-e1a1-4a0e-b160-943170f66505 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:19.838582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-10f3c2a7-5bc4-4288-967c-5211f3e5ebe4 req-e7cdd15c-e1a1-4a0e-b160-943170f66505 service nova] Creating event network-changed:80e0e160-ac89-4a84-8fa9-ebb6b875c3a8 for instance 135c9b2c-85e9-4a6e-b482-859be2c3201e on n-h2-858238-3 Nov 02 13:54:19.844874 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-10f3c2a7-5bc4-4288-967c-5211f3e5ebe4 req-e7cdd15c-e1a1-4a0e-b160-943170f66505 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055600 Nov 02 13:54:19.846022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1653/2705] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:19.853000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:19.865180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:19.877717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:19.878572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:19.879522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:19.887730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:19.888461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:19.889065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:20.664290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:20.695390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-863c47ed-f861-4334-baed-348a4ef5aed7 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1315 microversion: 2.1 time: 0.847258 Nov 02 13:54:20.695980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1654/2706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:19 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:20.712876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:20.713606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:20.735522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:20.736028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:20.739336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:20.741250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:20.741730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:20.747053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:21.276375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:21.291161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:21.297544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:21.298751 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcc562b1-675b-457c-8dc2-bf9aadb4c322 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1849 microversion: 2.42 time: 0.601820 Nov 02 13:54:21.299649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1655/2707] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:20 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1849 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:21.310920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41419ad8-5a1a-4b75-86e6-db33343aed7e tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f81fdbaf0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:25.098545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41419ad8-5a1a-4b75-86e6-db33343aed7e tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/673bb9f0-6e33-4dfb-8b64-6a27376ca556" status: 202 len: 0 microversion: 2.1 time: 3.794349 Nov 02 13:54:25.103656 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1656/2708] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:54:21 2022] DELETE /compute/v2.1/os-floating-ips/673bb9f0-6e33-4dfb-8b64-6a27376ca556 => generated 0 bytes in 3803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:25.108999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-71c6bc52-5f5a-4950-b3f2-dc87a314a609 req-68c2ba3c-245f-4f89-b81f-37709882d300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2484fac4-a923-4c3a-870c-0acfc7e9f715", "name": "network-vif-plugged", "status": "completed", "tag": "036fa077-dddc-42a0-b34a-402097028dce"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:25.142448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71c6bc52-5f5a-4950-b3f2-dc87a314a609 req-68c2ba3c-245f-4f89-b81f-37709882d300 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:25.143332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71c6bc52-5f5a-4950-b3f2-dc87a314a609 req-68c2ba3c-245f-4f89-b81f-37709882d300 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:25.144590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71c6bc52-5f5a-4950-b3f2-dc87a314a609 req-68c2ba3c-245f-4f89-b81f-37709882d300 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:25.178710 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-71c6bc52-5f5a-4950-b3f2-dc87a314a609 req-68c2ba3c-245f-4f89-b81f-37709882d300 service nova] Creating event network-vif-plugged:036fa077-dddc-42a0-b34a-402097028dce for instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 on n-h1-858238-3 Nov 02 13:54:25.192365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-71c6bc52-5f5a-4950-b3f2-dc87a314a609 req-68c2ba3c-245f-4f89-b81f-37709882d300 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087105 Nov 02 13:54:25.195150 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1657/2709] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:25.208465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-134e9450-de72-4e41-90b4-11db1d5fe207 tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] Calling method '.version_select at 0x7f6f81b41670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:25.467056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:25.476116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=23 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:25.589318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-134e9450-de72-4e41-90b4-11db1d5fe207 tempest-QuotasTestJSON-1279065869 tempest-QuotasTestJSON-1279065869-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2?user_id=0799f7697ec84725ac35a3d568069c21" status: 200 len: 371 microversion: 2.1 time: 0.388458 Nov 02 13:54:25.608819 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1658/2710] 10.222.0.18 () {58 vars in 1323 bytes} [Wed Nov 2 13:54:25 2022] GET /compute/v2.1/os-quota-sets/f62cc3c240bb40fd8096ca1506c6b0b2?user_id=0799f7697ec84725ac35a3d568069c21 => generated 371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:25.628705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:25.630307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:25.642523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:25.643402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:25.644093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:25.646245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:25.649622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:25.650810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.148431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:26.160490 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c72436a8-1006-4c5b-9730-b16e36ffaa54 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1293 microversion: 2.1 time: 0.549580 Nov 02 13:54:26.168469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1659/2711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:25 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1293 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:26.170378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:26.176769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:26.195259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.199528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.200148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.201367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.209789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.210643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.369213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:27.400541 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7075ab7-7e18-48e0-ae65-00c9591b9f61 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1522 microversion: 2.1 time: 1.233972 Nov 02 13:54:27.416343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1660/2712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:26 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1522 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:27.424285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:27.425098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:27.437909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.438704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.439349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.448179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.448928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.449510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.885197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:27.897230 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e3f7a4e8-d528-4e08-98af-cf5880a92d8d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1315 microversion: 2.1 time: 0.477833 Nov 02 13:54:27.917672 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1661/2713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:27 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:27.923402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:27.924351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:27.931601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.932756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.933426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.934747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.935750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.936415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:28.542958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:28.558602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:28.562477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:28.566391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b64cdd1-2582-4f50-a560-cb33eb879e0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1891 microversion: 2.42 time: 0.647196 Nov 02 13:54:28.567642 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1662/2714] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:27 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1891 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:28.575323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e294c78b-e3aa-4986-83fe-34e1ad1d0edf req-97159c55-bbff-4517-b6ae-00eb0cdd5ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "ebfa19ed-8088-41a6-92e6-19f7b9b8fac5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:28.603724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e294c78b-e3aa-4986-83fe-34e1ad1d0edf req-97159c55-bbff-4517-b6ae-00eb0cdd5ba2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:28.606346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e294c78b-e3aa-4986-83fe-34e1ad1d0edf req-97159c55-bbff-4517-b6ae-00eb0cdd5ba2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:28.608185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e294c78b-e3aa-4986-83fe-34e1ad1d0edf req-97159c55-bbff-4517-b6ae-00eb0cdd5ba2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:28.633593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e294c78b-e3aa-4986-83fe-34e1ad1d0edf req-97159c55-bbff-4517-b6ae-00eb0cdd5ba2 service nova] Creating event network-changed:ebfa19ed-8088-41a6-92e6-19f7b9b8fac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:28.677997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e294c78b-e3aa-4986-83fe-34e1ad1d0edf req-97159c55-bbff-4517-b6ae-00eb0cdd5ba2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106852 Nov 02 13:54:28.679804 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1663/2715] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:28.690708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4fd30af3-a72b-4731-9afe-d8ba2803ab2b tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f81957c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:31.434008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4fd30af3-a72b-4731-9afe-d8ba2803ab2b tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/6e14c2a1-0825-4bda-b540-5016272d9ad5" status: 202 len: 0 microversion: 2.1 time: 2.752405 Nov 02 13:54:31.434839 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1664/2716] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:54:28 2022] DELETE /compute/v2.1/os-floating-ips/6e14c2a1-0825-4bda-b540-5016272d9ad5 => generated 0 bytes in 2754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:31.442377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:31.443547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:31.454564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.455381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.456312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.457648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.458637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.459397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.734843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:31.755427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad491264-1ea7-4516-aeed-c2bcb57cd1a1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1475 microversion: 2.1 time: 0.319155 Nov 02 13:54:31.756944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1665/2717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:31 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1475 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:31.762271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c69f7b-9be3-4d3c-8450-33cd24a4bf94", "name": "network-vif-plugged", "status": "completed", "tag": "2430de1d-66f2-479a-a957-73361c2e5202"}, {"server_uuid": "135c9b2c-85e9-4a6e-b482-859be2c3201e", "name": "network-vif-plugged", "status": "completed", "tag": "80e0e160-ac89-4a84-8fa9-ebb6b875c3a8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:31.775576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.776463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.777261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.807998 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] Creating event network-vif-plugged:2430de1d-66f2-479a-a957-73361c2e5202 for instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 on n-h2-858238-3 Nov 02 13:54:31.808889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] Creating event network-vif-plugged:80e0e160-ac89-4a84-8fa9-ebb6b875c3a8 for instance 135c9b2c-85e9-4a6e-b482-859be2c3201e on n-h2-858238-3 Nov 02 13:54:31.817666 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ac8eac2f-de5c-4dfb-b495-5c376bbdda27 req-7f5c0111-6658-4312-a3a6-c3dd7747b385 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058781 Nov 02 13:54:31.824916 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1666/2718] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:31.832109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:31.833083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:31.856041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.857084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.857774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.859606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.865087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.866046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.879165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:32.404985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:32.421168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eeb6d454-a769-4faa-8dba-76336ca0e711 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1522 microversion: 2.1 time: 0.594306 Nov 02 13:54:32.439683 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1667/2719] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:31 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:32.668725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22be9069-7781-404c-838b-9acf7697e874 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Action: 'create', calling method: .version_select at 0x7f6f81d5ae50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1667860682", "metadata": {"Type": "work"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22be9069-7781-404c-838b-9acf7697e874 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Request method failure captured: Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 122 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaUv10fg8zHxH33JCRkNxe7r4JRBHF0dYwX7vDunmItdAKrcYBFnLWbegUukJoU1XFvukkwWdarGGUEdVYazZ-W_aEKW0tjx0FOl1fQLJN2GpPXbYKog2NxhhJOibWUJQGSTUuLE8iubhKyk0CeTqCktCf8XmzexzZZ3UFgMXyj_TQ Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/207d8199089544109f860f4459ba927b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_207d8199089544109f860f4459ba927b"}]}] Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 365cdc988b6849649974cfcad3ab624d Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1667860682", "metadata": {"Type": "work"}}} Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1667860682', 'metadata': {'Type': 'work'}}}} Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:54:32.676377 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:54:32.682364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:32.685262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22be9069-7781-404c-838b-9acf7697e874 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:32.686375 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22be9069-7781-404c-838b-9acf7697e874 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.244831 Nov 02 13:54:32.687165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1668/2720] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 13:54:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:54:32.711671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:32.712620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:32.722985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:32.725829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:32.726506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:32.727463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:32.728231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:32.728658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.063819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:33.077107 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ebd90e8-1435-4a74-be68-13bef17e0499 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1315 microversion: 2.1 time: 0.388692 Nov 02 13:54:33.081159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1669/2721] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:32 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:33.100284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:33.104058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:33.121242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.123289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.124478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.125879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.126538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.127675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.923804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:33.935954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:33.942099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:33.948324 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83a3dc59-8e6a-4e10-a416-6d4196d51820 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.865537 Nov 02 13:54:33.952240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1670/2722] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:33 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:33.971469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "e628c554-a424-42a4-a210-e83675fa84e3"}, {"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "e0acb975-a97c-4b3a-946a-e5affc445ac5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:33.989233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.997781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.998500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:34.025432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] Creating event network-changed:e628c554-a424-42a4-a210-e83675fa84e3 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:34.026225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] Creating event network-changed:e0acb975-a97c-4b3a-946a-e5affc445ac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:34.032859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6baaab28-f0dd-4faf-9afa-e14849509e9a req-6d8431b0-4d38-481b-af6f-67c8ac969930 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079014 Nov 02 13:54:34.037641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1671/2723] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:34.150321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1857851441", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7e53e086-dd5c-4df9-95b5-9e9382cf5479"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:34.300808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] validate_networks() for [('7e53e086-dd5c-4df9-95b5-9e9382cf5479', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:35.540289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:35.629577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:35.629577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:35.630193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:35.630702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:35.631309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:35.650253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:35.650990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:35.651604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:35.656122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:35.657012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:35.657803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:35.689792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:35.696152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for user 165803256c184acc801878f0cb60cc67 and project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:35.721350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:35.725166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:35.799390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-36d674d7-372e-4225-86be-49b7c948cd2b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759344 Nov 02 13:54:35.800308 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1672/2724] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:35.814049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c81dc343-fc00-444f-b6f2-4eb3b3b52722 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] Calling method '.version_select at 0x7f6f819dbee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:37.273427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c81dc343-fc00-444f-b6f2-4eb3b3b52722 tempest-FloatingIPDetailsTestJSON-1662718742 tempest-FloatingIPDetailsTestJSON-1662718742-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4b88b3a9-20db-4624-bc0a-94df69f055b3" status: 202 len: 0 microversion: 2.1 time: 1.464104 Nov 02 13:54:37.274027 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1673/2725] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:54:35 2022] DELETE /compute/v2.1/os-floating-ips/4b88b3a9-20db-4624-bc0a-94df69f055b3 => generated 0 bytes in 1473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:37.285348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1467511566", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:37.375802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:39.278905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:39.280189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:39.280844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:39.281459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:39.282059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:39.299834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:39.302096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:39.303354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:39.306369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:39.308636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:39.309433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:39.363303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:39.373604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:39.405888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:39.415010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:39.579713 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c01dd268-1253-44b4-84ee-0f049ca48394 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.304507 Nov 02 13:54:39.597251 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1674/2726] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:39.608880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-928bb7fb-aa8b-4b67-a2c2-ee260937de2d tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Action: 'create', calling method: .version_select at 0x7f6f81d5aca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-150457133", "metadata": {"Type": "work"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-928bb7fb-aa8b-4b67-a2c2-ee260937de2d tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Request method failure captured: Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 119 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaUv10fg8zHxH33JCRkNxe7r4JRBHF0dYwX7vDunmItdAKrcYBFnLWbegUukJoU1XFvukkwWdarGGUEdVYazZ-W_aEKW0tjx0FOl1fQLJN2GpPXbYKog2NxhhJOibWUJQGSTUuLE8iubhKyk0CeTqCktCf8XmzexzZZ3UFgMXyj_TQ Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/207d8199089544109f860f4459ba927b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_207d8199089544109f860f4459ba927b"}]}] Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 365cdc988b6849649974cfcad3ab624d Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-150457133", "metadata": {"Type": "work"}}} Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-150457133', 'metadata': {'Type': 'work'}}}} Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '0' Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:54:39.631850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:54:39.635826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:39.660416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-928bb7fb-aa8b-4b67-a2c2-ee260937de2d tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:39.666210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-928bb7fb-aa8b-4b67-a2c2-ee260937de2d tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.067487 Nov 02 13:54:39.680632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1675/2727] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 13:54:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:54:39.704062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:39.706541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:39.736173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:39.742396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:39.743115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:39.744192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:39.748748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:39.749412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:40.283415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:40.298549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b269056-74e9-4351-b386-740026f566f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1507 microversion: 2.1 time: 0.614922 Nov 02 13:54:40.299972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1676/2728] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:39 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:40.311138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:40.317326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:40.340868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:40.341360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:40.341801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:40.342517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:40.344470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:40.345091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:41.432577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:41.443484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70874f4c-1eb5-4597-8cf6-d007800e4397 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1503 microversion: 2.1 time: 1.142126 Nov 02 13:54:41.454798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1677/2729] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:40 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1503 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:41.462920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:41.473579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:41.491530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:41.492031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:41.492472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:41.493190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:41.493647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:41.494073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:42.299266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:42.310389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:42.312769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:42.314692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d3f9d62-9b36-4e1a-a39c-e20183342fcf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.858616 Nov 02 13:54:42.315473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1678/2730] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:41 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:42.322359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:42.323333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:42.333113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:42.334604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:42.335807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:42.336681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:42.337482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:42.337918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:43.223990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:43.234500 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2bc60d3-6005-4113-bbb6-a36977300906 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 200 len: 1308 microversion: 2.1 time: 0.917808 Nov 02 13:54:43.235957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1679/2731] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:42 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 1308 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:43.261812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "b580f924-6265-448a-9b14-4d6a702fe994"}, {"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "e707d585-acad-44e6-9040-e84131462d69"}, {"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "a4efc2d4-567e-4723-80c8-9c4971601415"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:43.274404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:43.274980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:43.275723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:43.292232 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Creating event network-changed:b580f924-6265-448a-9b14-4d6a702fe994 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:43.293064 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Creating event network-changed:e707d585-acad-44e6-9040-e84131462d69 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:43.293784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] Creating event network-changed:a4efc2d4-567e-4723-80c8-9c4971601415 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:43.300188 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c766a089-37f9-4726-ab69-04e8b15a7930 req-84ddc7d3-8f60-4aeb-b122-d594b17ed15e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.050367 Nov 02 13:54:43.301787 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1680/2732] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:43.307835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:43.308763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:43.318213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:43.319028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:43.320232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:43.321720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:43.322687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:43.324278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:43.369152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:54:43.572090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b8867e3-cec7-4a83-beea-f8d18a0e33fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 204 len: 0 microversion: 2.1 time: 0.266077 Nov 02 13:54:43.574735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1681/2733] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:54:43 2022] DELETE /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:54:43.580360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f693e702-ec79-4e79-8eaf-aafe8d8bb9a8 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Action: 'create', calling method: .version_select at 0x7f6f81a28d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2068673511", "metadata": {"Type": "work"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f693e702-ec79-4e79-8eaf-aafe8d8bb9a8 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Request method failure captured: Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 119 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaUv10fg8zHxH33JCRkNxe7r4JRBHF0dYwX7vDunmItdAKrcYBFnLWbegUukJoU1XFvukkwWdarGGUEdVYazZ-W_aEKW0tjx0FOl1fQLJN2GpPXbYKog2NxhhJOibWUJQGSTUuLE8iubhKyk0CeTqCktCf8XmzexzZZ3UFgMXyj_TQ Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/207d8199089544109f860f4459ba927b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_207d8199089544109f860f4459ba927b"}]}] Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 365cdc988b6849649974cfcad3ab624d Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2068673511", "metadata": {"Type": "work"}}} Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2068673511', 'metadata': {'Type': 'work'}}}} Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:54:43.586625 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f693e702-ec79-4e79-8eaf-aafe8d8bb9a8 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f693e702-ec79-4e79-8eaf-aafe8d8bb9a8 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011971 Nov 02 13:54:43.594441 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1682/2734] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 13:54:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:54:43.596210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:43.599132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:43.606271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:43.606787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:43.607268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:43.607975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:43.608429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:43.608849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:44.061469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:44.069327 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3684c745-b275-4652-bea8-0d03e06fe4e7 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 200 len: 1507 microversion: 2.1 time: 0.479417 Nov 02 13:54:44.079666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1683/2735] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:43 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:44.096379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:44.097541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:44.106776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:44.107541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:44.108156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:44.109032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:44.109644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:44.110226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:44.163320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:54:44.334872 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4658b86-1303-4af3-918c-0620c4d1008d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 204 len: 0 microversion: 2.1 time: 0.250481 Nov 02 13:54:44.340432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1684/2736] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:54:44 2022] DELETE /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:54:44.368452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:44.371560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:44.389480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:44.391141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:44.394307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:44.395997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:44.398981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:44.399637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.027266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:45.045550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:45.047605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:45.049400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2eb8557c-f1d9-49e3-a248-db26dc3c3c96 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.705976 Nov 02 13:54:45.050532 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1685/2737] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:44 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:45.061817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:45.070489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:45.084814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.085598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.086095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.086921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.087559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.087987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.313940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:45.325192 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04a06ffa-8af3-48cb-989d-017c52a20d2f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.272580 Nov 02 13:54:45.326361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1686/2738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:45 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:45.331336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-972dd0b4-d175-4844-9eb7-fafb1802f53b tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Calling method '.version_select at 0x7f6f85f41b80>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:45.393173 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-972dd0b4-d175-4844-9eb7-fafb1802f53b tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] HTTP exception thrown: Volume tempest-invalid-2011196818 could not be found. Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-972dd0b4-d175-4844-9eb7-fafb1802f53b tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Request method failure captured: Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2011196818 HTTP/1.1 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaUv10fg8zHxH33JCRkNxe7r4JRBHF0dYwX7vDunmItdAKrcYBFnLWbegUukJoU1XFvukkwWdarGGUEdVYazZ-W_aEKW0tjx0FOl1fQLJN2GpPXbYKog2NxhhJOibWUJQGSTUuLE8iubhKyk0CeTqCktCf8XmzexzZZ3UFgMXyj_TQ Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/207d8199089544109f860f4459ba927b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_207d8199089544109f860f4459ba927b"}]}] Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 365cdc988b6849649974cfcad3ab624d Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume tempest-invalid-2011196818 could not be found. Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'tempest-invalid-2011196818'} Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2011196818 could not be found. (HTTP 404) (Request-ID: req-623b08cf-98c0-4b91-961b-4e9cb8ca1276) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:54:45.397193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2011196818 could not be found. Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2011196818 could not be found. Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2011196818 could not be found. Nov 02 13:54:45.405253 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:45.412819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-972dd0b4-d175-4844-9eb7-fafb1802f53b tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Returning 404 to user: Volume tempest-invalid-2011196818 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:45.414576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-972dd0b4-d175-4844-9eb7-fafb1802f53b tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2011196818" status: 404 len: 99 microversion: 2.1 time: 0.086838 Nov 02 13:54:45.416294 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1687/2739] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:54:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2011196818 => generated 99 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:54:45.429140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:45.430351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:45.445990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.447378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.448484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.449971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.451059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.451829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.456987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:45.508295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:54:45.633449 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-65927557-65df-43d3-a508-7f38e2b6221e tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 204 len: 0 microversion: 2.1 time: 0.215137 Nov 02 13:54:45.634033 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1688/2740] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:54:45 2022] DELETE /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:54:45.640379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:45.641312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:45.647250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:45.649720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.650739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.651379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.652271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.652955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.653545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.908227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:45.928182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffcfddb1-b10d-4157-8a5a-5e133c1d87e4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 200 len: 1308 microversion: 2.1 time: 0.291455 Nov 02 13:54:45.929022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1689/2741] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:45 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:45.938090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:45.939158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:45.952844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.953758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.954546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:45.955857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:45.956692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:45.957439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:46.285863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:46.294883 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d652256e-a31a-4289-b8ed-347ec3fdfe7a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1509 microversion: 2.1 time: 0.364406 Nov 02 13:54:46.295782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1690/2742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:45 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:46.460504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1aeebe5d-ff64-4671-a368-8b96821f5e06 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Action: 'create', calling method: .version_select at 0x7f6f81f6f4c0>, body: {"keypair": {"name": "tempest-keypair-859730754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNl8hP7gZu7LqK9wbaLJw09XCnEFzUrnJhZi4x6XiRrELu0RVMtGaxrH8YM0WbT4iM45ZU9bw38mqbWKVNQVTyj5HP3AbU90mqbo1kM8xRK2vXfnS6gt6KJj5ISKY2sNg=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:46.480182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1aeebe5d-ff64-4671-a368-8b96821f5e06 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:46.486174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1aeebe5d-ff64-4671-a368-8b96821f5e06 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for user cb82a647e0ef46ea92cb6bc766ee24ea and project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:46.513514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1aeebe5d-ff64-4671-a368-8b96821f5e06 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.216277 Nov 02 13:54:46.514456 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1691/2743] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:54:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:46.520889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "a6219b37-8b62-4a43-a5a2-c07feff83afb"}, {"name": "network-changed", "server_uuid": "9bcbe90f-0c88-4001-974c-5f232a11b7c7", "tag": "7249fcba-6a05-440f-abbc-4d93af788699"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:46.534343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:46.534824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:46.535276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:46.548491 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] Creating event network-changed:a6219b37-8b62-4a43-a5a2-c07feff83afb for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:54:46.548955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] Creating event network-changed:7249fcba-6a05-440f-abbc-4d93af788699 for instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 on n-h1-858238-3 Nov 02 13:54:46.556724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b79064d2-cc44-46b9-8251-9e2cbc842c17 req-a5ae0f89-e313-4a0f-a98e-2ad30a37ebe5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040778 Nov 02 13:54:46.557654 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1692/2744] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:46.563758 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e40beae5-e081-4f39-b83d-52fd726453b2 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004990 Nov 02 13:54:46.565212 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1693/2745] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 13:54:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:54:46.573526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-990816559", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "33c42995-5a65-4daa-b956-d8895d884cd6"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:46.638271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] validate_networks() for [('33c42995-5a65-4daa-b956-d8895d884cd6', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:48.038940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:48.039628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:48.039848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:48.040260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:48.040672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:48.050142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:48.051265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:48.051612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:48.052361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:48.053350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:48.053933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:48.073347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Getting quotas for project 708743f0f3134a5e9444fed3dcad5ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:48.081766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Getting quotas for user fa9f0bc1c07c412fb4c6cc59e9a08efa and project 708743f0f3134a5e9444fed3dcad5ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:48.104589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:48.107623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:48.181412 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd4c3818-94be-4766-acb6-9a29e258d04f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615355 Nov 02 13:54:48.187320 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1694/2746] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:48.355887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-468e3dd5-26e4-4cd3-b2c7-d09b2b153f01 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Action: 'create', calling method: .version_select at 0x7f6f821634c0>, body: {"keypair": {"name": "tempest-keypair-851348231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOI5rxDdbD3ouEuh1CP82qI3IByo62Iv785WrnnweOb0TnBAryUTOunf9batUcP9NVR6TB5vDcxbw9dWfukad2S8kwgICm96RHfTvO/wMcaxLDYWgEWU/lvqGNkhzHK/KQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:48.378377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-468e3dd5-26e4-4cd3-b2c7-d09b2b153f01 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Getting quotas for project 85beb7dd39a34f3cae1913ae45e8e231. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:48.389216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-468e3dd5-26e4-4cd3-b2c7-d09b2b153f01 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Getting quotas for user 6a6800ea4e7544c4b03263fc7becd000 and project 85beb7dd39a34f3cae1913ae45e8e231. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:48.452306 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-468e3dd5-26e4-4cd3-b2c7-d09b2b153f01 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263631 Nov 02 13:54:48.453125 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1695/2747] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:54:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:48.466204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:48.467214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:48.477149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:48.477974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:48.478711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:48.491698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:48.492494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:48.494564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:49.190591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:49.206356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:49.212887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:49.218403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5583a94-4845-42d7-8d95-f9a3ca5e4acf tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.753429 Nov 02 13:54:49.220028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1696/2748] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:48 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:49.236616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:49.237577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:49.244921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:49.255004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:49.255789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:49.257107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:49.257823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:49.258486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:49.597823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:49.606168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02d87d54-3798-41a0-8788-f29579325174 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.384594 Nov 02 13:54:49.606771 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1697/2749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:49 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:49.611805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b056bdb9-b2c1-4478-984e-dcddb3c2e51b tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f81af1e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:49.622302 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b056bdb9-b2c1-4478-984e-dcddb3c2e51b tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-859730754" status: 200 len: 497 microversion: 2.1 time: 0.014245 Nov 02 13:54:49.622892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1698/2750] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Nov 2 13:54:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-859730754 => generated 497 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:49.628124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df8b5699-d891-487a-96b9-d78139a91686 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004023 Nov 02 13:54:49.629155 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1699/2751] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:54:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:54:49.634864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:49.635797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:49.642531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:49.643409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:49.644228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:49.644999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:49.645483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:49.645920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.082499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:50.099570 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fee260e-1bcc-4eeb-8652-38d4a1054c90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 200 len: 1308 microversion: 2.1 time: 0.469050 Nov 02 13:54:50.101124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1700/2752] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:49 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:50.106943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:50.108181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:50.120357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.121160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.121590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.122461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.123029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.124380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.165512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.165996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.166425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.166919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lazy-loading 'fault' on Instance uuid 135c9b2c-85e9-4a6e-b482-859be2c3201e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:54:50.261186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:50.269203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-530f217f-2b9e-4a11-9b01-b76bea18c8b1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 200 len: 1305 microversion: 2.1 time: 0.166292 Nov 02 13:54:50.269977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1701/2753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:50 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 1305 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:50.274158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a705fb91-e59b-4ec5-b7fe-8d29cb7078ee req-31f4c91c-c3c0-4d5f-ab50-4810e5a95fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c69f7b-9be3-4d3c-8450-33cd24a4bf94", "name": "network-vif-deleted", "tag": "2430de1d-66f2-479a-a957-73361c2e5202"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:50.283422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a705fb91-e59b-4ec5-b7fe-8d29cb7078ee req-31f4c91c-c3c0-4d5f-ab50-4810e5a95fa4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.283897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a705fb91-e59b-4ec5-b7fe-8d29cb7078ee req-31f4c91c-c3c0-4d5f-ab50-4810e5a95fa4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.284322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a705fb91-e59b-4ec5-b7fe-8d29cb7078ee req-31f4c91c-c3c0-4d5f-ab50-4810e5a95fa4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.297036 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a705fb91-e59b-4ec5-b7fe-8d29cb7078ee req-31f4c91c-c3c0-4d5f-ab50-4810e5a95fa4 service nova] Creating event network-vif-deleted:2430de1d-66f2-479a-a957-73361c2e5202 for instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 on n-h2-858238-3 Nov 02 13:54:50.303423 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a705fb91-e59b-4ec5-b7fe-8d29cb7078ee req-31f4c91c-c3c0-4d5f-ab50-4810e5a95fa4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031804 Nov 02 13:54:50.304057 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1702/2754] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:50.309766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:50.310491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:50.317212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.317695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.318184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.319016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.319536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.319918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.615866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:50.627879 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79daa8ec-43e0-438c-945f-67dbf34e2321 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1275 microversion: 2.1 time: 0.322531 Nov 02 13:54:50.628599 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1703/2755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:50 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1275 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:50.634144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0048ff27-fc34-4fc7-8f9b-6ef1fd02fae1 req-8ff20622-2887-47e0-b002-0d7158e33fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c823a6-b44f-427b-88cd-c2f82f438391", "tag": "0b6653d4-cd9e-41c1-868a-202a9ad76529"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:50.644126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0048ff27-fc34-4fc7-8f9b-6ef1fd02fae1 req-8ff20622-2887-47e0-b002-0d7158e33fee service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:50.644868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0048ff27-fc34-4fc7-8f9b-6ef1fd02fae1 req-8ff20622-2887-47e0-b002-0d7158e33fee service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:50.645294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0048ff27-fc34-4fc7-8f9b-6ef1fd02fae1 req-8ff20622-2887-47e0-b002-0d7158e33fee service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:50.657236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0048ff27-fc34-4fc7-8f9b-6ef1fd02fae1 req-8ff20622-2887-47e0-b002-0d7158e33fee service nova] Creating event network-changed:0b6653d4-cd9e-41c1-868a-202a9ad76529 for instance 31c823a6-b44f-427b-88cd-c2f82f438391 on n-h2-858238-3 Nov 02 13:54:50.664045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0048ff27-fc34-4fc7-8f9b-6ef1fd02fae1 req-8ff20622-2887-47e0-b002-0d7158e33fee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Nov 02 13:54:50.664819 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1704/2756] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:50.670400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3100f932-de92-48f6-9c08-69cef980ae11 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Calling method '.version_select at 0x7f6f85f6c310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:50.705097 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3100f932-de92-48f6-9c08-69cef980ae11 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] HTTP exception thrown: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3100f932-de92-48f6-9c08-69cef980ae11 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Request method failure captured: Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-volumes/38c21344-93a6-4a44-9403-3522323d10ac HTTP/1.1 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaUv10fg8zHxH33JCRkNxe7r4JRBHF0dYwX7vDunmItdAKrcYBFnLWbegUukJoU1XFvukkwWdarGGUEdVYazZ-W_aEKW0tjx0FOl1fQLJN2GpPXbYKog2NxhhJOibWUJQGSTUuLE8iubhKyk0CeTqCktCf8XmzexzZZ3UFgMXyj_TQ Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/207d8199089544109f860f4459ba927b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_207d8199089544109f860f4459ba927b"}]}] Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 365cdc988b6849649974cfcad3ab624d Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '38c21344-93a6-4a44-9403-3522323d10ac'} Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. (HTTP 404) (Request-ID: req-ed01d294-cf0c-4a06-b7a3-a98b6ca70fe5) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:54:50.707269 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3100f932-de92-48f6-9c08-69cef980ae11 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Returning 404 to user: Volume 38c21344-93a6-4a44-9403-3522323d10ac could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:50.712642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3100f932-de92-48f6-9c08-69cef980ae11 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/38c21344-93a6-4a44-9403-3522323d10ac" status: 404 len: 109 microversion: 2.1 time: 0.042480 Nov 02 13:54:50.715552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1705/2757] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:54:50 2022] DELETE /compute/v2.1/os-volumes/38c21344-93a6-4a44-9403-3522323d10ac => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:54:50.722529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6acf1c64-18b4-4102-b801-fb805033f0bd tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f85f6c9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:50.746417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6acf1c64-18b4-4102-b801-fb805033f0bd tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859730754" status: 202 len: 0 microversion: 2.1 time: 0.029152 Nov 02 13:54:50.747015 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1706/2758] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:54:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859730754 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:50.758161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-20986894", "imageRef": "f59a381f-5d55-4c51-a9e0-5daa3a823149", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c3c7d57f-4f3a-4a31-9cd2-11819acebd72"}], "security_groups": [{"name": "tempest-securitygroup--1617135034"}], "key_name": "tempest-keypair-851348231", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:50.995869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] validate_networks() for [('c3c7d57f-4f3a-4a31-9cd2-11819acebd72', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:52.210057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:52.215253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:52.215806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:52.216332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:52.217185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:52.234442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.234936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.235475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.236203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.237295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.237724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.257929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Getting quotas for project 85beb7dd39a34f3cae1913ae45e8e231. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:52.263434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Getting quotas for user 6a6800ea4e7544c4b03263fc7becd000 and project 85beb7dd39a34f3cae1913ae45e8e231. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:52.280175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:52.282719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f59a381f-5d55-4c51-a9e0-5daa3a823149',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:52.330492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35df3b42-de23-48a8-b57f-899cd2e15c6d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.582368 Nov 02 13:54:52.331473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1707/2759] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:52.341946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:52.342545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:52.350272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.350749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.351224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.351900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.352344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.352758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.759334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:52.770131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:52.772683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:52.774051 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44b0d3f4-4ef6-4c74-9024-59f346d19a5e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.441633 Nov 02 13:54:52.784711 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1708/2760] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:52 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:52.784711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-851fc9e0-649a-4fb0-8bfc-25b24d207c4a req-1d7174ff-341d-4a54-ae6d-2d3a0b25355c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcbe90f-0c88-4001-974c-5f232a11b7c7", "name": "network-vif-plugged", "status": "completed", "tag": "7249fcba-6a05-440f-abbc-4d93af788699"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:52.788834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-851fc9e0-649a-4fb0-8bfc-25b24d207c4a req-1d7174ff-341d-4a54-ae6d-2d3a0b25355c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.789617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-851fc9e0-649a-4fb0-8bfc-25b24d207c4a req-1d7174ff-341d-4a54-ae6d-2d3a0b25355c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.790365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-851fc9e0-649a-4fb0-8bfc-25b24d207c4a req-1d7174ff-341d-4a54-ae6d-2d3a0b25355c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.806344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-851fc9e0-649a-4fb0-8bfc-25b24d207c4a req-1d7174ff-341d-4a54-ae6d-2d3a0b25355c service nova] Creating event network-vif-plugged:7249fcba-6a05-440f-abbc-4d93af788699 for instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 on n-h1-858238-3 Nov 02 13:54:52.812024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-851fc9e0-649a-4fb0-8bfc-25b24d207c4a req-1d7174ff-341d-4a54-ae6d-2d3a0b25355c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 Nov 02 13:54:52.813246 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1709/2761] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:52.820435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:52.821383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:52.829786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.830508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.830949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.831848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.832319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.832739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.471990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:53.483213 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4890174a-76ac-4f9e-97fc-ccbd902a0b42 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.667429 Nov 02 13:54:53.485352 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1710/2762] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:52 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:53.493052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ff0906e-78bd-4469-a4ff-54a9a8afc063 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Calling method '.version_select at 0x7f6f81ff0af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:53.533707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3ff0906e-78bd-4469-a4ff-54a9a8afc063 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] HTTP exception thrown: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ff0906e-78bd-4469-a4ff-54a9a8afc063 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Request method failure captured: Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-volumes/0df49580-c4a1-4e30-ab31-f16fa200cb00 HTTP/1.1 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaUv10fg8zHxH33JCRkNxe7r4JRBHF0dYwX7vDunmItdAKrcYBFnLWbegUukJoU1XFvukkwWdarGGUEdVYazZ-W_aEKW0tjx0FOl1fQLJN2GpPXbYKog2NxhhJOibWUJQGSTUuLE8iubhKyk0CeTqCktCf8XmzexzZZ3UFgMXyj_TQ Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/207d8199089544109f860f4459ba927b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/207d8199089544109f860f4459ba927b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_207d8199089544109f860f4459ba927b"}]}] Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 207d8199089544109f860f4459ba927b Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-1443041122 Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 365cdc988b6849649974cfcad3ab624d Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-1443041122-project Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '0df49580-c4a1-4e30-ab31-f16fa200cb00'} Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. (HTTP 404) (Request-ID: req-83465eff-9ad0-41fa-ae3e-d24ff565ea59) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:54:53.541084 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ff0906e-78bd-4469-a4ff-54a9a8afc063 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] Returning 404 to user: Volume 0df49580-c4a1-4e30-ab31-f16fa200cb00 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:53.545651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ff0906e-78bd-4469-a4ff-54a9a8afc063 tempest-VolumesNegativeTest-1443041122 tempest-VolumesNegativeTest-1443041122-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0df49580-c4a1-4e30-ab31-f16fa200cb00" status: 404 len: 109 microversion: 2.1 time: 0.053967 Nov 02 13:54:53.550238 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1711/2763] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:54:53 2022] GET /compute/v2.1/os-volumes/0df49580-c4a1-4e30-ab31-f16fa200cb00 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:54:53.560001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46f23979-2771-461e-9b51-213f85a461d5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Action: 'create', calling method: .version_select at 0x7f6f85f67a60>, body: {"keypair": {"name": "tempest-keypair-1360333798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbD8CTJ6OBuFEUzO0UkeHVx6Rrxz3qnLFIARbwac8TSuvzOR1mVhPMHYCrdp/FybSSxcIKRLyQm+2A0ZgV2FJwZwP+K3NmAwIn6i5jMgGtfM8JWBcgytE+28WAtTsgXlQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:53.591919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-46f23979-2771-461e-9b51-213f85a461d5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:53.598057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-46f23979-2771-461e-9b51-213f85a461d5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for user cb82a647e0ef46ea92cb6bc766ee24ea and project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:53.612311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:53.639923 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46f23979-2771-461e-9b51-213f85a461d5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087358 Nov 02 13:54:53.640597 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1712/2764] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:54:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:53.645680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:53.646826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:53.664309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.665113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.666065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.676980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.677867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.678985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.086357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:54.098956 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4231666a-ce37-42f9-b01a-32cd2f7ffe82 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 200 len: 1308 microversion: 2.1 time: 0.456644 Nov 02 13:54:54.099635 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1713/2765] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:53 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:54.119694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:54.120627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:54.128411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:54.129084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:54.129708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.131178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:54.132099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:54.132921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.168190 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e HTTP/1.1 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '135c9b2c-85e9-4a6e-b482-859be2c3201e'} Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:54.169977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:54:54.174875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:54.175482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66148155-119d-4ba1-837a-f88ad1e21bb4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 404 len: 111 microversion: 2.1 time: 0.064421 Nov 02 13:54:54.190036 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1714/2766] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:54 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:54:54.230329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:54.232947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:54.264248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:54.271042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:54.274862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.278401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:54.280752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:54.281230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.935567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:54.982951 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-869681b4-3aeb-4e47-a6df-aa17dca1d9be tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.791025 Nov 02 13:54:54.984288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1715/2767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:54 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:55.000484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:55.003942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:55.030613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.031956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.035152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.037360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.043991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.044690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.082138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:55.192666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:55.205803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a043ed8e-497c-4489-8bdd-ed9b6a3947e1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1301 microversion: 2.1 time: 0.219264 Nov 02 13:54:55.209518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1716/2768] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:54 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1301 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:55.218531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a172cf93-6a6f-4cc1-aad7-c1243d3ae929 req-24b0dab9-813d-4006-a61e-8ceb65cf1395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135c9b2c-85e9-4a6e-b482-859be2c3201e", "name": "network-vif-deleted", "tag": "80e0e160-ac89-4a84-8fa9-ebb6b875c3a8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:55.245314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a172cf93-6a6f-4cc1-aad7-c1243d3ae929 req-24b0dab9-813d-4006-a61e-8ceb65cf1395 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.246505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a172cf93-6a6f-4cc1-aad7-c1243d3ae929 req-24b0dab9-813d-4006-a61e-8ceb65cf1395 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.248712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a172cf93-6a6f-4cc1-aad7-c1243d3ae929 req-24b0dab9-813d-4006-a61e-8ceb65cf1395 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.280221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a172cf93-6a6f-4cc1-aad7-c1243d3ae929 req-24b0dab9-813d-4006-a61e-8ceb65cf1395 service nova] Creating event network-vif-deleted:80e0e160-ac89-4a84-8fa9-ebb6b875c3a8 for instance 135c9b2c-85e9-4a6e-b482-859be2c3201e on n-h2-858238-3 Nov 02 13:54:55.298860 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a172cf93-6a6f-4cc1-aad7-c1243d3ae929 req-24b0dab9-813d-4006-a61e-8ceb65cf1395 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087219 Nov 02 13:54:55.299525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1717/2769] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:55.307373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45213a4f-bbd4-4645-8663-08406ce7dc27 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f8224e700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:55.414124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45213a4f-bbd4-4645-8663-08406ce7dc27 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360333798" status: 202 len: 0 microversion: 2.1 time: 0.110884 Nov 02 13:54:55.416610 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1718/2770] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 13:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360333798 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:55.432201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:55.432972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:55.441056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.441693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.442030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.442753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.443777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.444206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.952007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:55.962814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:55.977380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:55.979988 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f894623-4edb-409b-8f07-cf50f09dd185 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.558991 Nov 02 13:54:55.980583 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1719/2771] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:54:55 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:55.996272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-588894149", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:56.119518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:57.309761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:57.311251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:57.311986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:57.312729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:57.313475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:57.335124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:57.341081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:57.341848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:57.344353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:57.345069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:57.355852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:57.392938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:57.410302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:57.439521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:57.444999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:57.555763 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a028d40e-b753-4530-9aed-f2f0d6708be0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572734 Nov 02 13:54:57.560156 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1720/2772] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:57.571481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:57.572560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:57.587757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:57.590015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:57.594430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:57.596508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:57.598139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:57.601392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:58.472528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:58.490721 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-570d0f8e-425d-4e16-a5b2-d62c9fbd93f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.928914 Nov 02 13:54:58.491421 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1721/2773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:57 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:58.514478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:58.515565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:58.523328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:58.524144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:58.524746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:58.525625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:58.526227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:58.526806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.062923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:59.074987 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6b06705-506e-4cb9-9000-e41f77393f20 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 200 len: 1487 microversion: 2.1 time: 0.564881 Nov 02 13:54:59.101786 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1722/2774] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:58 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 1487 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:59.115660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ab572e9-0a97-4114-8d89-5659e22989f4 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Action: 'create', calling method: .version_select at 0x7f6f81337ca0>, body: {"keypair": {"name": "tempest-keypair-609623119", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:59.157301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1ab572e9-0a97-4114-8d89-5659e22989f4 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:59.170368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1ab572e9-0a97-4114-8d89-5659e22989f4 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for user cb82a647e0ef46ea92cb6bc766ee24ea and project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:59.221694 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ab572e9-0a97-4114-8d89-5659e22989f4 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.118518 Nov 02 13:54:59.222830 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1723/2775] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:54:59 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:59.228229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ee7fe9cd-6a9e-4896-ab2c-563e3f416944 req-4ec42e05-6669-47f0-8e8e-c26c228a91bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c823a6-b44f-427b-88cd-c2f82f438391", "name": "network-vif-plugged", "status": "completed", "tag": "0b6653d4-cd9e-41c1-868a-202a9ad76529"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:59.255169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ee7fe9cd-6a9e-4896-ab2c-563e3f416944 req-4ec42e05-6669-47f0-8e8e-c26c228a91bb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.261428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ee7fe9cd-6a9e-4896-ab2c-563e3f416944 req-4ec42e05-6669-47f0-8e8e-c26c228a91bb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.261984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ee7fe9cd-6a9e-4896-ab2c-563e3f416944 req-4ec42e05-6669-47f0-8e8e-c26c228a91bb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.295374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ee7fe9cd-6a9e-4896-ab2c-563e3f416944 req-4ec42e05-6669-47f0-8e8e-c26c228a91bb service nova] Creating event network-vif-plugged:0b6653d4-cd9e-41c1-868a-202a9ad76529 for instance 31c823a6-b44f-427b-88cd-c2f82f438391 on n-h2-858238-3 Nov 02 13:54:59.308090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ee7fe9cd-6a9e-4896-ab2c-563e3f416944 req-4ec42e05-6669-47f0-8e8e-c26c228a91bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082689 Nov 02 13:54:59.316123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1724/2776] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:59.323776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:59.324692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:59.332606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.333241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.334966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.336545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.337574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.339307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.792320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:59.806096 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-663164c1-aa5f-4b90-9970-d4d72e429530 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.482998 Nov 02 13:54:59.807305 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1725/2777] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:59 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:59.816651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:59.817265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:59.827080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.827600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.828043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.828900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.829469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.830677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:00.397044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:00.405749 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2844c549-d96b-434b-9b79-0f19f2628911 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.596312 Nov 02 13:55:00.430363 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1726/2778] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:59 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:00.437638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:00.438540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:00.467994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:00.468507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:00.468941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:00.469692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:00.470151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:00.473407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:00.950454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:00.964476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:00.966216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:00.967723 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59d79d62-8f7c-4de8-85b9-4d892707e004 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.536024 Nov 02 13:55:00.990129 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1727/2779] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:00 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:00.995409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-fced89d4-bd17-4cf8-9cda-a505153b66ed req-e4e960e9-34bd-4b6a-aee3-88a70bb74360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cdade5-690b-46b3-96cc-dd698e3a15be", "tag": "a25334d8-675f-4ad0-a6e5-eb956a10d261"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:01.020023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fced89d4-bd17-4cf8-9cda-a505153b66ed req-e4e960e9-34bd-4b6a-aee3-88a70bb74360 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.021002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fced89d4-bd17-4cf8-9cda-a505153b66ed req-e4e960e9-34bd-4b6a-aee3-88a70bb74360 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.021670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fced89d4-bd17-4cf8-9cda-a505153b66ed req-e4e960e9-34bd-4b6a-aee3-88a70bb74360 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.035497 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fced89d4-bd17-4cf8-9cda-a505153b66ed req-e4e960e9-34bd-4b6a-aee3-88a70bb74360 service nova] Creating event network-changed:a25334d8-675f-4ad0-a6e5-eb956a10d261 for instance 07cdade5-690b-46b3-96cc-dd698e3a15be on n-h2-858238-3 Nov 02 13:55:01.042581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-fced89d4-bd17-4cf8-9cda-a505153b66ed req-e4e960e9-34bd-4b6a-aee3-88a70bb74360 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050329 Nov 02 13:55:01.043712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1728/2780] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:01.049414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:01.050245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:01.057784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.058711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.059495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.060773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.061741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.062695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.215087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:01.227887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf3192df-3e3d-46cc-8d77-ebd1a438317d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1272 microversion: 2.1 time: 0.182475 Nov 02 13:55:01.230281 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1729/2781] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:01 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:01.235477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:01.244701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:01.262809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.266940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.267697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.269218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.270182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.271089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.396369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90963da7-593b-4a09-9348-11509ec84478 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7/action" status: 202 len: 0 microversion: 2.1 time: 0.164326 Nov 02 13:55:01.398105 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1730/2782] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:01 2022] POST /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:01.404139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef6dc508-4087-4b69-8ba2-a965dd08158e tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f81b99e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:01.453167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef6dc508-4087-4b69-8ba2-a965dd08158e tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609623119" status: 202 len: 0 microversion: 2.1 time: 0.053785 Nov 02 13:55:01.454986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1731/2783] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:55:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609623119 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:01.476990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:01.481484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:01.500999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.500999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.501442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.507259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.507772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.508215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.850487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:01.861549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0706103d-4b46-4e1c-9781-0de62ad73335 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.400729 Nov 02 13:55:01.864096 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1732/2784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:01 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:01.871908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:01.878949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:01.893695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.895766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.897639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.904841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.909108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.909678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:02.518277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:02.531826 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5cfa716a-9161-4730-956e-0ac86e241968 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.663585 Nov 02 13:55:02.534931 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1733/2785] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:01 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:02.544653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:02.549044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:02.564608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:02.569572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:02.570363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:02.571604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:02.572484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:02.576231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:02.825827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:02.835648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6200d6de-bb78-4433-8d15-a68a52793325 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 200 len: 1472 microversion: 2.1 time: 0.299047 Nov 02 13:55:02.836783 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1734/2786] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:02 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:02.842244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:02.843077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:02.860720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:02.861723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:02.862236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:02.863292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:02.864057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:02.864687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:03.298843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:03.309837 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17e50deb-3752-4e21-adef-ee320ad4cce8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.471795 Nov 02 13:55:03.315992 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1735/2787] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:02 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:03.321280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0634a574-7680-49a1-8f91-736175edbe51 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Action: 'create', calling method: .version_select at 0x7f6f819db790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-33060451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQiHxxMXFQ06odd0usKH+oBrSK5Y3C8PPvXaCCvTKMdnZZF08fZoeLBYCzuoYqzkuGaZeEUjPVfEi4YjF9Rcfx7DdBf3wC6DYRU9SxVmAx273qt1B2Wi5P84xYLirctow=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:03.339825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-0634a574-7680-49a1-8f91-736175edbe51 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:03.347012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-0634a574-7680-49a1-8f91-736175edbe51 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for user cb82a647e0ef46ea92cb6bc766ee24ea and project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:03.375481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0634a574-7680-49a1-8f91-736175edbe51 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058013 Nov 02 13:55:03.376482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1736/2788] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:55:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:03.382491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:03.383402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:03.390446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:03.391235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:03.391697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:03.392355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:03.392802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:03.393227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:03.996441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.006990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.008462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.009665 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a363c3e1-7274-4122-a196-5e1c4f1df578 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.631979 Nov 02 13:55:04.010252 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1737/2789] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:03 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:04.014688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:04.015330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:04.033572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.034714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.035739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.037297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.038604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.039994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.265505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.268942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:04.276250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1675b8e-11b8-4a43-8b99-98adeb84ed22 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.264981 Nov 02 13:55:04.277191 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1738/2790] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:04 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:04.282860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1531313090"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:04.285649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:04.293420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.294178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.294613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.295346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.295803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.296226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.547642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfc12cc0-7e02-43a1-aeb8-9a659593f7db tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7/action" status: 202 len: 0 microversion: 2.1 time: 0.268799 Nov 02 13:55:04.548514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1739/2791] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:04 2022] POST /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:55:04.554922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:04.555660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:04.566193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.566783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.569228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.571277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.571956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.572463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.823821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.832187 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c4f2a78-ade7-44e9-999f-bc1207d167c8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.282439 Nov 02 13:55:04.832774 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1740/2792] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:04 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:04.838064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b35a714-ca92-4921-b64a-469ddd2c9901", "tag": "5b9a93b3-3215-4e28-9ba2-4749d81de91d"}, {"name": "network-changed", "server_uuid": "e95b31f0-63d4-4394-a173-98421faf4b34", "tag": "14184870-b06b-402e-9346-4449d75aef7a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:04.854746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.855323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.855746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.869506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] Creating event network-changed:5b9a93b3-3215-4e28-9ba2-4749d81de91d for instance 9b35a714-ca92-4921-b64a-469ddd2c9901 on n-h2-858238-3 Nov 02 13:55:04.870225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] Creating event network-changed:14184870-b06b-402e-9346-4449d75aef7a for instance e95b31f0-63d4-4394-a173-98421faf4b34 on n-h1-858238-3 Nov 02 13:55:04.880088 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-72b6941b-da63-4db3-b583-83a791a243ab req-b0ffe074-8932-4a30-a113-e73ade4546ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045440 Nov 02 13:55:04.880891 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1741/2793] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:04.886220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ed8dc70-dc72-4a3b-a4ef-0232ca0b3bfb tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Action: 'create', calling method: .version_select at 0x7f6f85e9f670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-581493638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMskjT47YRcRocESdrJBIoaPWHKv7fYYa0P7Q2Chi+9dMpRctUScbCbBDyre2in8/oTOwu5lw3gnuNO6kyHLN6fkJ6JvRPy6qMaZOG0mX20H8eQH5CQet0SgZE/k6NcEg=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:04.893026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:04.907302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4ed8dc70-dc72-4a3b-a4ef-0232ca0b3bfb tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:04.913588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4ed8dc70-dc72-4a3b-a4ef-0232ca0b3bfb tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for user cb82a647e0ef46ea92cb6bc766ee24ea and project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:04.944196 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ed8dc70-dc72-4a3b-a4ef-0232ca0b3bfb tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.061963 Nov 02 13:55:04.944849 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1742/2794] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:55:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:04.949757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:04.950491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:04.958179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.959932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.959932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.960318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.960766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.961183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.108321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.116360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b46ca386-f2a9-4b70-8561-be7751ce7f5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.170429 Nov 02 13:55:05.116945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1743/2795] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:04 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.123196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.124043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.131834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.132219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.132748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.133343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.133793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.134197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.287453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.300189 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-684c7fb4-6d6a-48af-a5b2-f9ff8d6e67e8 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.181961 Nov 02 13:55:05.301641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1744/2796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.309534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa6940c7-4c84-4a3a-a363-b6ce1762ea90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85f61790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.366937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa6940c7-4c84-4a3a-a363-b6ce1762ea90 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.063570 Nov 02 13:55:05.367718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1745/2797] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.372346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60d18e76-3091-468b-90f9-e34fd577a9a6 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Action: 'create', calling method: .version_select at 0x7f6f8194de50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1261587727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhu25ljeOp9CaEGE9/yzE4JStXLdBqbfDgHmjwmFmAX8uHMSCQIAjQKFanRRe3j8wUhIQbKdZW5rTkal4Poz933OKujNtN20kLI8d5CzgoYqFeTDx3U7/h6XGfGCdQHbQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:05.389091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-60d18e76-3091-468b-90f9-e34fd577a9a6 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:05.395429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-60d18e76-3091-468b-90f9-e34fd577a9a6 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Getting quotas for user cb82a647e0ef46ea92cb6bc766ee24ea and project 707388eeaea84300a3bc83705c34daf4. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:05.425598 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60d18e76-3091-468b-90f9-e34fd577a9a6 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.056836 Nov 02 13:55:05.426704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1746/2798] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:55:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:05.433343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.433957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.440610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.441103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.441526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.442256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.443325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.445033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.668979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.677699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.679464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.680675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-691ae90c-c5ba-49b1-8466-a5d3268c9e53 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.253229 Nov 02 13:55:05.681243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1747/2799] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:05.686892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.687530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.693337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.693812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.694243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.695611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.696056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.696640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.842773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.851557 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3be9962f-5db4-4a85-8bf6-18cfab4f73c1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.168669 Nov 02 13:55:05.852295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1748/2800] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.857199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-336e9641-f1f8-4144-bbac-237ec1f0f6a5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f8194d700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.861103 n-d-858238-3 devstack@n-api.service[137559]: WARNING oslo_db.sqlalchemy.utils [None req-336e9641-f1f8-4144-bbac-237ec1f0f6a5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:55:05.866853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-336e9641-f1f8-4144-bbac-237ec1f0f6a5 tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.013327 Nov 02 13:55:05.867450 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1749/2801] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.877750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.878361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.885327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.885808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.886234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.886936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.887423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.887923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.043660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:06.052936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d106bac7-2e7f-484c-9fc9-e961fb0a2fb7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1309 microversion: 2.1 time: 0.178840 Nov 02 13:55:06.066455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1750/2802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1309 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:06.066455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c7c40e1-08ec-4bd3-9f25-f2b932fa7eac tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f85f67b80>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.083170 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c7c40e1-08ec-4bd3-9f25-f2b932fa7eac tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1261587727" status: 202 len: 0 microversion: 2.1 time: 0.028524 Nov 02 13:55:06.084406 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1751/2803] 10.222.0.18 () {58 vars in 1278 bytes} [Wed Nov 2 13:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1261587727 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:06.096416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb121538-8ade-4a01-b1b9-53b941ee1fcf tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f85f615e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.121540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb121538-8ade-4a01-b1b9-53b941ee1fcf tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-581493638" status: 202 len: 0 microversion: 2.1 time: 0.031826 Nov 02 13:55:06.122215 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1752/2804] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-581493638 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:55:06.132463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74c6f797-a547-4305-8822-389534e6eaec tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] Calling method '.version_select at 0x7f6f85f6c160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.154565 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74c6f797-a547-4305-8822-389534e6eaec tempest-KeyPairsV2TestJSON-842076215 tempest-KeyPairsV2TestJSON-842076215-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-33060451" status: 202 len: 0 microversion: 2.1 time: 0.027816 Nov 02 13:55:06.155211 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1753/2805] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-33060451 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:55:06.165016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.168730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:06.176070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.176825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.177307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.178003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.178451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.178872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.455992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:06.472045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c87bf9a2-2e15-4f2b-ae0d-f6223a582541 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.315739 Nov 02 13:55:06.472704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1754/2806] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:06 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:06.501222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.506694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:06.516682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.517186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.517771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.518496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.519414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.520068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.128208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.173006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-764a998b-da1b-42eb-a971-b1d1f9b0f5e2 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.674505 Nov 02 13:55:07.173833 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1755/2807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:06 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:07.193785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c910f4a4-6314-486c-802d-4497f09758aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85e9fca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:07.297889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c910f4a4-6314-486c-802d-4497f09758aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.107876 Nov 02 13:55:07.298491 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1756/2808] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:07 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:07.310487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:07.311126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:07.327346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.327840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.328296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.328984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.329431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.336405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.373713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:07.837495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.852233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.854121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.862984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b12f083b-2224-4ed1-a843-f77fe3bdfa4f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.558688 Nov 02 13:55:07.863908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1757/2809] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:07 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:07.891839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:07.892877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:07.904458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.905468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.906067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.907140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.907801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.908514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.003161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:09.013097 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-150de3ee-6982-4456-86e3-d313d18e970d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 1.139344 Nov 02 13:55:09.014025 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1758/2810] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:07 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:09.019963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:09.021043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:09.028000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.028943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.030040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.031929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.032549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.033298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.136284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:09.145258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6f221959-8a69-4bd0-bfc1-bcae3e347a3e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 200 len: 1288 microversion: 2.1 time: 0.129996 Nov 02 13:55:09.146285 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1759/2811] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:09 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 1288 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:09.151758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6cb26446-74aa-4564-a429-181990bd71a5 req-d647b458-efd7-4e07-81eb-0ed7d8ec0f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c823a6-b44f-427b-88cd-c2f82f438391", "name": "network-vif-deleted", "tag": "0b6653d4-cd9e-41c1-868a-202a9ad76529"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:09.172852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6cb26446-74aa-4564-a429-181990bd71a5 req-d647b458-efd7-4e07-81eb-0ed7d8ec0f7e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.173990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6cb26446-74aa-4564-a429-181990bd71a5 req-d647b458-efd7-4e07-81eb-0ed7d8ec0f7e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.175895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6cb26446-74aa-4564-a429-181990bd71a5 req-d647b458-efd7-4e07-81eb-0ed7d8ec0f7e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.192025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6cb26446-74aa-4564-a429-181990bd71a5 req-d647b458-efd7-4e07-81eb-0ed7d8ec0f7e service nova] Creating event network-vif-deleted:0b6653d4-cd9e-41c1-868a-202a9ad76529 for instance 31c823a6-b44f-427b-88cd-c2f82f438391 on n-h2-858238-3 Nov 02 13:55:09.198572 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6cb26446-74aa-4564-a429-181990bd71a5 req-d647b458-efd7-4e07-81eb-0ed7d8ec0f7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050602 Nov 02 13:55:09.199770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1760/2812] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:09.207676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:09.208760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:09.217205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.218478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.219574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.221237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.222467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.223526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.528444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:09.537782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3f52cda-7333-49d3-bdc2-22eb0da258c8 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.336414 Nov 02 13:55:09.539047 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1761/2813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:09 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:09.545053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:09.546068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:09.556329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.557233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.557970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.559373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.560010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.560681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.851835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:09.872783 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-026ebad6-1039-4afd-b0f6-4c6cabb76c44 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.330889 Nov 02 13:55:09.896930 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1762/2814] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:09 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:09.918931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa3cb678-53be-4072-94b6-4414d3e7366e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f8136b5e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:10.030973 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa3cb678-53be-4072-94b6-4414d3e7366e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.128996 Nov 02 13:55:10.032667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1763/2815] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:09 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:10.039396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:10.040235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:10.049780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.050518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.051453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.053416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.054209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.055043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.094631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:10.427692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:10.439007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:10.441137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:10.442631 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c1214285-925c-4a54-a44f-039c8cc6451a tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.408778 Nov 02 13:55:10.470310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1764/2816] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:10 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:10.483959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:10.486773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:10.494425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.498788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.500693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.501966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.503409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.504295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.800122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:10.811618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-529ab14c-5fe9-414b-9edd-f169a4ff8103 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.338340 Nov 02 13:55:10.812433 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1765/2817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:10 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:10.846580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:10.847059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:10.864800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.865316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.868643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.870004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.870468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.870917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.912878 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 HTTP/1.1 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '31c823a6-b44f-427b-88cd-c2f82f438391'} Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:10.914744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85f232b2-df67-4208-adb9-5f5e442eaa7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 404 len: 111 microversion: 2.1 time: 0.086665 Nov 02 13:55:10.920734 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1766/2818] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:10 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:11.225794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Calling method '.version_select at 0x7f6f85f6c550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:11.241830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=59 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:11.255533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.256040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.256471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.259783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.260276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.260711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.300124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43dea572-e851-4593-9b25-d0a2466dc97a tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.381860 Nov 02 13:55:11.307492 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1767/2819] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Nov 2 13:55:10 2022] GET /compute/v2.1/limits => generated 511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:11.314809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:11.315732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:11.324629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.325336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.325838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.326593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.327883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.328415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.538079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:11.549027 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-744db1c0-418b-44b0-a595-c65a04eca0f4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.239663 Nov 02 13:55:11.549939 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1768/2820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:11 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:11.568254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:11.569148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:11.576467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.577151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.577771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.578646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.579651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.580409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.835519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:11.848269 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0dfecae6-f043-40e6-82a5-1f1e60d20b9b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.297053 Nov 02 13:55:11.860972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1769/2821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:11 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:11.866217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e997aca-599a-4aff-8845-4291ae188f7a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81a9f940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:11.930313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e997aca-599a-4aff-8845-4291ae188f7a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.067670 Nov 02 13:55:11.931623 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1770/2822] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:11 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:11.938543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-728073420", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:12.028495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:55:12.622521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:55:12.623347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:55:12.623883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:55:12.624472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:55:12.624971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:55:12.635760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.636239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.636661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.637371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.637998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.638567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.660300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:12.666506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:12.681873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:55:12.684382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:55:12.749894 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98c52143-e27a-4171-8919-462f97f1c667 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816814 Nov 02 13:55:12.757405 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1771/2823] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:55:12.765535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:12.766559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:12.779786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.780636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.781286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.782215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.783040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.784609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.128562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:13.140624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:13.142568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:13.143814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-487afbff-99ec-4725-929a-3bcf2017f33f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.392099 Nov 02 13:55:13.144849 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1772/2824] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:12 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:13.153968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1003573301", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:13.234220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:55:13.504722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:13.513318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Getting quotas for project a500efa05c02491aaaed7f1f00e90515. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:13.526610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Getting quotas for user 460ec0dcdb754b9eb0b01ce746a8b863 and project a500efa05c02491aaaed7f1f00e90515. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:13.544561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Request method failure captured: Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 1752 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYna9QtL-1AAdmVVdf1eTZxxUHA3IBkGE8HJYsqwIU8pEQU7TOxxQVTQMdEZ6OHyl4Nmby9BUv1F7rLUm2mZlbNJSPP0G8ULm9vlOq0KNVHf_32PgH5t_a9MQRsJpyNOGhzD_ElSDWjMwuXyLqX9N9y1tBiNTq2pxArTWLBr_a0an7bE Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a500efa05c02491aaaed7f1f00e90515 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1734463193 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a500efa05c02491aaaed7f1f00e90515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a500efa05c02491aaaed7f1f00e90515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a500efa05c02491aaaed7f1f00e90515"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a500efa05c02491aaaed7f1f00e90515"}]}] Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1734463193 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a500efa05c02491aaaed7f1f00e90515 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1734463193 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 460ec0dcdb754b9eb0b01ce746a8b863 Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1003573301", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:13.546968 n-d-858238-3 devstack@n-api.service[137559]: exception: Maximum number of metadata items exceeds 128 Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1003573301', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:55:13.549713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:13.557325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-657ded7f-7b0c-416b-8a70-1d2167c4924b tempest-AbsoluteLimitsNegativeTestJSON-1734463193 tempest-AbsoluteLimitsNegativeTestJSON-1734463193-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.408701 Nov 02 13:55:13.561909 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1773/2825] 10.222.0.18 () {60 vars in 1148 bytes} [Wed Nov 2 13:55:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 416 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:55:13.573116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:13.576184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:13.592324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:13.592818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:13.593252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.600370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:13.600862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:13.601294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.876418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:13.891540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8a0d3aa-129d-4582-bfbb-9733f7e8f0a9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.325122 Nov 02 13:55:13.892159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1774/2826] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:13 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:13.910063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:13.910867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:13.921413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:13.926405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:13.927642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.932330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:13.932987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:13.933606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.240139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:14.263484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80e2cbc8-8457-4b36-b310-2379e45ba3e0 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.362313 Nov 02 13:55:14.265380 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1775/2827] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:13 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.282750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:14.286061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:14.306960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.307553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.307989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.308708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.309157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.316766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.430355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:14.438941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b6c62a8-5a39-4e55-aa81-c6c765fb682e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1272 microversion: 2.1 time: 0.168212 Nov 02 13:55:14.439865 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1776/2828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:14 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.462710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:14.463357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:14.469391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.469869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.470296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.471295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.471906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.472482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.746618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:14.760329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75951096-c31f-4e2e-b389-e7da59c39d2b tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.302509 Nov 02 13:55:14.762120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1777/2829] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:14 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.767943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-03f0590b-e115-4dc7-a714-72f1e318dd1b req-170140c1-e282-4099-adfe-019cf6fa9739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cdade5-690b-46b3-96cc-dd698e3a15be", "name": "network-vif-plugged", "status": "completed", "tag": "a25334d8-675f-4ad0-a6e5-eb956a10d261"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:14.795516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-03f0590b-e115-4dc7-a714-72f1e318dd1b req-170140c1-e282-4099-adfe-019cf6fa9739 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.797266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-03f0590b-e115-4dc7-a714-72f1e318dd1b req-170140c1-e282-4099-adfe-019cf6fa9739 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.801604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-03f0590b-e115-4dc7-a714-72f1e318dd1b req-170140c1-e282-4099-adfe-019cf6fa9739 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.818713 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-03f0590b-e115-4dc7-a714-72f1e318dd1b req-170140c1-e282-4099-adfe-019cf6fa9739 service nova] Creating event network-vif-plugged:a25334d8-675f-4ad0-a6e5-eb956a10d261 for instance 07cdade5-690b-46b3-96cc-dd698e3a15be on n-h2-858238-3 Nov 02 13:55:14.825494 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-03f0590b-e115-4dc7-a714-72f1e318dd1b req-170140c1-e282-4099-adfe-019cf6fa9739 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060949 Nov 02 13:55:14.826755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1778/2830] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:14.835181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-acb17fa1-2827-425e-afb9-1944a39966b4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85df7700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:14.917216 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-acb17fa1-2827-425e-afb9-1944a39966b4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.086343 Nov 02 13:55:14.918545 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1779/2831] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:14 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.933728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:14.938037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:14.957959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.958901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.959598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.961493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.964669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.965289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:15.471066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:15.493108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:15.495409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:15.501702 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c1a3970-6756-4b5b-a7a5-ff5facca7440 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.578959 Nov 02 13:55:15.515184 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1780/2832] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:14 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:15.523023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:15.524036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:15.550184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.551039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.551815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:15.553234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.553721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.554145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.104158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:16.119068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-268ba5dd-39fa-4750-ba92-6f0df14a9f00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.609632 Nov 02 13:55:16.121705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1781/2833] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:15 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:16.142413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:16.143034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:16.157504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.158251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.158902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.164093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.168211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.171537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.488935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:16.499764 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df66e37c-b88e-47e7-a3b2-b21f6f11f636 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1317 microversion: 2.1 time: 0.376928 Nov 02 13:55:16.502908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1782/2834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:16 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:16.515555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:16.518934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:16.533712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.543029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.543753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.544654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:16.545266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:16.545901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.930116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:16.949039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f5bcbb72-6e45-4890-9828-20bd94f06ed0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.444680 Nov 02 13:55:16.965595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1783/2835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:16 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:16.993296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:16.993922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:17.021521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.028932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.036166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.039708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.040481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.041509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.292885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:17.305622 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db4a67ff-fafb-4e25-b6d8-704384156bb1 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.338765 Nov 02 13:55:17.306555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1784/2836] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:16 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:17.311277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a222a5ed-dea2-4ada-b359-17197000f6f8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81f17790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:17.447743 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a222a5ed-dea2-4ada-b359-17197000f6f8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.139704 Nov 02 13:55:17.448753 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1785/2837] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:17 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:17.460326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:17.461080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:17.475175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.480461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.481173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.482594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.483301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.484857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.859684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:17.891174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:17.899435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:17.901513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-33441e26-538a-4668-9eb3-8d8384dc3834 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.451612 Nov 02 13:55:17.925611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1786/2838] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:17 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:17.931811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ba2d28fc-8bdc-4678-8b67-04a2cfdf2e53 req-2ca1163a-7ef7-4bd4-ba69-b08ff96c9b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b35a714-ca92-4921-b64a-469ddd2c9901", "name": "network-vif-plugged", "status": "completed", "tag": "5b9a93b3-3215-4e28-9ba2-4749d81de91d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:17.972320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ba2d28fc-8bdc-4678-8b67-04a2cfdf2e53 req-2ca1163a-7ef7-4bd4-ba69-b08ff96c9b83 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.972796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ba2d28fc-8bdc-4678-8b67-04a2cfdf2e53 req-2ca1163a-7ef7-4bd4-ba69-b08ff96c9b83 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.973219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ba2d28fc-8bdc-4678-8b67-04a2cfdf2e53 req-2ca1163a-7ef7-4bd4-ba69-b08ff96c9b83 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.992608 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ba2d28fc-8bdc-4678-8b67-04a2cfdf2e53 req-2ca1163a-7ef7-4bd4-ba69-b08ff96c9b83 service nova] Creating event network-vif-plugged:5b9a93b3-3215-4e28-9ba2-4749d81de91d for instance 9b35a714-ca92-4921-b64a-469ddd2c9901 on n-h2-858238-3 Nov 02 13:55:17.999196 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ba2d28fc-8bdc-4678-8b67-04a2cfdf2e53 req-2ca1163a-7ef7-4bd4-ba69-b08ff96c9b83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070523 Nov 02 13:55:18.000525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1787/2839] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:18.016549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:18.018017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:18.025545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.026698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.027430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.028920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.029714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.030820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.110034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:18.587941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:18.614929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70755c0f-255d-442e-bb44-bd09972a53ac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.604830 Nov 02 13:55:18.620909 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1788/2840] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:18 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:18.641324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:18.651292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:18.668265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.671794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.673651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.678162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.680836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.684922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.022331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:19.046914 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec55465c-cf45-43cd-ae71-65d925b9cb5f tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1507 microversion: 2.1 time: 0.421430 Nov 02 13:55:19.052648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1789/2841] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:18 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:19.079889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:19.087443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:19.102898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.108144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.110582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.113250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.114576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.116277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.621597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:19.637083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b04b5f7-d668-45c1-ad4e-ed4cedf91a13 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.580514 Nov 02 13:55:19.671707 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1790/2842] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:19 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:19.700376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:19.703732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:19.732357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.733989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.749896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.751547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.759351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.760442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.198300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:20.209271 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-347409e3-8371-46fb-884d-9d13ce9b4c70 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1369 microversion: 2.1 time: 0.529237 Nov 02 13:55:20.214267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1791/2843] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:19 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1369 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:20.225770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c90972a3-0e0b-4ee7-b7f5-2a45dfe8fb4d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85e588b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:20.312057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c90972a3-0e0b-4ee7-b7f5-2a45dfe8fb4d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.093917 Nov 02 13:55:20.312822 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1792/2844] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:20 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:20.324809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:20.328689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:20.342376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.346732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.347340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.348151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.352389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.352942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.762960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:20.786829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:20.789465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:20.791541 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba4be6a1-c539-423b-b504-5a11ce0b81dd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.475060 Nov 02 13:55:20.793177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1793/2845] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:20 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:20.806319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a74c25d6-7dda-4c75-871f-174713c22d81 req-b8a57e36-7fd9-44e3-984f-bfa58807cd6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8a7b0f-3adb-4756-adcd-73c1a8765e94", "tag": "310b5ef2-1f4e-4b22-af09-fa6e2329276c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:20.827941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a74c25d6-7dda-4c75-871f-174713c22d81 req-b8a57e36-7fd9-44e3-984f-bfa58807cd6f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.833951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a74c25d6-7dda-4c75-871f-174713c22d81 req-b8a57e36-7fd9-44e3-984f-bfa58807cd6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.835518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a74c25d6-7dda-4c75-871f-174713c22d81 req-b8a57e36-7fd9-44e3-984f-bfa58807cd6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.854963 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a74c25d6-7dda-4c75-871f-174713c22d81 req-b8a57e36-7fd9-44e3-984f-bfa58807cd6f service nova] Creating event network-changed:310b5ef2-1f4e-4b22-af09-fa6e2329276c for instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 on n-h1-858238-3 Nov 02 13:55:20.861888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a74c25d6-7dda-4c75-871f-174713c22d81 req-b8a57e36-7fd9-44e3-984f-bfa58807cd6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066167 Nov 02 13:55:20.868023 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1794/2846] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:20.873975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:20.874901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:20.885744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.887394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.888111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.889962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:20.890639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:20.891253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.621638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:21.644823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62654d3d-fed6-4a45-b745-adf9b49f0dfd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1507 microversion: 2.1 time: 0.775132 Nov 02 13:55:21.657331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1795/2847] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:20 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:21.684527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:21.693020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:21.714567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.716118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.716855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.719390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.724387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.727026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.382630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:22.398572 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac034311-e0bd-4a13-9745-8a78860b9c24 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.725487 Nov 02 13:55:22.405143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1796/2848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:21 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:22.418494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-95d42069-8d1e-4e9d-a38e-6db544243c12 req-9dea1b4f-f80b-4875-8566-5286320549d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "e628c554-a424-42a4-a210-e83675fa84e3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:22.456347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95d42069-8d1e-4e9d-a38e-6db544243c12 req-9dea1b4f-f80b-4875-8566-5286320549d9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:22.456954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95d42069-8d1e-4e9d-a38e-6db544243c12 req-9dea1b4f-f80b-4875-8566-5286320549d9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:22.457397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95d42069-8d1e-4e9d-a38e-6db544243c12 req-9dea1b4f-f80b-4875-8566-5286320549d9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.500263 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-95d42069-8d1e-4e9d-a38e-6db544243c12 req-9dea1b4f-f80b-4875-8566-5286320549d9 service nova] Creating event network-vif-plugged:e628c554-a424-42a4-a210-e83675fa84e3 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:22.520811 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-95d42069-8d1e-4e9d-a38e-6db544243c12 req-9dea1b4f-f80b-4875-8566-5286320549d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108907 Nov 02 13:55:22.524509 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1797/2849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:22.546423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:22.549243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:22.576692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:22.577177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:22.582141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.582925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:22.587442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:22.592257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.673044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:23.095027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:23.117029 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14245294-7ace-47d6-896e-ddfcfe763c25 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.590489 Nov 02 13:55:23.118073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1798/2850] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:22 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:23.128449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:23.131938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:23.152961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.157753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.158207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.159164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.159911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.160637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.367530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:23.380276 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0168f41-ee87-415e-831d-2dd54ab13e9c tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1556 microversion: 2.1 time: 0.260757 Nov 02 13:55:23.381208 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1799/2851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:23 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:23.386555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-731599bd-f7fa-4b4c-865a-7acf60427fe8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85e2fc10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:23.466747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-731599bd-f7fa-4b4c-865a-7acf60427fe8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.084468 Nov 02 13:55:23.476510 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1800/2852] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:23 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:23.483840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:23.491714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:23.497818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.498548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.499171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.500075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.500692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.501341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.547682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=11 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:23.672216 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a7a7558-78b3-47e3-8adb-2c8d85385bf4 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "PUT /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1079 microversion: 2.1 time: 0.194159 Nov 02 13:55:23.683135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1801/2853] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 13:55:23 2022] PUT /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1079 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:23.694301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:23.694989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:23.713191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.713689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.714119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.719184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.720912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.721366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.164240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:24.180143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:24.182015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:24.184598 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6440ec0f-a0a4-4ef3-9917-3f6a75d47b5f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.510402 Nov 02 13:55:24.185345 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1802/2854] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:23 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:24.212097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:24.212601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:24.219541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.221094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.221693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.222669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.223358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.224472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.334223 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12819159-f6b8-4a8b-a3ed-911c8df1f049 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131929 Nov 02 13:55:24.335377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1803/2855] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:55:24 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:24.340404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:24.341215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:24.349274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.349993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.350617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.351519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.351980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.352404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.658970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:24.671183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-296a4c55-7717-4e35-b7ec-51d1cbdc141d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.334530 Nov 02 13:55:24.671897 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1804/2856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:24 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:24.688595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:24.689408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:24.704957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.706826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.708777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.711758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.712703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.713429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.931365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:24.957065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23a0a7bd-da00-4f54-b3f5-03d505a3930c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1505 microversion: 2.1 time: 0.282416 Nov 02 13:55:24.962619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1805/2857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:24 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:24.976850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:24.984729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.005461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.006310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.006989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.015157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.015799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.016349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.291004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:25.301168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34c28121-6cca-4642-a81d-f3b5d6f4db17 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.336802 Nov 02 13:55:25.305107 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1806/2858] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:24 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:25.325275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23550aee-f031-4528-86f1-bab0c564a815 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85e90430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.414083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23550aee-f031-4528-86f1-bab0c564a815 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.106284 Nov 02 13:55:25.415081 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1807/2859] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:25 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:25.421648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcbe90f-0c88-4001-974c-5f232a11b7c7", "name": "network-vif-plugged", "status": "completed", "tag": "7249fcba-6a05-440f-abbc-4d93af788699"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "b580f924-6265-448a-9b14-4d6a702fe994"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "a4efc2d4-567e-4723-80c8-9c4971601415"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "e707d585-acad-44e6-9040-e84131462d69"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:25.446169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.455875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.460138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.477805 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Creating event network-vif-plugged:7249fcba-6a05-440f-abbc-4d93af788699 for instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 on n-h1-858238-3 Nov 02 13:55:25.478549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Creating event network-vif-plugged:b580f924-6265-448a-9b14-4d6a702fe994 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:25.479327 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Creating event network-vif-plugged:a4efc2d4-567e-4723-80c8-9c4971601415 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:25.480107 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] Creating event network-vif-plugged:e707d585-acad-44e6-9040-e84131462d69 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:25.487487 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bebc4a56-3eed-4d03-a378-d6c4bbfa6273 req-8943cdbc-eeca-43ac-8eb8-c36e3c7e6b94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.070793 Nov 02 13:55:25.488310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1808/2860] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:25.493335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.494117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.500371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.500859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.501294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.501992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.502450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.502871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.805046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:25.813987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:25.828351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98ae181f-0745-4548-a044-6a8b54da6620 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1505 microversion: 2.1 time: 0.337620 Nov 02 13:55:25.829253 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1809/2861] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:25 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:25.859845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.861108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.871133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.872139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.873022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.875519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.876491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.878849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.620723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:26.632135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:26.633864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:26.635044 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-373d6542-a3e6-45bb-a18a-730ae202a176 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.783172 Nov 02 13:55:26.648280 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1810/2862] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:25 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:26.663840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:26.666019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:26.673422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.674012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.674445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.675180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.675679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.676102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.873084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:26.888062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3daf7721-a8ef-4582-b709-ca6bb3179de9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.238271 Nov 02 13:55:26.889013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1811/2863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:26 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:26.895170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:26.899126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:26.906868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.907521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.908009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.909199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.910000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.910652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.034349 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12af3726-0794-4018-8b40-799150579118 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "PUT /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1081 microversion: 2.1 time: 0.143550 Nov 02 13:55:27.035508 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1812/2864] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 13:55:26 2022] PUT /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1081 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:27.042805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:27.044065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:27.058378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.076935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.082550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.085521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.086299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.094290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.313304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:27.323714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67df7712-5999-4574-a2f5-a562af2aa49e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.285935 Nov 02 13:55:27.324873 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1813/2865] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:27 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:27.331031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f5071ec-86ac-4c0a-a3c7-bb14b8b25fef tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85e2f940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:27.415784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f5071ec-86ac-4c0a-a3c7-bb14b8b25fef tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.088814 Nov 02 13:55:27.424756 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1814/2866] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:27 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:27.437279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:27.443445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:27.458147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.459593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.460268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.461766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.462938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.463621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.667927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:27.679729 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5c23e67-26f0-42e1-9f0a-ce79b3f6a5d9 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1507 microversion: 2.1 time: 0.254142 Nov 02 13:55:27.681287 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1815/2867] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:27 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:27.686685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:27.687676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:27.699202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.700279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.701534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.703570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.704217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.704802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:28.039605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:28.052176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:28.054242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:28.055147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9bc10bdc-4dee-401b-9028-05c470e344e2 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.372316 Nov 02 13:55:28.056257 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1816/2868] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:27 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:28.063132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "e0acb975-a97c-4b3a-946a-e5affc445ac5"}, {"server_uuid": "e95b31f0-63d4-4394-a173-98421faf4b34", "name": "network-vif-plugged", "status": "completed", "tag": "14184870-b06b-402e-9346-4449d75aef7a"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "a6219b37-8b62-4a43-a5a2-c07feff83afb"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-plugged", "status": "completed", "tag": "ebfa19ed-8088-41a6-92e6-19f7b9b8fac5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:28.074969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:28.075489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:28.075912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:28.114215 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Creating event network-vif-plugged:e0acb975-a97c-4b3a-946a-e5affc445ac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:28.114720 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Creating event network-vif-plugged:14184870-b06b-402e-9346-4449d75aef7a for instance e95b31f0-63d4-4394-a173-98421faf4b34 on n-h1-858238-3 Nov 02 13:55:28.115241 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Creating event network-vif-plugged:a6219b37-8b62-4a43-a5a2-c07feff83afb for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:28.115736 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] Creating event network-vif-plugged:ebfa19ed-8088-41a6-92e6-19f7b9b8fac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:28.137297 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3c89e198-af3d-41f1-89d2-6a0937b1d5b3 req-904de050-5e2b-4ca9-84ee-02590b0a6861 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.079692 Nov 02 13:55:28.137920 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1817/2869] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:28.180614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:28.181609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:28.203030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:28.205276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:28.210891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:28.212972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:28.214428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:28.216209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.062081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:29.077611 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3050dc0-43cd-4ad5-a267-675e5affc0eb tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1507 microversion: 2.1 time: 0.932462 Nov 02 13:55:29.078712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1818/2870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:28 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1507 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:29.084175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:29.085045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:29.092715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.093647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.094320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.095275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.095909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.096492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.392281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:29.405408 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f3136ba-10e1-4083-a72e-d88f4fdee600 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1314 microversion: 2.1 time: 0.324225 Nov 02 13:55:29.406177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1819/2871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:29 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:29.411410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:29.412677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:29.419671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.420942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.420942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.421980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.422768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.423211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.662802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:29.672399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-638cd604-4f2a-4283-bc70-aa2e0d4fae74 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.263929 Nov 02 13:55:29.673484 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1820/2872] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:29 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:29.679229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b85bcec-9c7a-44aa-a3b9-6be1232c7047 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81a9f1f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:29.753571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b85bcec-9c7a-44aa-a3b9-6be1232c7047 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.078917 Nov 02 13:55:29.754670 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1821/2873] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:29 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:29.777381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-181c6631-74c8-42c2-81d3-b2040e4ddf6c req-f52a0465-2b9b-44fc-be9e-6af6f9eb99e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b35a714-ca92-4921-b64a-469ddd2c9901", "tag": "5b9a93b3-3215-4e28-9ba2-4749d81de91d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:29.789344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-181c6631-74c8-42c2-81d3-b2040e4ddf6c req-f52a0465-2b9b-44fc-be9e-6af6f9eb99e8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.790080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-181c6631-74c8-42c2-81d3-b2040e4ddf6c req-f52a0465-2b9b-44fc-be9e-6af6f9eb99e8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.790694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-181c6631-74c8-42c2-81d3-b2040e4ddf6c req-f52a0465-2b9b-44fc-be9e-6af6f9eb99e8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.809315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-181c6631-74c8-42c2-81d3-b2040e4ddf6c req-f52a0465-2b9b-44fc-be9e-6af6f9eb99e8 service nova] Creating event network-changed:5b9a93b3-3215-4e28-9ba2-4749d81de91d for instance 9b35a714-ca92-4921-b64a-469ddd2c9901 on n-h2-858238-3 Nov 02 13:55:29.821158 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-181c6631-74c8-42c2-81d3-b2040e4ddf6c req-f52a0465-2b9b-44fc-be9e-6af6f9eb99e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059856 Nov 02 13:55:29.822301 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1822/2874] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:29.839181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:29.841434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:29.855370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.856045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.856651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.857632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.858358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.859147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.471425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:30.504182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:30.506539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:30.510984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9097793e-4a9e-4757-944e-8b9aac09791c tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1879 microversion: 2.42 time: 0.687009 Nov 02 13:55:30.513952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1823/2875] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:29 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1879 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:30.524128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:30.525825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:30.556549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:30.557435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:30.558182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.561004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:30.561908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:30.563661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.667733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:30.892332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:30.898486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6852b89-0ee2-4460-8e0c-4c4cd1635b16 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 204 len: 0 microversion: 2.1 time: 0.382812 Nov 02 13:55:30.908503 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1824/2876] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:30 2022] DELETE /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:31.405591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d971a34f-b766-44bd-81e3-9bd79b7f9638 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f80b97dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1761496274", "description": "tempest-description-1561878156"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:31.756002 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d971a34f-b766-44bd-81e3-9bd79b7f9638 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.845269 Nov 02 13:55:31.757995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1825/2877] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:55:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:31.765748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-48c1c1fa-7eb5-4f02-96fe-ac7486b73446 req-cd505b25-0979-418b-a912-48e30c78ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8a7b0f-3adb-4756-adcd-73c1a8765e94", "name": "network-vif-plugged", "status": "completed", "tag": "310b5ef2-1f4e-4b22-af09-fa6e2329276c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:31.780775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-48c1c1fa-7eb5-4f02-96fe-ac7486b73446 req-cd505b25-0979-418b-a912-48e30c78ee73 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.781579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-48c1c1fa-7eb5-4f02-96fe-ac7486b73446 req-cd505b25-0979-418b-a912-48e30c78ee73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.782163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-48c1c1fa-7eb5-4f02-96fe-ac7486b73446 req-cd505b25-0979-418b-a912-48e30c78ee73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:31.820462 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-48c1c1fa-7eb5-4f02-96fe-ac7486b73446 req-cd505b25-0979-418b-a912-48e30c78ee73 service nova] Creating event network-vif-plugged:310b5ef2-1f4e-4b22-af09-fa6e2329276c for instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 on n-h1-858238-3 Nov 02 13:55:31.847726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-48c1c1fa-7eb5-4f02-96fe-ac7486b73446 req-cd505b25-0979-418b-a912-48e30c78ee73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087272 Nov 02 13:55:31.848915 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1826/2878] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:31.870275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:31.875226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:31.903329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.905333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.908394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:31.910117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.912331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.913118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.282713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:32.291633 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0675961b-cd83-4898-9943-f9c5d86b2cac tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1502 microversion: 2.1 time: 0.429479 Nov 02 13:55:32.292233 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1827/2879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:31 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1502 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:32.309283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:32.309914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:32.340408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:32.340988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:32.342096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.342096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:32.342972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:32.344088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.749908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:32.777712 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2de6057-8469-4a45-8d5c-75c8e4716a5d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1320 microversion: 2.1 time: 0.484021 Nov 02 13:55:32.778718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1828/2880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:32 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1320 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:32.802723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74df364c-a08e-4f99-b4dd-71f513341cca tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80b9bc10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:32.911670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74df364c-a08e-4f99-b4dd-71f513341cca tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1410 microversion: 2.1 time: 0.123618 Nov 02 13:55:32.912170 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1829/2881] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:32 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1410 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:32.925571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:32.926207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:32.942511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:32.942994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:32.949531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.950567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:32.951260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:32.955161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.998116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:33.005545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:33.067430 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Instance is already in deleting state, ignoring this request Nov 02 13:55:33.069303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-63dc4994-debc-47ba-b584-4e5062a6b5f6 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 204 len: 0 microversion: 2.1 time: 0.153313 Nov 02 13:55:33.073291 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1830/2882] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:32 2022] DELETE /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:33.079849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:33.080634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:33.087376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.087868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.088355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.089068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.089519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.090126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.436686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:33.460609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:33.463759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:33.470439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1fefbe5-07ae-4594-8315-12a4952cdc1d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2836 microversion: 2.42 time: 0.393116 Nov 02 13:55:33.471215 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1831/2883] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:55:33 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2836 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:33.485141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-647fd465-e429-4370-b82a-e41561f40c26 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f85e2fc10>, body: {"security_group_rule": {"parent_group_id": "d3cf5239-ea88-4e23-b730-1790954e717f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:34.310628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-647fd465-e429-4370-b82a-e41561f40c26 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.834009 Nov 02 13:55:34.311517 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1832/2884] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:34.320731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:34.321705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:34.364683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.365674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.371280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.372695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.387296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.388027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.464769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.465753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.466474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.467251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lazy-loading 'fault' on Instance uuid 07cdade5-690b-46b3-96cc-dd698e3a15be {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:34.534702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa9f0bc1c07c412fb4c6cc59e9a08efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708743f0f3134a5e9444fed3dcad5ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:34.552288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c109cab9-2251-4ed7-b36d-21db9478ba00 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 200 len: 1307 microversion: 2.1 time: 0.237894 Nov 02 13:55:34.563314 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1833/2885] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:34 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:34.563314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:34.563314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:34.565595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.566275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.567137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.568204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.569440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.570054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.740813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82f04867-77e0-480f-9c30-475cb687b367 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.186240 Nov 02 13:55:34.741419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1834/2886] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 13:55:34 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f/os-interface => generated 1832 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:34.749381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:34.750253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:34.769494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.770897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.771984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.773092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:34.774049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:34.774753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:35.212031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:35.229309 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-deb92a01-573e-461a-a760-96a8a58c9606 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1501 microversion: 2.1 time: 0.484699 Nov 02 13:55:35.231348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1835/2887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:34 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1501 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:35.259948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d3dfc77-210b-44c8-ab0c-a69f1d7789a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85f6c310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:35.364127 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d3dfc77-210b-44c8-ab0c-a69f1d7789a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1419 microversion: 2.1 time: 0.130364 Nov 02 13:55:35.369949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1836/2888] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:35 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1419 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:35.381104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-80f0794a-b88b-4de9-8f8d-429dfcbea08d req-e5988c3e-8ca7-4b05-ab9b-39dca1377515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cdade5-690b-46b3-96cc-dd698e3a15be", "name": "network-vif-deleted", "tag": "a25334d8-675f-4ad0-a6e5-eb956a10d261"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:35.400758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-80f0794a-b88b-4de9-8f8d-429dfcbea08d req-e5988c3e-8ca7-4b05-ab9b-39dca1377515 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:35.401606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-80f0794a-b88b-4de9-8f8d-429dfcbea08d req-e5988c3e-8ca7-4b05-ab9b-39dca1377515 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:35.402389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-80f0794a-b88b-4de9-8f8d-429dfcbea08d req-e5988c3e-8ca7-4b05-ab9b-39dca1377515 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:35.417111 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-80f0794a-b88b-4de9-8f8d-429dfcbea08d req-e5988c3e-8ca7-4b05-ab9b-39dca1377515 service nova] Creating event network-vif-deleted:a25334d8-675f-4ad0-a6e5-eb956a10d261 for instance 07cdade5-690b-46b3-96cc-dd698e3a15be on n-h2-858238-3 Nov 02 13:55:35.427394 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-80f0794a-b88b-4de9-8f8d-429dfcbea08d req-e5988c3e-8ca7-4b05-ab9b-39dca1377515 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060819 Nov 02 13:55:35.428094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1837/2889] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:35.437256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff12b81d-a1b4-4988-80cd-0944e99766ae tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f80b97160>, body: {"security_group_rule": {"parent_group_id": "d3cf5239-ea88-4e23-b730-1790954e717f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:35.612198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ff12b81d-a1b4-4988-80cd-0944e99766ae tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: This rule already exists in group d3cf5239-ea88-4e23-b730-1790954e717f Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff12b81d-a1b4-4988-80cd-0944e99766ae tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 138 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "d3cf5239-ea88-4e23-b730-1790954e717f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: exception: This rule already exists in group d3cf5239-ea88-4e23-b730-1790954e717f Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd3cf5239-ea88-4e23-b730-1790954e717f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d3cf5239-ea88-4e23-b730-1790954e717f Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d3cf5239-ea88-4e23-b730-1790954e717f Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:35.615467 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:35.619851 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:35.619851 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:35.619851 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d3cf5239-ea88-4e23-b730-1790954e717f Nov 02 13:55:35.619851 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:35.619851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff12b81d-a1b4-4988-80cd-0944e99766ae tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 400 to user: This rule already exists in group d3cf5239-ea88-4e23-b730-1790954e717f {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:35.619851 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff12b81d-a1b4-4988-80cd-0944e99766ae tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.188075 Nov 02 13:55:35.625685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1838/2890] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:35 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:55:35.634655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:35.642832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:35.666292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:35.667192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:35.667950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:35.669114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:35.669936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:35.675750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:35.974371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:35.983692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a85d2cff-31e7-4640-b6ed-7fb5c1a28891 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1501 microversion: 2.1 time: 0.356457 Nov 02 13:55:35.984433 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1839/2891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:35 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1501 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:35.998998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2363c998-362d-4071-a04d-bfbc336f3e85"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:36.001680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:36.016187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.016747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.017172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.018807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.019506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.020144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.349599 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-150a875e-d23a-4259-9982-944e057dc642 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363173 Nov 02 13:55:36.350414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1840/2892] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 13:55:35 2022] POST /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:36.356395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b676c9-e849-4086-bcfb-a54c2c16c8f8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85dce0d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:36.463310 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62b676c9-e849-4086-bcfb-a54c2c16c8f8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 200 len: 1419 microversion: 2.1 time: 0.111250 Nov 02 13:55:36.475181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1841/2893] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:55:36 2022] GET /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 1419 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:36.482938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:36.483998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 07cdade5-690b-46b3-96cc-dd698e3a15be] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:36.491727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.492394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.492990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.493865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.494500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.494910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.511006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] HTTP exception thrown: Instance 07cdade5-690b-46b3-96cc-dd698e3a15be could not be found. Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Request method failure captured: Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be HTTP/1.1 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnX3BFDU5hs9Bkw_h-a1Q6t5n70uSGSPUyAB2aHik--WjucSXJ_8nTGs7uk64ciD6AViGgA26hlmDH0UlTGTGVD0yokNlHoRHtD7wvToW_rz9MuPlH5V6wtifhFplVg4mbFdRibJhVLjdpBwL6O3lddc6EJ_2fqN1TmayO5wdZbyGWk Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_708743f0f3134a5e9444fed3dcad5ed3"}]}] Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: fa9f0bc1c07c412fb4c6cc59e9a08efa Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 07cdade5-690b-46b3-96cc-dd698e3a15be could not be found. Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '07cdade5-690b-46b3-96cc-dd698e3a15be'} Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cdade5-690b-46b3-96cc-dd698e3a15be could not be found. Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cdade5-690b-46b3-96cc-dd698e3a15be could not be found. Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:36.512902 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cdade5-690b-46b3-96cc-dd698e3a15be could not be found. Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Returning 404 to user: Instance 07cdade5-690b-46b3-96cc-dd698e3a15be could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1800d144-0957-47d8-92e6-c02384fbd340 tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be" status: 404 len: 111 microversion: 2.1 time: 0.037386 Nov 02 13:55:36.517568 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1842/2894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:36 2022] GET /compute/v2.1/servers/07cdade5-690b-46b3-96cc-dd698e3a15be => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:36.523167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91a6ba88-e57e-448d-a067-b4962c6aecf5 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f85e688b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:36.919927 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91a6ba88-e57e-448d-a067-b4962c6aecf5 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/e5fb410a-e52f-4a55-9152-75c37c8229ca" status: 202 len: 0 microversion: 2.1 time: 0.401804 Nov 02 13:55:36.921292 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1843/2895] 10.222.0.18 () {58 vars in 1287 bytes} [Wed Nov 2 13:55:36 2022] DELETE /compute/v2.1/os-security-group-rules/e5fb410a-e52f-4a55-9152-75c37c8229ca => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:36.934186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:36.936091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:36.946829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.948020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.948612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.950299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.950953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.951686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.988126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:37.087080 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4a80139-b403-4871-a20e-2d762b550565 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 204 len: 0 microversion: 2.1 time: 0.163445 Nov 02 13:55:37.087696 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1844/2896] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:36 2022] DELETE /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:37.096742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc055b2d-e29e-41d4-8c94-463de0e241bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85da2a60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:37.856920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc055b2d-e29e-41d4-8c94-463de0e241bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 204 len: 0 microversion: 2.1 time: 0.764717 Nov 02 13:55:37.857488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1845/2897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:37 2022] DELETE /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 0 bytes in 769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:37.862533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:37.863197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:37.870075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:37.870853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:37.871522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:37.872597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:37.873171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:37.873893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:37.893075 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] HTTP exception thrown: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Request method failure captured: Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 HTTP/1.1 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnX3BFDU5hs9Bkw_h-a1Q6t5n70uSGSPUyAB2aHik--WjucSXJ_8nTGs7uk64ciD6AViGgA26hlmDH0UlTGTGVD0yokNlHoRHtD7wvToW_rz9MuPlH5V6wtifhFplVg4mbFdRibJhVLjdpBwL6O3lddc6EJ_2fqN1TmayO5wdZbyGWk Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_708743f0f3134a5e9444fed3dcad5ed3"}]}] Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: fa9f0bc1c07c412fb4c6cc59e9a08efa Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '65c69f7b-9be3-4d3c-8450-33cd24a4bf94'} Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:37.897168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:37.900951 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:37.903683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Returning 404 to user: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:37.905013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b61e0bf8-2791-47ae-9623-836c1f0c013c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 404 len: 111 microversion: 2.1 time: 0.046486 Nov 02 13:55:37.905797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1846/2898] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:37 2022] DELETE /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:37.911725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d7cb9ab-7828-4852-b62d-e49f598814fd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f85e2f9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1529002443", "description": "tempest-description-724916861"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:38.097694 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d7cb9ab-7828-4852-b62d-e49f598814fd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.190456 Nov 02 13:55:38.109301 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1847/2899] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:55:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:38.114357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:38.115169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:38.135786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.136553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.137712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.138643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.141139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.142148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.350433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:38.375226 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-25e26741-ad15-4fd1-929e-b46017b751b5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1507 microversion: 2.1 time: 0.263862 Nov 02 13:55:38.381156 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1848/2900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:38 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:38.397047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ba547225-bec0-45f4-9386-63da4b4ec9b8 req-fbb6a24f-21ac-4ef1-951a-fdd262e14f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "tag": "ebfa19ed-8088-41a6-92e6-19f7b9b8fac5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:38.410687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ba547225-bec0-45f4-9386-63da4b4ec9b8 req-fbb6a24f-21ac-4ef1-951a-fdd262e14f84 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.411349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ba547225-bec0-45f4-9386-63da4b4ec9b8 req-fbb6a24f-21ac-4ef1-951a-fdd262e14f84 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.411910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ba547225-bec0-45f4-9386-63da4b4ec9b8 req-fbb6a24f-21ac-4ef1-951a-fdd262e14f84 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.427980 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ba547225-bec0-45f4-9386-63da4b4ec9b8 req-fbb6a24f-21ac-4ef1-951a-fdd262e14f84 service nova] Creating event network-changed:ebfa19ed-8088-41a6-92e6-19f7b9b8fac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:55:38.435198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ba547225-bec0-45f4-9386-63da4b4ec9b8 req-fbb6a24f-21ac-4ef1-951a-fdd262e14f84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048295 Nov 02 13:55:38.436906 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1849/2901] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:38.443358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b6889cce-7b0a-4781-a3d1-bdb389117521 req-accf96f3-5517-4ca4-991b-9388df2883fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcbe90f-0c88-4001-974c-5f232a11b7c7", "name": "network-vif-unplugged", "status": "completed", "tag": "7249fcba-6a05-440f-abbc-4d93af788699"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:38.453325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6889cce-7b0a-4781-a3d1-bdb389117521 req-accf96f3-5517-4ca4-991b-9388df2883fb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.453789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6889cce-7b0a-4781-a3d1-bdb389117521 req-accf96f3-5517-4ca4-991b-9388df2883fb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.454213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6889cce-7b0a-4781-a3d1-bdb389117521 req-accf96f3-5517-4ca4-991b-9388df2883fb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.467498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b6889cce-7b0a-4781-a3d1-bdb389117521 req-accf96f3-5517-4ca4-991b-9388df2883fb service nova] Creating event network-vif-unplugged:7249fcba-6a05-440f-abbc-4d93af788699 for instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 on n-h1-858238-3 Nov 02 13:55:38.474051 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b6889cce-7b0a-4781-a3d1-bdb389117521 req-accf96f3-5517-4ca4-991b-9388df2883fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035407 Nov 02 13:55:38.474683 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1850/2902] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:38.483022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:38.483652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:38.490244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.490729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.491190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.491892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.492339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.492758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.526998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:38.571011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:38.686469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5cee3ee8-9750-4e94-bd2d-f98e47b78265 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 204 len: 0 microversion: 2.1 time: 0.207333 Nov 02 13:55:38.687142 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1851/2903] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:38 2022] DELETE /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:38.703942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:38.706996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: 65c69f7b-9be3-4d3c-8450-33cd24a4bf94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:38.721170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.721955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.722501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.723854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.724515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.725713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.744469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] HTTP exception thrown: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Request method failure captured: Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 HTTP/1.1 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnX3BFDU5hs9Bkw_h-a1Q6t5n70uSGSPUyAB2aHik--WjucSXJ_8nTGs7uk64ciD6AViGgA26hlmDH0UlTGTGVD0yokNlHoRHtD7wvToW_rz9MuPlH5V6wtifhFplVg4mbFdRibJhVLjdpBwL6O3lddc6EJ_2fqN1TmayO5wdZbyGWk Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_708743f0f3134a5e9444fed3dcad5ed3"}]}] Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: fa9f0bc1c07c412fb4c6cc59e9a08efa Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '65c69f7b-9be3-4d3c-8450-33cd24a4bf94'} Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:38.746546 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Returning 404 to user: Instance 65c69f7b-9be3-4d3c-8450-33cd24a4bf94 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:38.750530 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-123dc2f7-4777-4c3d-8d76-489e5916f65d tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94" status: 404 len: 111 microversion: 2.1 time: 0.054937 Nov 02 13:55:38.752093 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1852/2904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:38 2022] GET /compute/v2.1/servers/65c69f7b-9be3-4d3c-8450-33cd24a4bf94 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:38.757501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c500b62-6a59-4ed2-b493-646e33a84237 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f8133da60>, body: {"security_group_rule": {"parent_group_id": "a689518e-cd8b-45ea-ab31-4a1528cbd946", "ip_protocol": "tcp", "from_port": 1925535654, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:38.908091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-5c500b62-6a59-4ed2-b493-646e33a84237 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Invalid port range 1925535654:22. Former value cannot be greater than the later Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c500b62-6a59-4ed2-b493-646e33a84237 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 146 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "a689518e-cd8b-45ea-ab31-4a1528cbd946", "ip_protocol": "tcp", "from_port": 1925535654, "to_port": 22}} Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid port range 1925535654:22. Former value cannot be greater than the later Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a689518e-cd8b-45ea-ab31-4a1528cbd946', 'ip_protocol': 'tcp', 'from_port': 1925535654, 'to_port': 22}}} Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1925535654:22. Former value cannot be greater than the later Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1925535654:22. Former value cannot be greater than the later Nov 02 13:55:38.910469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1925535654:22. Former value cannot be greater than the later Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c500b62-6a59-4ed2-b493-646e33a84237 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 400 to user: Invalid port range 1925535654:22. Former value cannot be greater than the later {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c500b62-6a59-4ed2-b493-646e33a84237 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.159516 Nov 02 13:55:38.917703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1853/2905] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:38 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:55:38.920888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:38.921395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:38.931334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.932104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.932688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.933711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:38.934328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:38.934902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:38.955913 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] HTTP exception thrown: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Request method failure captured: Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d HTTP/1.1 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnX3BFDU5hs9Bkw_h-a1Q6t5n70uSGSPUyAB2aHik--WjucSXJ_8nTGs7uk64ciD6AViGgA26hlmDH0UlTGTGVD0yokNlHoRHtD7wvToW_rz9MuPlH5V6wtifhFplVg4mbFdRibJhVLjdpBwL6O3lddc6EJ_2fqN1TmayO5wdZbyGWk Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_708743f0f3134a5e9444fed3dcad5ed3"}]}] Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: fa9f0bc1c07c412fb4c6cc59e9a08efa Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e4fbdd6a-c37c-4e4a-867e-c66728467c2d'} Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:38.957736 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:38.961751 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:38.963448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Returning 404 to user: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:38.964562 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa6b2e66-2614-43b0-a223-efd3bc733c8c tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 404 len: 111 microversion: 2.1 time: 0.050653 Nov 02 13:55:38.965300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1854/2906] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:38 2022] DELETE /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:38.970475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1929488072", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7e53e086-dd5c-4df9-95b5-9e9382cf5479"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:39.043960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] validate_networks() for [('7e53e086-dd5c-4df9-95b5-9e9382cf5479', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:55:39.515114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:55:39.516064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:55:39.516570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:55:39.517565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:55:39.518173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:55:39.534478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.535186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.535649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.536914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.537449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.538849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.561327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:39.570220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for user 165803256c184acc801878f0cb60cc67 and project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:39.588574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:55:39.591444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:55:39.664725 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7188483c-6cec-4087-a76c-3f9173f45611 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697746 Nov 02 13:55:39.665669 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1855/2907] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:55:39.670338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a12fb9ff-3e4e-468a-9260-1b8d5d2126f3 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f80b975e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1302497493", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:39.673242 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a12fb9ff-3e4e-468a-9260-1b8d5d2126f3 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Security group id should be uuid Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a12fb9ff-3e4e-468a-9260-1b8d5d2126f3 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 131 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1302497493", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group id should be uuid Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1302497493', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:39.674587 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:39.679932 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 13:55:39.679932 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.679932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a12fb9ff-3e4e-468a-9260-1b8d5d2126f3 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 400 to user: Security group id should be uuid {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:39.679932 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a12fb9ff-3e4e-468a-9260-1b8d5d2126f3 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009356 Nov 02 13:55:39.679932 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1856/2908] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:39 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:55:39.682555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:39.683225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] [instance: e4fbdd6a-c37c-4e4a-867e-c66728467c2d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:39.689660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.690484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.690919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.691649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.692752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.693178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.708823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] HTTP exception thrown: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Request method failure captured: Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d HTTP/1.1 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnX3BFDU5hs9Bkw_h-a1Q6t5n70uSGSPUyAB2aHik--WjucSXJ_8nTGs7uk64ciD6AViGgA26hlmDH0UlTGTGVD0yokNlHoRHtD7wvToW_rz9MuPlH5V6wtifhFplVg4mbFdRibJhVLjdpBwL6O3lddc6EJ_2fqN1TmayO5wdZbyGWk Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/708743f0f3134a5e9444fed3dcad5ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_708743f0f3134a5e9444fed3dcad5ed3"}]}] Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 708743f0f3134a5e9444fed3dcad5ed3 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2046564557 Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: fa9f0bc1c07c412fb4c6cc59e9a08efa Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-2046564557-project Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e4fbdd6a-c37c-4e4a-867e-c66728467c2d'} Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:39.710361 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] Returning 404 to user: Instance e4fbdd6a-c37c-4e4a-867e-c66728467c2d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:39.715267 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9178ffa5-e1ce-4c24-81ed-d50d07ede6dd tempest-ServerDiskConfigTestJSON-2046564557 tempest-ServerDiskConfigTestJSON-2046564557-project] 10.222.0.18 "GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d" status: 404 len: 111 microversion: 2.1 time: 0.034124 Nov 02 13:55:39.715960 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1857/2909] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:39 2022] GET /compute/v2.1/servers/e4fbdd6a-c37c-4e4a-867e-c66728467c2d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:39.720395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:39.720998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:39.727835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.728297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.728899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.729795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.730248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.730665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:40.022795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:40.034888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a8c1ce6-fbf3-4878-b779-14317ec05d1f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1507 microversion: 2.1 time: 0.318049 Nov 02 13:55:40.048507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1858/2910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:39 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:40.059501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a1a012f-6e37-42e3-b4dd-f8c251fa348e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:40.060115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a1a012f-6e37-42e3-b4dd-f8c251fa348e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:40.157252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a1a012f-6e37-42e3-b4dd-f8c251fa348e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:40.166326 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a1a012f-6e37-42e3-b4dd-f8c251fa348e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1208 microversion: 2.1 time: 0.116646 Nov 02 13:55:40.169261 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1859/2911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:40 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:40.181573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28e8e671-6803-4411-a075-9e2938c4b8de tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f85e2f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-182043915", "description": "tempest-description-803105275"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:40.390183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28e8e671-6803-4411-a075-9e2938c4b8de tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.219290 Nov 02 13:55:40.391408 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1860/2912] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:55:40 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:40.406231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8695f65a-eb77-401d-9471-60a405fb1b3c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f85f613a0>, body: {"security_group_rule": {"parent_group_id": "e79bd54b-c3f6-4126-84f5-32ccdfe4bdad", "ip_protocol": "tempest-999-737623240", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:40.499931 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8695f65a-eb77-401d-9471-60a405fb1b3c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Invalid IP protocol tempest-999-737623240. Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8695f65a-eb77-401d-9471-60a405fb1b3c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 156 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "e79bd54b-c3f6-4126-84f5-32ccdfe4bdad", "ip_protocol": "tempest-999-737623240", "from_port": 22, "to_port": 22}} Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid IP protocol tempest-999-737623240. Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e79bd54b-c3f6-4126-84f5-32ccdfe4bdad', 'ip_protocol': 'tempest-999-737623240', 'from_port': 22, 'to_port': 22}}} Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-737623240. Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-737623240. Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:40.501675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-737623240. Nov 02 13:55:40.506498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:40.507981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8695f65a-eb77-401d-9471-60a405fb1b3c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 400 to user: Invalid IP protocol tempest-999-737623240. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:40.508838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8695f65a-eb77-401d-9471-60a405fb1b3c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.107986 Nov 02 13:55:40.509433 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1861/2913] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:40 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 13:55:40.522025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c5d583c-0f9b-40c3-8ac8-5b8fb518a1db tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f85f61c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-128383201", "description": "tempest-description-1343149632"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:40.918288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c5d583c-0f9b-40c3-8ac8-5b8fb518a1db tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.401456 Nov 02 13:55:40.920063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1862/2914] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:55:40 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:55:40.934070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-507a49c5-d099-42b1-a25f-28f1f0a479ab tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f80b8b310>, body: {"security_group_rule": {"parent_group_id": "8aa801b9-f193-4d56-951e-8e7bdc472d97", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:41.198928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-507a49c5-d099-42b1-a25f-28f1f0a479ab tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-507a49c5-d099-42b1-a25f-28f1f0a479ab tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 138 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "8aa801b9-f193-4d56-951e-8e7bdc472d97", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8aa801b9-f193-4d56-951e-8e7bdc472d97', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:55:41.201326 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:55:41.206834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:41.208106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-507a49c5-d099-42b1-a25f-28f1f0a479ab tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:41.221734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-507a49c5-d099-42b1-a25f-28f1f0a479ab tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.290858 Nov 02 13:55:41.222911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1863/2915] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:40 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:55:41.245825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:41.248537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:41.289886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:41.293626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:41.295078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:41.297633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:41.298243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:41.299584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:42.039519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:42.049506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e01c07f9-452c-4a1a-b375-5186d30591b3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1507 microversion: 2.1 time: 0.823288 Nov 02 13:55:42.055261 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1864/2916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:41 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1507 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:42.066727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:42.067787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:42.092484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:42.093357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:42.094030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:42.094975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:42.095695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:42.096749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:42.317550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:42.326970 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfd00190-5499-4037-bfb0-c17a785f725f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1266 microversion: 2.1 time: 0.270283 Nov 02 13:55:42.334033 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1865/2917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:42 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:42.339089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34f75d43-e132-432a-815b-d57e00dd854c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f80b93ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-755447181", "description": "tempest-description-1836213587"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:42.998822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34f75d43-e132-432a-815b-d57e00dd854c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.663369 Nov 02 13:55:42.999810 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1866/2918] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:55:42 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:43.010556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-937878fb-a04e-40ed-b258-d6e3c8aa77b3 req-47f5781a-45ab-45c6-b20c-188a57588744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcbe90f-0c88-4001-974c-5f232a11b7c7", "name": "network-vif-deleted", "tag": "7249fcba-6a05-440f-abbc-4d93af788699"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:43.056753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-937878fb-a04e-40ed-b258-d6e3c8aa77b3 req-47f5781a-45ab-45c6-b20c-188a57588744 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:43.069057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-937878fb-a04e-40ed-b258-d6e3c8aa77b3 req-47f5781a-45ab-45c6-b20c-188a57588744 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:43.076787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-937878fb-a04e-40ed-b258-d6e3c8aa77b3 req-47f5781a-45ab-45c6-b20c-188a57588744 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:43.127412 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-937878fb-a04e-40ed-b258-d6e3c8aa77b3 req-47f5781a-45ab-45c6-b20c-188a57588744 service nova] Creating event network-vif-deleted:7249fcba-6a05-440f-abbc-4d93af788699 for instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 on n-h1-858238-3 Nov 02 13:55:43.152349 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-937878fb-a04e-40ed-b258-d6e3c8aa77b3 req-47f5781a-45ab-45c6-b20c-188a57588744 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151036 Nov 02 13:55:43.158318 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1867/2919] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:43.177232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6075aec3-2c7f-4db7-8b9e-6d0ecacb4bc9 req-24af2591-cb24-4bc2-a956-3c2b9755cca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8a7b0f-3adb-4756-adcd-73c1a8765e94", "name": "network-vif-deleted", "tag": "310b5ef2-1f4e-4b22-af09-fa6e2329276c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:43.216708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6075aec3-2c7f-4db7-8b9e-6d0ecacb4bc9 req-24af2591-cb24-4bc2-a956-3c2b9755cca6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:43.219310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6075aec3-2c7f-4db7-8b9e-6d0ecacb4bc9 req-24af2591-cb24-4bc2-a956-3c2b9755cca6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:43.222567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6075aec3-2c7f-4db7-8b9e-6d0ecacb4bc9 req-24af2591-cb24-4bc2-a956-3c2b9755cca6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:43.258374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6075aec3-2c7f-4db7-8b9e-6d0ecacb4bc9 req-24af2591-cb24-4bc2-a956-3c2b9755cca6 service nova] Creating event network-vif-deleted:310b5ef2-1f4e-4b22-af09-fa6e2329276c for instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 on n-h1-858238-3 Nov 02 13:55:43.280619 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6075aec3-2c7f-4db7-8b9e-6d0ecacb4bc9 req-24af2591-cb24-4bc2-a956-3c2b9755cca6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115603 Nov 02 13:55:43.282090 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1868/2920] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:43.290370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e590e28-87df-4d8d-88ea-2bb33657b224 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f80b97f70>, body: {"security_group_rule": {"parent_group_id": "91198c8c-ad63-411c-a68e-e8c1610e9e6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 1020162652}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:43.851737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1e590e28-87df-4d8d-88ea-2bb33657b224 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Invalid port range 22:1020162652. Valid TCP ports should be between 1-65535 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e590e28-87df-4d8d-88ea-2bb33657b224 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 146 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "91198c8c-ad63-411c-a68e-e8c1610e9e6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 1020162652}} Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid port range 22:1020162652. Valid TCP ports should be between 1-65535 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': '91198c8c-ad63-411c-a68e-e8c1610e9e6b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1020162652}}} Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1020162652. Valid TCP ports should be between 1-65535 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1020162652. Valid TCP ports should be between 1-65535 Nov 02 13:55:43.853666 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1020162652. Valid TCP ports should be between 1-65535 Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e590e28-87df-4d8d-88ea-2bb33657b224 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 400 to user: Invalid port range 22:1020162652. Valid TCP ports should be between 1-65535 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e590e28-87df-4d8d-88ea-2bb33657b224 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.570202 Nov 02 13:55:43.860809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1869/2921] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:43 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 574 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:55:43.863458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:43.865502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:43.905592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:43.906084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:43.907196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:43.908145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:43.909848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:43.911565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.024646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.025285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.039046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.039775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lazy-loading 'fault' on Instance uuid aa8a7b0f-3adb-4756-adcd-73c1a8765e94 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:44.167349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:44.182471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ceda793-32f8-407e-ac94-9737fb8035a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 200 len: 1310 microversion: 2.1 time: 0.324585 Nov 02 13:55:44.183011 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1870/2922] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:43 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:44.209333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:44.210392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:44.218032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.219035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.219885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.221670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.222422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.223177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.900809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:44.914696 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa77cdea-5c5f-451c-a259-187907604a29 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1308 microversion: 2.1 time: 0.717407 Nov 02 13:55:44.929007 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1871/2923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:44 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1308 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:44.944816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Action: 'create', calling method: .version_select at 0x7f6f85dcef70>, body: {"security_group_rule": {"parent_group_id": "9af12546-3683-4294-a346-feb7fdadc144", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:45.019463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:55:45.020708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Neutron security group 9af12546-3683-4294-a346-feb7fdadc144 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:55:45.020708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.020708 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 138 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: {"security_group_rule": {"parent_group_id": "9af12546-3683-4294-a346-feb7fdadc144", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9af12546-3683-4294-a346-feb7fdadc144', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:55:45.023288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 404 to user: Security group 9af12546-3683-4294-a346-feb7fdadc144 does not exist Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-a338d366-69d1-4785-945b-0422196777c8'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-620762f8-91fc-47ab-8d6b-2c7214320d06 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.095179 Nov 02 13:55:45.034826 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1872/2924] 10.222.0.18 () {60 vars in 1195 bytes} [Wed Nov 2 13:55:44 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:45.045874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f80b8b940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:45.095438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:55:45.096278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Neutron security group rule 005f721f-342c-46ef-a8e6-b655322289e9 not found {{(pid=137559) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 13:55:45.099755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] HTTP exception thrown: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.099755 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Request method failure captured: Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-group-rules/005f721f-342c-46ef-a8e6-b655322289e9 HTTP/1.1 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbRGVA62meIq35_1KfXRlfr4Brirqe-1q1KHnHMW6dqPus9ZhUtUpoWcA--WDrsON0zP9M0FJftX19mV96x1XGULpUvW9r9WLt1M61R9IZdt3lLb6qjSQ6Sn44FWbvApHebAV0B4v1Cc6EiNoE9h9J5zc6QufnKWsFhobPDHhyZbOk Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/20f61f892f7a4b6998f9bb3d9fecf56d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_20f61f892f7a4b6998f9bb3d9fecf56d"}]}] Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 20f61f892f7a4b6998f9bb3d9fecf56d Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6e0b2985d85040b4833749e58497366f Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-490199452-project Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '005f721f-342c-46ef-a8e6-b655322289e9'} Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:55:45.104155 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Returning 404 to user: Security group rule 005f721f-342c-46ef-a8e6-b655322289e9 does not exist Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-27d87480-95cb-4bea-a92f-0a22ea5c0717'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:45.108953 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75396739-8ed0-4c0f-b8c2-f737a09320bd tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/005f721f-342c-46ef-a8e6-b655322289e9" status: 404 len: 199 microversion: 2.1 time: 0.073867 Nov 02 13:55:45.113530 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1873/2925] 10.222.0.18 () {58 vars in 1287 bytes} [Wed Nov 2 13:55:45 2022] DELETE /compute/v2.1/os-security-group-rules/005f721f-342c-46ef-a8e6-b655322289e9 => generated 199 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:55:45.126371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58440671-93f0-45a1-8a0c-b9f87e06c430 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f81f6f820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:45.643558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58440671-93f0-45a1-8a0c-b9f87e06c430 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/91198c8c-ad63-411c-a68e-e8c1610e9e6b" status: 202 len: 0 microversion: 2.1 time: 0.524166 Nov 02 13:55:45.644146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1874/2926] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:55:45 2022] DELETE /compute/v2.1/os-security-groups/91198c8c-ad63-411c-a68e-e8c1610e9e6b => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:45.651404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:45.652084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:45.664927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:45.665915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:45.667170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:45.668141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:45.668942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:45.669557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:45.702113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 HTTP/1.1 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'aa8a7b0f-3adb-4756-adcd-73c1a8765e94'} Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:45.703905 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 13:55:45.709344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:55:45.713929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:45.716411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1bef8ec-555f-46a6-a03f-f54ecf9452fb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 404 len: 111 microversion: 2.1 time: 0.069708 Nov 02 13:55:45.721453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1875/2927] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:45 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:45.745435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0129106e-f43b-4a74-a3f0-41136ca26a38 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f85dcef70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:46.198014 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0129106e-f43b-4a74-a3f0-41136ca26a38 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8aa801b9-f193-4d56-951e-8e7bdc472d97" status: 202 len: 0 microversion: 2.1 time: 0.474911 Nov 02 13:55:46.199991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1876/2928] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:55:45 2022] DELETE /compute/v2.1/os-security-groups/8aa801b9-f193-4d56-951e-8e7bdc472d97 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:46.207918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-858c8e38-21ad-4cb3-8131-158dd34253d8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: .version_select at 0x7f6f80ba10d0>, body: {"keypair": {"name": "tempest-key-2037070467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmAENJ13lPsCGZsgJmzs0ojzGO5p3pO74DOki4xJLwjKSNWGwgp6LYvaNze5vbYnWXUxSVuDYbtf4R45npKJcIWo3RL9DIdA/fzJMOVYImwgzWOZNq06nf8rKujROJ15w=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:46.232630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-858c8e38-21ad-4cb3-8131-158dd34253d8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:46.235622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:46.240977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-858c8e38-21ad-4cb3-8131-158dd34253d8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:46.299437 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-858c8e38-21ad-4cb3-8131-158dd34253d8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.097416 Nov 02 13:55:46.300826 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1877/2929] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:55:46 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:46.306709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:46.307354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:46.314647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.315541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.316049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.317392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.318150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.318477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.555982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:46.567709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2d87b52-e211-4009-b322-46bdf5278b62 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1308 microversion: 2.1 time: 0.264945 Nov 02 13:55:46.569595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1878/2930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:46 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:46.583977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-98472a48-6d2d-4113-8519-d0a3ea3a044e req-29a16a44-b917-4c6d-b0cb-0e5b92c9ddf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc10b59-116f-41f9-8a18-3fdae1910ef0", "tag": "25935a61-cdc0-430c-aedf-ba06411a429d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:46.603876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-98472a48-6d2d-4113-8519-d0a3ea3a044e req-29a16a44-b917-4c6d-b0cb-0e5b92c9ddf3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.604978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-98472a48-6d2d-4113-8519-d0a3ea3a044e req-29a16a44-b917-4c6d-b0cb-0e5b92c9ddf3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.605944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-98472a48-6d2d-4113-8519-d0a3ea3a044e req-29a16a44-b917-4c6d-b0cb-0e5b92c9ddf3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.643948 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-98472a48-6d2d-4113-8519-d0a3ea3a044e req-29a16a44-b917-4c6d-b0cb-0e5b92c9ddf3 service nova] Creating event network-changed:25935a61-cdc0-430c-aedf-ba06411a429d for instance efc10b59-116f-41f9-8a18-3fdae1910ef0 on n-h2-858238-3 Nov 02 13:55:46.656697 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-98472a48-6d2d-4113-8519-d0a3ea3a044e req-29a16a44-b917-4c6d-b0cb-0e5b92c9ddf3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084313 Nov 02 13:55:46.659390 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1879/2931] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:46.672559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0c60078-2c1f-40ea-9b4c-a5012b82ff2c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f80bb21f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:47.093719 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0c60078-2c1f-40ea-9b4c-a5012b82ff2c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e79bd54b-c3f6-4126-84f5-32ccdfe4bdad" status: 202 len: 0 microversion: 2.1 time: 0.431199 Nov 02 13:55:47.094390 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1880/2932] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:55:46 2022] DELETE /compute/v2.1/os-security-groups/e79bd54b-c3f6-4126-84f5-32ccdfe4bdad => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:47.102897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec648731-f8a1-417e-9a44-096ace7dffdf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '.version_select at 0x7f6f80bb2430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:47.115049 n-d-858238-3 devstack@n-api.service[137559]: WARNING oslo_db.sqlalchemy.utils [None req-ec648731-f8a1-417e-9a44-096ace7dffdf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:55:47.120874 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec648731-f8a1-417e-9a44-096ace7dffdf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024971 Nov 02 13:55:47.133048 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1881/2933] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 13:55:47 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:47.138116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6927c10c-5546-4e75-afeb-9bbc12e89bb8 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f80b8b9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:47.420598 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6927c10c-5546-4e75-afeb-9bbc12e89bb8 tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a689518e-cd8b-45ea-ab31-4a1528cbd946" status: 202 len: 0 microversion: 2.1 time: 0.283021 Nov 02 13:55:47.423535 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1882/2934] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:55:47 2022] DELETE /compute/v2.1/os-security-groups/a689518e-cd8b-45ea-ab31-4a1528cbd946 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:47.436637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-32878774", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-key-2037070467", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:47.528404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:55:48.130525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:55:48.131174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:55:48.131861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:55:48.132802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:55:48.133220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:55:48.151310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.153197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.155334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.156874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.159553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.163363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.192925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:48.198748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:48.213870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:55:48.216336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:55:48.274560 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6edcf214-b799-47f1-8139-118fccc07252 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848504 Nov 02 13:55:48.282237 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1883/2935] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:55:48.289202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60678672-52b6-4c34-8249-66d49a0b767c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] Calling method '.version_select at 0x7f6f80ba6e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:48.757268 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60678672-52b6-4c34-8249-66d49a0b767c tempest-SecurityGroupRulesNegativeTestJSON-490199452 tempest-SecurityGroupRulesNegativeTestJSON-490199452-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d3cf5239-ea88-4e23-b730-1790954e717f" status: 202 len: 0 microversion: 2.1 time: 0.473141 Nov 02 13:55:48.762032 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1884/2936] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:55:48 2022] DELETE /compute/v2.1/os-security-groups/d3cf5239-ea88-4e23-b730-1790954e717f => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:48.768480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:48.770602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:48.782510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.783649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.784390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.785529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.786388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.787253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.972279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:48.980666 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2c353bd-1c9d-4139-8595-3569e062dd8f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1308 microversion: 2.1 time: 0.216775 Nov 02 13:55:48.981258 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1885/2937] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:48 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:48.986924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:48.987744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:48.994226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.994985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.995714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.997238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.998203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.998958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:49.075978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:49.083787 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f28527aa-ba5c-42ec-a3dc-2e35c74fb4ef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1231 microversion: 2.1 time: 0.100993 Nov 02 13:55:49.084383 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1886/2938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:48 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:50.005813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:50.007196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:50.021945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:50.023048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:50.026294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.028489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:50.029173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:50.029611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.507825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:50.520746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a029e65-6ccb-4639-b0e7-c543cc18b467 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1308 microversion: 2.1 time: 0.518651 Nov 02 13:55:50.531751 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1887/2939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:50 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:50.548353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:50.549449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:50.560452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:50.561248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:50.564531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.566199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:50.567710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:50.568473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.696097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:50.705504 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3b52670-5c42-4a0e-94a0-365c2b33038e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1285 microversion: 2.1 time: 0.165278 Nov 02 13:55:50.725965 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1888/2940] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:50 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:50.736957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:50.741364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:50.758330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:50.758829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:50.759297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.760027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:50.760475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:50.760895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.835039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:50.950554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:51.038206 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91a6cdf5-2d5f-462d-8b35-11729e11be95 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 204 len: 0 microversion: 2.1 time: 0.310085 Nov 02 13:55:51.040177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1889/2941] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:55:50 2022] DELETE /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:51.058956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:51.062636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:51.076928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.077473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.082564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.087603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.088156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.089598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.374238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:51.397924 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4ba9bb6-526a-438c-b7f0-98aa29dbbdd2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1554 microversion: 2.1 time: 0.350197 Nov 02 13:55:51.409561 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1890/2942] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:51 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1554 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:51.552278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:51.552993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:51.566218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.566813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.569520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.570399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.570964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.577216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.928029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:51.944741 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6f56c2fd-0641-499e-bf80-75466bf83f23 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1308 microversion: 2.1 time: 0.390939 Nov 02 13:55:51.946037 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1891/2943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:51 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:51.960019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:51.961102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:51.973989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.981297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.981911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.982762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.983360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.983957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.290577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:52.298910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-effd5367-8a7b-4e99-b976-019cd8f80637 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.351563 Nov 02 13:55:52.307845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1892/2944] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:51 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:52.431647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cf39dd2c-41ab-4ed4-8569-2743efd0ccf1 req-1ba45725-8444-476e-a1dc-d1d23e1937b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc10b59-116f-41f9-8a18-3fdae1910ef0", "name": "network-vif-plugged", "status": "completed", "tag": "25935a61-cdc0-430c-aedf-ba06411a429d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:52.451725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf39dd2c-41ab-4ed4-8569-2743efd0ccf1 req-1ba45725-8444-476e-a1dc-d1d23e1937b2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.461801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf39dd2c-41ab-4ed4-8569-2743efd0ccf1 req-1ba45725-8444-476e-a1dc-d1d23e1937b2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.462657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf39dd2c-41ab-4ed4-8569-2743efd0ccf1 req-1ba45725-8444-476e-a1dc-d1d23e1937b2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.485707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cf39dd2c-41ab-4ed4-8569-2743efd0ccf1 req-1ba45725-8444-476e-a1dc-d1d23e1937b2 service nova] Creating event network-vif-plugged:25935a61-cdc0-430c-aedf-ba06411a429d for instance efc10b59-116f-41f9-8a18-3fdae1910ef0 on n-h2-858238-3 Nov 02 13:55:52.492407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cf39dd2c-41ab-4ed4-8569-2743efd0ccf1 req-1ba45725-8444-476e-a1dc-d1d23e1937b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064480 Nov 02 13:55:52.493780 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1893/2945] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:55:52.499405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:52.508573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:52.525283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.525993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.526618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.527583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.528137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.528808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:53.496644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:53.513634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42bf290d-4a3b-4ec4-ad45-ac9fb473d1c6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1554 microversion: 2.1 time: 1.018352 Nov 02 13:55:53.531809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1894/2946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:52 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1554 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:53.537838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:53.538699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:53.545532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:53.546326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:53.547063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:53.548065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:53.548694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:53.549290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:54.462134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:54.475057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d143453-5ff1-46e7-a61c-95924a648208 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1308 microversion: 2.1 time: 0.941621 Nov 02 13:55:54.477034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1895/2947] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:53 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1308 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:54.491738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:54.492657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:54.511945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:54.513404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:54.514087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:54.515026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:54.515713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:54.516344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:54.920224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:54.945750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f162b29-66c2-42f8-8040-d58293972c3c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.464954 Nov 02 13:55:54.946871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1896/2948] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:54 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:55.236469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Calling method '.version_select at 0x7f6f80ba1c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:55.239775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.241554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.242343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.290447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.290933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.291560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.329431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.331114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.331757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.349671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-800f1c6c-4974-4d71-9544-80faa103ce68 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1938985639-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.399869 Nov 02 13:55:55.352719 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1897/2949] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 13:55:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:55.372247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:55.372864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:55.390488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.391120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.392612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.393654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.394271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.396503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.528759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:55.552769 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d6cfc32-83e5-4d27-8966-636cec812634 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1345 microversion: 2.1 time: 0.188335 Nov 02 13:55:55.555995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1898/2950] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:55 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:55.565557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a3392a76-8c81-438f-85b6-5f792d45f940 req-8bb3092c-7e3c-4ba8-b4d5-9d414cfb9d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc30ecf-e7bb-412c-b46a-742ad67a1820", "tag": "bbe5c729-1737-445f-a9a4-4b44497d4163"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:55.611456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a3392a76-8c81-438f-85b6-5f792d45f940 req-8bb3092c-7e3c-4ba8-b4d5-9d414cfb9d2f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.615502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a3392a76-8c81-438f-85b6-5f792d45f940 req-8bb3092c-7e3c-4ba8-b4d5-9d414cfb9d2f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.616258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a3392a76-8c81-438f-85b6-5f792d45f940 req-8bb3092c-7e3c-4ba8-b4d5-9d414cfb9d2f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.656443 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a3392a76-8c81-438f-85b6-5f792d45f940 req-8bb3092c-7e3c-4ba8-b4d5-9d414cfb9d2f service nova] Creating event network-changed:bbe5c729-1737-445f-a9a4-4b44497d4163 for instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 on n-h2-858238-3 Nov 02 13:55:55.678822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a3392a76-8c81-438f-85b6-5f792d45f940 req-8bb3092c-7e3c-4ba8-b4d5-9d414cfb9d2f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120037 Nov 02 13:55:55.683784 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1899/2951] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:55.697955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:55.698749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:55.725527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.726335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.727622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.728606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.729457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.730109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.056078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:56.074374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57b49cf0-15b4-432c-aefc-e2b8716dbb49 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1487 microversion: 2.1 time: 0.388488 Nov 02 13:55:56.076427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1900/2952] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:55 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1487 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:56.088112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:56.089450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:56.104245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.105415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.106801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.108120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.108943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.109818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.419252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:56.438929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b905d37-2f93-47e3-bdbb-2f40082d4858 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.360652 Nov 02 13:55:56.439897 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1901/2953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:56 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:56.477705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb7ecbea-7012-4166-b62d-f669e27df844 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:56.488291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7ecbea-7012-4166-b62d-f669e27df844 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.489152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7ecbea-7012-4166-b62d-f669e27df844 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.489927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7ecbea-7012-4166-b62d-f669e27df844 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.612128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb7ecbea-7012-4166-b62d-f669e27df844 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:55:56.727368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb7ecbea-7012-4166-b62d-f669e27df844 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0/action" status: 202 len: 0 microversion: 2.1 time: 0.270394 Nov 02 13:55:56.732877 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1902/2954] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:55:56 2022] POST /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:56.741013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:56.742304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:56.749483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.750306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.751459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.752796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.753476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.754699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.941047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:56.979352 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-880efa57-e8a4-4b77-a17a-7e312aaf61b0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1345 microversion: 2.1 time: 0.244859 Nov 02 13:55:56.995138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1903/2955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:56 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:56.995138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:56.995138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:57.030281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:57.033793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:57.034524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:57.036094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:57.037455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:57.038110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:57.407134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:57.422861 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c6460e7-0212-445a-bdd4-091b4afa142c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.440903 Nov 02 13:55:57.423135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1904/2956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:56 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:57.474759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:57.475423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:57.486659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:57.487181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:57.487778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:57.488948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:57.489414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:57.489823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.075632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:58.103263 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2346910-3d8d-45d7-8191-93f174ace598 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.626815 Nov 02 13:55:58.104572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1905/2957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:57 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:58.118577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3921abcb-465f-4407-ac8f-da4fe03ff041 req-ae8f1d96-4bc5-4806-bbf8-6e25c1961516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95b31f0-63d4-4394-a173-98421faf4b34", "name": "network-vif-deleted", "tag": "14184870-b06b-402e-9346-4449d75aef7a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:58.150491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3921abcb-465f-4407-ac8f-da4fe03ff041 req-ae8f1d96-4bc5-4806-bbf8-6e25c1961516 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.150491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3921abcb-465f-4407-ac8f-da4fe03ff041 req-ae8f1d96-4bc5-4806-bbf8-6e25c1961516 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.151211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3921abcb-465f-4407-ac8f-da4fe03ff041 req-ae8f1d96-4bc5-4806-bbf8-6e25c1961516 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.186302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:58.197624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3921abcb-465f-4407-ac8f-da4fe03ff041 req-ae8f1d96-4bc5-4806-bbf8-6e25c1961516 service nova] Creating event network-vif-deleted:14184870-b06b-402e-9346-4449d75aef7a for instance e95b31f0-63d4-4394-a173-98421faf4b34 on n-h1-858238-3 Nov 02 13:55:58.207374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:58.213377 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3921abcb-465f-4407-ac8f-da4fe03ff041 req-ae8f1d96-4bc5-4806-bbf8-6e25c1961516 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103309 Nov 02 13:55:58.215074 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1906/2958] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:58.230371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:58.233890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:58.253376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.255723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.256861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.259865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.260876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.264606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.305289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:58.402340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:58.415258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a27662dc-3e8b-4810-9373-43e707942512 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1345 microversion: 2.1 time: 0.197834 Nov 02 13:55:58.416482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1907/2959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:58 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:58.449728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:58.450692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:58.473520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.474345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.476343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.478200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.478919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.480900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.770187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:58.782339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5bc7a23e-7bd5-4323-bdb0-b04d3a38e7a0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.338053 Nov 02 13:55:58.796516 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1908/2960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:58 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:59.103154 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:55:59.103691 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:55:59.137582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:59.141734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:59.168609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.169754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.174508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:59.176057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.176559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.179029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:59.246945 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:55:59.247180 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:55:59.548437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:59.562223 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efffcf22-617d-4958-9f26-f11554c1aa27 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.431544 Nov 02 13:55:59.566014 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1909/2961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:59 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:59.590568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:59.596734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:59.609236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.610011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.610831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:59.611854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.612535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.613168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:59.750506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:59.768369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-800abd3b-8a10-4890-9ce8-73bf963fc483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1345 microversion: 2.1 time: 0.199947 Nov 02 13:55:59.768981 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1910/2962] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:59 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1345 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:59.809467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:59.810078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:59.822262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.824819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.825297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:59.826029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.826481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.826905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:00.077547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:00.114716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-462a3dd5-c734-480f-ad4d-b5e57d70c137 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.308557 Nov 02 13:56:00.116502 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1911/2963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:59 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:56:00.595196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:00.595894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:00.617698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:00.618604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:00.619254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:00.621113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:00.621897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:00.623042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:00.994205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:01.009701 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11439359-6422-420f-a8bf-e9427363874f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.419744 Nov 02 13:56:01.010955 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1912/2964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:00 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:56:01.029747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:01.030627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:01.053542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:01.054253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:01.054868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:01.055767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:01.056397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:01.059688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:01.248234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:01.264383 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-140326b9-b509-4913-83b0-fc7732641a82 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 200 len: 1345 microversion: 2.1 time: 0.251964 Nov 02 13:56:01.275928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1913/2965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:01 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 1345 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:01.281144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:01.281991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:01.291217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:01.291783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:01.292232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:01.292933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:01.293453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:01.294087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:01.743654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:01.796348 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28a9339a-a3f6-49d0-9c4a-1d7c0877e630 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.512248 Nov 02 13:56:01.798084 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1914/2966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:01 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:02.121293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-903735290", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "40cabb09-89e5-4ae4-9f57-afe914bdf5ba"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:02.158079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:02.309011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] validate_networks() for [('40cabb09-89e5-4ae4-9f57-afe914bdf5ba', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:03.218374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:03.219534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:03.220198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:03.220617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:03.221101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:03.235448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:03.238526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:03.239238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:03.242463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:03.243262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:03.243857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:03.291001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Getting quotas for project b6cf42e893914fc78ebdfaa755fd41c5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:03.310525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Getting quotas for user cb43ad7cb6614b9ba106923e51b4db0e and project b6cf42e893914fc78ebdfaa755fd41c5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:03.340316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:03.343041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:03.448365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644347 Nov 02 13:56:03.454863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1915/2967] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:56:03.454863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f2b37bde-e39e-403e-8284-39a9dae18e20 req-ed8e39b7-08ef-44c4-9bc5-0c84823d82d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc30ecf-e7bb-412c-b46a-742ad67a1820", "name": "network-vif-plugged", "status": "completed", "tag": "bbe5c729-1737-445f-a9a4-4b44497d4163"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:03.479746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f2b37bde-e39e-403e-8284-39a9dae18e20 req-ed8e39b7-08ef-44c4-9bc5-0c84823d82d4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:03.480325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f2b37bde-e39e-403e-8284-39a9dae18e20 req-ed8e39b7-08ef-44c4-9bc5-0c84823d82d4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:03.481491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f2b37bde-e39e-403e-8284-39a9dae18e20 req-ed8e39b7-08ef-44c4-9bc5-0c84823d82d4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:03.517506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f2b37bde-e39e-403e-8284-39a9dae18e20 req-ed8e39b7-08ef-44c4-9bc5-0c84823d82d4 service nova] Creating event network-vif-plugged:bbe5c729-1737-445f-a9a4-4b44497d4163 for instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 on n-h2-858238-3 Nov 02 13:56:03.544214 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f2b37bde-e39e-403e-8284-39a9dae18e20 req-ed8e39b7-08ef-44c4-9bc5-0c84823d82d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093558 Nov 02 13:56:03.552972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1916/2968] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:03.572559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:03.576049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:03.597396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:03.597921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:03.598358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:03.599068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:03.612878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:03.613883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:04.645630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:04.659376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc234b37-7661-4346-b01e-7ca8957eb18f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 1.104828 Nov 02 13:56:04.675519 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1917/2969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:03 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:04.685861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:04.691300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:04.714290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:04.716947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:04.718967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:04.721669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:04.726316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:04.727444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:04.780432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 HTTP/1.1 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e95b31f0-63d4-4394-a173-98421faf4b34'} Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:04.789022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ff482af-2bc9-47b6-b673-274a3f8b1936 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 404 len: 111 microversion: 2.1 time: 0.113260 Nov 02 13:56:04.796704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1918/2970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:04 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:04.816191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:04.831718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:04.861961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:04.863208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:04.864323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:04.868196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:04.874358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:04.875481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:05.314402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:05.327732 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-718aa6e6-4220-49dc-b3f2-d4d1f0768eea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.527201 Nov 02 13:56:05.329266 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1919/2971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:04 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:05.341400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:05.343666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:05.361416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:05.364098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:05.370445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:05.372774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:05.376206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:05.376990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:05.882597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:05.908823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd5bda0b-837b-4686-ab2b-d068b7fb7b57 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1212 microversion: 2.1 time: 0.575795 Nov 02 13:56:05.931113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1920/2972] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:05 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1212 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:05.945512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:05.949160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:05.987768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:05.989165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:05.989694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:05.990782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:05.990914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:05.991339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:06.056607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34/os-volume_attachments HTTP/1.1 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': 'e95b31f0-63d4-4394-a173-98421faf4b34'} Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:06.069706 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54fd173c-7d3b-4a7a-bebf-6e9c9efb9a16 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.139492 Nov 02 13:56:06.076806 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1921/2973] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:56:05 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34/os-volume_attachments => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:06.082325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:06.082325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:06.105180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:06.105680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:06.106117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:06.106832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:06.111860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:06.112764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:06.895866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:06.908160 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-679bcc00-0630-47e9-a046-524713787cfd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1327 microversion: 2.1 time: 0.830702 Nov 02 13:56:06.909064 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1922/2974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:06 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1327 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:06.931904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:06.932903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:06.945134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:06.945634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:06.946082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:06.946796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:06.947289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:06.949488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:07.386483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:07.395604 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b117281-a3f1-405c-9bfa-3c9b7913b865 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.485288 Nov 02 13:56:07.396476 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1923/2975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:06 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:07.401382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2113934541", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:07.493263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:08.307368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:08.308851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:08.309356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:08.309910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:08.311033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:08.327823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:08.329257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:08.329904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:08.333212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:08.333924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:08.335582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:08.370147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:08.377501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:08.424010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:08.427960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:08.509843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ad31a8f-c911-4ed7-876b-4446fb6cd297 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112113 Nov 02 13:56:08.520706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1924/2976] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:56:08.525909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:08.526766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:08.534802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:08.535668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:08.536410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:08.537274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:08.537975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:08.538963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:08.993324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:09.020729 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5dbba1c3-0a1a-4059-becf-5de67e5e0fc2 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1316 microversion: 2.1 time: 0.491092 Nov 02 13:56:09.021809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1925/2977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:08 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:09.043367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e60fc873-61c2-4446-b06a-c39d48e06379"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:09.048957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:09.078965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:09.080890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:09.081635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:09.085330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:09.086099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:09.089035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:09.400429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:09.612134 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17f95b9f-a9cb-43cb-80f2-48fce7bd306d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "POST /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588395 Nov 02 13:56:09.614254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1926/2978] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 13:56:09 2022] POST /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:09.633996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:09.634907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:09.689406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:09.693447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:09.694578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:09.695690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:09.705388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:09.708184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:10.538823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:10.546856 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-327bc5a3-243b-409c-a7be-1ff3d6c687ba tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1508 microversion: 2.1 time: 0.931080 Nov 02 13:56:10.550863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1927/2979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:09 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1508 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:10.561507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:10.563049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:10.583880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:10.584746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:10.585388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:10.586345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:10.587001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:10.587665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:11.349887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:11.360569 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ebc084d1-e6f2-4ace-ace2-7564c862819e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.807997 Nov 02 13:56:11.362455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1928/2980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:10 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:11.368375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:11.369295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:11.376686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:11.377435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:11.378230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:11.380041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:11.383006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:11.384754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:11.599990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:11.612954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8b93477-5a8e-4034-93d2-2005ed37360e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1273 microversion: 2.1 time: 0.247051 Nov 02 13:56:11.615149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1929/2981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:11 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:11.622554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:11.623400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:11.634908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:11.635993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:11.636838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:11.638217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:11.638776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:11.639466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:12.618630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:12.636304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8bac0043-31f1-4fec-a9c2-51ee2d65f7ed tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1316 microversion: 2.1 time: 1.018855 Nov 02 13:56:12.637951 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1930/2982] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:11 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1316 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:12.644186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:12.645814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:12.654763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:12.656065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:12.656936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:12.658354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:12.659124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:12.659958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:13.177772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:13.201099 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cb2721a-d86d-4c17-94c8-a77ee3c57b6b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1508 microversion: 2.1 time: 0.561497 Nov 02 13:56:13.211183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1931/2983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:12 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1508 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:13.211183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:13.211183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:13.222725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:13.223563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:13.224525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:13.225406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:13.226154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:13.226585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:13.260376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:56:13.417543 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e3bdbfd-2597-466f-a048-aec4e5f9b894 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 204 len: 0 microversion: 2.1 time: 0.213718 Nov 02 13:56:13.418863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1932/2984] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:56:13 2022] DELETE /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:56:13.427369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-81ca1e44-9450-4ae2-935a-0b5cd068332a req-0e60e64c-4940-49fc-8aab-fe745100d780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c1777b-1508-43aa-beaa-46270f4d6aed", "tag": "8b2b44a8-a963-4f92-b560-d89887d32a26"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:13.445740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-81ca1e44-9450-4ae2-935a-0b5cd068332a req-0e60e64c-4940-49fc-8aab-fe745100d780 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:13.446735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-81ca1e44-9450-4ae2-935a-0b5cd068332a req-0e60e64c-4940-49fc-8aab-fe745100d780 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:13.447417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-81ca1e44-9450-4ae2-935a-0b5cd068332a req-0e60e64c-4940-49fc-8aab-fe745100d780 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:13.478658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-81ca1e44-9450-4ae2-935a-0b5cd068332a req-0e60e64c-4940-49fc-8aab-fe745100d780 service nova] Creating event network-changed:8b2b44a8-a963-4f92-b560-d89887d32a26 for instance e9c1777b-1508-43aa-beaa-46270f4d6aed on n-h1-858238-3 Nov 02 13:56:13.487532 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-81ca1e44-9450-4ae2-935a-0b5cd068332a req-0e60e64c-4940-49fc-8aab-fe745100d780 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066519 Nov 02 13:56:13.489091 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1933/2985] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:13.506420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:13.511254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:13.523938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:13.524423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:13.524850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:13.525588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:13.528737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:13.531024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:14.293926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:14.307759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2efa819-991f-4c86-8e16-931359aff25e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.814820 Nov 02 13:56:14.309518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1934/2986] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:13 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:14.317737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:14.318479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:14.325374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:14.326163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:14.326752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:14.327619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:14.328354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:14.328982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:14.370186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:56:14.538119 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca701572-c7c4-4929-b3ae-6fcda3fc04bf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 204 len: 0 microversion: 2.1 time: 0.227021 Nov 02 13:56:14.551191 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1935/2987] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:56:14 2022] DELETE /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:56:14.564919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:14.566252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:14.577809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:14.578607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:14.580736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:14.582696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:14.585072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:14.587695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:14.963022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:14.973518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed2f4974-720c-4f73-ae8a-a6dd4228cb8c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1315 microversion: 2.1 time: 0.427366 Nov 02 13:56:14.974127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1936/2988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:14 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:14.987320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:14.993756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:15.005491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:15.006478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:15.007490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:15.008871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:15.010958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:15.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:15.718030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:15.746823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3648afcb-e266-4c2e-bc91-bc0bcaa042bf tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1316 microversion: 2.1 time: 0.767834 Nov 02 13:56:15.760407 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1937/2989] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:14 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:15.769954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:15.772940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:15.795070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:15.805472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:15.806525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:15.808092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:15.808908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:15.809659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:16.419607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:16.444686 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c074a304-5a0d-4b8c-a43b-b17c9947fadb tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1514 microversion: 2.1 time: 0.673900 Nov 02 13:56:16.449315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1938/2990] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:15 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1514 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:16.464550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:16.465517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:16.489173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:16.492694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:16.493225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:16.494835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:16.496488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:16.497004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:17.305772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:17.315256 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6614e20-2ba8-4960-9828-265ea6319dfe tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.864521 Nov 02 13:56:17.316167 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1939/2991] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:16 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:17.337424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:17.338211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:17.345031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:17.345503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:17.345934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:17.346830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:17.348115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:17.348698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:17.366339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:17.858340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:17.872877 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a46cdec4-83af-4518-b8a0-073bd83a31d6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1315 microversion: 2.1 time: 0.543913 Nov 02 13:56:17.884732 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1940/2992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:17 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:17.905863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:17.906660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:17.922809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:17.923365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:17.923799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:17.924503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:17.924953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:17.925372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:18.291224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:18.313068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f7f9d9b-e3b2-4834-90a0-e3a02dfdc447 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1316 microversion: 2.1 time: 0.425838 Nov 02 13:56:18.316100 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1941/2993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:17 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:18.329251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:18.330390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:18.340695 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:56:18.347478 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:56:18.347870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:18.352421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:18.353760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:18.356148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:18.357089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:18.362787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:18.362787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:18.392339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:18.564413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:18.577703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e4dede4-52e4-40b7-b25a-898c17f0699d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1472 microversion: 2.1 time: 0.257400 Nov 02 13:56:18.578548 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1942/2994] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:18 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:18.606101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e05f89ae-40b6-422c-a6ac-1a9addccd39e req-306ac193-1ccd-4343-991c-48f8ea5586d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b35a3db-6758-48ea-820f-45beb5e0f762", "tag": "e79bc4e2-67f1-4d1b-9016-0fb50bd60a95"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:18.630955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e05f89ae-40b6-422c-a6ac-1a9addccd39e req-306ac193-1ccd-4343-991c-48f8ea5586d0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:18.631459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e05f89ae-40b6-422c-a6ac-1a9addccd39e req-306ac193-1ccd-4343-991c-48f8ea5586d0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:18.634198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e05f89ae-40b6-422c-a6ac-1a9addccd39e req-306ac193-1ccd-4343-991c-48f8ea5586d0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:18.653617 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e05f89ae-40b6-422c-a6ac-1a9addccd39e req-306ac193-1ccd-4343-991c-48f8ea5586d0 service nova] Creating event network-changed:e79bc4e2-67f1-4d1b-9016-0fb50bd60a95 for instance 1b35a3db-6758-48ea-820f-45beb5e0f762 on n-h2-858238-3 Nov 02 13:56:18.662371 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e05f89ae-40b6-422c-a6ac-1a9addccd39e req-306ac193-1ccd-4343-991c-48f8ea5586d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062623 Nov 02 13:56:18.662999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1943/2995] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:18.906053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Calling method '.version_select at 0x7f6f80afbdc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:18.943510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:56:18.944249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Neutron security group 567656d1-de43-420d-9c2e-011b6af08d56 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:56:18.944786 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] HTTP exception thrown: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.944786 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Request method failure captured: Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/567656d1-de43-420d-9c2e-011b6af08d56 HTTP/1.1 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncBT1DiyPfAaejBSs7JzV6dxNnkRC__iOWo9ZQQJj2RCPnH770ty98h7mOQBpQU0nNOIZUSYta2QqJBeb0S4s3up8qDkXMZcf8dTLGM_I87sxlKweIOgJ1nD2INt6hUarawYI8dr43Jxh07EibizBixUivgv7syJJ_tS28MvwBURho Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46d0d26e4a3c47d0bda6134d16af4c59"}]}] Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 36f868e90e094d589fa41a09006d24ee Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '567656d1-de43-420d-9c2e-011b6af08d56'} Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:56:18.946859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Returning 404 to user: Security group 567656d1-de43-420d-9c2e-011b6af08d56 does not exist Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-3a61cd91-8209-467c-987a-b028af8c710c'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ffcc174-9730-4544-8637-68595e29fe32 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/567656d1-de43-420d-9c2e-011b6af08d56" status: 404 len: 194 microversion: 2.1 time: 0.268912 Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1944/2996] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:56:18 2022] DELETE /compute/v2.1/os-security-groups/567656d1-de43-420d-9c2e-011b6af08d56 => generated 194 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:18.954889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8146a9f4-baf7-4dd8-933d-27e6002cbce0 req-d9f8f2c1-559d-4690-ab55-add3b8405e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c1777b-1508-43aa-beaa-46270f4d6aed", "name": "network-vif-plugged", "status": "completed", "tag": "8b2b44a8-a963-4f92-b560-d89887d32a26"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:18.969956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8146a9f4-baf7-4dd8-933d-27e6002cbce0 req-d9f8f2c1-559d-4690-ab55-add3b8405e5d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:18.970419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8146a9f4-baf7-4dd8-933d-27e6002cbce0 req-d9f8f2c1-559d-4690-ab55-add3b8405e5d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:18.971034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8146a9f4-baf7-4dd8-933d-27e6002cbce0 req-d9f8f2c1-559d-4690-ab55-add3b8405e5d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:18.983664 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8146a9f4-baf7-4dd8-933d-27e6002cbce0 req-d9f8f2c1-559d-4690-ab55-add3b8405e5d service nova] Creating event network-vif-plugged:8b2b44a8-a963-4f92-b560-d89887d32a26 for instance e9c1777b-1508-43aa-beaa-46270f4d6aed on n-h1-858238-3 Nov 02 13:56:18.989781 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8146a9f4-baf7-4dd8-933d-27e6002cbce0 req-d9f8f2c1-559d-4690-ab55-add3b8405e5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039539 Nov 02 13:56:18.990842 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1945/2997] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:18.997612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:18.998581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:19.004694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:19.007560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:19.008313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:19.009176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:19.010222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:19.010900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:19.011536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:19.267002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:19.280289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c85400c1-6d67-4fbc-bb38-4b7a5a22990d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.287972 Nov 02 13:56:19.280897 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1946/2998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:18 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:19.296046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:19.297159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:19.309861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:19.315362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:19.316488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:19.317397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:19.318141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:19.318563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:19.515004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:19.525254 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-afb79a5e-c6e4-4b7a-8cac-0721dd765288 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1315 microversion: 2.1 time: 0.243228 Nov 02 13:56:19.526556 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1947/2999] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:19 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:19.531825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd509015-9cbc-4bfd-a1a5-ef5ec66c2631 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003761 Nov 02 13:56:19.536693 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1948/3000] 10.222.0.18 () {58 vars in 1164 bytes} [Wed Nov 2 13:56:19 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:56:19.542774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:19.543623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:19.550275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:19.550925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:19.551258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:19.552456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:19.553162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:19.553782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:19.758055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:19.767946 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2292815e-d5ed-4121-b03d-94e67c5e0611 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1316 microversion: 2.1 time: 0.229896 Nov 02 13:56:19.780143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1949/3001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:19 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:19.786915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52ae7a35-9156-4f0a-86fb-6ab49793cb63 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Calling method '.version_select at 0x7f6f80ad09d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:20.141577 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52ae7a35-9156-4f0a-86fb-6ab49793cb63 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.360025 Nov 02 13:56:20.142621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1950/3002] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 13:56:19 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:20.148428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:20.149393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:20.156963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:20.158358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:20.158938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:20.159746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:20.160729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:20.161757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:20.220089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:20.220739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:20.221449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:20.222194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lazy-loading 'fault' on Instance uuid 3dc30ecf-e7bb-412c-b46a-742ad67a1820 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:56:20.279072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:20.288513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff22884e-e957-4d2d-a103-c3aecec04545 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 200 len: 1317 microversion: 2.1 time: 0.144562 Nov 02 13:56:20.299502 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1951/3003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:20 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:20.312406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ed98642-722e-41c2-8735-3fbc45363525 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Calling method '.version_select at 0x7f6f80afb040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:20.731522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-9ed98642-722e-41c2-8735-3fbc45363525 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:56:20.733003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9ed98642-722e-41c2-8735-3fbc45363525 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 13:56:20.733003 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ed98642-722e-41c2-8735-3fbc45363525 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Request method failure captured: Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-security-groups/a3544aa3-8bef-4976-b3f9-b17ec7071875 HTTP/1.1 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncBT1DiyPfAaejBSs7JzV6dxNnkRC__iOWo9ZQQJj2RCPnH770ty98h7mOQBpQU0nNOIZUSYta2QqJBeb0S4s3up8qDkXMZcf8dTLGM_I87sxlKweIOgJ1nD2INt6hUarawYI8dr43Jxh07EibizBixUivgv7syJJ_tS28MvwBURho Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46d0d26e4a3c47d0bda6134d16af4c59"}]}] Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 36f868e90e094d589fa41a09006d24ee Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: exception: Insufficient rights for removing default security group. Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a3544aa3-8bef-4976-b3f9-b17ec7071875'} Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:56:20.735487 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] Nov 02 13:56:20.740283 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:20.743911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ed98642-722e-41c2-8735-3fbc45363525 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 13:56:20.743911 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-de4d5209-f8c5-4735-84e0-7bafe2966ab8'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:20.745047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ed98642-722e-41c2-8735-3fbc45363525 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a3544aa3-8bef-4976-b3f9-b17ec7071875" status: 400 len: 182 microversion: 2.1 time: 0.444204 Nov 02 13:56:20.746270 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1952/3004] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 13:56:20 2022] DELETE /compute/v2.1/os-security-groups/a3544aa3-8bef-4976-b3f9-b17ec7071875 => generated 182 bytes in 446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:56:20.753623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:20.754270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:20.775068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:20.775650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:20.776097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:20.788178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:20.789014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:20.789644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:21.226183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:21.239863 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f51935c6-c637-45c7-b522-a370f2485982 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.491799 Nov 02 13:56:21.240663 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1953/3005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:20 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:21.248372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:21.252094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:21.270234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:21.270829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:21.272401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:21.276962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:21.277778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:21.278354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:21.617666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:21.630447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6ab5ed5-3440-4d01-969d-274bd7cafe59 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1315 microversion: 2.1 time: 0.387793 Nov 02 13:56:21.631186 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1954/3006] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:21 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:21.639310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-92ccc875-63e0-4668-99b3-5d25bc4d92fd req-6c2287d7-7604-49f6-8957-555eaae85856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc30ecf-e7bb-412c-b46a-742ad67a1820", "name": "network-vif-deleted", "tag": "bbe5c729-1737-445f-a9a4-4b44497d4163"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:21.657696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-92ccc875-63e0-4668-99b3-5d25bc4d92fd req-6c2287d7-7604-49f6-8957-555eaae85856 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:21.658525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-92ccc875-63e0-4668-99b3-5d25bc4d92fd req-6c2287d7-7604-49f6-8957-555eaae85856 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:21.659262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-92ccc875-63e0-4668-99b3-5d25bc4d92fd req-6c2287d7-7604-49f6-8957-555eaae85856 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:21.689450 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-92ccc875-63e0-4668-99b3-5d25bc4d92fd req-6c2287d7-7604-49f6-8957-555eaae85856 service nova] Creating event network-vif-deleted:bbe5c729-1737-445f-a9a4-4b44497d4163 for instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 on n-h2-858238-3 Nov 02 13:56:21.702502 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-92ccc875-63e0-4668-99b3-5d25bc4d92fd req-6c2287d7-7604-49f6-8957-555eaae85856 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069672 Nov 02 13:56:21.703481 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1955/3007] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:21.727089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Calling method '.version_select at 0x7f6f80aeca60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:21.758708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:56:21.759370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Neutron security group 8185d0f0-f42a-407c-ac63-2034b7458f08 not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:56:21.759876 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] HTTP exception thrown: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.759876 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Request method failure captured: Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-security-groups/8185d0f0-f42a-407c-ac63-2034b7458f08 HTTP/1.1 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncBT1DiyPfAaejBSs7JzV6dxNnkRC__iOWo9ZQQJj2RCPnH770ty98h7mOQBpQU0nNOIZUSYta2QqJBeb0S4s3up8qDkXMZcf8dTLGM_I87sxlKweIOgJ1nD2INt6hUarawYI8dr43Jxh07EibizBixUivgv7syJJ_tS28MvwBURho Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46d0d26e4a3c47d0bda6134d16af4c59"}]}] Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 36f868e90e094d589fa41a09006d24ee Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8185d0f0-f42a-407c-ac63-2034b7458f08'} Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:56:21.763681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] Nov 02 13:56:21.767815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:21.772558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Returning 404 to user: Security group 8185d0f0-f42a-407c-ac63-2034b7458f08 does not exist Nov 02 13:56:21.772558 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-07da8587-2be8-4d8c-be7c-5b12c97141c0'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:21.773734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-922e3d14-ef81-4a80-8041-db59f919d37b tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/8185d0f0-f42a-407c-ac63-2034b7458f08" status: 404 len: 194 microversion: 2.1 time: 0.058907 Nov 02 13:56:21.774549 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1956/3008] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 13:56:21 2022] GET /compute/v2.1/os-security-groups/8185d0f0-f42a-407c-ac63-2034b7458f08 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:21.779914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:21.781436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:21.793599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:21.794626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:21.795418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:21.797165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:21.797968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:21.798644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.063856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:22.073915 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b51fea51-cbd7-4a81-9cd5-eb701517d423 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1505 microversion: 2.1 time: 0.297851 Nov 02 13:56:22.074667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1957/3009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:21 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:22.080664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:22.081324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:22.088319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.089052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.089897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.090884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.091573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.092210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.110103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 HTTP/1.1 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3dc30ecf-e7bb-412c-b46a-742ad67a1820'} Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:22.112614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 13:56:22.116843 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.119238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:22.120535 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6da82a41-2f7a-4e13-9567-175029c9b66b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 404 len: 111 microversion: 2.1 time: 0.044833 Nov 02 13:56:22.121706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1958/3010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:22 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:22.127089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Action: 'update', calling method: .version_select at 0x7f6f80ae5700>, body: {"security_group": {"name": "tempest-sg-973670800", "description": "tempest-description-394579583"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:22.161571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:56:22.162507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Neutron security group e79fa307-234f-48d9-82c2-700b665de8da not found {{(pid=137559) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:56:22.163145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] HTTP exception thrown: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.163145 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Request method failure captured: Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/os-security-groups/e79fa307-234f-48d9-82c2-700b665de8da HTTP/1.1 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 100 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncBT1DiyPfAaejBSs7JzV6dxNnkRC__iOWo9ZQQJj2RCPnH770ty98h7mOQBpQU0nNOIZUSYta2QqJBeb0S4s3up8qDkXMZcf8dTLGM_I87sxlKweIOgJ1nD2INt6hUarawYI8dr43Jxh07EibizBixUivgv7syJJ_tS28MvwBURho Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/46d0d26e4a3c47d0bda6134d16af4c59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_46d0d26e4a3c47d0bda6134d16af4c59"}]}] Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 46d0d26e4a3c47d0bda6134d16af4c59 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626 Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 36f868e90e094d589fa41a09006d24ee Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1786924626-project Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: {"security_group": {"name": "tempest-sg-973670800", "description": "tempest-description-394579583"}} Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: exception: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e79fa307-234f-48d9-82c2-700b665de8da', 'body': {'security_group': {'name': 'tempest-sg-973670800', 'description': 'tempest-description-394579583'}}} Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:56:22.167435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] Returning 404 to user: Security group e79fa307-234f-48d9-82c2-700b665de8da does not exist Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-47b761a6-f763-4266-aba7-5d0f636d51fa'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06c6707f-3381-42b9-bf69-ead011af26a9 tempest-SecurityGroupsNegativeTestJSON-1786924626 tempest-SecurityGroupsNegativeTestJSON-1786924626-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/e79fa307-234f-48d9-82c2-700b665de8da" status: 404 len: 194 microversion: 2.1 time: 0.046174 Nov 02 13:56:22.179815 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1959/3011] 10.222.0.18 () {60 vars in 1290 bytes} [Wed Nov 2 13:56:22 2022] PUT /compute/v2.1/os-security-groups/e79fa307-234f-48d9-82c2-700b665de8da => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:22.189939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:22.189939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:22.208914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.209421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.210386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.211165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.211585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.212011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.295668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:22.296686 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2031e116-b036-46cd-9285-6b9db7653ff0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed/os-instance-actions/req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1" status: 200 len: 313 microversion: 2.1 time: 0.117652 Nov 02 13:56:22.297380 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1960/3012] 10.222.0.18 () {58 vars in 1419 bytes} [Wed Nov 2 13:56:22 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed/os-instance-actions/req-fccda0e8-ea77-4d61-9b3b-c559ab53b6f1 => generated 313 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:22.314165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58da8815-2a6e-4dfe-b7cf-9241886d04f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '.version_select at 0x7f6f80ae5f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:22.364346 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58da8815-2a6e-4dfe-b7cf-9241886d04f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-key-2037070467" status: 202 len: 0 microversion: 2.1 time: 0.060764 Nov 02 13:56:22.375537 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1961/3013] 10.222.0.18 () {58 vars in 1209 bytes} [Wed Nov 2 13:56:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2037070467 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:56:22.375537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:22.375537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:22.384076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.384630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.385077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.386219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.386659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.387083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.727331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:22.744927 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-988089a0-ff60-4846-8c75-f1970cb60726 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.377379 Nov 02 13:56:22.749845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1962/3014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:22 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:22.769338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:22.778156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:22.792855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.793452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.793984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.794769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:22.795485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:22.796163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:22.959160 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04952c35-a151-4390-a718-c4b3db58cde1 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "POST /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed/action" status: 202 len: 0 microversion: 2.1 time: 0.205085 Nov 02 13:56:22.979795 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1963/3015] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:56:22 2022] POST /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:56:22.993079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-659677318", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:23.143696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:24.854478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:24.855147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:24.855490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:24.855962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:24.856598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:24.867499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:24.868087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:24.868772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:24.869595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:24.870123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:24.870604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:24.891860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:24.897337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:24.912121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:24.918559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:24.976654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-427d96e0-fb72-416c-9ffe-3af2d2349d20 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994161 Nov 02 13:56:24.977571 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1964/3016] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:56:24.998009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:24.999896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:25.020057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:25.021062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:25.021725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:25.023710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:25.025119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:25.025844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:25.292442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:25.295843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:25.359160 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff66ccf0-d214-4ffe-af3f-d28f7e2fef0a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1315 microversion: 2.1 time: 0.379998 Nov 02 13:56:25.363267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1965/3017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:24 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:25.376185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:25.377123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:25.433233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:25.433702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:25.442213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:25.448131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:25.448623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:25.449067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:25.854508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:25.867800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64b51d75-a04a-4f42-a30e-22ecf415bb1b tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1512 microversion: 2.1 time: 0.495948 Nov 02 13:56:25.869752 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1966/3018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:25 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:25.885485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:25.890976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:25.902519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:25.903323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:25.903947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:25.904958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:25.906371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:25.906971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:25.998205 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61244f5a-dc2d-4958-8e5d-7475e0ce2f45 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125840 Nov 02 13:56:25.999253 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1967/3019] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:56:25 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:26.009531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:26.010739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:26.029775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:26.030388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:26.031604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:26.032946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:26.035051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:26.037804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:26.523676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:26.539391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38ec369f-bb1a-4b3a-9a35-3299077c958f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.538762 Nov 02 13:56:26.556343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1968/3020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:25 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:26.556343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-597d6f9c-f792-44e0-834f-01cf97676cc2 req-f1bbea1e-a3df-4a1d-93f3-2be0683f49d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b35a3db-6758-48ea-820f-45beb5e0f762", "name": "network-vif-plugged", "status": "completed", "tag": "e79bc4e2-67f1-4d1b-9016-0fb50bd60a95"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:26.563364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-597d6f9c-f792-44e0-834f-01cf97676cc2 req-f1bbea1e-a3df-4a1d-93f3-2be0683f49d6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:26.563947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-597d6f9c-f792-44e0-834f-01cf97676cc2 req-f1bbea1e-a3df-4a1d-93f3-2be0683f49d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:26.564538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-597d6f9c-f792-44e0-834f-01cf97676cc2 req-f1bbea1e-a3df-4a1d-93f3-2be0683f49d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:26.622569 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-597d6f9c-f792-44e0-834f-01cf97676cc2 req-f1bbea1e-a3df-4a1d-93f3-2be0683f49d6 service nova] Creating event network-vif-plugged:e79bc4e2-67f1-4d1b-9016-0fb50bd60a95 for instance 1b35a3db-6758-48ea-820f-45beb5e0f762 on n-h2-858238-3 Nov 02 13:56:26.634454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-597d6f9c-f792-44e0-834f-01cf97676cc2 req-f1bbea1e-a3df-4a1d-93f3-2be0683f49d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090405 Nov 02 13:56:26.635469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1969/3021] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:26.651818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:26.652600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:26.669841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:26.670376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:26.672190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:26.674226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:26.676264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:26.677355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:27.389519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:27.401282 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8497ea02-6dbe-4155-96de-8154c4f6fd64 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1260 microversion: 2.1 time: 0.762188 Nov 02 13:56:27.406762 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1970/3022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:26 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1260 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:27.424826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:27.426692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:27.441910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:27.445163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:27.445612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:27.446358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:27.446816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:27.447276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:27.628471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lazy-loading 'services' on Instance uuid 9b35a714-ca92-4921-b64a-469ddd2c9901 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:56:27.770319 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b42d0766-683f-4e99-8fd2-91aab941f2bf tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments/e60fc873-61c2-4446-b06a-c39d48e06379" status: 202 len: 0 microversion: 2.1 time: 0.356721 Nov 02 13:56:27.771701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1971/3023] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 13:56:27 2022] DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments/e60fc873-61c2-4446-b06a-c39d48e06379 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:56:27.781359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:27.783000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:27.794325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:27.797413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:27.799877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:27.804082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:27.805390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:27.806394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:28.141762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:28.156447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-536a8e41-2ede-4841-a720-872fe6fb6fc8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1315 microversion: 2.1 time: 0.382925 Nov 02 13:56:28.157622 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1972/3024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:27 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:28.166298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:28.168519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:28.179244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:28.180304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:28.181057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:28.182216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:28.182541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:28.183366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:28.478694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:28.506823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2de2a66-f9ec-40be-bd7a-7f89a51888ab tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1505 microversion: 2.1 time: 0.345274 Nov 02 13:56:28.508019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1973/3025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:28 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:28.519779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:28.521217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:28.533085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:28.534220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:28.535540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:28.537594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:28.538635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:28.539619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:28.974322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:28.986371 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e30a7f0-c284-46c6-a5d1-b2a9cc399ed0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.476850 Nov 02 13:56:28.987287 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1974/3026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:28 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:28.994717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:28.995631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:29.009945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:29.010454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:29.010893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:29.011651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:29.012103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:29.012524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:30.228945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:30.259394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:30.262400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:30.264400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58580f87-9ea0-4430-a134-dd4003043fdc tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2954 microversion: 2.42 time: 1.273548 Nov 02 13:56:30.268689 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1975/3027] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:56:28 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2954 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:56:30.280722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:30.284516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:30.305440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:30.306351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:30.307491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:30.319613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:30.320778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:30.321527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:30.729830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:30.740265 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d64b83fa-9206-431b-be0e-f89786e59536 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1308 microversion: 2.1 time: 0.464773 Nov 02 13:56:30.755144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1976/3028] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:30 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:30.759647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '.version_select at 0x7f6f80a96670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:30.760461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:30.780908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:30.784907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:30.787482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:30.790048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:30.790740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:30.792311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:30.889733 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5ee71bd-f5fd-418a-8ab7-582c648e0ca0 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.139730 Nov 02 13:56:30.890354 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1977/3029] 10.222.0.18 () {58 vars in 1296 bytes} [Wed Nov 2 13:56:30 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed/os-instance-actions => generated 611 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:30.905613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:30.906364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:30.920123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:30.920596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:30.924562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:30.925644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:30.926376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:30.928372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:31.093319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:31.104801 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8363134-6a49-4b7e-9c09-c101437e2fce tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1273 microversion: 2.1 time: 0.204242 Nov 02 13:56:31.119598 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1978/3030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:30 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:31.119598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:31.119598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:31.150926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:31.151373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:31.151807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:31.152521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:31.152999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:31.153420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:31.587350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:31.604481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b366980-f881-4b6c-a75a-d6987e3860bf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.497758 Nov 02 13:56:31.606390 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1979/3031] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:31 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:31.622279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:31.624773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:31.636532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:31.637630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:31.638974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:31.641253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:31.642107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:31.643573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:31.958524 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ea575da-00fd-41e0-b59a-e648dc579a3d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.350195 Nov 02 13:56:31.969223 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1980/3032] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 13:56:31 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f/os-interface => generated 1832 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:56:31.969223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d033c32c-a1ff-489b-bf83-bdf14840390e req-b6452160-c865-4502-a260-e071a0f66413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b35a3db-6758-48ea-820f-45beb5e0f762", "name": "network-vif-deleted", "tag": "e79bc4e2-67f1-4d1b-9016-0fb50bd60a95"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:31.980154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d033c32c-a1ff-489b-bf83-bdf14840390e req-b6452160-c865-4502-a260-e071a0f66413 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:31.980669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d033c32c-a1ff-489b-bf83-bdf14840390e req-b6452160-c865-4502-a260-e071a0f66413 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:31.981369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d033c32c-a1ff-489b-bf83-bdf14840390e req-b6452160-c865-4502-a260-e071a0f66413 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.012788 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d033c32c-a1ff-489b-bf83-bdf14840390e req-b6452160-c865-4502-a260-e071a0f66413 service nova] Creating event network-vif-deleted:e79bc4e2-67f1-4d1b-9016-0fb50bd60a95 for instance 1b35a3db-6758-48ea-820f-45beb5e0f762 on n-h2-858238-3 Nov 02 13:56:32.024382 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d033c32c-a1ff-489b-bf83-bdf14840390e req-b6452160-c865-4502-a260-e071a0f66413 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062413 Nov 02 13:56:32.025651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1981/3033] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:32.041718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:32.044008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:32.061195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.061686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.062122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.065370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.066077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.067024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.101074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:56:32.135128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:32.225023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58ac5e80-6b38-42a1-b76f-ba85c7bd9319 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 204 len: 0 microversion: 2.1 time: 0.196633 Nov 02 13:56:32.226315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1982/3034] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:56:32 2022] DELETE /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:56:32.243825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:32.245468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:32.260839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.261123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.261481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.262189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.262635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.263269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.565517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:32.584255 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56a67e8e-f774-40f3-bd39-00cffebe02e7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1308 microversion: 2.1 time: 0.356242 Nov 02 13:56:32.585702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1983/3035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:32 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:32.591240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:32.592695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:32.601822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.602550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.603179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.604315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.604965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.605617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.724744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:32.734353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43abc8d0-e8e6-4d5f-87d2-aa21c3271b3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 200 len: 1294 microversion: 2.1 time: 0.147152 Nov 02 13:56:32.736006 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1984/3036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:32 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:32.757535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:32.758148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:32.765546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.766400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.767005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.768010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.768848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.770295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:33.125451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:33.134809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96478f3c-0e5f-4467-bbcf-7e0bd01db7dd tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1511 microversion: 2.1 time: 0.397343 Nov 02 13:56:33.135800 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1985/3037] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:32 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:33.140696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:33.141367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:33.149100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:33.149773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:33.151060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:33.151060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:33.151428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:33.151795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:33.714986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:33.735734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee30c07b-b757-439f-83d5-ef3194b7e9a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.598831 Nov 02 13:56:33.737850 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1986/3038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:33 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:33.936327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:33.938388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:33.938482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:33.944543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:33.947670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:33.948588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:33.949265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:33.981663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ac0a2f3-4b0d-446e-9129-41aaf175335d tempest-AZV2TestJSON-1457157105 tempest-AZV2TestJSON-1457157105-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.242063 Nov 02 13:56:33.982510 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1987/3039] 10.222.0.18 () {58 vars in 1164 bytes} [Wed Nov 2 13:56:33 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:56:33.987500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:33.988924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:34.010741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:34.017180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:34.019760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:34.021972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:34.024228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:34.027058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:34.029560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:34.905165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:35.044474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:35.063690 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-125e83c7-1b61-4373-aad0-a074eb94930c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1308 microversion: 2.1 time: 1.079861 Nov 02 13:56:35.067335 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1988/3040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:33 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1308 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:35.077480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:35.078425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:35.093247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.095692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.096609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.099182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.099660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.106302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.137050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 HTTP/1.1 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1b35a3db-6758-48ea-820f-45beb5e0f762'} Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:35.145791 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 13:56:35.153574 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:35.156892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:35.160667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e20320ff-69a3-43ab-9f68-7bda57ec0040 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 404 len: 111 microversion: 2.1 time: 0.091902 Nov 02 13:56:35.163053 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1989/3041] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:35 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:35.180306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-95d32275-e3af-40b3-881a-227a2907d676 req-ac4a79f9-0b65-40dd-8a1e-98664a8dc6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace70082-6a39-497a-a4be-05b1ca885614", "tag": "a386bd49-2520-443e-91c9-0b4b073ab189"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:35.200242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95d32275-e3af-40b3-881a-227a2907d676 req-ac4a79f9-0b65-40dd-8a1e-98664a8dc6aa service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.201212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95d32275-e3af-40b3-881a-227a2907d676 req-ac4a79f9-0b65-40dd-8a1e-98664a8dc6aa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.201891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95d32275-e3af-40b3-881a-227a2907d676 req-ac4a79f9-0b65-40dd-8a1e-98664a8dc6aa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.218198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-95d32275-e3af-40b3-881a-227a2907d676 req-ac4a79f9-0b65-40dd-8a1e-98664a8dc6aa service nova] Creating event network-changed:a386bd49-2520-443e-91c9-0b4b073ab189 for instance ace70082-6a39-497a-a4be-05b1ca885614 on n-h2-858238-3 Nov 02 13:56:35.225148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-95d32275-e3af-40b3-881a-227a2907d676 req-ac4a79f9-0b65-40dd-8a1e-98664a8dc6aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060194 Nov 02 13:56:35.228713 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1990/3042] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:35.248608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:35.249897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:35.274182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.275180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.276924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.279789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.280278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.280723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.845570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb43ad7cb6614b9ba106923e51b4db0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cf42e893914fc78ebdfaa755fd41c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:35.869311 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6ad0e6e-ed82-4724-9912-e57abdb6ec2e tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 200 len: 1511 microversion: 2.1 time: 0.638882 Nov 02 13:56:35.873195 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1991/3043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:35 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 1511 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:35.884336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:35.884928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:35.894313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.895562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.896411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.897436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.897966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.898460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:36.148825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:36.161596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b1e7164-488e-436c-863b-ccc129f8cfc6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1497 microversion: 2.1 time: 0.286848 Nov 02 13:56:36.162796 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1992/3044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:35 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:36.168098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-640239127", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:36.237354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:36.992803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:36.993359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:36.994040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:36.994802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:36.995251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:37.005130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.005614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.006207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.007146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.007767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.008743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.029761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:37.042946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:37.072417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:37.075351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:37.137456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94bd88ba-f8f3-47a0-8fda-25081a8b0963 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973711 Nov 02 13:56:37.138879 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1993/3045] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:56:37.144365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:37.147727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:37.157155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.158412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.159310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.160503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.161161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.162079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.213783 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1097dcfa-95b3-4b29-b1df-b835fbc860ed tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073455 Nov 02 13:56:37.214594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1994/3046] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:56:37 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:56:37.227258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:37.228431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:37.237198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.238820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.239509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.240600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.241372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.241983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.537921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:37.556513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22acda1b-413d-4157-a19b-c83a26d41304 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1308 microversion: 2.1 time: 0.340681 Nov 02 13:56:37.558310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1995/3047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:37 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:37.576523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:37.577305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] [instance: e9c1777b-1508-43aa-beaa-46270f4d6aed] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:37.584490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.584984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.585423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.586129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.586586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.587196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.609774 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] HTTP exception thrown: Instance e9c1777b-1508-43aa-beaa-46270f4d6aed could not be found. Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Request method failure captured: Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed HTTP/1.1 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnbxMfmYxwhkHXcr9GJhPrYMXwX7CAVGYQa70jnGWy_gUBAEeDE6F1hmFQiV99c6VDKXRwjiZkQA0-JfaFmoq1wgs8C0_6BMXqEtQiwbA1IVL32e0jnkOTXrqy0Fs8eHC7m6gPEXgh3L_o5GXOEeqjIr6l0Gq9rcsrOIDB7aVDpiMMk Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b6cf42e893914fc78ebdfaa755fd41c5 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceActionsTestJSON-1827970362 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6cf42e893914fc78ebdfaa755fd41c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b6cf42e893914fc78ebdfaa755fd41c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b6cf42e893914fc78ebdfaa755fd41c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b6cf42e893914fc78ebdfaa755fd41c5"}]}] Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceActionsTestJSON-1827970362 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b6cf42e893914fc78ebdfaa755fd41c5 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1827970362 Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceActionsTestJSON-1827970362-project Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: cb43ad7cb6614b9ba106923e51b4db0e Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceActionsTestJSON-1827970362-project Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e9c1777b-1508-43aa-beaa-46270f4d6aed could not be found. Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e9c1777b-1508-43aa-beaa-46270f4d6aed'} Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1777b-1508-43aa-beaa-46270f4d6aed could not be found. Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1777b-1508-43aa-beaa-46270f4d6aed could not be found. Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:37.620425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1777b-1508-43aa-beaa-46270f4d6aed could not be found. Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] Returning 404 to user: Instance e9c1777b-1508-43aa-beaa-46270f4d6aed could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe7114a1-af36-4611-96a0-de5caa2511e8 tempest-InstanceActionsTestJSON-1827970362 tempest-InstanceActionsTestJSON-1827970362-project] 10.222.0.18 "GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed" status: 404 len: 111 microversion: 2.1 time: 0.062050 Nov 02 13:56:37.625472 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1996/3048] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:37 2022] GET /compute/v2.1/servers/e9c1777b-1508-43aa-beaa-46270f4d6aed => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:37.642364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-68f553eb-7996-4d11-804a-a88cfb8797ff tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:37.642988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-68f553eb-7996-4d11-804a-a88cfb8797ff tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:37.833332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68f553eb-7996-4d11-804a-a88cfb8797ff tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:37.849313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-68f553eb-7996-4d11-804a-a88cfb8797ff tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1214 microversion: 2.1 time: 0.216989 Nov 02 13:56:37.850392 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1997/3049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:37 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:37.855010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:37.868856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:37.877412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.877906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.878616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:37.879525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:37.880157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:37.880749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.253889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:38.275968 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fd9b6ee-7beb-4465-8a3f-59faea65aa81 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 200 len: 1474 microversion: 2.1 time: 0.417903 Nov 02 13:56:38.279651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1998/3050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:37 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 1474 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:38.305493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:38.309832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:38.339027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.339729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.342331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.343998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.345683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.346805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.463474 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4f9f792-f6b3-4255-9abb-dd5111f80cff tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181565 Nov 02 13:56:38.472081 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 1999/3051] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 13:56:38 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901/os-volume_attachments => generated 25 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:56:38.480515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f9b63100-eab8-45f3-89e6-7d3e30c32f4d req-7ab43f29-d774-4ce2-a8fe-647120c3d61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c1777b-1508-43aa-beaa-46270f4d6aed", "name": "network-vif-deleted", "tag": "8b2b44a8-a963-4f92-b560-d89887d32a26"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:38.495423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9b63100-eab8-45f3-89e6-7d3e30c32f4d req-7ab43f29-d774-4ce2-a8fe-647120c3d61d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.496184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9b63100-eab8-45f3-89e6-7d3e30c32f4d req-7ab43f29-d774-4ce2-a8fe-647120c3d61d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.497105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9b63100-eab8-45f3-89e6-7d3e30c32f4d req-7ab43f29-d774-4ce2-a8fe-647120c3d61d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.516210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f9b63100-eab8-45f3-89e6-7d3e30c32f4d req-7ab43f29-d774-4ce2-a8fe-647120c3d61d service nova] Creating event network-vif-deleted:8b2b44a8-a963-4f92-b560-d89887d32a26 for instance e9c1777b-1508-43aa-beaa-46270f4d6aed on n-h1-858238-3 Nov 02 13:56:38.548376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f9b63100-eab8-45f3-89e6-7d3e30c32f4d req-7ab43f29-d774-4ce2-a8fe-647120c3d61d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073040 Nov 02 13:56:38.552924 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2000/3052] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:38.575423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1130252821"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:38.578150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:38.595567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.600225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.601563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.604032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.604668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.606165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:39.024484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b88c596-7561-40ca-8df9-9f7d5195e399 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0/action" status: 202 len: 0 microversion: 2.1 time: 0.466011 Nov 02 13:56:39.025234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2001/3053] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:56:38 2022] POST /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:56:39.035502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:39.039940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:39.055275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:39.056290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:39.056940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:39.061881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:39.062656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:39.063321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:39.073935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:39.139977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:56:39.328484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3e6cc18-b042-4f3c-b01d-67620856809d tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 204 len: 0 microversion: 2.1 time: 0.301369 Nov 02 13:56:39.329922 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2002/3054] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:56:39 2022] DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:56:39.343312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:39.346493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:39.367309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:39.372699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:39.373801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:39.374997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:39.379071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:39.380002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:40.364340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:40.379656 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48206fdd-4f2a-46c8-9630-74aca27015e1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1308 microversion: 2.1 time: 1.048749 Nov 02 13:56:40.380991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2003/3055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:39 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1308 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:40.385953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:40.386885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:40.404930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:40.405432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:40.405876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:40.406594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:40.407050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:40.412088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:40.540731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:40.552061 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-97ac7c68-2dc8-4226-8e41-b307ab27ae4a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1272 microversion: 2.1 time: 0.169464 Nov 02 13:56:40.553614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2004/3056] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:40 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:40.559472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0105162a-770f-4a5c-ae2f-6d08e123be2d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80afba60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:40.643941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0105162a-770f-4a5c-ae2f-6d08e123be2d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.088866 Nov 02 13:56:40.645028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2005/3057] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:40 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:40.651406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:40.652210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:40.660245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:40.661372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:40.662031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:40.662739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:40.662927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:40.663327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:41.074396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:41.085975 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d49c5509-9e46-4a71-82c6-09865d1a2a99 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1680 microversion: 2.1 time: 0.439513 Nov 02 13:56:41.087809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2006/3058] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:40 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1680 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:41.092901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c1036715-187b-4d10-a9f9-fa49691a3733 req-94d5d44e-91b0-493f-b25d-28fbc7a69461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace70082-6a39-497a-a4be-05b1ca885614", "name": "network-vif-plugged", "status": "completed", "tag": "a386bd49-2520-443e-91c9-0b4b073ab189"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:41.123498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1036715-187b-4d10-a9f9-fa49691a3733 req-94d5d44e-91b0-493f-b25d-28fbc7a69461 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:41.124286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1036715-187b-4d10-a9f9-fa49691a3733 req-94d5d44e-91b0-493f-b25d-28fbc7a69461 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:41.124891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1036715-187b-4d10-a9f9-fa49691a3733 req-94d5d44e-91b0-493f-b25d-28fbc7a69461 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:41.195142 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c1036715-187b-4d10-a9f9-fa49691a3733 req-94d5d44e-91b0-493f-b25d-28fbc7a69461 service nova] Creating event network-vif-plugged:a386bd49-2520-443e-91c9-0b4b073ab189 for instance ace70082-6a39-497a-a4be-05b1ca885614 on n-h2-858238-3 Nov 02 13:56:41.201769 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c1036715-187b-4d10-a9f9-fa49691a3733 req-94d5d44e-91b0-493f-b25d-28fbc7a69461 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112165 Nov 02 13:56:41.203960 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2007/3059] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:41.408350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:41.412199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:41.425324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:41.425824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:41.426262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:41.427020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:41.428804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:41.428804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:42.160413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:42.176670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f0ef695-cb49-4c76-8f9d-d8c60add62a3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1308 microversion: 2.1 time: 0.774179 Nov 02 13:56:42.178829 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2008/3060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:41 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1308 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:56:42.189814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:42.190471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:42.206030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:42.206707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:42.207048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:42.207868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:42.208342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:42.208777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:43.672837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:43.695482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1411de64-e39d-40b2-ac76-e4f40b202b5d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1314 microversion: 2.1 time: 1.515431 Nov 02 13:56:43.696087 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2009/3061] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:42 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1314 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:43.715739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-425585d2-4b59-4ae9-9e75-0e4320f4b10f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85f48c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:43.857018 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-425585d2-4b59-4ae9-9e75-0e4320f4b10f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.152014 Nov 02 13:56:43.859884 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2010/3062] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:43 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:43.868067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:43.870496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:43.915930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:43.936721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:43.937316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:43.938090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:43.955345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:43.958486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:44.566281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a6800ea4e7544c4b03263fc7becd000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb7dd39a34f3cae1913ae45e8e231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:44.575408 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c5a2431-e040-4da7-8bca-f64e3fccf795 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 200 len: 1680 microversion: 2.1 time: 0.713933 Nov 02 13:56:44.582133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2011/3063] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:43 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 1680 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:44.602456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:44.603077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:44.647376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:44.647972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:44.648529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:44.651279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:44.652119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:44.652562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:45.312092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:45.339760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af6c4826-833b-4bba-bf66-41a682979d7b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1490 microversion: 2.1 time: 0.749390 Nov 02 13:56:45.348494 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2012/3064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:44 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1490 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:45.353874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:45.358269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:45.383412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:45.383967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:45.389018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:45.390168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:45.392165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:45.396439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:46.653659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:46.670544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea27ea62-7bbf-4714-916e-8e12c030844b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1314 microversion: 2.1 time: 1.320542 Nov 02 13:56:46.671737 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2013/3065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:45 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1314 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:46.881322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-536666689", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "40506ab6-0e7b-4deb-afcc-32da0ffaa999"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:46.996980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] validate_networks() for [('40506ab6-0e7b-4deb-afcc-32da0ffaa999', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:47.020167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:47.840021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:49.793371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:49.793966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:49.794249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:49.795215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:49.795639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:49.820643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:49.821132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:49.821561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:49.828733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:49.832783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:49.833233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:49.888493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Getting quotas for project 6ea881978e47412492e0c27570b60494. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:49.897377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Getting quotas for user 94c6a12f32a9437a8d4475b2d7e72ae2 and project 6ea881978e47412492e0c27570b60494. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:49.918836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:49.922612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:50.008384 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfe5711e-b4d5-42f5-8ab0-103fb1185d80 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.334985 Nov 02 13:56:50.018009 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2014/3066] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 13:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3339 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:56:50.021831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c2faa636-abc0-453d-9531-38697fbc6ce9 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80ae5f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:50.101514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c2faa636-abc0-453d-9531-38697fbc6ce9 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.088332 Nov 02 13:56:50.113740 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2015/3067] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:50 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:50.127226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:50.128709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:50.147629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:50.148499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:50.151865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:50.153541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:50.154247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:50.155856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:50.183790 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] HTTP exception thrown: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Request method failure captured: Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 HTTP/1.1 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZ9fM58UtlZBsG2SSe8cUuotX-pmz_LuBafe-lwh2J7-lJZ7zLfMkN1VxIuJimvn1U0sdgVRTxVZl1rGXDzkJ6GcLVY5CxYwuRGpA2DmpbhKyapu8NU5olfLcWZl3Tu5eLBsqQ_kXZzDqg-V3xxFiWiv7skIAwHf9YI9zRXrGLqhfY Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 85beb7dd39a34f3cae1913ae45e8e231 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85beb7dd39a34f3cae1913ae45e8e231"}]}] Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 85beb7dd39a34f3cae1913ae45e8e231 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachSCSIVolumeTestJSON-1485253695-project Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a6800ea4e7544c4b03263fc7becd000 Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1485253695-project Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9b35a714-ca92-4921-b64a-469ddd2c9901'} Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:50.185669 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Returning 404 to user: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:50.191674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-230b6b6a-b040-43aa-ba8a-78405b1f930f tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 404 len: 111 microversion: 2.1 time: 0.072036 Nov 02 13:56:50.192385 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2016/3068] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:50 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:50.197152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-659677318", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:50.256770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:51.371206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:51.372515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:51.373223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:51.373876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:51.374590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:51.392068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.394316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.396058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.397934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.400601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.408503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.449306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:51.466669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:51.501783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:51.518020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:51.552162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:51.650261 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e913fea-ba10-47cc-856d-90f3d02c2ef5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456517 Nov 02 13:56:51.652223 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2017/3069] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:56:51.665356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e3a652cf-7130-4417-a1b8-30ffd6b5a38a req-ff99200e-1b2f-43c4-965b-a5faf064d7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc10b59-116f-41f9-8a18-3fdae1910ef0", "name": "network-vif-plugged", "status": "completed", "tag": "25935a61-cdc0-430c-aedf-ba06411a429d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:51.702102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3a652cf-7130-4417-a1b8-30ffd6b5a38a req-ff99200e-1b2f-43c4-965b-a5faf064d7ac service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.702603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3a652cf-7130-4417-a1b8-30ffd6b5a38a req-ff99200e-1b2f-43c4-965b-a5faf064d7ac service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.704757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3a652cf-7130-4417-a1b8-30ffd6b5a38a req-ff99200e-1b2f-43c4-965b-a5faf064d7ac service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.725540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e3a652cf-7130-4417-a1b8-30ffd6b5a38a req-ff99200e-1b2f-43c4-965b-a5faf064d7ac service nova] Creating event network-vif-plugged:25935a61-cdc0-430c-aedf-ba06411a429d for instance efc10b59-116f-41f9-8a18-3fdae1910ef0 on n-h2-858238-3 Nov 02 13:56:51.734693 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e3a652cf-7130-4417-a1b8-30ffd6b5a38a req-ff99200e-1b2f-43c4-965b-a5faf064d7ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080848 Nov 02 13:56:51.737031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2018/3070] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:51.743905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c1bebc79-1a45-45a1-9375-28a1f3d29d66 req-c943656d-fec3-41a7-909d-70dea7b3c8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b35a714-ca92-4921-b64a-469ddd2c9901", "name": "network-vif-deleted", "tag": "5b9a93b3-3215-4e28-9ba2-4749d81de91d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:51.761752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1bebc79-1a45-45a1-9375-28a1f3d29d66 req-c943656d-fec3-41a7-909d-70dea7b3c8d2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.762430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1bebc79-1a45-45a1-9375-28a1f3d29d66 req-c943656d-fec3-41a7-909d-70dea7b3c8d2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.763046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1bebc79-1a45-45a1-9375-28a1f3d29d66 req-c943656d-fec3-41a7-909d-70dea7b3c8d2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.792631 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c1bebc79-1a45-45a1-9375-28a1f3d29d66 req-c943656d-fec3-41a7-909d-70dea7b3c8d2 service nova] Creating event network-vif-deleted:5b9a93b3-3215-4e28-9ba2-4749d81de91d for instance 9b35a714-ca92-4921-b64a-469ddd2c9901 on n-h2-858238-3 Nov 02 13:56:51.809101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c1bebc79-1a45-45a1-9375-28a1f3d29d66 req-c943656d-fec3-41a7-909d-70dea7b3c8d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070021 Nov 02 13:56:51.809637 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2019/3071] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:51.825608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:51.826328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:51.841926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.843788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.848559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.855425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.856122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.856873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:52.269777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:52.299389 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2cd739e-86bf-4b68-af1a-f3c00e6a5afe tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1314 microversion: 2.1 time: 0.486840 Nov 02 13:56:52.301325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2020/3072] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:51 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:52.309863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:52.311004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:52.319694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:52.320533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:52.321428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:52.322453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:52.323136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:52.323954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:52.512652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:52.537391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:52.539298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:52.540441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4067759f-cefe-4381-9dc9-a927f806c629 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1310 microversion: 2.21 time: 0.236922 Nov 02 13:56:52.541004 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2021/3073] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:56:52 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1310 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:56:52.566012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2955d84a-0ccc-485c-90ff-0197c2c094b7 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '.version_select at 0x7f6f80a4db80>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:52.613915 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2955d84a-0ccc-485c-90ff-0197c2c094b7 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851348231" status: 202 len: 0 microversion: 2.1 time: 0.065324 Nov 02 13:56:52.616099 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2022/3074] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 13:56:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851348231 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:56:52.624969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-109f6df7-4c63-4947-bf91-f8822660853d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f8133dca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:52.711796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-109f6df7-4c63-4947-bf91-f8822660853d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.093225 Nov 02 13:56:52.712925 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2023/3075] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:52 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:52.726497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f074f60-db68-4a7f-a578-dcf059513fb5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:52.727159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f074f60-db68-4a7f-a578-dcf059513fb5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:52.863716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f074f60-db68-4a7f-a578-dcf059513fb5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:52.874685 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f074f60-db68-4a7f-a578-dcf059513fb5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1208 microversion: 2.1 time: 0.158272 Nov 02 13:56:52.878412 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2024/3076] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:52 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:53.332248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:53.333363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:53.347139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:53.348905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.350476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:53.351338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:53.353368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.353859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:53.810019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:53.837791 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62b42aed-e0c2-4183-8eb0-ee612ce4fcda tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1314 microversion: 2.1 time: 0.513336 Nov 02 13:56:53.838720 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2025/3077] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:53 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:56:53.853518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:53.854843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:53.871036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:53.878950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.880366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:53.881293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:53.881968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.882566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.092476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:54.105915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:54.109582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:54.113020 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4bea4e9f-5e6a-45bb-95d8-9ecc1d156d1b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1316 microversion: 2.21 time: 0.272237 Nov 02 13:56:54.126948 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2026/3078] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:56:53 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:56:54.126948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-746e2f55-79a5-4030-9d06-4227539d24dd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80aa1e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:54.209373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-746e2f55-79a5-4030-9d06-4227539d24dd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.092358 Nov 02 13:56:54.211997 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2027/3079] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:54 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:54.237467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-686ddcf2-83f4-4f86-ab03-81de32e69cba req-2dc250ec-84c1-4270-8aaa-6db84bdda830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4faaeab-c604-437e-abea-6ed148068013", "tag": "05aecb77-bf79-4945-8af5-3a8110c7a16a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:54.265257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-686ddcf2-83f4-4f86-ab03-81de32e69cba req-2dc250ec-84c1-4270-8aaa-6db84bdda830 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.267081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-686ddcf2-83f4-4f86-ab03-81de32e69cba req-2dc250ec-84c1-4270-8aaa-6db84bdda830 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.267613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-686ddcf2-83f4-4f86-ab03-81de32e69cba req-2dc250ec-84c1-4270-8aaa-6db84bdda830 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.296560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:54.323366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-686ddcf2-83f4-4f86-ab03-81de32e69cba req-2dc250ec-84c1-4270-8aaa-6db84bdda830 service nova] Creating event network-changed:05aecb77-bf79-4945-8af5-3a8110c7a16a for instance f4faaeab-c604-437e-abea-6ed148068013 on n-h1-858238-3 Nov 02 13:56:54.349264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-686ddcf2-83f4-4f86-ab03-81de32e69cba req-2dc250ec-84c1-4270-8aaa-6db84bdda830 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124930 Nov 02 13:56:54.350050 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2028/3080] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:54.381564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:54.382265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:54.426965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.435062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.435746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.436668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.437283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.437862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.635961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:54.647886 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc12f33a-6e36-4f64-970b-731303fd7b6e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1266 microversion: 2.1 time: 0.289469 Nov 02 13:56:54.662190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2029/3081] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:54 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:54.864611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:54.865290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:54.878625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.879378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.880009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.880896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.881523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.882109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:55.539754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:55.551917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-308918e6-3baa-4711-b502-165f9b714b51 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1314 microversion: 2.1 time: 0.691764 Nov 02 13:56:55.553381 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2030/3082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:54 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:55.571852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:55.572465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:55.583290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:55.583776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:55.584203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:55.584893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:55.585342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:55.585757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:56.744792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:56.758186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:56.759696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:56.760841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c34d5f0-4786-4c0c-9ade-425e0d02cbda tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1358 microversion: 2.21 time: 1.206376 Nov 02 13:56:56.766522 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2031/3083] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:56:55 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1358 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:56:56.772081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0fdc733c-5f5e-4bb6-9bad-c03ae40e4645 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80aa14c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:57.240273 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0fdc733c-5f5e-4bb6-9bad-c03ae40e4645 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.472445 Nov 02 13:56:57.257167 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2032/3084] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:56 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:57.274243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:57.275532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:57.295856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.307362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.308115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.309079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.310869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.311650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.513488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:57.526510 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ca5cad6-c5a5-409b-96db-3e0c1494fd24 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1266 microversion: 2.1 time: 0.267790 Nov 02 13:56:57.527729 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2033/3085] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:57 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:57.546290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d8d3aac8-8bc8-4f25-8cfd-aabd35b78e46 req-401cec00-9162-42d5-8ea1-d5c06e7302b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faaeab-c604-437e-abea-6ed148068013", "name": "network-vif-plugged", "status": "completed", "tag": "05aecb77-bf79-4945-8af5-3a8110c7a16a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:57.573224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d8d3aac8-8bc8-4f25-8cfd-aabd35b78e46 req-401cec00-9162-42d5-8ea1-d5c06e7302b9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.573961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d8d3aac8-8bc8-4f25-8cfd-aabd35b78e46 req-401cec00-9162-42d5-8ea1-d5c06e7302b9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.574582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d8d3aac8-8bc8-4f25-8cfd-aabd35b78e46 req-401cec00-9162-42d5-8ea1-d5c06e7302b9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.598352 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d8d3aac8-8bc8-4f25-8cfd-aabd35b78e46 req-401cec00-9162-42d5-8ea1-d5c06e7302b9 service nova] Creating event network-vif-plugged:05aecb77-bf79-4945-8af5-3a8110c7a16a for instance f4faaeab-c604-437e-abea-6ed148068013 on n-h1-858238-3 Nov 02 13:56:57.606363 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d8d3aac8-8bc8-4f25-8cfd-aabd35b78e46 req-401cec00-9162-42d5-8ea1-d5c06e7302b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077121 Nov 02 13:56:57.619207 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2034/3086] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:57.625271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:57.626220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:57.650390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.651369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.652553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.654045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.656245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.657001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:58.188181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:58.201088 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-994451f9-d617-48da-9b20-87761d31a3c3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1314 microversion: 2.1 time: 0.580079 Nov 02 13:56:58.206013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2035/3087] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:57 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:58.211485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:58.212101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:58.245476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:58.254233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:58.254998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:58.255933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:58.256559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:58.257156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:58.700860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:58.717584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:58.734571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:58.738149 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a79ce717-dc17-4732-b1c8-1c83c0a3a18d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1358 microversion: 2.21 time: 0.530375 Nov 02 13:56:58.760033 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2036/3088] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:56:58 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1358 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:56:58.778441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3af7e0a2-90a4-4be7-83ad-7e6cdcdbfc14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a5c1f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:58.882339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3af7e0a2-90a4-4be7-83ad-7e6cdcdbfc14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.120127 Nov 02 13:56:58.885337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2037/3089] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:56:58 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:58.900097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:58.902863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:58.918714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:58.923199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:58.924535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:58.926061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:58.931463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:58.932253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.369912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:59.383420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-247b11cc-a165-4b11-919b-285c2e0c74f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1308 microversion: 2.1 time: 0.496651 Nov 02 13:56:59.391594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2038/3090] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:58 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:59.428409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:59.430047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:59.437249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.438282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.439551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.440701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.441929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.442586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.664597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:59.680739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3fbee9e5-91cd-450c-aed8-47845df9cdde tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1502 microversion: 2.1 time: 0.281318 Nov 02 13:56:59.681750 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2039/3091] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:56:59 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:59.709018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:59.709955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:59.721085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.730016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.734033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.735881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.736789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.737501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.902091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-996b881c-47b4-4977-827d-e1291898779e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013/action" status: 202 len: 0 microversion: 2.1 time: 0.198205 Nov 02 13:56:59.910966 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2040/3092] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:56:59 2022] POST /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:56:59.918030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:59.919254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:59.952838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.953784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.954467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.955437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.956211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.957433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:00.683305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:00.699232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:00.701263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:00.706367 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d91cf2d8-28de-49b1-98de-4c0006dc8839 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1358 microversion: 2.21 time: 0.792807 Nov 02 13:57:00.711700 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2041/3093] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:56:59 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1358 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:00.717353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-094e35a3-37cb-493c-b30c-1a05f2992920 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a5c940>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:00.813748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-094e35a3-37cb-493c-b30c-1a05f2992920 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.100522 Nov 02 13:57:00.818822 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2042/3094] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:00 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:00.828237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:00.832037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:00.854347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:00.858216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:00.859429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:00.868181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:00.869140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:00.869677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:01.424452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:02.338034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:02.355118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-815a57f1-3adc-4d88-a634-b0235ad24320 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1487 microversion: 2.1 time: 1.527824 Nov 02 13:57:02.367286 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2043/3095] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:00 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1487 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:02.380713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1f621922-f241-4d4f-a546-ab99818d94d0 req-487a32c2-c165-4473-b7db-884557492095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c2a47a-a905-412f-9ba5-6207ba471f87", "tag": "5fa7ab5f-3593-4c13-8b9d-703aed2970b4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:02.469132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1f621922-f241-4d4f-a546-ab99818d94d0 req-487a32c2-c165-4473-b7db-884557492095 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:02.469886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1f621922-f241-4d4f-a546-ab99818d94d0 req-487a32c2-c165-4473-b7db-884557492095 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:02.471181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1f621922-f241-4d4f-a546-ab99818d94d0 req-487a32c2-c165-4473-b7db-884557492095 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:02.505505 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1f621922-f241-4d4f-a546-ab99818d94d0 req-487a32c2-c165-4473-b7db-884557492095 service nova] Creating event network-changed:5fa7ab5f-3593-4c13-8b9d-703aed2970b4 for instance a6c2a47a-a905-412f-9ba5-6207ba471f87 on n-h2-858238-3 Nov 02 13:57:02.519997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1f621922-f241-4d4f-a546-ab99818d94d0 req-487a32c2-c165-4473-b7db-884557492095 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149049 Nov 02 13:57:02.521118 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2044/3096] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:02.526763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:02.527778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:02.538063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:02.539193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:02.540481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:02.541534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:02.542757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:02.543387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:02.868746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=14 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:03.155312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:03.192092 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-502dd6ce-6b74-44f1-8a3f-9c05b8302c59 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1308 microversion: 2.1 time: 0.664851 Nov 02 13:57:03.195399 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2045/3097] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:02 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:03.227776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:03.231394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:03.248485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:03.249688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:03.251314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:03.254040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:03.255666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:03.259532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:03.697346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:03.716675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:03.718113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:03.722259 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-acee85ac-5b8d-4484-a222-aa58a1ea9715 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1358 microversion: 2.21 time: 0.522163 Nov 02 13:57:03.722880 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2046/3098] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:03 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1358 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:03.740024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3aa99959-2c4d-4e8f-ba07-2617019dd10f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a585e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:03.862264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3aa99959-2c4d-4e8f-ba07-2617019dd10f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.130676 Nov 02 13:57:03.862874 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2047/3099] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:03 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:03.879560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:03.881832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:03.913196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:03.917087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:03.918407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:03.919138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:03.925183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:03.931870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:03.996095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:04.075334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:04.175878 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d12361c-5e70-4ff0-85e2-23178d9c2b4b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 204 len: 0 microversion: 2.1 time: 0.310485 Nov 02 13:57:04.177224 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2048/3100] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:03 2022] DELETE /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:04.186287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:04.187681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:04.204602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:04.206764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:04.208947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:04.209984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:04.212729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:04.214253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:04.274971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] HTTP exception thrown: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Request method failure captured: Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 HTTP/1.1 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZ9fM58UtlZBsG2SSe8cUuotX-pmz_LuBafe-lwh2J7-lJZ7zLfMkN1VxIuJimvn1U0sdgVRTxVZl1rGXDzkJ6GcLVY5CxYwuRGpA2DmpbhKyapu8NU5olfLcWZl3Tu5eLBsqQ_kXZzDqg-V3xxFiWiv7skIAwHf9YI9zRXrGLqhfY Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 85beb7dd39a34f3cae1913ae45e8e231 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85beb7dd39a34f3cae1913ae45e8e231"}]}] Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 85beb7dd39a34f3cae1913ae45e8e231 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachSCSIVolumeTestJSON-1485253695-project Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a6800ea4e7544c4b03263fc7becd000 Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1485253695-project Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9b35a714-ca92-4921-b64a-469ddd2c9901'} Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:04.277033 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:04.281342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:04.288047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Returning 404 to user: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:04.289278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-301e342f-1c88-44ed-b52f-e52421d3425a tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 404 len: 111 microversion: 2.1 time: 0.110126 Nov 02 13:57:04.291133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2049/3101] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:04 2022] DELETE /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:57:04.298198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:04.304140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:04.321813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:04.323863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:04.326958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:04.328034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:04.328580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:04.338152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:05.192823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:05.209001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2122f43-2cd3-4c05-aeef-aa78d1300675 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1493 microversion: 2.1 time: 0.916538 Nov 02 13:57:05.210467 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2050/3102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:04 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1493 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:05.217903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:05.222877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:05.242015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:05.246348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:05.247088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:05.250548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:05.251363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:05.251975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:06.187144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:06.199779 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb7e8290-fb24-4f8e-88f1-da9ed3e0cc86 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1308 microversion: 2.1 time: 0.987685 Nov 02 13:57:06.200817 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2051/3103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:05 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1308 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:06.208494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:06.209145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] [instance: 9b35a714-ca92-4921-b64a-469ddd2c9901] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:06.218714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:06.219263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:06.222586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:06.225320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:06.225816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:06.226259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:06.242415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] HTTP exception thrown: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Request method failure captured: Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 HTTP/1.1 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZ9fM58UtlZBsG2SSe8cUuotX-pmz_LuBafe-lwh2J7-lJZ7zLfMkN1VxIuJimvn1U0sdgVRTxVZl1rGXDzkJ6GcLVY5CxYwuRGpA2DmpbhKyapu8NU5olfLcWZl3Tu5eLBsqQ_kXZzDqg-V3xxFiWiv7skIAwHf9YI9zRXrGLqhfY Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 85beb7dd39a34f3cae1913ae45e8e231 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85beb7dd39a34f3cae1913ae45e8e231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85beb7dd39a34f3cae1913ae45e8e231"}]}] Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 85beb7dd39a34f3cae1913ae45e8e231 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1485253695 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachSCSIVolumeTestJSON-1485253695-project Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6a6800ea4e7544c4b03263fc7becd000 Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1485253695-project Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9b35a714-ca92-4921-b64a-469ddd2c9901'} Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:06.244040 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. Nov 02 13:57:06.249351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:06.250766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] Returning 404 to user: Instance 9b35a714-ca92-4921-b64a-469ddd2c9901 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:06.251984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd0efd62-6fc5-4033-86fd-dbe15edbeb41 tempest-AttachSCSIVolumeTestJSON-1485253695 tempest-AttachSCSIVolumeTestJSON-1485253695-project] 10.222.0.18 "GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901" status: 404 len: 111 microversion: 2.1 time: 0.050696 Nov 02 13:57:06.253606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2052/3104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:06 2022] GET /compute/v2.1/servers/9b35a714-ca92-4921-b64a-469ddd2c9901 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:57:06.258636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-79b9d992-0f72-4348-91a8-3dea15788325 req-270698cf-2fac-48cc-b79e-f43da9b6160f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb483c5-671e-47e1-a125-a0fb95e7f084", "tag": "1acd8a38-169e-4296-8751-aee49f24bad6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:06.273001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79b9d992-0f72-4348-91a8-3dea15788325 req-270698cf-2fac-48cc-b79e-f43da9b6160f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:06.274014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79b9d992-0f72-4348-91a8-3dea15788325 req-270698cf-2fac-48cc-b79e-f43da9b6160f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:06.274890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79b9d992-0f72-4348-91a8-3dea15788325 req-270698cf-2fac-48cc-b79e-f43da9b6160f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:06.293509 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-79b9d992-0f72-4348-91a8-3dea15788325 req-270698cf-2fac-48cc-b79e-f43da9b6160f service nova] Creating event network-changed:1acd8a38-169e-4296-8751-aee49f24bad6 for instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 on n-h1-858238-3 Nov 02 13:57:06.306613 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-79b9d992-0f72-4348-91a8-3dea15788325 req-270698cf-2fac-48cc-b79e-f43da9b6160f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051193 Nov 02 13:57:06.308239 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2053/3105] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:06.316771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:06.318196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:06.326917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:06.327740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:06.328375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:06.329292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:06.329922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:06.330535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:07.311895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:07.327509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:07.329733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:07.330917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2941a09-7e94-4e0f-a56d-9b366b9db412 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1358 microversion: 2.21 time: 1.020998 Nov 02 13:57:07.336434 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2054/3106] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:06 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1358 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:07.347761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84d0bcdf-72e8-4d66-b296-04c7f31e2aac tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80ab10d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:07.461251 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84d0bcdf-72e8-4d66-b296-04c7f31e2aac tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.123569 Nov 02 13:57:07.463485 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2055/3107] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:07 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:07.469577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:07.472429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:07.497299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:07.501508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:07.502419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:07.506014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:07.507390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:07.510785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:08.194796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:08.209812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5db0e29e-3030-4a12-a6c1-7b68b003e822 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1493 microversion: 2.1 time: 0.743711 Nov 02 13:57:08.215604 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2056/3108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:07 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1493 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:08.602762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-71459b78-461e-4b55-bf64-05f6eaf319df req-847c649e-ca83-4b58-9e59-7ecb74d07b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c2a47a-a905-412f-9ba5-6207ba471f87", "name": "network-vif-plugged", "status": "completed", "tag": "5fa7ab5f-3593-4c13-8b9d-703aed2970b4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:08.621533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71459b78-461e-4b55-bf64-05f6eaf319df req-847c649e-ca83-4b58-9e59-7ecb74d07b0b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:08.626799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71459b78-461e-4b55-bf64-05f6eaf319df req-847c649e-ca83-4b58-9e59-7ecb74d07b0b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:08.627543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71459b78-461e-4b55-bf64-05f6eaf319df req-847c649e-ca83-4b58-9e59-7ecb74d07b0b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:08.655774 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-71459b78-461e-4b55-bf64-05f6eaf319df req-847c649e-ca83-4b58-9e59-7ecb74d07b0b service nova] Creating event network-vif-plugged:5fa7ab5f-3593-4c13-8b9d-703aed2970b4 for instance a6c2a47a-a905-412f-9ba5-6207ba471f87 on n-h2-858238-3 Nov 02 13:57:08.664836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-71459b78-461e-4b55-bf64-05f6eaf319df req-847c649e-ca83-4b58-9e59-7ecb74d07b0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.447291 Nov 02 13:57:08.665966 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2057/3109] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:08.686683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:08.688260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:08.695585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:08.696622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:08.698157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:08.708137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:08.709811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:08.710691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:09.828812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:09.872268 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59b3f378-e899-4075-b497-21f0ad5a9d1b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1308 microversion: 2.1 time: 1.202945 Nov 02 13:57:09.913776 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2058/3110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:08 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1308 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:09.921820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:09.922913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:09.936067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:09.936637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:09.937190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:09.938327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:09.938786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:09.939233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:10.370097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:10.395998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:10.398184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:10.406040 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9bd5e77b-ba50-49ba-a45e-f0f2d6837926 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1358 microversion: 2.21 time: 0.487991 Nov 02 13:57:10.428003 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2059/3111] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:09 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1358 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:10.433698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01308f93-83bb-4732-87f4-b445b618700a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80ae5af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:10.529309 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01308f93-83bb-4732-87f4-b445b618700a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1410 microversion: 2.1 time: 0.099826 Nov 02 13:57:10.530618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2060/3112] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:10 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:10.536530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:10.545217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:10.561614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:10.562910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:10.563932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:10.565193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:10.568833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:10.570447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:11.229658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:11.230777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:11.230777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:11.231219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lazy-loading 'fault' on Instance uuid f4faaeab-c604-437e-abea-6ed148068013 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:11.484003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:11.492017 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f3c9c5a-58e6-494f-812c-2718b89c0a26 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 200 len: 1304 microversion: 2.1 time: 0.960123 Nov 02 13:57:11.492637 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2061/3113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:10 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 1304 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:11.503839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e79ecd72-fe92-4df9-b3e9-5e883ca05e0a req-96b5d6b4-9828-436a-b112-97a4e124c28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faaeab-c604-437e-abea-6ed148068013", "name": "network-vif-deleted", "tag": "05aecb77-bf79-4945-8af5-3a8110c7a16a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:11.548591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e79ecd72-fe92-4df9-b3e9-5e883ca05e0a req-96b5d6b4-9828-436a-b112-97a4e124c28c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:11.549094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e79ecd72-fe92-4df9-b3e9-5e883ca05e0a req-96b5d6b4-9828-436a-b112-97a4e124c28c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:11.549523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e79ecd72-fe92-4df9-b3e9-5e883ca05e0a req-96b5d6b4-9828-436a-b112-97a4e124c28c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:11.595645 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e79ecd72-fe92-4df9-b3e9-5e883ca05e0a req-96b5d6b4-9828-436a-b112-97a4e124c28c service nova] Creating event network-vif-deleted:05aecb77-bf79-4945-8af5-3a8110c7a16a for instance f4faaeab-c604-437e-abea-6ed148068013 on n-h1-858238-3 Nov 02 13:57:11.626287 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e79ecd72-fe92-4df9-b3e9-5e883ca05e0a req-96b5d6b4-9828-436a-b112-97a4e124c28c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126072 Nov 02 13:57:11.631869 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2062/3114] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:11.647732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b7c41d22-d0d4-4da1-b0e1-0ee93abea665 req-3b4bfaea-4088-48c2-87cd-65a2a7a3c8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb483c5-671e-47e1-a125-a0fb95e7f084", "name": "network-vif-plugged", "status": "completed", "tag": "1acd8a38-169e-4296-8751-aee49f24bad6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:11.679901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b7c41d22-d0d4-4da1-b0e1-0ee93abea665 req-3b4bfaea-4088-48c2-87cd-65a2a7a3c8f9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:11.680682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b7c41d22-d0d4-4da1-b0e1-0ee93abea665 req-3b4bfaea-4088-48c2-87cd-65a2a7a3c8f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:11.681295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b7c41d22-d0d4-4da1-b0e1-0ee93abea665 req-3b4bfaea-4088-48c2-87cd-65a2a7a3c8f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:11.718499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b7c41d22-d0d4-4da1-b0e1-0ee93abea665 req-3b4bfaea-4088-48c2-87cd-65a2a7a3c8f9 service nova] Creating event network-vif-plugged:1acd8a38-169e-4296-8751-aee49f24bad6 for instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 on n-h1-858238-3 Nov 02 13:57:11.740099 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b7c41d22-d0d4-4da1-b0e1-0ee93abea665 req-3b4bfaea-4088-48c2-87cd-65a2a7a3c8f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106374 Nov 02 13:57:11.741034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2063/3115] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:11.752502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:11.753248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:11.768960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:11.769459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:11.771554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:11.773133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:11.774182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:11.777173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:12.244310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:12.261351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6cbb0ed-6eda-4a2c-a619-2ce1789355ab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1308 microversion: 2.1 time: 0.513333 Nov 02 13:57:12.267197 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2064/3116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:11 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:12.274045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:12.282017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:12.292506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:12.293003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:12.293435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:12.294149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:12.294599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:12.295021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:13.068328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:13.081697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:13.083702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:13.085284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-112cddc3-4941-4d15-8500-2827d510281d tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1550 microversion: 2.21 time: 0.816232 Nov 02 13:57:13.086071 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2065/3117] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:12 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1550 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:13.097893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b29e00ca-3fc3-4f5f-a144-c4e8d54a786c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a5c040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:13.184399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b29e00ca-3fc3-4f5f-a144-c4e8d54a786c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1419 microversion: 2.1 time: 0.096975 Nov 02 13:57:13.185684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2066/3118] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:13 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1419 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:13.194050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:13.196272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:13.224045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:13.224571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:13.225026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:13.226062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:13.226802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:13.227476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:13.244999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 HTTP/1.1 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f4faaeab-c604-437e-abea-6ed148068013'} Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:13.248918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 13:57:13.253193 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:13.257098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:13.269409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39544f0d-d5fa-4de6-a1fc-9d8d627d9e3b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 404 len: 111 microversion: 2.1 time: 0.080778 Nov 02 13:57:13.270234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2067/3119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:13 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:57:13.285115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:13.285870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:13.307899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:13.308867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:13.309535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:13.310732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:13.311491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:13.315423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:13.351447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:13.529883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:13.612448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-443e9442-5392-481f-9a74-47d2d0f6f3d7 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 204 len: 0 microversion: 2.21 time: 0.335518 Nov 02 13:57:13.619621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2068/3120] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:57:13 2022] DELETE /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:57:13.631215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da9ee748-032c-44df-a859-693e8c4dfcf8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80ae7c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:13.729670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da9ee748-032c-44df-a859-693e8c4dfcf8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 200 len: 1419 microversion: 2.1 time: 0.107816 Nov 02 13:57:13.731839 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2069/3121] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:13 2022] GET /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 1419 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:13.736953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:13.738023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:13.744952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:13.745477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:13.746017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:13.746836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:13.747578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:13.748113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:14.314982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:14.326114 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-24042af6-321a-495b-91b0-cb9ace7b76c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1489 microversion: 2.1 time: 0.593009 Nov 02 13:57:14.326957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2070/3122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:13 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1489 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:14.349107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1678915775", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:14.421398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:16.308762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:16.309972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:16.310469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:16.310891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:16.311538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:16.323829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:16.325421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:16.326108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:16.327087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:16.327796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:16.328677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:16.358670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:16.368730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:16.387805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:16.391548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:16.468829 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-065a6305-f6b6-4770-94eb-36bbb67c92a2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131881 Nov 02 13:57:16.477196 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2071/3123] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:57:16.565453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-346464982", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "86f936e7-c591-4cfa-9e22-5d8bb5a9cd3f"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:16.636072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] validate_networks() for [('86f936e7-c591-4cfa-9e22-5d8bb5a9cd3f', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:18.008343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:18.009994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:18.010729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:18.011517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:18.012149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:18.024894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.026500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.027691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.029382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.030625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.031934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.053476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:18.068936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Getting quotas for project cb3ce66791824ed0ab53aa5c729bd15c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:18.075623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Getting quotas for user 7723f37ab6ef443bb38d36cc4d6ca68f and project cb3ce66791824ed0ab53aa5c729bd15c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:18.103531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Going to run 2 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:18.105923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:18.207485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 3cb563bb-1703-4d1a-b80d-4607b01bcad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=211412a4-ec7b-43f9-8880-4ad4f13fbd20,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:18.374144 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14e9b344-5166-4ccf-a69c-5364ef1f7653 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.891779 Nov 02 13:57:18.375714 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2072/3124] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:57:18.386053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:18.389980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:18.404444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.409223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.410626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.411768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.412332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.415261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.547718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.554138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.554671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.555283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lazy-loading 'fault' on Instance uuid a6c2a47a-a905-412f-9ba5-6207ba471f87 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:18.987801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:19.039639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:19.053185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94c6a12f32a9437a8d4475b2d7e72ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea881978e47412492e0c27570b60494', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:19.062028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-07101f2f-95ab-4541-8cb6-8678d143c61b tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 200 len: 1348 microversion: 2.21 time: 0.684576 Nov 02 13:57:19.091907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2073/3125] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:18 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 1348 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:19.109618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed11b511-2996-43c3-888c-656ce45c14c7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a5cee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:20.022688 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed11b511-2996-43c3-888c-656ce45c14c7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 204 len: 0 microversion: 2.1 time: 0.929013 Nov 02 13:57:20.023315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2074/3126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:19 2022] DELETE /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 0 bytes in 931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:20.032057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:20.032931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:20.045877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:20.051438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:20.052070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:20.053242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:20.053885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:20.054349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:20.618050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:20.631930 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5a213ae-3aa7-4128-80d0-bf2fbf16fe80 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1490 microversion: 2.1 time: 0.603787 Nov 02 13:57:20.634124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2075/3127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:20 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1490 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:20.650185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:20.651436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:20.666250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:20.667167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:20.667836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:20.668787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:20.684875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:20.689342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.034379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:21.051046 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a2c4c16-0b87-4571-a1fc-d6893a1fe5f2 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1273 microversion: 2.1 time: 0.415395 Nov 02 13:57:21.055190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2076/3128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:20 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1273 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:21.076301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-87752cc9-38aa-45f5-a564-d6c45c5244cc req-7d6ffb1f-a352-47b3-a6df-5fc1df3f9f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc10b59-116f-41f9-8a18-3fdae1910ef0", "name": "network-vif-unplugged", "status": "completed", "tag": "25935a61-cdc0-430c-aedf-ba06411a429d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:21.101769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-87752cc9-38aa-45f5-a564-d6c45c5244cc req-7d6ffb1f-a352-47b3-a6df-5fc1df3f9f97 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.102364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-87752cc9-38aa-45f5-a564-d6c45c5244cc req-7d6ffb1f-a352-47b3-a6df-5fc1df3f9f97 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.102874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-87752cc9-38aa-45f5-a564-d6c45c5244cc req-7d6ffb1f-a352-47b3-a6df-5fc1df3f9f97 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.116151 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-87752cc9-38aa-45f5-a564-d6c45c5244cc req-7d6ffb1f-a352-47b3-a6df-5fc1df3f9f97 service nova] Creating event network-vif-unplugged:25935a61-cdc0-430c-aedf-ba06411a429d for instance efc10b59-116f-41f9-8a18-3fdae1910ef0 on n-h2-858238-3 Nov 02 13:57:21.127235 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-87752cc9-38aa-45f5-a564-d6c45c5244cc req-7d6ffb1f-a352-47b3-a6df-5fc1df3f9f97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063010 Nov 02 13:57:21.128894 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2077/3129] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:21.264518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d340fc64-1063-4236-b05e-7473471b2828 req-e0a01582-f489-4655-87e6-792b3c0e3248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c2a47a-a905-412f-9ba5-6207ba471f87", "name": "network-vif-deleted", "tag": "5fa7ab5f-3593-4c13-8b9d-703aed2970b4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:21.301673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d340fc64-1063-4236-b05e-7473471b2828 req-e0a01582-f489-4655-87e6-792b3c0e3248 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.302169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d340fc64-1063-4236-b05e-7473471b2828 req-e0a01582-f489-4655-87e6-792b3c0e3248 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.302611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d340fc64-1063-4236-b05e-7473471b2828 req-e0a01582-f489-4655-87e6-792b3c0e3248 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.343292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d340fc64-1063-4236-b05e-7473471b2828 req-e0a01582-f489-4655-87e6-792b3c0e3248 service nova] Creating event network-vif-deleted:5fa7ab5f-3593-4c13-8b9d-703aed2970b4 for instance a6c2a47a-a905-412f-9ba5-6207ba471f87 on n-h2-858238-3 Nov 02 13:57:21.365039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d340fc64-1063-4236-b05e-7473471b2828 req-e0a01582-f489-4655-87e6-792b3c0e3248 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232872 Nov 02 13:57:21.365674 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2078/3130] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:21.380301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:21.395459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:21.401254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Searching by: {'deleted': False, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:57:21.413395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.414278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.414958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.415956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.416645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.419766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.450621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:57:21.508442 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ba49669-161e-4a2b-98e6-32e712932155 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.133960 Nov 02 13:57:21.510486 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2079/3131] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:57:21 2022] GET /compute/v2.1/servers => generated 675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:21.526173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:21.526947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:21.547375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.552205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.552988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.553761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.554246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.554687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.639160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:21.805904 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7488106d-1daf-46b9-8452-287ca40065eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 204 len: 0 microversion: 2.1 time: 0.293077 Nov 02 13:57:21.807413 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2080/3132] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:21 2022] DELETE /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:21.845505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:21.847661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:21.874259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.878178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.878794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.881882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.885253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.885713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.915346 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] HTTP exception thrown: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Request method failure captured: Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 HTTP/1.1 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncc5ApbniqIUuRbOkscz8gv1QTAT6YMD35wDeazBIOe5GOl19I0dXa6f6X9XA8MQUJ5DH2jbarhKIabGzUWTGx0McYuQOoX0LEpJtBgNetF0FlxZB11Kb5oZyfTOEtOtr7Vi5uYD1vxI2dga63jhQ_2nDg9t23W-aOEAbog-NGe1pw Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 6ea881978e47412492e0c27570b60494 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ea881978e47412492e0c27570b60494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ea881978e47412492e0c27570b60494"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ea881978e47412492e0c27570b60494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ea881978e47412492e0c27570b60494"}]}] Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 6ea881978e47412492e0c27570b60494 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceActionsV221TestJSON-1627159327-project Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 94c6a12f32a9437a8d4475b2d7e72ae2 Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceActionsV221TestJSON-1627159327-project Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a6c2a47a-a905-412f-9ba5-6207ba471f87'} Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:21.918271 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:21.925496 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:21.928222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Returning 404 to user: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:21.929992 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a31d44d5-ed23-4d08-9aca-c0a70da4cbb8 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 404 len: 111 microversion: 2.21 time: 0.104072 Nov 02 13:57:21.931727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2081/3133] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:21 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:57:21.941320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:21.942757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:21.952413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.953611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.954698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.956225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:21.958018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:21.958919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.596676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:22.615501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14b61d31-0a16-4cb9-8282-96b499d6fd5e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1489 microversion: 2.1 time: 0.682034 Nov 02 13:57:22.635546 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2082/3134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:21 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1489 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:22.635546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:22.635546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:22.639196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.640275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.641290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.642682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.644354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.645248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.789173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:22.801990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4965d32-e0c0-4ad2-986a-313ce4c5435f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1277 microversion: 2.1 time: 0.184048 Nov 02 13:57:22.803029 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2083/3135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:22 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:22.819853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '.version_select at 0x7f6f80ac51f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:22.819853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:22.830489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.831805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.832910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.834496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.835869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.836507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.934491 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8c06dba-1658-4604-b16b-90bd23d195ea tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.130341 Nov 02 13:57:22.937733 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2084/3136] 10.222.0.18 () {60 vars in 1337 bytes} [Wed Nov 2 13:57:22 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87/os-instance-actions => generated 611 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:57:22.948897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:22.949927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:22.956603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.957188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.957691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.958506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.959243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.960883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:23.246142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:23.259015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c35b130c-e020-45ca-9c15-9866eddfb81d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1315 microversion: 2.1 time: 0.319105 Nov 02 13:57:23.259983 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2085/3137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:22 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:23.284839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2145276597", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7e53e086-dd5c-4df9-95b5-9e9382cf5479"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:23.379607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] validate_networks() for [('7e53e086-dd5c-4df9-95b5-9e9382cf5479', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:25.012884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:25.013691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:25.013997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:25.014838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:25.016297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:25.026839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.027516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.028197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.029171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.029846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.030496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.052528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:25.058939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for user 165803256c184acc801878f0cb60cc67 and project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:25.077616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:25.082121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:25.162941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5ac8407a-4432-4ed1-8b90-eee55c0d91f1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883474 Nov 02 13:57:25.163715 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2086/3138] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:57:25.169013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:25.169788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:25.178274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.179162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.179829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.181341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.182051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.182668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.218124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:25.319841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3bd14bab-ad20-4209-b961-4c582830951a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 204 len: 0 microversion: 2.1 time: 0.153081 Nov 02 13:57:25.322258 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2087/3139] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:25 2022] DELETE /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:25.329791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:25.332846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:25.338671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:INSERT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:25.348789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.349912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.350427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.351267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.351829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.352326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.387484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] HTTP exception thrown: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Request method failure captured: Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 HTTP/1.1 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncc5ApbniqIUuRbOkscz8gv1QTAT6YMD35wDeazBIOe5GOl19I0dXa6f6X9XA8MQUJ5DH2jbarhKIabGzUWTGx0McYuQOoX0LEpJtBgNetF0FlxZB11Kb5oZyfTOEtOtr7Vi5uYD1vxI2dga63jhQ_2nDg9t23W-aOEAbog-NGe1pw Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 6ea881978e47412492e0c27570b60494 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ea881978e47412492e0c27570b60494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ea881978e47412492e0c27570b60494"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ea881978e47412492e0c27570b60494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ea881978e47412492e0c27570b60494"}]}] Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 6ea881978e47412492e0c27570b60494 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceActionsV221TestJSON-1627159327-project Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 94c6a12f32a9437a8d4475b2d7e72ae2 Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceActionsV221TestJSON-1627159327-project Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a6c2a47a-a905-412f-9ba5-6207ba471f87'} Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:25.390478 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:25.395957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:25.400990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Returning 404 to user: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:25.400990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83efcc40-17e5-496a-bdaf-5b51ee7a7e62 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 404 len: 111 microversion: 2.21 time: 0.074565 Nov 02 13:57:25.400990 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2088/3140] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:57:25 2022] DELETE /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:57:25.424204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:25.424761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:25.432023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.432527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.432962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.434075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.434893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.435781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.655489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:25.665276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:25.669911 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ce1a923-4c7f-4d1c-964e-1f7bddd43c88 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1277 microversion: 2.1 time: 0.268586 Nov 02 13:57:25.671295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2089/3141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:25 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:25.677485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:25.678901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:25.687418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.689229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.690738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.691912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.692561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.693373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:26.372081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:26.382703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eaec3a3f-c4a5-4ed5-a8bd-4740e27c1907 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1315 microversion: 2.1 time: 0.709852 Nov 02 13:57:26.383285 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2090/3142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:25 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:26.672752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-79833c1a-d42b-4775-9911-c454b486bece req-2744a6f5-899c-4dd4-aaf4-fe23e2b6bb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc10b59-116f-41f9-8a18-3fdae1910ef0", "name": "network-vif-deleted", "tag": "25935a61-cdc0-430c-aedf-ba06411a429d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:26.695786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79833c1a-d42b-4775-9911-c454b486bece req-2744a6f5-899c-4dd4-aaf4-fe23e2b6bb43 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:26.696772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79833c1a-d42b-4775-9911-c454b486bece req-2744a6f5-899c-4dd4-aaf4-fe23e2b6bb43 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:26.697688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-79833c1a-d42b-4775-9911-c454b486bece req-2744a6f5-899c-4dd4-aaf4-fe23e2b6bb43 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:26.776203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-79833c1a-d42b-4775-9911-c454b486bece req-2744a6f5-899c-4dd4-aaf4-fe23e2b6bb43 service nova] Creating event network-vif-deleted:25935a61-cdc0-430c-aedf-ba06411a429d for instance efc10b59-116f-41f9-8a18-3fdae1910ef0 on n-h2-858238-3 Nov 02 13:57:26.791821 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-79833c1a-d42b-4775-9911-c454b486bece req-2744a6f5-899c-4dd4-aaf4-fe23e2b6bb43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404115 Nov 02 13:57:26.793657 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2091/3143] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:26.818037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:26.819778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:26.843545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:26.847459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:26.852367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:26.853972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:26.854611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:26.855394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:27.159009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:27.167657 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30f3f5e5-b68b-4f98-b6b9-2ee28d83fbea tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1260 microversion: 2.1 time: 0.370730 Nov 02 13:57:27.168903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2092/3144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:26 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1260 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:27.187516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:27.188545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:27.202132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:27.204348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:27.206821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:27.208349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:27.209370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:27.210250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:28.230196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:28.248781 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c72a669-cab6-4553-8cec-fa628455be22 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1495 microversion: 2.1 time: 1.078661 Nov 02 13:57:28.249408 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2093/3145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:27 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1495 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:28.254865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:28.264584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] [instance: a6c2a47a-a905-412f-9ba5-6207ba471f87] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:28.272041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:28.272797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:28.273460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:28.274362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:28.275189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:28.275798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:28.296701 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] HTTP exception thrown: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Request method failure captured: Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 HTTP/1.1 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYncc5ApbniqIUuRbOkscz8gv1QTAT6YMD35wDeazBIOe5GOl19I0dXa6f6X9XA8MQUJ5DH2jbarhKIabGzUWTGx0McYuQOoX0LEpJtBgNetF0FlxZB11Kb5oZyfTOEtOtr7Vi5uYD1vxI2dga63jhQ_2nDg9t23W-aOEAbog-NGe1pw Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 6ea881978e47412492e0c27570b60494 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ea881978e47412492e0c27570b60494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ea881978e47412492e0c27570b60494"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ea881978e47412492e0c27570b60494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ea881978e47412492e0c27570b60494"}]}] Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 6ea881978e47412492e0c27570b60494 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1627159327 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-InstanceActionsV221TestJSON-1627159327-project Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 94c6a12f32a9437a8d4475b2d7e72ae2 Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-InstanceActionsV221TestJSON-1627159327-project Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a6c2a47a-a905-412f-9ba5-6207ba471f87'} Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:28.298746 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] Returning 404 to user: Instance a6c2a47a-a905-412f-9ba5-6207ba471f87 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:28.307476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93c31a39-8d41-432d-95c2-5169d2a14368 tempest-InstanceActionsV221TestJSON-1627159327 tempest-InstanceActionsV221TestJSON-1627159327-project] 10.222.0.18 "GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87" status: 404 len: 111 microversion: 2.21 time: 0.049613 Nov 02 13:57:28.308533 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2094/3146] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:57:28 2022] GET /compute/v2.1/servers/a6c2a47a-a905-412f-9ba5-6207ba471f87 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:57:28.313435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:28.314049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:28.321554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:28.322139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:28.322591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:28.323502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:28.323784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:28.324210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.015191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:29.026055 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-09768c26-7604-4559-a039-0ef782678bc6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.716353 Nov 02 13:57:29.026645 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2095/3147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:28 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:29.053254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6d868127-111a-4fdd-8e05-1e4570f71763 req-1f741b2c-36b4-4e26-9814-9ae20bbc43b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb563bb-1703-4d1a-b80d-4607b01bcad6", "tag": "0118b65a-d471-4fb0-b355-e36ac45793c4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:29.071631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6d868127-111a-4fdd-8e05-1e4570f71763 req-1f741b2c-36b4-4e26-9814-9ae20bbc43b9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.072700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6d868127-111a-4fdd-8e05-1e4570f71763 req-1f741b2c-36b4-4e26-9814-9ae20bbc43b9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.073462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6d868127-111a-4fdd-8e05-1e4570f71763 req-1f741b2c-36b4-4e26-9814-9ae20bbc43b9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.100978 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6d868127-111a-4fdd-8e05-1e4570f71763 req-1f741b2c-36b4-4e26-9814-9ae20bbc43b9 service nova] Creating event network-changed:0118b65a-d471-4fb0-b355-e36ac45793c4 for instance 3cb563bb-1703-4d1a-b80d-4607b01bcad6 on n-h1-858238-3 Nov 02 13:57:29.107820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6d868127-111a-4fdd-8e05-1e4570f71763 req-1f741b2c-36b4-4e26-9814-9ae20bbc43b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079561 Nov 02 13:57:29.109117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2096/3148] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:29.116785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:29.117765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:29.126833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.127935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.128656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.129547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.130172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.130742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.661053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:29.678604 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28a80ab1-4cc3-4e8e-b85b-a756cc6b2c3c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1315 microversion: 2.1 time: 0.567416 Nov 02 13:57:29.679582 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2097/3149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:29 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:29.691907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:29.694076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:29.711633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.713337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.713337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.713806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.714425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.715033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.880906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:30.890092 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c83a2924-edb3-4afd-a4ee-6d245d5e3892 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1308 microversion: 2.1 time: 1.209169 Nov 02 13:57:30.897072 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2098/3150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:29 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1308 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:30.919997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:30.924229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:30.935604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.936699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.937367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.939453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.940831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.941914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.026600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.029729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.030581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.031318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lazy-loading 'fault' on Instance uuid 7bb483c5-671e-47e1-a125-a0fb95e7f084 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:31.197688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:31.229416 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6c5fd94d-1ca3-4ec4-a2aa-ce97881f2907 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 200 len: 1298 microversion: 2.1 time: 0.323852 Nov 02 13:57:31.231860 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2099/3151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:30 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 1298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:31.243172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:31.244773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:31.252531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.253394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.255842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.257033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.257743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.258464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.846967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:31.855516 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb94deb1-7543-49a8-a063-c087b73d78c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.621201 Nov 02 13:57:31.856126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2100/3152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:31 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:31.874357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:31.876282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:31.885449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.886727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.887413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.888292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.888905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.889476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:32.516676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:32.525492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-043cdbb0-a25e-4d81-94f3-510cd3855f3d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1315 microversion: 2.1 time: 0.664036 Nov 02 13:57:32.526078 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2101/3153] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:31 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:32.541904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9270f9e1-f6ae-4560-9cb3-a230e60b490d", "tag": "021b56a7-a549-4d8a-938d-96d4a3432c7f"}, {"server_uuid": "7bb483c5-671e-47e1-a125-a0fb95e7f084", "name": "network-vif-deleted", "tag": "1acd8a38-169e-4296-8751-aee49f24bad6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:32.564515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:32.565375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:32.566271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:32.604312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] Creating event network-changed:021b56a7-a549-4d8a-938d-96d4a3432c7f for instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d on n-h2-858238-3 Nov 02 13:57:32.606651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] Creating event network-vif-deleted:1acd8a38-169e-4296-8751-aee49f24bad6 for instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 on n-h1-858238-3 Nov 02 13:57:32.628350 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-fc85ba4a-3497-4dcd-bba2-893f8903befa req-e397170a-c7f0-4eaf-86f5-464941139413 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089986 Nov 02 13:57:32.632291 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2102/3154] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:32.641596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:32.643032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:32.660631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:32.661128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:32.661566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:32.662281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:32.662736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:32.663279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.618454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:33.645676 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b197faa7-313e-4054-9537-61274b7de15c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1308 microversion: 2.1 time: 1.011404 Nov 02 13:57:33.646529 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2103/3155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:32 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1308 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:33.652873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:33.653718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:33.662241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.662829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.663382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.664133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.664603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.665034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.693809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 HTTP/1.1 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7bb483c5-671e-47e1-a125-a0fb95e7f084'} Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:33.696693 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 13:57:33.704201 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:33.706557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:33.708052 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70c08ef9-59ad-46da-8091-9f09789fdc23 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 404 len: 111 microversion: 2.1 time: 0.059626 Nov 02 13:57:33.708999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2104/3156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:33 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:57:33.715622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-21857e65-8351-4bbd-b5e8-ac2bdc6af1e8 req-93f85b0b-8fca-48e6-baee-611532867a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e372cb2-6bbd-464c-8e36-a3180d6d6a65", "tag": "92b7eb8b-8282-488a-99ac-9205b9f0c1d1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:33.727237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-21857e65-8351-4bbd-b5e8-ac2bdc6af1e8 req-93f85b0b-8fca-48e6-baee-611532867a9b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.728026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-21857e65-8351-4bbd-b5e8-ac2bdc6af1e8 req-93f85b0b-8fca-48e6-baee-611532867a9b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.728627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-21857e65-8351-4bbd-b5e8-ac2bdc6af1e8 req-93f85b0b-8fca-48e6-baee-611532867a9b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.768597 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-21857e65-8351-4bbd-b5e8-ac2bdc6af1e8 req-93f85b0b-8fca-48e6-baee-611532867a9b service nova] Creating event network-changed:92b7eb8b-8282-488a-99ac-9205b9f0c1d1 for instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 on n-h2-858238-3 Nov 02 13:57:33.782954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-21857e65-8351-4bbd-b5e8-ac2bdc6af1e8 req-93f85b0b-8fca-48e6-baee-611532867a9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072474 Nov 02 13:57:33.789790 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2105/3157] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:33.804287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:33.806861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:33.825330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.826069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.827544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.829506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.831768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.832422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.201251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:34.216156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b1aa538-7fe8-4502-baac-e355da3cc5d8 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.424907 Nov 02 13:57:34.216681 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2106/3158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:33 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:34.233030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-43fb4c32-26b5-4b7b-b883-e51ad0f2e12b req-ef1a0486-2b15-4472-9cf2-01cdfdba4117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb563bb-1703-4d1a-b80d-4607b01bcad6", "name": "network-vif-plugged", "status": "completed", "tag": "0118b65a-d471-4fb0-b355-e36ac45793c4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:34.243246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-43fb4c32-26b5-4b7b-b883-e51ad0f2e12b req-ef1a0486-2b15-4472-9cf2-01cdfdba4117 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.243723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-43fb4c32-26b5-4b7b-b883-e51ad0f2e12b req-ef1a0486-2b15-4472-9cf2-01cdfdba4117 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.244149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-43fb4c32-26b5-4b7b-b883-e51ad0f2e12b req-ef1a0486-2b15-4472-9cf2-01cdfdba4117 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.257101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-43fb4c32-26b5-4b7b-b883-e51ad0f2e12b req-ef1a0486-2b15-4472-9cf2-01cdfdba4117 service nova] Creating event network-vif-plugged:0118b65a-d471-4fb0-b355-e36ac45793c4 for instance 3cb563bb-1703-4d1a-b80d-4607b01bcad6 on n-h1-858238-3 Nov 02 13:57:34.262304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-43fb4c32-26b5-4b7b-b883-e51ad0f2e12b req-ef1a0486-2b15-4472-9cf2-01cdfdba4117 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044388 Nov 02 13:57:34.263261 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2107/3159] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:34.270338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:34.270572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:34.277794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.278296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.278857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.279746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.280312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.280743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.043643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:35.067312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:35.120373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:35.136812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aee6f2b6-8371-40b2-a824-164b4a9d7f17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1315 microversion: 2.1 time: 0.872289 Nov 02 13:57:35.151834 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2108/3160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:34 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:35.159942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:35.160745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:35.167668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.168485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.169230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.170458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.171896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.172990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.216771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:35.276453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:35.381935 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3c3ed17-70e4-40e9-af10-3bc31da65f45 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 204 len: 0 microversion: 2.1 time: 0.228117 Nov 02 13:57:35.384356 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2109/3161] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:35 2022] DELETE /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:35.397535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:35.398694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:35.438498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.438970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.441664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.445076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.447339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.449791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.541531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:36.589206 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f88e558-3da7-4103-86d3-85f62a63419b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1308 microversion: 2.1 time: 1.201125 Nov 02 13:57:36.591194 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2110/3162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:35 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1308 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:36.604301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3b39b7e3-4e0c-459a-b75c-635f95c4d4fe req-ecefdf78-d07b-46a7-b8b0-c858c23c685e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211412a4-ec7b-43f9-8880-4ad4f13fbd20", "tag": "74c8e1b8-a0ef-42d5-ac6a-ca77dee00c76"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:36.627060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3b39b7e3-4e0c-459a-b75c-635f95c4d4fe req-ecefdf78-d07b-46a7-b8b0-c858c23c685e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.630038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3b39b7e3-4e0c-459a-b75c-635f95c4d4fe req-ecefdf78-d07b-46a7-b8b0-c858c23c685e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.630488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3b39b7e3-4e0c-459a-b75c-635f95c4d4fe req-ecefdf78-d07b-46a7-b8b0-c858c23c685e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.658580 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3b39b7e3-4e0c-459a-b75c-635f95c4d4fe req-ecefdf78-d07b-46a7-b8b0-c858c23c685e service nova] Creating event network-changed:74c8e1b8-a0ef-42d5-ac6a-ca77dee00c76 for instance 211412a4-ec7b-43f9-8880-4ad4f13fbd20 on n-h2-858238-3 Nov 02 13:57:36.676717 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3b39b7e3-4e0c-459a-b75c-635f95c4d4fe req-ecefdf78-d07b-46a7-b8b0-c858c23c685e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078556 Nov 02 13:57:36.676717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2111/3163] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:36.684759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:36.685620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:36.713467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.722236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.728184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.729156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.741726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.742459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.131177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.143700 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43389781-ae63-436b-92fe-d24a0ae32136 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.463169 Nov 02 13:57:37.160051 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2112/3164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:36 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:37.176522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:37.182747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:37.198762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.203604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.206136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.207823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.211980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.212732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.665928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.681345 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54f9aaad-b756-4376-b3fb-140f028d663e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 200 len: 1496 microversion: 2.1 time: 0.519250 Nov 02 13:57:37.682368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2113/3165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:37 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 1496 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:37.692268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:37.696005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:37.713829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.714701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.716761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.718308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.720286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.722154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.313196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:38.359542 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d8eece7c-0348-459b-ad88-0ecfe232dabd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1315 microversion: 2.1 time: 0.672969 Nov 02 13:57:38.361124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2114/3166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:37 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:38.379066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a322ed3c-f3c2-482a-9ee2-d5a0e50d41fa req-35c9d71d-075f-4046-9f22-9cf43193a994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9270f9e1-f6ae-4560-9cb3-a230e60b490d", "name": "network-vif-plugged", "status": "completed", "tag": "021b56a7-a549-4d8a-938d-96d4a3432c7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:38.424370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a322ed3c-f3c2-482a-9ee2-d5a0e50d41fa req-35c9d71d-075f-4046-9f22-9cf43193a994 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.425068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a322ed3c-f3c2-482a-9ee2-d5a0e50d41fa req-35c9d71d-075f-4046-9f22-9cf43193a994 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.425878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a322ed3c-f3c2-482a-9ee2-d5a0e50d41fa req-35c9d71d-075f-4046-9f22-9cf43193a994 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.445455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a322ed3c-f3c2-482a-9ee2-d5a0e50d41fa req-35c9d71d-075f-4046-9f22-9cf43193a994 service nova] Creating event network-vif-plugged:021b56a7-a549-4d8a-938d-96d4a3432c7f for instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d on n-h2-858238-3 Nov 02 13:57:38.455369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a322ed3c-f3c2-482a-9ee2-d5a0e50d41fa req-35c9d71d-075f-4046-9f22-9cf43193a994 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089484 Nov 02 13:57:38.457143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2115/3167] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:38.591184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-912798149", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "d42104fd-8c76-47b6-ab60-c9a72e1f2a43"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:38.683231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] validate_networks() for [('d42104fd-8c76-47b6-ab60-c9a72e1f2a43', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:39.888554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:39.890161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:39.890678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:39.891573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:39.892183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:39.924081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:39.924890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:39.925844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.926638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:39.927140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:39.927602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.951747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Getting quotas for project d326159935494ce7b55123dbc3b579db. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:39.959168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Getting quotas for user 6d9ff2af96134b3ab325b5a8424de6ab and project d326159935494ce7b55123dbc3b579db. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:39.977232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:39.979966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:40.072217 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d86f482-38b3-4ba9-bdcb-e9caf0b9821e tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.592460 Nov 02 13:57:40.078348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2116/3168] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:57:40.117373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:40.120104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:40.151312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.152155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.152838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.153791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.154459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.155215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.907367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:40.919010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df7fef65-8cb5-463e-b02d-8f9c1835bbf4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1308 microversion: 2.1 time: 0.839357 Nov 02 13:57:40.934541 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2117/3169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:40 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1308 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:40.944215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:40.945690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:40.954456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.955386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.956443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.957450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.958297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.959280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.376095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:41.386187 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a1ccf39-6837-4ecf-b7c6-da4b5480f358 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.447459 Nov 02 13:57:41.387855 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2118/3170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:40 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:41.407400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:41.408254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:41.416344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.417155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.417847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.419245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.421528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.422322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.446385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 HTTP/1.1 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ace70082-6a39-497a-a4be-05b1ca885614'} Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:41.448389 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 13:57:41.453735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:57:41.460550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:41.461439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-20282498-69e9-4a93-8fd3-9ac141164908 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 404 len: 111 microversion: 2.1 time: 0.072614 Nov 02 13:57:41.462638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2119/3171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:41 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:57:41.477240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6ded069d-7f9d-4917-9604-f6369d9fd409 req-5acf728e-6c5c-4817-a440-b4c9f47951ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace70082-6a39-497a-a4be-05b1ca885614", "name": "network-vif-deleted", "tag": "a386bd49-2520-443e-91c9-0b4b073ab189"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:41.512226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ded069d-7f9d-4917-9604-f6369d9fd409 req-5acf728e-6c5c-4817-a440-b4c9f47951ba service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.512709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ded069d-7f9d-4917-9604-f6369d9fd409 req-5acf728e-6c5c-4817-a440-b4c9f47951ba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.513141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ded069d-7f9d-4917-9604-f6369d9fd409 req-5acf728e-6c5c-4817-a440-b4c9f47951ba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.545104 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6ded069d-7f9d-4917-9604-f6369d9fd409 req-5acf728e-6c5c-4817-a440-b4c9f47951ba service nova] Creating event network-vif-deleted:a386bd49-2520-443e-91c9-0b4b073ab189 for instance ace70082-6a39-497a-a4be-05b1ca885614 on n-h2-858238-3 Nov 02 13:57:41.562470 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6ded069d-7f9d-4917-9604-f6369d9fd409 req-5acf728e-6c5c-4817-a440-b4c9f47951ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098277 Nov 02 13:57:41.563831 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2120/3172] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:41.573854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:41.574573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:41.621409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.622154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.622771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.623921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.624559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.625156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.055756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.076682 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-747e519b-a0f3-418d-8172-2175c4d50f44 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1502 microversion: 2.1 time: 0.511362 Nov 02 13:57:42.085986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2121/3173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:41 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1502 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:42.100292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:42.101428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:42.113416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.115907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.117491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.118859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.119613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.120492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.314720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.328828 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee5d6556-1c86-4a65-b7ed-7cc8e2bb2db8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1289 microversion: 2.1 time: 0.239234 Nov 02 13:57:42.349439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2122/3174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:42 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1289 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:42.354700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f501140e-e9fd-4007-bd3f-6c3b53919f6b req-5bc263d2-b97c-4e9f-9231-fe247853feb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e372cb2-6bbd-464c-8e36-a3180d6d6a65", "name": "network-vif-plugged", "status": "completed", "tag": "92b7eb8b-8282-488a-99ac-9205b9f0c1d1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:42.367010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f501140e-e9fd-4007-bd3f-6c3b53919f6b req-5bc263d2-b97c-4e9f-9231-fe247853feb2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.367741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f501140e-e9fd-4007-bd3f-6c3b53919f6b req-5bc263d2-b97c-4e9f-9231-fe247853feb2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.368229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f501140e-e9fd-4007-bd3f-6c3b53919f6b req-5bc263d2-b97c-4e9f-9231-fe247853feb2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.391999 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f501140e-e9fd-4007-bd3f-6c3b53919f6b req-5bc263d2-b97c-4e9f-9231-fe247853feb2 service nova] Creating event network-vif-plugged:92b7eb8b-8282-488a-99ac-9205b9f0c1d1 for instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 on n-h2-858238-3 Nov 02 13:57:42.414815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f501140e-e9fd-4007-bd3f-6c3b53919f6b req-5bc263d2-b97c-4e9f-9231-fe247853feb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059583 Nov 02 13:57:42.416288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2123/3175] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:42.427751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-958627408", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:42.564526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:43.650799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:43.652030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:43.652760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:43.653175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:43.653586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:43.666698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.670788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.671559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.672631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.674113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.674959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.706227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:43.711464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:43.718289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:43.766377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:43.772587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:43.900966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-946665ba-8087-4c92-af80-a115050296d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482033 Nov 02 13:57:43.901659 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2124/3176] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:57:43.917772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:43.918474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:43.937787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.938797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.939300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.940828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.943079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.944735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.374289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:44.383083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0d41740-25ee-4a77-af88-2d1729480b13 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1308 microversion: 2.1 time: 0.472339 Nov 02 13:57:44.400258 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2125/3177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:43 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:44.407265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:44.407784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:44.415242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.416604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.417231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.418155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.418809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.419547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.453679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lazy-loading 'flavor' on Instance uuid 9270f9e1-f6ae-4560-9cb3-a230e60b490d {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:44.808544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6b22912-ea0c-42e6-8e66-278660294c61 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d/action" status: 202 len: 0 microversion: 2.1 time: 0.406436 Nov 02 13:57:44.809574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2126/3178] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:57:44 2022] POST /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:57:44.816413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:44.817510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:44.828626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.829531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.830374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.832225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.833120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.845556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.235419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:45.246370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3f2a6f4-f67f-4266-978b-ef88ad35b922 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.434920 Nov 02 13:57:45.260540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2127/3179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:44 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:45.272104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:45.273104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:45.281991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:45.282509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:45.282947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.284142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:45.284607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:45.285101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.317587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:46.287920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.298264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec560350-d725-45b6-a239-c173526bc527 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1331 microversion: 2.1 time: 1.036716 Nov 02 13:57:46.299592 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2128/3180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:45 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1331 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:46.307598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.308413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.320429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.321445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.322114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.322836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.323341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.323916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.453571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.466933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6276112-bfaa-4980-a65b-691743f27fef tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1266 microversion: 2.1 time: 0.165939 Nov 02 13:57:46.467696 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2129/3181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:46 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:46.473791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-876fda04-cdae-4979-b958-5153084b5751 req-ba0f533d-5d5c-43b6-86d3-cb9306b8a766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211412a4-ec7b-43f9-8880-4ad4f13fbd20", "name": "network-vif-plugged", "status": "completed", "tag": "74c8e1b8-a0ef-42d5-ac6a-ca77dee00c76"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:46.484402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-876fda04-cdae-4979-b958-5153084b5751 req-ba0f533d-5d5c-43b6-86d3-cb9306b8a766 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.484973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-876fda04-cdae-4979-b958-5153084b5751 req-ba0f533d-5d5c-43b6-86d3-cb9306b8a766 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.485482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-876fda04-cdae-4979-b958-5153084b5751 req-ba0f533d-5d5c-43b6-86d3-cb9306b8a766 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.498518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-876fda04-cdae-4979-b958-5153084b5751 req-ba0f533d-5d5c-43b6-86d3-cb9306b8a766 service nova] Creating event network-vif-plugged:74c8e1b8-a0ef-42d5-ac6a-ca77dee00c76 for instance 211412a4-ec7b-43f9-8880-4ad4f13fbd20 on n-h2-858238-3 Nov 02 13:57:46.504890 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-876fda04-cdae-4979-b958-5153084b5751 req-ba0f533d-5d5c-43b6-86d3-cb9306b8a766 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035608 Nov 02 13:57:46.506138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2130/3182] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:46.518866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.519639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.527079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.527601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.528329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.528825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.529299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.529796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.000709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.025126 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b32d4b6-c852-447e-81ee-16801d3cb1d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.517287 Nov 02 13:57:47.043952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2131/3183] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:46 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:47.089099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:47.090202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:47.101818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.103010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.103812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.105306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.106311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.107325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.604328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.624014 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7243cfe1-3aaf-4249-856c-b495ba7ce06f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1488 microversion: 2.1 time: 0.578384 Nov 02 13:57:47.625164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2132/3184] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:47 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1488 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:47.630578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5be8ff11-11fd-46f9-a6a5-efa7445217eb req-816e437e-e758-481f-87a1-0d5679ffb677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d", "tag": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:47.653645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5be8ff11-11fd-46f9-a6a5-efa7445217eb req-816e437e-e758-481f-87a1-0d5679ffb677 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.654130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5be8ff11-11fd-46f9-a6a5-efa7445217eb req-816e437e-e758-481f-87a1-0d5679ffb677 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.654561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5be8ff11-11fd-46f9-a6a5-efa7445217eb req-816e437e-e758-481f-87a1-0d5679ffb677 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.682293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5be8ff11-11fd-46f9-a6a5-efa7445217eb req-816e437e-e758-481f-87a1-0d5679ffb677 service nova] Creating event network-changed:b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd for instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d on n-h1-858238-3 Nov 02 13:57:47.692626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5be8ff11-11fd-46f9-a6a5-efa7445217eb req-816e437e-e758-481f-87a1-0d5679ffb677 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065935 Nov 02 13:57:47.694043 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2133/3185] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:47.700427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:47.701448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:47.710034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.710917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.711575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.712524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.713176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.713780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.072664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.087483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56b0ac83-d344-491f-b175-92c3887e2f95 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1319 microversion: 2.1 time: 0.391069 Nov 02 13:57:48.100052 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2134/3186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:47 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:48.133689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:48.134788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.148493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.149289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.151525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.153831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.154973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.155782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.722794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.731864 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f63858c0-c64c-4dda-a4f3-74cebc35aebf tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1331 microversion: 2.1 time: 0.629861 Nov 02 13:57:48.732448 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2135/3187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:48 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1331 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:48.737507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:48.738117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.745694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.746416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.747026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.748072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.748707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.749346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.678028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:49.686370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10e09aa3-712e-48c9-a72d-92cea2c106d5 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1308 microversion: 2.1 time: 0.952673 Nov 02 13:57:49.706863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2136/3188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:48 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1308 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:49.712840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:49.713587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:49.720638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.722230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.722771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.724092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.725343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.725852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.750960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lazy-loading 'flavor' on Instance uuid 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:49.840810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a667820-89e6-4c79-9215-f96e6a862321 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65/action" status: 202 len: 0 microversion: 2.1 time: 0.131438 Nov 02 13:57:49.843473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2137/3189] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:57:49 2022] POST /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:57:49.852167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:49.852982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:49.859646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.860780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.861454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.862962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.863683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.864185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.429360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:50.439015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f72f509c-e7ba-4c84-9642-092b625e7097 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.592337 Nov 02 13:57:50.439559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2138/3190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:49 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:50.445350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:50.445962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.452476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.453201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.453857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.454765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.455619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.456139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.891171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:50.909329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb808904-9a4a-49ab-a247-8c4f3db3e2b6 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 200 len: 1508 microversion: 2.1 time: 0.467396 Nov 02 13:57:50.909935 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2139/3191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:50 2022] GET /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:50.915725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:50.916557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.934755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.935598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.936411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.937312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.937935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.938529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.249053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.259636 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b33849d-5bec-47bf-bc78-f2cc4123c1b6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1331 microversion: 2.1 time: 0.348383 Nov 02 13:57:51.260943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2140/3192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:50 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1331 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:51.266823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:51.268519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:51.276760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.277628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.278310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.279730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.280435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.280924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.854473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.869234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf53f0da-f7c3-4ac6-952e-4dc2c5088917 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 200 len: 1479 microversion: 2.1 time: 0.604484 Nov 02 13:57:51.870039 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2141/3193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:51 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 1479 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:51.895279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:51.898022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:51.910831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.915639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.916216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.917067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.918260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.919564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.953298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:52.966103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ca0e11d-10ff-4e59-8e5b-ac518a503f32 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1308 microversion: 2.1 time: 1.080997 Nov 02 13:57:52.967239 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2142/3194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:51 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1308 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:52.992287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:52.993872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 3cb563bb-1703-4d1a-b80d-4607b01bcad6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:53.012275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:53.022051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:53.029742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:53.030846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:53.031772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:53.032634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:53.672618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:53.698289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:53.702180 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-31c4aa6b-3d68-4fb2-be2e-0a6e10857f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/3cb563bb-1703-4d1a-b80d-4607b01bcad6" status: 200 len: 1507 microversion: 2.1 time: 0.733440 Nov 02 13:57:53.706627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2143/3195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:52 2022] GET /compute/v2.1/servers/3cb563bb-1703-4d1a-b80d-4607b01bcad6 => generated 1507 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:53.713054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:53.714222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:53.720378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:53.721195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:53.725147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:53.726123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:53.726595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:53.727251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:53.745149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:54.021683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:54.026498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:54.036466 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87330a2e-f354-4a1c-b507-b8a185b8ea17 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.326582 Nov 02 13:57:54.037827 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2144/3196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:53 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:54.052648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-97293d4b-0744-4a99-ac44-76a3792c1604 req-32427660-8e18-4285-a0de-e32e4a87957c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa9be90-bb3f-4bcd-96e6-92a85c290df0", "tag": "97bea379-d58a-4b77-b13c-44787ba7658a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:54.075902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-97293d4b-0744-4a99-ac44-76a3792c1604 req-32427660-8e18-4285-a0de-e32e4a87957c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.076562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-97293d4b-0744-4a99-ac44-76a3792c1604 req-32427660-8e18-4285-a0de-e32e4a87957c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.077105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-97293d4b-0744-4a99-ac44-76a3792c1604 req-32427660-8e18-4285-a0de-e32e4a87957c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.097113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-97293d4b-0744-4a99-ac44-76a3792c1604 req-32427660-8e18-4285-a0de-e32e4a87957c service nova] Creating event network-changed:97bea379-d58a-4b77-b13c-44787ba7658a for instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 on n-h1-858238-3 Nov 02 13:57:54.104019 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-97293d4b-0744-4a99-ac44-76a3792c1604 req-32427660-8e18-4285-a0de-e32e4a87957c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057203 Nov 02 13:57:54.105437 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2145/3197] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:54.115644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-690219951"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:54.122017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:54.130158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.130898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.131575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.132551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.133038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.133530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.442590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3300f1e7-27f1-48f0-9e2a-6f68c20adf98 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65/action" status: 202 len: 0 microversion: 2.1 time: 0.332954 Nov 02 13:57:54.443833 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2146/3198] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:57:54 2022] POST /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:57:54.470303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:54.471537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:54.486374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.487795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.488475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.489575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.490540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.491264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.928883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:54.946001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec15b2f9-5c4d-4dfe-9953-e5f1fe467cb4 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1331 microversion: 2.1 time: 0.500628 Nov 02 13:57:54.947402 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2147/3199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:54 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1331 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:54.953735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-29f60599-254b-43c9-8852-6ea406d43227 req-bf0842fa-d38e-4a65-82e4-f49a6501d3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d", "name": "network-vif-plugged", "status": "completed", "tag": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:54.965612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-29f60599-254b-43c9-8852-6ea406d43227 req-bf0842fa-d38e-4a65-82e4-f49a6501d3f2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.966419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-29f60599-254b-43c9-8852-6ea406d43227 req-bf0842fa-d38e-4a65-82e4-f49a6501d3f2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.967046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-29f60599-254b-43c9-8852-6ea406d43227 req-bf0842fa-d38e-4a65-82e4-f49a6501d3f2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.981229 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-29f60599-254b-43c9-8852-6ea406d43227 req-bf0842fa-d38e-4a65-82e4-f49a6501d3f2 service nova] Creating event network-vif-plugged:b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd for instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d on n-h1-858238-3 Nov 02 13:57:54.987713 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-29f60599-254b-43c9-8852-6ea406d43227 req-bf0842fa-d38e-4a65-82e4-f49a6501d3f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038921 Nov 02 13:57:54.988645 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2148/3200] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:55.187149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a583df35-e829-4426-8d82-c3a439430ecc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'create', calling method: .version_select at 0x7f6f80b93790>, body: {"keypair": {"name": "tempest-keypair-1586223354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxD+E24HW8/a7UYGe5RXd774aL0XgT1i+Jm9rBcl8sPCdSsS+KZDqqMons+56ZCtKloqlxCBL9oRD2AOr6+0PwBG88wd9XPdz6vV7Eru2cWooMuJSKmY2LvL3TFgLcZ8Q=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:55.222644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a583df35-e829-4426-8d82-c3a439430ecc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for project 440bbc53bad84aeda15c454a82450493. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:55.230002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a583df35-e829-4426-8d82-c3a439430ecc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for user 53bef65bfa79486a8f0180f2f86eddba and project 440bbc53bad84aeda15c454a82450493. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:55.278190 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a583df35-e829-4426-8d82-c3a439430ecc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.287673 Nov 02 13:57:55.279939 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2149/3201] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:57:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:55.285336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.286145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 3cb563bb-1703-4d1a-b80d-4607b01bcad6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.293295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.293828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.294265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.294971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.295463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.296042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.332442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 3cb563bb-1703-4d1a-b80d-4607b01bcad6] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:55.456275 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-454e3c8e-089d-4ea0-adcd-a679808286c2 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3cb563bb-1703-4d1a-b80d-4607b01bcad6" status: 204 len: 0 microversion: 2.1 time: 0.175638 Nov 02 13:57:55.457944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2150/3202] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:55 2022] DELETE /compute/v2.1/servers/3cb563bb-1703-4d1a-b80d-4607b01bcad6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:55.464294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.465649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.475230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.475717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.476429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.477271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.487635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.488331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.781161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:55.814445 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4183255a-e152-4601-bdef-dfb1e4172c9a tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1308 microversion: 2.1 time: 0.354814 Nov 02 13:57:55.818680 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2151/3203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:55 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:55.837202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c96295be-5861-4193-a9fa-33bd512e83ec tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a5c790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.904482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c96295be-5861-4193-a9fa-33bd512e83ec tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 200 len: 1435 microversion: 2.1 time: 0.071685 Nov 02 13:57:55.919348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2152/3204] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:55 2022] GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 1435 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:55.919348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.919348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.922143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.922708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.923357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.924714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.925200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.925646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:56.157299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:56.170373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb2fe07b-0b42-491c-aaa8-c6016f4e2396 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.263743 Nov 02 13:57:56.183156 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2153/3205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:55 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:56.190537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:56.195549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:56.204751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:56.206164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:56.206994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:56.208217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:56.209459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:56.210248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:56.257441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 211412a4-ec7b-43f9-8880-4ad4f13fbd20] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:56.414591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfaff6a7-f66d-4560-b305-de3df234ce3a tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "DELETE /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20" status: 204 len: 0 microversion: 2.1 time: 0.229003 Nov 02 13:57:56.415557 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2154/3206] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:57:56 2022] DELETE /compute/v2.1/servers/211412a4-ec7b-43f9-8880-4ad4f13fbd20 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:56.446170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:56.447584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:56.460105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:56.461841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:56.463040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:56.465097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:56.466471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:56.467796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:56.655412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:56.665387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fe797af-d29a-477d-abe2-638a08152531 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1331 microversion: 2.1 time: 0.234535 Nov 02 13:57:56.666261 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2155/3207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:56 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1331 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:56.672188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-627630157", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "86f936e7-c591-4cfa-9e22-5d8bb5a9cd3f"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:56.763025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] validate_networks() for [('86f936e7-c591-4cfa-9e22-5d8bb5a9cd3f', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:57.529628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:57.530360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:57.531732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:57.532701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:57.534549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:57.549641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.550157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.550607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.551551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.552015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.552440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.574609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Getting quotas for project cb3ce66791824ed0ab53aa5c729bd15c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:57.582185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Getting quotas for user 7723f37ab6ef443bb38d36cc4d6ca68f and project cb3ce66791824ed0ab53aa5c729bd15c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:57.586959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:57.601603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Going to run 2 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:57.604799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: f6003ade-e03a-4969-98b4-75ef449083d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:57.658517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=f6003ade-e03a-4969-98b4-75ef449083d9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:57.749695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5ae4105a-2560-4b4c-9792-70acd43484d9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.081049 Nov 02 13:57:57.750702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2156/3208] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:57:57.765749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:57.768267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:57.803766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.804296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.806110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.806912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.808379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.808706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:58.567652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:58.586812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a855dcbb-b434-4e2e-874a-e1e19df00ea9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1308 microversion: 2.1 time: 0.830140 Nov 02 13:57:58.599973 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2157/3209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:57 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1308 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:58.614260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e83d158e-d364-4589-a817-4653f896fba3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81c29160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:58.683155 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e83d158e-d364-4589-a817-4653f896fba3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 200 len: 1435 microversion: 2.1 time: 0.081719 Nov 02 13:57:58.688389 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2158/3210] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:57:58 2022] GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 1435 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:58.694555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:58.711861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:58.731886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.732303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.736333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:58.742353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.747855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.749666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:59.612560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:59.640607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e021248e-c26a-4f24-b724-7ad37f7bdbaa tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.949684 Nov 02 13:57:59.643648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2159/3211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:58 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:59.659504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:59.661990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:59.681664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:59.683507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:59.688446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:59.689440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:59.696375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:59.701083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:00.366544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:00.380395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58b938f9-96cd-4867-b338-433a853d06e6 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1535 microversion: 2.1 time: 0.733978 Nov 02 13:58:00.381422 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2160/3212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:59 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1535 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:00.399247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:00.406068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:00.406874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Searching by: {'deleted': False, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:58:00.413557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:00.414040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:00.414670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:00.416330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:00.417525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:00.418303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:00.481643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:58:00.488269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:00.530986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9416481f-5b39-4a4f-9e1c-c8d3c5644d52 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.148031 Nov 02 13:58:00.532214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2161/3213] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 13:58:00 2022] GET /compute/v2.1/servers => generated 1333 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:00.538297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-51ae432a-0126-42d1-b352-1176aee7664e req-5c2ce497-5e71-4f5f-8900-37ecdd911f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e372cb2-6bbd-464c-8e36-a3180d6d6a65", "name": "network-vif-plugged", "status": "completed", "tag": "92b7eb8b-8282-488a-99ac-9205b9f0c1d1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:00.555358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-51ae432a-0126-42d1-b352-1176aee7664e req-5c2ce497-5e71-4f5f-8900-37ecdd911f7d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:00.556283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-51ae432a-0126-42d1-b352-1176aee7664e req-5c2ce497-5e71-4f5f-8900-37ecdd911f7d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:00.556954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-51ae432a-0126-42d1-b352-1176aee7664e req-5c2ce497-5e71-4f5f-8900-37ecdd911f7d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:00.583365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-51ae432a-0126-42d1-b352-1176aee7664e req-5c2ce497-5e71-4f5f-8900-37ecdd911f7d service nova] Creating event network-vif-plugged:92b7eb8b-8282-488a-99ac-9205b9f0c1d1 for instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 on n-h2-858238-3 Nov 02 13:58:00.596394 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-51ae432a-0126-42d1-b352-1176aee7664e req-5c2ce497-5e71-4f5f-8900-37ecdd911f7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059781 Nov 02 13:58:00.603347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2162/3214] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:00.614179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:00.620257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:00.637745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:00.639032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:00.640895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:00.641976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:00.647179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:00.648042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:01.622528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:01.642781 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffc0664b-beca-4437-a219-be430fd7bcdc tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1308 microversion: 2.1 time: 1.037102 Nov 02 13:58:01.655710 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2163/3215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:00 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1308 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:01.683008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64ebc5b7-497c-4f79-9f0f-107b76c405a8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80ab1040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:01.794830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64ebc5b7-497c-4f79-9f0f-107b76c405a8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 200 len: 1435 microversion: 2.1 time: 0.130503 Nov 02 13:58:01.796071 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2164/3216] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:58:01 2022] GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 1435 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:01.817153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cb585473-31ab-47ef-9cc3-ec124b33d164 req-a5c0fb4a-63de-4af0-9099-78dd39b60781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb563bb-1703-4d1a-b80d-4607b01bcad6", "name": "network-vif-deleted", "tag": "0118b65a-d471-4fb0-b355-e36ac45793c4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:01.846994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb585473-31ab-47ef-9cc3-ec124b33d164 req-a5c0fb4a-63de-4af0-9099-78dd39b60781 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:01.851871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb585473-31ab-47ef-9cc3-ec124b33d164 req-a5c0fb4a-63de-4af0-9099-78dd39b60781 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:01.852705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb585473-31ab-47ef-9cc3-ec124b33d164 req-a5c0fb4a-63de-4af0-9099-78dd39b60781 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:01.889269 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cb585473-31ab-47ef-9cc3-ec124b33d164 req-a5c0fb4a-63de-4af0-9099-78dd39b60781 service nova] Creating event network-vif-deleted:0118b65a-d471-4fb0-b355-e36ac45793c4 for instance 3cb563bb-1703-4d1a-b80d-4607b01bcad6 on n-h1-858238-3 Nov 02 13:58:01.898671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cb585473-31ab-47ef-9cc3-ec124b33d164 req-a5c0fb4a-63de-4af0-9099-78dd39b60781 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098641 Nov 02 13:58:01.903791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2165/3217] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:01.914933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-298765ec-2f02-4f4e-b4ea-7b45e8bed6ff tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'create', calling method: .version_select at 0x7f6f85da2dc0>, body: {"pool": "b97a9e12-2fb3-456c-8ab0-aa34fb4c040d"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:06.597955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-298765ec-2f02-4f4e-b4ea-7b45e8bed6ff tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.692033 Nov 02 13:58:06.608075 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2166/3218] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:58:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:06.614241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:06.615323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:06.626602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:06.628140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:06.628833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:06.630762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:06.631867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:06.633609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:06.788368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:06.820245 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b90b9c6-11d8-478a-9537-f20be47ca6de tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 200 len: 1275 microversion: 2.1 time: 0.205851 Nov 02 13:58:06.822516 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2167/3219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:06 2022] GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:06.846708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:06.847709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:06.869245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:06.869895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:06.870700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:06.873444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:06.874554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:06.875248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:07.332233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:07.344553 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54bc2fb2-9caa-4c45-8353-0fac4da69e5b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.518019 Nov 02 13:58:07.346801 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2168/3220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:06 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:07.361989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2134864782", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846ebbf-8ebf-4f30-afa6-7c615971cecb"}], "security_groups": [{"name": "tempest-securitygroup--376238217"}], "key_name": "tempest-keypair-1586223354", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:07.591540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:07.816335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] validate_networks() for [('f846ebbf-8ebf-4f30-afa6-7c615971cecb', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:58:09.020407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:58:09.021069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:58:09.021295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:58:09.021955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:58:09.022620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:58:09.031808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.032568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.033732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:09.034684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.035386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.035808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:09.059306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:09.065342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for user 53bef65bfa79486a8f0180f2f86eddba and project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:09.083996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:58:09.086676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:58:09.152329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf4eda30-9914-4c8c-b68f-7267a8332acb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.800761 Nov 02 13:58:09.154864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2169/3221] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:58:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:58:09.160999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-450e8306-4dc9-4344-b2a2-ca0636f9d80c req-9d7dbe23-8ae7-4db0-b19e-66b1cca98c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211412a4-ec7b-43f9-8880-4ad4f13fbd20", "name": "network-vif-deleted", "tag": "74c8e1b8-a0ef-42d5-ac6a-ca77dee00c76"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:09.172263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-450e8306-4dc9-4344-b2a2-ca0636f9d80c req-9d7dbe23-8ae7-4db0-b19e-66b1cca98c51 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.173072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-450e8306-4dc9-4344-b2a2-ca0636f9d80c req-9d7dbe23-8ae7-4db0-b19e-66b1cca98c51 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.174680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-450e8306-4dc9-4344-b2a2-ca0636f9d80c req-9d7dbe23-8ae7-4db0-b19e-66b1cca98c51 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:09.189368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-450e8306-4dc9-4344-b2a2-ca0636f9d80c req-9d7dbe23-8ae7-4db0-b19e-66b1cca98c51 service nova] Creating event network-vif-deleted:74c8e1b8-a0ef-42d5-ac6a-ca77dee00c76 for instance 211412a4-ec7b-43f9-8880-4ad4f13fbd20 on n-h2-858238-3 Nov 02 13:58:09.196772 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-450e8306-4dc9-4344-b2a2-ca0636f9d80c req-9d7dbe23-8ae7-4db0-b19e-66b1cca98c51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040205 Nov 02 13:58:09.199602 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2170/3222] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:09.213481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b1a2fa90-9ed0-48fd-a4a1-b9721874f1ed req-48015a8e-fdb9-43cd-abba-b8410599bac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa9be90-bb3f-4bcd-96e6-92a85c290df0", "name": "network-vif-plugged", "status": "completed", "tag": "97bea379-d58a-4b77-b13c-44787ba7658a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:09.228094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b1a2fa90-9ed0-48fd-a4a1-b9721874f1ed req-48015a8e-fdb9-43cd-abba-b8410599bac1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.229680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b1a2fa90-9ed0-48fd-a4a1-b9721874f1ed req-48015a8e-fdb9-43cd-abba-b8410599bac1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.230363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b1a2fa90-9ed0-48fd-a4a1-b9721874f1ed req-48015a8e-fdb9-43cd-abba-b8410599bac1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:09.248387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b1a2fa90-9ed0-48fd-a4a1-b9721874f1ed req-48015a8e-fdb9-43cd-abba-b8410599bac1 service nova] Creating event network-vif-plugged:97bea379-d58a-4b77-b13c-44787ba7658a for instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 on n-h1-858238-3 Nov 02 13:58:09.256090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b1a2fa90-9ed0-48fd-a4a1-b9721874f1ed req-48015a8e-fdb9-43cd-abba-b8410599bac1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054157 Nov 02 13:58:09.257734 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2171/3223] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:09.265536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:09.266933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:09.274815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.275943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.276658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:09.278011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.278763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.279690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:10.171341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:10.185350 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35c9a58b-00c1-4dd3-a367-8cb49dc6609e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1308 microversion: 2.1 time: 0.925941 Nov 02 13:58:10.187738 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2172/3224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:09 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1308 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:10.194445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d22e578c-2cef-4e1c-82a5-142e2ff9a8be tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80a5cd30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:10.269982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d22e578c-2cef-4e1c-82a5-142e2ff9a8be tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 200 len: 1435 microversion: 2.1 time: 0.080781 Nov 02 13:58:10.270952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2173/3225] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:58:10 2022] GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 1435 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:10.277033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'action', calling method: .version_select at 0x7f6f842c4e50>, body: {"addFloatingIp": {"address": "172.25.9.43"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:10.280583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:10.291840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:10.293367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:10.294076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:10.295265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:10.296304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:10.296991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:10.342030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:58:10.342843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquired lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:58:13.956418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Building network info cache for instance {{(pid=137559) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:58:15.468764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Updating instance_info_cache with network_info: [{"id": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd", "address": "fa:16:3e:ff:f8:87", "network": {"id": "d42104fd-8c76-47b6-ab60-c9a72e1f2a43", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-377214937-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d326159935494ce7b55123dbc3b579db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5e494a0-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137559) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:58:15.493273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Releasing lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:58:15.493457 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a257ed5f-ccf9-48aa-9919-eba1e18943f0 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action" status: 202 len: 0 microversion: 2.1 time: 5.221215 Nov 02 13:58:15.497744 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2174/3226] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:10 2022] POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action => generated 0 bytes in 5226 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:58:15.505199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2207c33c-9c6d-48fe-9023-71b361b7f3f0 req-59e8d49e-2b05-4ea4-b9f0-2695b1d72e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6003ade-e03a-4969-98b4-75ef449083d9", "tag": "a560d93a-8827-4cac-8330-3531b7ba220b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:15.519839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2207c33c-9c6d-48fe-9023-71b361b7f3f0 req-59e8d49e-2b05-4ea4-b9f0-2695b1d72e74 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:15.520625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2207c33c-9c6d-48fe-9023-71b361b7f3f0 req-59e8d49e-2b05-4ea4-b9f0-2695b1d72e74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:15.521385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2207c33c-9c6d-48fe-9023-71b361b7f3f0 req-59e8d49e-2b05-4ea4-b9f0-2695b1d72e74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:15.548567 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2207c33c-9c6d-48fe-9023-71b361b7f3f0 req-59e8d49e-2b05-4ea4-b9f0-2695b1d72e74 service nova] Creating event network-changed:a560d93a-8827-4cac-8330-3531b7ba220b for instance f6003ade-e03a-4969-98b4-75ef449083d9 on n-h1-858238-3 Nov 02 13:58:15.563296 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2207c33c-9c6d-48fe-9023-71b361b7f3f0 req-59e8d49e-2b05-4ea4-b9f0-2695b1d72e74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063563 Nov 02 13:58:15.565720 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2175/3227] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:15.633531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:15.640880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:15.661905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:15.662397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:15.662833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:15.663639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:15.664093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:15.664522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:15.984359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:15.996903 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e0ae321-65cf-412b-9ff5-88904bf3b208 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 200 len: 1317 microversion: 2.1 time: 0.415826 Nov 02 13:58:15.999936 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2176/3228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:15 2022] GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:16.006120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:16.007062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:16.038034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:16.038875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:16.039614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:16.040894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:16.041675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:16.042562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:16.362267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:16.379960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-160a4494-5d32-45f0-8a1d-4dc4f111269f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1508 microversion: 2.1 time: 0.378405 Nov 02 13:58:16.380564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2177/3229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:16 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:16.388340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:16.395267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:16.402476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:16.410401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:16.411737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:16.416792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:16.417874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:16.418863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:16.746603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:16.782178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a4f82b9-6f71-42c6-8dcb-30f2f800ff9d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1364 microversion: 2.1 time: 0.400261 Nov 02 13:58:16.782797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2178/3230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:16 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1364 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:16.787805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:16.788906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:16.804864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:16.805451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:16.805964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:16.806746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:16.811723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:16.812825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:17.101868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:17.111875 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a82aeb35-83ed-4688-86ea-d8131d0a967c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1489 microversion: 2.1 time: 0.327127 Nov 02 13:58:17.113123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2179/3231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:16 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1489 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:17.118702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ed32d3d-6f9a-4744-9d61-2365fd1038c9 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85eb40d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:17.182405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ed32d3d-6f9a-4744-9d61-2365fd1038c9 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 200 len: 1444 microversion: 2.1 time: 0.067922 Nov 02 13:58:17.183002 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2180/3232] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:58:17 2022] GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 1444 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:17.188512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9830dfe9-290e-4343-b4fd-fa7d5d15f4e0 req-271feeca-30c4-4cc2-9fce-4dee1fcdae5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6003ade-e03a-4969-98b4-75ef449083d9", "name": "network-vif-plugged", "status": "completed", "tag": "a560d93a-8827-4cac-8330-3531b7ba220b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:17.201341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9830dfe9-290e-4343-b4fd-fa7d5d15f4e0 req-271feeca-30c4-4cc2-9fce-4dee1fcdae5e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:17.201891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9830dfe9-290e-4343-b4fd-fa7d5d15f4e0 req-271feeca-30c4-4cc2-9fce-4dee1fcdae5e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:17.202529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9830dfe9-290e-4343-b4fd-fa7d5d15f4e0 req-271feeca-30c4-4cc2-9fce-4dee1fcdae5e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:17.217511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9830dfe9-290e-4343-b4fd-fa7d5d15f4e0 req-271feeca-30c4-4cc2-9fce-4dee1fcdae5e service nova] Creating event network-vif-plugged:a560d93a-8827-4cac-8330-3531b7ba220b for instance f6003ade-e03a-4969-98b4-75ef449083d9 on n-h1-858238-3 Nov 02 13:58:17.224627 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9830dfe9-290e-4343-b4fd-fa7d5d15f4e0 req-271feeca-30c4-4cc2-9fce-4dee1fcdae5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040187 Nov 02 13:58:17.225561 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2181/3233] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:17.231202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-817689cc-3144-4e90-85ad-a0cbcda28db3 req-387f6f3b-85d0-4274-bf39-d268fccd6a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:17.243263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-817689cc-3144-4e90-85ad-a0cbcda28db3 req-387f6f3b-85d0-4274-bf39-d268fccd6a40 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:17.243750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-817689cc-3144-4e90-85ad-a0cbcda28db3 req-387f6f3b-85d0-4274-bf39-d268fccd6a40 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:17.244132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-817689cc-3144-4e90-85ad-a0cbcda28db3 req-387f6f3b-85d0-4274-bf39-d268fccd6a40 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:17.260994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-817689cc-3144-4e90-85ad-a0cbcda28db3 req-387f6f3b-85d0-4274-bf39-d268fccd6a40 service nova] Creating event network-changed:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 13:58:17.267480 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-817689cc-3144-4e90-85ad-a0cbcda28db3 req-387f6f3b-85d0-4274-bf39-d268fccd6a40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040398 Nov 02 13:58:17.268716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2182/3234] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:17.276199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d2314ce-e90b-4da5-ba4e-d86b31a3553c tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'create', calling method: .version_select at 0x7f6f85eb40d0>, body: {"pool": "b97a9e12-2fb3-456c-8ab0-aa34fb4c040d"} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:19.046353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:19.074770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:19.554161 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d2314ce-e90b-4da5-ba4e-d86b31a3553c tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.283599 Nov 02 13:58:19.555124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2183/3235] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 13:58:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:19.567007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:19.568116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:19.575995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:19.578980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:19.579710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:19.580679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:19.581357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:19.581937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:19.914388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:19.923719 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92dbde5f-79ad-466b-9938-70896b666207 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 200 len: 1317 microversion: 2.1 time: 0.367069 Nov 02 13:58:19.924326 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2184/3236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:19 2022] GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:19.938452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:19.941730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:19.953242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:19.954440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:19.954888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:19.956333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:19.956781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:19.957366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:20.040424 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e300909-d8ee-41d0-9b75-727ea65421c3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "PUT /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1084 microversion: 2.1 time: 0.114971 Nov 02 13:58:20.043340 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2185/3237] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 13:58:19 2022] PUT /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1084 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:20.050634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c1197af2-ad6b-4c90-a44b-68ead7520a44 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f85f6c9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:20.117394 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c1197af2-ad6b-4c90-a44b-68ead7520a44 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 200 len: 1444 microversion: 2.1 time: 0.070479 Nov 02 13:58:20.118415 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2186/3238] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:58:20 2022] GET /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 1444 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:20.137343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:20.138149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:20.146101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.146687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.147274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:20.148051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.148755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.149228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:20.427006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:20.435897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:20.438920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7fa2e2ff-085b-454c-b1b1-bcbfe0a9f281 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1524 microversion: 2.1 time: 0.318764 Nov 02 13:58:20.440579 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2187/3239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:20 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1524 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:20.448142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1fcc5a-df58-4c44-b9f7-94cc3082214d", "tag": "7c238a0f-d9e0-4510-98d3-8562cc97eaf8"}, {"name": "network-changed", "server_uuid": "d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d", "tag": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:20.459755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.460690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.461284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:20.478236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] Creating event network-changed:7c238a0f-d9e0-4510-98d3-8562cc97eaf8 for instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d on n-h2-858238-3 Nov 02 13:58:20.478994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] Creating event network-changed:b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd for instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d on n-h1-858238-3 Nov 02 13:58:20.489139 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e3646cbb-8408-492a-9f47-ba6c0dd57180 req-bc510225-b4d7-43ab-ac5d-2544c6f07d6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047191 Nov 02 13:58:20.489986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2188/3240] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:20.495374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:20.496316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:20.504956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.506219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.507205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:20.508544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.509162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.509744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.351305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:21.360315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-930f824a-bd8e-4afb-a240-d67a083487d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1364 microversion: 2.1 time: 0.868950 Nov 02 13:58:21.364603 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2189/3241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:20 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1364 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:21.370610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a9a496c0-2a12-4d37-b129-19f6c17eb4ee req-b259e73d-6e67-427a-be14-4c9e9bb6d0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1fcc5a-df58-4c44-b9f7-94cc3082214d", "name": "network-vif-plugged", "status": "completed", "tag": "7c238a0f-d9e0-4510-98d3-8562cc97eaf8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:21.402443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a9a496c0-2a12-4d37-b129-19f6c17eb4ee req-b259e73d-6e67-427a-be14-4c9e9bb6d0a7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:21.403041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a9a496c0-2a12-4d37-b129-19f6c17eb4ee req-b259e73d-6e67-427a-be14-4c9e9bb6d0a7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:21.406135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a9a496c0-2a12-4d37-b129-19f6c17eb4ee req-b259e73d-6e67-427a-be14-4c9e9bb6d0a7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.437021 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a9a496c0-2a12-4d37-b129-19f6c17eb4ee req-b259e73d-6e67-427a-be14-4c9e9bb6d0a7 service nova] Creating event network-vif-plugged:7c238a0f-d9e0-4510-98d3-8562cc97eaf8 for instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d on n-h2-858238-3 Nov 02 13:58:21.448489 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a9a496c0-2a12-4d37-b129-19f6c17eb4ee req-b259e73d-6e67-427a-be14-4c9e9bb6d0a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082437 Nov 02 13:58:21.454400 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2190/3242] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:21.466436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.166"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:21.477914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:21.491228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:21.495866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:21.496676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.497669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:21.498359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:21.499056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.543411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:58:21.544110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquired lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:58:23.066243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG neutronclient.v2_0.client [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d.", "detail": ""}} {{(pid=137559) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:58:23.066923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Releasing lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:58:23.067714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.067714 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Request method failure captured: Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action HTTP/1.1 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 46 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndQQTAPEWRi7b5aUXB_D84zvR1XEtSToAbaAkkhFjZat7d6-rWUSi-HmlcyPMrvANg_iafzdA7NkukAYXOvdei64coZpYXqwBluy2mvP6ElguzcXc44JtjDOzPdQzK-TKJrpjqWLWPlCtohMhvngv6zd3BpxC4fNvfalx0heAUXWWc Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d326159935494ce7b55123dbc3b579db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d326159935494ce7b55123dbc3b579db"}]}] Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d9ff2af96134b3ab325b5a8424de6ab Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: {"addFloatingIp": {"address": "172.25.9.166"}} Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd6bdfa61-ddc0-4464-aff5-ee5ac763ac0d', 'body': {'addFloatingIp': {'address': '172.25.9.166'}}} Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:58:23.070494 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] Nov 02 13:58:23.075475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:23.081422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Returning 400 to user: Cannot associate floating IP 172.25.9.166 (8dce6ad4-38be-46b5-96fe-d494b14f7b6f) with port b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network b97a9e12-2fb3-456c-8ab0-aa34fb4c040d. Nov 02 13:58:23.081422 n-d-858238-3 devstack@n-api.service[137559]: Neutron server returns request_ids: ['req-24d5a0e4-32bb-4a0f-8df4-86a417b2a4b7'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:23.081422 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-995ed359-25e5-41d9-b5ac-5979ebf74e11 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action" status: 400 len: 382 microversion: 2.1 time: 1.618176 Nov 02 13:58:23.081422 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2191/3243] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:21 2022] POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action => generated 382 bytes in 1624 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:58:23.086972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:23.087889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:23.095862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:23.096486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:23.097072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:23.097851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:23.098384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:23.098882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:23.402584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:23.421256 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f50b1cf2-f5c1-4a40-8e40-e528ef96e93b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1510 microversion: 2.1 time: 0.340488 Nov 02 13:58:23.421874 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2192/3244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:23 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:23.437663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9248db69-f4da-4e6b-8fe5-39b373e69d07 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81bbb5e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:24.182760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9248db69-f4da-4e6b-8fe5-39b373e69d07 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 204 len: 0 microversion: 2.1 time: 0.759778 Nov 02 13:58:24.186755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2193/3245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:23 2022] DELETE /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:24.193790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:24.194409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:24.201054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.201873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.202505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.203450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.204429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.205914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.377404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:24.391058 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-261f5fad-f60d-46c1-84f8-1df0029ae730 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 200 len: 1506 microversion: 2.1 time: 0.202502 Nov 02 13:58:24.392539 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2194/3246] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:24 2022] GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:24.398180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:24.399234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:24.413422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.414336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.414991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.416004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.416703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.417630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.623610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:24.634390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb4efc91-e2a9-49f1-97d6-04cbe97a72d0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1524 microversion: 2.1 time: 0.240313 Nov 02 13:58:24.647954 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2195/3247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:24 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1524 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:24.661160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:24.662174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:24.668764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.669531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.670139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.671133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.671664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.672164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.861531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:24.870218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c115c61d-3958-4af2-85a8-cf5195e73e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1364 microversion: 2.1 time: 0.220829 Nov 02 13:58:24.872994 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2196/3248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:24 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:24.890758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d897fcf4-e170-4c2c-9990-2ab68595846b tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '.version_select at 0x7f6f81bbb0d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:25.965010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d897fcf4-e170-4c2c-9990-2ab68595846b tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/8dce6ad4-38be-46b5-96fe-d494b14f7b6f" status: 202 len: 0 microversion: 2.1 time: 1.090806 Nov 02 13:58:25.968975 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2197/3249] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:58:24 2022] DELETE /compute/v2.1/os-floating-ips/8dce6ad4-38be-46b5-96fe-d494b14f7b6f => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:58:25.971832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:25.972636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:25.984652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:25.985870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:25.987326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:25.988452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:25.989365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:25.989921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.154476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:26.167085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df7a0508-a9e6-4663-a310-d46186850112 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1510 microversion: 2.1 time: 0.199845 Nov 02 13:58:26.167910 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2198/3250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:25 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:26.172307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-plugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}, {"server_uuid": "9270f9e1-f6ae-4560-9cb3-a230e60b490d", "name": "network-vif-plugged", "status": "completed", "tag": "021b56a7-a549-4d8a-938d-96d4a3432c7f"}, {"server_uuid": "7e372cb2-6bbd-464c-8e36-a3180d6d6a65", "name": "network-vif-unplugged", "status": "completed", "tag": "92b7eb8b-8282-488a-99ac-9205b9f0c1d1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:26.197842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.198335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.198769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.230759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Creating event network-vif-plugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 13:58:26.231308 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Creating event network-vif-plugged:021b56a7-a549-4d8a-938d-96d4a3432c7f for instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d on n-h2-858238-3 Nov 02 13:58:26.231813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] Creating event network-vif-unplugged:92b7eb8b-8282-488a-99ac-9205b9f0c1d1 for instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 on n-h2-858238-3 Nov 02 13:58:26.246646 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-503d1c65-ba33-439b-9274-cb23aed70035 req-7f789e2c-bd92-4942-b1df-f5c34722109f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.077563 Nov 02 13:58:26.247621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2199/3251] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:26.262966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:26.266521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:26.279556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.280064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.280502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.281931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.282395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.283693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.341475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:26.519354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:26.529732 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c7a5e1f8-2beb-41ed-977b-477d8e4907d2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 204 len: 0 microversion: 2.1 time: 0.280636 Nov 02 13:58:26.531263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2200/3252] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:58:26 2022] DELETE /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:26.542490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:26.543584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: f6003ade-e03a-4969-98b4-75ef449083d9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:26.555883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.556801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.557495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.559556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.560688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.561532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.800783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:26.820395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1df65912-bff7-45e7-a0a7-e0a9c051c51c tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9" status: 200 len: 1506 microversion: 2.1 time: 0.285502 Nov 02 13:58:26.822368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2201/3253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:26 2022] GET /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:26.827979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:26.828844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:26.836615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.837127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.837574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.838703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:26.838703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:26.839183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.054317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:27.067445 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b484b2ef-391c-4726-8eff-d24792b8b1cd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1524 microversion: 2.1 time: 0.243641 Nov 02 13:58:27.072177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2202/3254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:26 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:27.084903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:27.085518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:27.094600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:27.095154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:27.095590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.096305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:27.096768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:27.097187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.275323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:27.288410 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9630d56-a382-4bef-a0cc-3cd4f79d7634 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1364 microversion: 2.1 time: 0.208246 Nov 02 13:58:27.290697 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2203/3255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:27 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:27.300755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.43"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:27.528585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:27.537768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:27.538695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:27.540087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.541648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:27.542448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:27.543291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.852260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:58:27.852925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquired lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:58:29.176791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Building network info cache for instance {{(pid=137559) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:58:30.800520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Updating instance_info_cache with network_info: [{"id": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd", "address": "fa:16:3e:ff:f8:87", "network": {"id": "d42104fd-8c76-47b6-ab60-c9a72e1f2a43", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-377214937-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d326159935494ce7b55123dbc3b579db", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5e494a0-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137559) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:58:30.844827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Releasing lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:58:30.847921 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19435843-d5c8-4fd5-a893-e3b17f896dad tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action" status: 202 len: 0 microversion: 2.1 time: 3.555152 Nov 02 13:58:30.849717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2204/3256] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:27 2022] POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action => generated 0 bytes in 3558 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:58:30.862075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:30.863280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:30.882483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:30.883623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:30.884256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:30.887334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:30.888074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:30.889336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:30.937198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:31.029071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:31.227649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4324e0c8-b473-4def-a6ec-0a17a7083724 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 204 len: 0 microversion: 2.1 time: 0.375587 Nov 02 13:58:31.232967 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2205/3257] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:58:30 2022] DELETE /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:31.239186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-935499243", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7e53e086-dd5c-4df9-95b5-9e9382cf5479"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:31.361841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] validate_networks() for [('7e53e086-dd5c-4df9-95b5-9e9382cf5479', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:58:31.857805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:58:31.858315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:58:31.859344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:58:31.860178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:58:31.860617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:58:31.873404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:31.873890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:31.874324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:31.875220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:31.875672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:31.876093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:31.900856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:31.907154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for user 165803256c184acc801878f0cb60cc67 and project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:31.920602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:58:31.923048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:58:31.977782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d74dd730-5a82-45cb-93b5-111c73311a11 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743376 Nov 02 13:58:31.978609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2206/3258] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:58:31.990281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:31.991122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: f6003ade-e03a-4969-98b4-75ef449083d9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:31.998339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:31.999280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.000105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.001222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.002527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.003413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.033865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: f6003ade-e03a-4969-98b4-75ef449083d9] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:32.158675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e7baec9-433d-4762-9427-194aee1a4f5e tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9" status: 204 len: 0 microversion: 2.1 time: 0.177150 Nov 02 13:58:32.159651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2207/3259] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:58:31 2022] DELETE /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:32.165557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.166888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.174343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.175002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.175571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.176370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.176928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.177687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.366178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:32.374365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-994c0d97-0caf-4b03-b8c0-a352e3c108c8 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1524 microversion: 2.1 time: 0.213333 Nov 02 13:58:32.374950 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2208/3260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:32 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1524 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:32.380446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.381713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.395979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.396472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.396905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.397697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.398306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.398727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.558713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:32.572809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7bad358-7271-4445-9093-eb9e207d66fb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1552 microversion: 2.1 time: 0.196214 Nov 02 13:58:32.573959 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2209/3261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:32 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:32.591589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-dc17bec2-d1ba-4809-a4d8-90c128dfdc07 req-c9c8d158-6d08-4586-b9c0-7c5ffe39840e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d", "tag": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:32.609459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dc17bec2-d1ba-4809-a4d8-90c128dfdc07 req-c9c8d158-6d08-4586-b9c0-7c5ffe39840e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.609926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dc17bec2-d1ba-4809-a4d8-90c128dfdc07 req-c9c8d158-6d08-4586-b9c0-7c5ffe39840e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.610348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dc17bec2-d1ba-4809-a4d8-90c128dfdc07 req-c9c8d158-6d08-4586-b9c0-7c5ffe39840e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.622722 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-dc17bec2-d1ba-4809-a4d8-90c128dfdc07 req-c9c8d158-6d08-4586-b9c0-7c5ffe39840e service nova] Creating event network-changed:b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd for instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d on n-h1-858238-3 Nov 02 13:58:32.629149 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-dc17bec2-d1ba-4809-a4d8-90c128dfdc07 req-c9c8d158-6d08-4586-b9c0-7c5ffe39840e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043388 Nov 02 13:58:32.629149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2210/3262] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:32.635870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-65e85fbb-0ad9-4a7e-9f2f-0468e3edd5a8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '.version_select at 0x7f6f825c8dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:35.969410 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-65e85fbb-0ad9-4a7e-9f2f-0468e3edd5a8 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/8a37ca4b-e47f-46b4-9b81-be999e24dd4a" status: 202 len: 0 microversion: 2.1 time: 3.333903 Nov 02 13:58:35.992379 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2211/3263] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 13:58:32 2022] DELETE /compute/v2.1/os-floating-ips/8a37ca4b-e47f-46b4-9b81-be999e24dd4a => generated 0 bytes in 3363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:58:36.032606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.035765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.052639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.053687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.053687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.054660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.059935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.060699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.243826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:36.275625 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cb088e1-6e56-429e-8d6a-75266d133fbf tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 200 len: 1474 microversion: 2.1 time: 0.271924 Nov 02 13:58:36.282282 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2212/3264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:35 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 1474 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:36.296814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.297909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.325472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.327591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.329051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.330393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.335791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.349886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.680356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:36.695319 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d33f8e4-3499-402c-808b-f379982df851 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 200 len: 1307 microversion: 2.1 time: 0.410775 Nov 02 13:58:36.708996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2213/3265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:36 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 1307 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:36.718275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.718789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.729449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.730314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.730924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.731862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.732518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.733116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.803567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:36.936769 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4e3348e-d199-4f28-b447-2da05607dcb9 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 204 len: 0 microversion: 2.1 time: 0.226217 Nov 02 13:58:36.937567 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2214/3266] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:58:36 2022] DELETE /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:36.950728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.951498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.959173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.959965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.960523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.961238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.961789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.962204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.113953 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e01afeed-d926-4dcb-9063-173d96ae71ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174345 Nov 02 13:58:37.125702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2215/3267] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 13:58:36 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:37.139927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:37.140871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:37.149084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.150192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.150870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.152152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.152849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.153744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.649153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:37.660729 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2dd97d3-717b-41e9-97eb-7d63c42bda40 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1506 microversion: 2.1 time: 0.524731 Nov 02 13:58:37.661970 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2216/3268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:37 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:37.669151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c85b4feb-8dac-44dd-ae38-4656ddc298aa req-2c4c1b3f-9ca1-40ce-b647-327f1f1df7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e372cb2-6bbd-464c-8e36-a3180d6d6a65", "name": "network-vif-deleted", "tag": "92b7eb8b-8282-488a-99ac-9205b9f0c1d1"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:37.683024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c85b4feb-8dac-44dd-ae38-4656ddc298aa req-2c4c1b3f-9ca1-40ce-b647-327f1f1df7dc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.684587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c85b4feb-8dac-44dd-ae38-4656ddc298aa req-2c4c1b3f-9ca1-40ce-b647-327f1f1df7dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.687005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c85b4feb-8dac-44dd-ae38-4656ddc298aa req-2c4c1b3f-9ca1-40ce-b647-327f1f1df7dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.708578 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c85b4feb-8dac-44dd-ae38-4656ddc298aa req-2c4c1b3f-9ca1-40ce-b647-327f1f1df7dc service nova] Creating event network-vif-deleted:92b7eb8b-8282-488a-99ac-9205b9f0c1d1 for instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 on n-h2-858238-3 Nov 02 13:58:37.716985 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c85b4feb-8dac-44dd-ae38-4656ddc298aa req-2c4c1b3f-9ca1-40ce-b647-327f1f1df7dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053349 Nov 02 13:58:37.718043 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2217/3269] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:37.725423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f5059010-c06a-4f47-aea6-0350e43f3b41 req-3c32bd17-065a-4b74-9997-afbeeab5fb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6003ade-e03a-4969-98b4-75ef449083d9", "name": "network-vif-deleted", "tag": "a560d93a-8827-4cac-8330-3531b7ba220b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:37.738968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f5059010-c06a-4f47-aea6-0350e43f3b41 req-3c32bd17-065a-4b74-9997-afbeeab5fb2a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.739478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f5059010-c06a-4f47-aea6-0350e43f3b41 req-3c32bd17-065a-4b74-9997-afbeeab5fb2a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.739908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f5059010-c06a-4f47-aea6-0350e43f3b41 req-3c32bd17-065a-4b74-9997-afbeeab5fb2a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.756178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f5059010-c06a-4f47-aea6-0350e43f3b41 req-3c32bd17-065a-4b74-9997-afbeeab5fb2a service nova] Creating event network-vif-deleted:a560d93a-8827-4cac-8330-3531b7ba220b for instance f6003ade-e03a-4969-98b4-75ef449083d9 on n-h1-858238-3 Nov 02 13:58:37.767711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f5059010-c06a-4f47-aea6-0350e43f3b41 req-3c32bd17-065a-4b74-9997-afbeeab5fb2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Nov 02 13:58:37.768980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2218/3270] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:38.110254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.110254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.121285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.122091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.122451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.123250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.123680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.124382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.169086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:38.287948 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76b7a9b8-bc6d-4b24-9022-09fd069069ec tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 204 len: 0 microversion: 2.42 time: 0.515181 Nov 02 13:58:38.293098 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2219/3271] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:58:37 2022] DELETE /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:58:38.296983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c93d4f6-09f2-4ab4-bab2-79e57feca072 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c93d4f6-09f2-4ab4-bab2-79e57feca072 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Request method failure captured: Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action HTTP/1.1 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 34 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndQQTAPEWRi7b5aUXB_D84zvR1XEtSToAbaAkkhFjZat7d6-rWUSi-HmlcyPMrvANg_iafzdA7NkukAYXOvdei64coZpYXqwBluy2mvP6ElguzcXc44JtjDOzPdQzK-TKJrpjqWLWPlCtohMhvngv6zd3BpxC4fNvfalx0heAUXWWc Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d326159935494ce7b55123dbc3b579db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d326159935494ce7b55123dbc3b579db"}]}] Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d9ff2af96134b3ab325b5a8424de6ab Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: {"addFloatingIp": {"address": ""}} Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd6bdfa61-ddc0-4464-aff5-ee5ac763ac0d', 'body': {'addFloatingIp': {'address': ''}}} Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:58:38.301938 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c93d4f6-09f2-4ab4-bab2-79e57feca072 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8c93d4f6-09f2-4ab4-bab2-79e57feca072 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action" status: 400 len: 142 microversion: 2.1 time: 0.012939 Nov 02 13:58:38.308898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2220/3272] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:38 2022] POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action => generated 142 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:58:38.310831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.311696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: f6003ade-e03a-4969-98b4-75ef449083d9] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.318117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.318612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.319193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.319791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.320254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.320677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.335658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] HTTP exception thrown: Instance f6003ade-e03a-4969-98b4-75ef449083d9 could not be found. Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Request method failure captured: Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9 HTTP/1.1 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnc5IYWjPWydh0lro_8JCsBvN8RX-Sc1xoqNt2oHEkifKeasJWcRpMrbFKR688MLIi9Fq8PvK6NN0VQEXZkRuKKV_uVmngFExOVlAW-2sn_CTUh_YtD77eq9tJ6o9p-PlWTj9CQ-WwZbvetTvvmu0y1_Pz_UvNSgFP2dzOJtoL0tkAA Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cb3ce66791824ed0ab53aa5c729bd15c Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateTestJSON-502004619 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb3ce66791824ed0ab53aa5c729bd15c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb3ce66791824ed0ab53aa5c729bd15c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb3ce66791824ed0ab53aa5c729bd15c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb3ce66791824ed0ab53aa5c729bd15c"}]}] Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateTestJSON-502004619 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cb3ce66791824ed0ab53aa5c729bd15c Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateTestJSON-502004619 Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateTestJSON-502004619-project Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7723f37ab6ef443bb38d36cc4d6ca68f Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateTestJSON-502004619-project Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f6003ade-e03a-4969-98b4-75ef449083d9 could not be found. Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f6003ade-e03a-4969-98b4-75ef449083d9'} Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6003ade-e03a-4969-98b4-75ef449083d9 could not be found. Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6003ade-e03a-4969-98b4-75ef449083d9 could not be found. Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:38.337236 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6003ade-e03a-4969-98b4-75ef449083d9 could not be found. Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Returning 404 to user: Instance f6003ade-e03a-4969-98b4-75ef449083d9 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd80a5ad-43f8-468f-a6b5-2ddf1b67b8c1 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9" status: 404 len: 111 microversion: 2.1 time: 0.033186 Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2221/3273] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:38 2022] GET /compute/v2.1/servers/f6003ade-e03a-4969-98b4-75ef449083d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.351848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.355472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.355472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.355472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.355472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.355472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.357145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.371640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:38.374299 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 HTTP/1.1 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'afa9be90-bb3f-4bcd-96e6-92a85c290df0'} Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:38.375941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-588a8f80-8bf6-46d2-954d-0cec75ec42a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 404 len: 111 microversion: 2.1 time: 0.037291 Nov 02 13:58:38.381172 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2222/3274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:38 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:58:38.383536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a52fb8a5-8eb2-4ca2-b644-c8ffb0c86248 req-5e2a162c-e2c6-48f7-959d-0c8f61347b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9270f9e1-f6ae-4560-9cb3-a230e60b490d", "name": "network-vif-unplugged", "status": "completed", "tag": "021b56a7-a549-4d8a-938d-96d4a3432c7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:38.396692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a52fb8a5-8eb2-4ca2-b644-c8ffb0c86248 req-5e2a162c-e2c6-48f7-959d-0c8f61347b4e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.397436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a52fb8a5-8eb2-4ca2-b644-c8ffb0c86248 req-5e2a162c-e2c6-48f7-959d-0c8f61347b4e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.397874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a52fb8a5-8eb2-4ca2-b644-c8ffb0c86248 req-5e2a162c-e2c6-48f7-959d-0c8f61347b4e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.432340 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a52fb8a5-8eb2-4ca2-b644-c8ffb0c86248 req-5e2a162c-e2c6-48f7-959d-0c8f61347b4e service nova] Creating event network-vif-unplugged:021b56a7-a549-4d8a-938d-96d4a3432c7f for instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d on n-h2-858238-3 Nov 02 13:58:38.444183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a52fb8a5-8eb2-4ca2-b644-c8ffb0c86248 req-5e2a162c-e2c6-48f7-959d-0c8f61347b4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064000 Nov 02 13:58:38.445449 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2223/3275] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:38.465220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.466873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.496511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.498516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.499017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.501062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.503414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.503414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.166330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:39.178381 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58388580-2915-4457-8583-dc11c0157ea5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 200 len: 1307 microversion: 2.1 time: 0.731119 Nov 02 13:58:39.181686 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2224/3276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:38 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 1307 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:39.196267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:39.197480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:39.207956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.208814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.209327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.210182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.210807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.211354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.761980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:39.778185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:39.780474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:39.782368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49831969-beb1-47e3-9e2e-c22d7aa1b3ab tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2960 microversion: 2.42 time: 0.597737 Nov 02 13:58:39.785356 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2225/3277] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:58:39 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2960 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:39.790929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:39.793817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:39.802176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.802677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.803155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.804508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.805428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.806276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.854558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:58:39.854965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquired lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:58:40.069854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Releasing lock "refresh_cache-d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" {{(pid=137559) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:58:40.071434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] HTTP exception thrown: floating IP not found Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Request method failure captured: Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action HTTP/1.1 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 41 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndQQTAPEWRi7b5aUXB_D84zvR1XEtSToAbaAkkhFjZat7d6-rWUSi-HmlcyPMrvANg_iafzdA7NkukAYXOvdei64coZpYXqwBluy2mvP6ElguzcXc44JtjDOzPdQzK-TKJrpjqWLWPlCtohMhvngv6zd3BpxC4fNvfalx0heAUXWWc Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d326159935494ce7b55123dbc3b579db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d326159935494ce7b55123dbc3b579db"}]}] Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d9ff2af96134b3ab325b5a8424de6ab Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: exception: floating IP not found Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd6bdfa61-ddc0-4464-aff5-ee5ac763ac0d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 02 13:58:40.074893 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 02 13:58:40.079656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:40.083023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Returning 404 to user: floating IP not found {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:40.084238 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77065a27-c137-4c1f-9fe1-efaa5d2a21d2 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action" status: 404 len: 67 microversion: 2.1 time: 0.297595 Nov 02 13:58:40.090969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2226/3278] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:39 2022] POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action => generated 67 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:58:40.098385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:40.099438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:40.106177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:40.107286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:40.108101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:40.109209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:40.109911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:40.110565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:40.332205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7723f37ab6ef443bb38d36cc4d6ca68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3ce66791824ed0ab53aa5c729bd15c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:40.342933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fb717d3-1242-4c71-8de8-20a9bae70d78 tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 200 len: 1512 microversion: 2.1 time: 0.250311 Nov 02 13:58:40.347507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2227/3279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:40 2022] GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:40.354823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1164339235", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f185f223-23a3-45bd-b0e9-cfee8f53e4f5"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:40.462475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] validate_networks() for [('f185f223-23a3-45bd-b0e9-cfee8f53e4f5', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:58:41.135294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:58:41.136019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:58:41.136495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:58:41.137065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:58:41.137486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:58:41.149091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.149577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.150236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.150978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.151456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.152059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.172352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:41.179907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Getting quotas for user f83d5a681892401eaeb2cf03015aaf67 and project 0b7c416c213c49ceb0c946bd8ca232fd. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:41.182414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:41.200218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:58:41.202597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:58:41.262028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10d01508-69a8-40be-9386-76884d3079f0 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911085 Nov 02 13:58:41.268774 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2228/3280] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:58:41.268774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:41.269097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:41.276604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.277104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.277541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.278484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.278952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.279736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.576156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:41.592336 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80a4bba2-7fc2-4d98-8b75-da3ae11350a1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 200 len: 1449 microversion: 2.1 time: 0.328167 Nov 02 13:58:41.603866 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2229/3281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:41 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 1449 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:41.646870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4492a2c9-7080-407f-9da6-72976de16ef6 req-3b1eb11e-30e5-461f-af62-4c540ab1fe4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa9be90-bb3f-4bcd-96e6-92a85c290df0", "name": "network-vif-deleted", "tag": "97bea379-d58a-4b77-b13c-44787ba7658a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:41.662920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4492a2c9-7080-407f-9da6-72976de16ef6 req-3b1eb11e-30e5-461f-af62-4c540ab1fe4d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.664809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4492a2c9-7080-407f-9da6-72976de16ef6 req-3b1eb11e-30e5-461f-af62-4c540ab1fe4d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.665854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4492a2c9-7080-407f-9da6-72976de16ef6 req-3b1eb11e-30e5-461f-af62-4c540ab1fe4d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.699168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4492a2c9-7080-407f-9da6-72976de16ef6 req-3b1eb11e-30e5-461f-af62-4c540ab1fe4d service nova] Creating event network-vif-deleted:97bea379-d58a-4b77-b13c-44787ba7658a for instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 on n-h1-858238-3 Nov 02 13:58:41.708132 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4492a2c9-7080-407f-9da6-72976de16ef6 req-3b1eb11e-30e5-461f-af62-4c540ab1fe4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075852 Nov 02 13:58:41.710588 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2230/3282] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:41.725466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-17ee946d-da56-45cd-8de8-5b4b1e74abb2 req-07ef0d18-3a3a-4e53-a79b-18fbc670154f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faabbaf3-73f3-44c4-88cf-73a182ad7bc1", "tag": "2fdaa5a4-877c-496b-9b5c-08e91604cf7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:41.739481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-17ee946d-da56-45cd-8de8-5b4b1e74abb2 req-07ef0d18-3a3a-4e53-a79b-18fbc670154f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.739614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-17ee946d-da56-45cd-8de8-5b4b1e74abb2 req-07ef0d18-3a3a-4e53-a79b-18fbc670154f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.740186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-17ee946d-da56-45cd-8de8-5b4b1e74abb2 req-07ef0d18-3a3a-4e53-a79b-18fbc670154f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.756838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-17ee946d-da56-45cd-8de8-5b4b1e74abb2 req-07ef0d18-3a3a-4e53-a79b-18fbc670154f service nova] Creating event network-changed:2fdaa5a4-877c-496b-9b5c-08e91604cf7f for instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 on n-h2-858238-3 Nov 02 13:58:41.764214 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-17ee946d-da56-45cd-8de8-5b4b1e74abb2 req-07ef0d18-3a3a-4e53-a79b-18fbc670154f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051813 Nov 02 13:58:41.765165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2231/3283] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:41.771662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b8920e4-4383-4b2f-b849-c7e7a197852f tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:42.018306 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8b8920e4-4383-4b2f-b849-c7e7a197852f tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b8920e4-4383-4b2f-b849-c7e7a197852f tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Request method failure captured: Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action HTTP/1.1 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 44 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndQQTAPEWRi7b5aUXB_D84zvR1XEtSToAbaAkkhFjZat7d6-rWUSi-HmlcyPMrvANg_iafzdA7NkukAYXOvdei64coZpYXqwBluy2mvP6ElguzcXc44JtjDOzPdQzK-TKJrpjqWLWPlCtohMhvngv6zd3BpxC4fNvfalx0heAUXWWc Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d326159935494ce7b55123dbc3b579db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d326159935494ce7b55123dbc3b579db"}]}] Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d9ff2af96134b3ab325b5a8424de6ab Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: exception: Floating IP not found for address 0.0.0.0. Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd6bdfa61-ddc0-4464-aff5-ee5ac763ac0d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 02 13:58:42.022380 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:42.028533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b8920e4-4383-4b2f-b849-c7e7a197852f tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:42.030153 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b8920e4-4383-4b2f-b849-c7e7a197852f tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action" status: 404 len: 88 microversion: 2.1 time: 0.262061 Nov 02 13:58:42.037469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2232/3284] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:41 2022] POST /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d/action => generated 88 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:58:42.052292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:42.063007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:42.089293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.090098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.090769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.093482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.094893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.095567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.752603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:42.761140 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f94862ac-9643-4f7a-839b-06f2fa9a294d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 200 len: 1307 microversion: 2.1 time: 0.716075 Nov 02 13:58:42.761965 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2233/3285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:42 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 1307 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:42.766523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:42.767150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:42.778322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.778659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.779176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.779827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.780307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.780735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.425043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.437974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.441041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.442461 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e7429dd-5343-4ebb-8096-fb76a8254ae1 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2960 microversion: 2.42 time: 0.679622 Nov 02 13:58:43.459679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2234/3286] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:58:42 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2960 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:43.459679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:43.459679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:43.468083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.468678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.469710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.470004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.470564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.471058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.938398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.948574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef8adf52-3f55-4b4d-be1c-9d1eca6f787f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1267 microversion: 2.1 time: 0.496226 Nov 02 13:58:43.949388 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2235/3287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:43 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1267 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:43.970813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:43.971872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] [instance: 6e1fcc5a-df58-4c44-b9f7-94cc3082214d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:43.982077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.983447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.984383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.987694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.988543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.989379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.022144 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] HTTP exception thrown: Instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d could not be found. Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Request method failure captured: Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d HTTP/1.1 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnc5IYWjPWydh0lro_8JCsBvN8RX-Sc1xoqNt2oHEkifKeasJWcRpMrbFKR688MLIi9Fq8PvK6NN0VQEXZkRuKKV_uVmngFExOVlAW-2sn_CTUh_YtD77eq9tJ6o9p-PlWTj9CQ-WwZbvetTvvmu0y1_Pz_UvNSgFP2dzOJtoL0tkAA Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cb3ce66791824ed0ab53aa5c729bd15c Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateTestJSON-502004619 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb3ce66791824ed0ab53aa5c729bd15c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb3ce66791824ed0ab53aa5c729bd15c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb3ce66791824ed0ab53aa5c729bd15c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb3ce66791824ed0ab53aa5c729bd15c"}]}] Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateTestJSON-502004619 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cb3ce66791824ed0ab53aa5c729bd15c Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateTestJSON-502004619 Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateTestJSON-502004619-project Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7723f37ab6ef443bb38d36cc4d6ca68f Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateTestJSON-502004619-project Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d could not be found. Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6e1fcc5a-df58-4c44-b9f7-94cc3082214d'} Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d could not be found. Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d could not be found. Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:44.026459 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d could not be found. Nov 02 13:58:44.038823 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:44.042475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] Returning 404 to user: Instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:44.044483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6132f843-62b5-4a10-a9bf-191a15142d2f tempest-MultipleCreateTestJSON-502004619 tempest-MultipleCreateTestJSON-502004619-project] 10.222.0.18 "GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d" status: 404 len: 111 microversion: 2.1 time: 0.077759 Nov 02 13:58:44.045409 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2236/3288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:43 2022] GET /compute/v2.1/servers/6e1fcc5a-df58-4c44-b9f7-94cc3082214d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:58:44.053795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:44.054623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:44.071723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.072262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.072716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.092873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.093376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.095405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.149679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:44.159144 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Working on deleting snapshot 67846998-3669-41d2-9a7c-a1764cc89567 from shelved instance... Nov 02 13:58:45.102174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Doing local delete in cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=137559) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 13:58:45.102966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.103553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.104057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.104548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 13:58:45.109128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] deallocate_for_instance() {{(pid=137559) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 13:58:47.367709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Updating instance_info_cache with network_info: [] {{(pid=137559) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:58:47.872295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:47.888168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59fcbec1-c57a-4947-8f5f-d50f0783c683 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 204 len: 0 microversion: 2.1 time: 3.841473 Nov 02 13:58:47.892978 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2237/3289] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:58:44 2022] DELETE /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 0 bytes in 3843 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:47.898940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:47.900203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:47.915210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.916046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.916674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.919703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.929613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.942488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.978002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:48.091376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e9cd50f-8e0c-4c02-b1b8-4f41078de671 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 204 len: 0 microversion: 2.1 time: 0.196416 Nov 02 13:58:48.092718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2238/3290] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:58:47 2022] DELETE /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:48.100588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:48.101648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:48.112593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.113168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.113678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.114460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.115430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.115944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.606169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:48.615788 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc9f3a94-5fd0-488b-a476-20ec2f0b5298 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 200 len: 1307 microversion: 2.1 time: 0.521427 Nov 02 13:58:48.617074 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2239/3291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:48 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 1307 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:48.635022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}, {"server_uuid": "6e1fcc5a-df58-4c44-b9f7-94cc3082214d", "name": "network-vif-deleted", "tag": "7c238a0f-d9e0-4510-98d3-8562cc97eaf8"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:48.662659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.663906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.664415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.678854 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] Creating event network-changed:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 13:58:48.679766 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] Creating event network-vif-deleted:7c238a0f-d9e0-4510-98d3-8562cc97eaf8 for instance 6e1fcc5a-df58-4c44-b9f7-94cc3082214d on n-h2-858238-3 Nov 02 13:58:48.687851 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c2d387cb-7ba7-476b-a4da-307c88d6c8ba req-79f41b42-da43-4ad2-94f3-c8450a2efc18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069217 Nov 02 13:58:48.690965 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2240/3292] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:48.697440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:48.698582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:48.707063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.707605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.708043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.708754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.709469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.709895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:49.339936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:49.353739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:49.355401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:49.356752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ebef54e1-5b98-435d-bc0c-cddcb051c810 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2871 microversion: 2.42 time: 0.664018 Nov 02 13:58:49.357321 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2241/3293] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:58:48 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2871 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:49.362740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:49.364488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:49.371904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:49.372693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:49.373325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:49.383550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:49.384290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:49.384938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.051316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:50.073586 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0eee7d53-1ec7-4b36-9b82-bfe57033bf78 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1309 microversion: 2.1 time: 0.714855 Nov 02 13:58:50.074704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2242/3294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:49 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1309 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:50.093000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6041076a-1918-4729-b244-1b392582f6a0 req-30548dba-0894-4a73-9a48-5164b050e519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faabbaf3-73f3-44c4-88cf-73a182ad7bc1", "name": "network-vif-plugged", "status": "completed", "tag": "2fdaa5a4-877c-496b-9b5c-08e91604cf7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:50.132325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6041076a-1918-4729-b244-1b392582f6a0 req-30548dba-0894-4a73-9a48-5164b050e519 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.132775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6041076a-1918-4729-b244-1b392582f6a0 req-30548dba-0894-4a73-9a48-5164b050e519 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.134394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6041076a-1918-4729-b244-1b392582f6a0 req-30548dba-0894-4a73-9a48-5164b050e519 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.150934 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6041076a-1918-4729-b244-1b392582f6a0 req-30548dba-0894-4a73-9a48-5164b050e519 service nova] Creating event network-vif-plugged:2fdaa5a4-877c-496b-9b5c-08e91604cf7f for instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 on n-h2-858238-3 Nov 02 13:58:50.156737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6041076a-1918-4729-b244-1b392582f6a0 req-30548dba-0894-4a73-9a48-5164b050e519 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080548 Nov 02 13:58:50.158000 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2243/3295] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:50.165518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:50.166535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:50.186458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.187398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.187999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.189700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.190411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.191342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.214958 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d HTTP/1.1 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9270f9e1-f6ae-4560-9cb3-a230e60b490d'} Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:50.217302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 13:58:50.223164 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.225253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:50.226936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b233e32d-1c6c-470a-ba11-c04c2afa1a6d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 404 len: 111 microversion: 2.1 time: 0.066377 Nov 02 13:58:50.231469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2244/3296] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:50 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:58:50.237563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:50.238397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:50.248154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.248916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.249732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.250649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.251384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.252508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.330233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.330233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.330703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.333924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lazy-loading 'fault' on Instance uuid d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:58:50.684589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ff2af96134b3ab325b5a8424de6ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd326159935494ce7b55123dbc3b579db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:50.694518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4dedd638-917d-46f5-b7f3-67f1275de002 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 200 len: 1321 microversion: 2.1 time: 0.461444 Nov 02 13:58:50.697903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2245/3297] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:50 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:50.716050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:50.716987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:50.726736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.727268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.727708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.728416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.728874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.729295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:51.161167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:51.193981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:51.300094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:51.320722 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cf22b79-e8ed-4896-a4f0-eddeee88261b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 200 len: 1307 microversion: 2.1 time: 0.620398 Nov 02 13:58:51.331593 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2246/3298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:50 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 1307 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:51.343999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3c438980-c7da-4df7-b361-28a56316d216 req-7ba74a79-0460-41bb-a691-4407fa3c211d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d", "name": "network-vif-deleted", "tag": "b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:51.354311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c438980-c7da-4df7-b361-28a56316d216 req-7ba74a79-0460-41bb-a691-4407fa3c211d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:51.355114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c438980-c7da-4df7-b361-28a56316d216 req-7ba74a79-0460-41bb-a691-4407fa3c211d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:51.355708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c438980-c7da-4df7-b361-28a56316d216 req-7ba74a79-0460-41bb-a691-4407fa3c211d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:51.369669 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c438980-c7da-4df7-b361-28a56316d216 req-7ba74a79-0460-41bb-a691-4407fa3c211d service nova] Creating event network-vif-deleted:b5e494a0-4dfa-41c3-8fe6-e4aa357dd5bd for instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d on n-h1-858238-3 Nov 02 13:58:51.376085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3c438980-c7da-4df7-b361-28a56316d216 req-7ba74a79-0460-41bb-a691-4407fa3c211d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042761 Nov 02 13:58:51.378119 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2247/3299] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:51.392882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:51.396316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:51.405104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:51.405867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:51.406585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:51.407633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:51.408372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:51.409053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:51.950728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:51.963770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:51.965107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:51.970470 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d007858-f928-4cf1-afdf-01260bebab70 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2824 microversion: 2.42 time: 0.590960 Nov 02 13:58:51.977624 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2248/3300] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:58:51 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2824 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:52.008063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-578338377", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:52.154914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:58:53.722943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:58:53.724402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:58:53.725046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:58:53.725616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:58:53.726215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:58:53.736989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:53.737850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:53.738495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:53.739598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:53.740248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:53.742038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:53.807783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:53.814317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:53.843241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:58:53.846514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:58:53.921476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62b8c737-a503-4d87-ac72-c391eee85d23 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.928164 Nov 02 13:58:53.931801 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2249/3301] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:58:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:58:53.946292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9270f9e1-f6ae-4560-9cb3-a230e60b490d", "name": "network-vif-deleted", "tag": "021b56a7-a549-4d8a-938d-96d4a3432c7f"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-deleted", "tag": "a6219b37-8b62-4a43-a5a2-c07feff83afb"}, {"name": "network-changed", "server_uuid": "5823a8df-506f-437d-a91d-25fc785d86b4", "tag": "cc0c907c-f19c-4138-8736-112dcec5dfda"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:53.988063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:53.988658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:53.989115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:54.020436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.server_external_events [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Unable to find a host for instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d. Dropping event network-vif-deleted {{(pid=137559) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:58:54.021219 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Creating event network-vif-deleted:a6219b37-8b62-4a43-a5a2-c07feff83afb for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:54.022285 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] Creating event network-changed:cc0c907c-f19c-4138-8736-112dcec5dfda for instance 5823a8df-506f-437d-a91d-25fc785d86b4 on n-h1-858238-3 Nov 02 13:58:54.036083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5998b955-0329-4a64-9610-bcf3acf4a460 req-2d9696d4-9850-4302-a0ef-b984119b69f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 518 microversion: 2.1 time: 0.105330 Nov 02 13:58:54.037557 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2250/3302] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 518 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 13:58:54.049209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:54.050457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:54.063600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:54.065301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:54.066405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:54.067977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:54.068822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:54.070203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:54.977229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:54.998531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55c22875-a0dd-4858-8ce9-89961c84ac26 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1309 microversion: 2.1 time: 0.957262 Nov 02 13:58:55.012933 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2251/3303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:54 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1309 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:55.032952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:55.034541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] [instance: d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:55.069551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.070067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.070518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.072525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.073008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.073448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.109615 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] HTTP exception thrown: Instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d could not be found. Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Request method failure captured: Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d HTTP/1.1 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndQQTAPEWRi7b5aUXB_D84zvR1XEtSToAbaAkkhFjZat7d6-rWUSi-HmlcyPMrvANg_iafzdA7NkukAYXOvdei64coZpYXqwBluy2mvP6ElguzcXc44JtjDOzPdQzK-TKJrpjqWLWPlCtohMhvngv6zd3BpxC4fNvfalx0heAUXWWc Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d326159935494ce7b55123dbc3b579db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d326159935494ce7b55123dbc3b579db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d326159935494ce7b55123dbc3b579db"}]}] Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d326159935494ce7b55123dbc3b579db Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6d9ff2af96134b3ab325b5a8424de6ab Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d could not be found. Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd6bdfa61-ddc0-4464-aff5-ee5ac763ac0d'} Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d could not be found. Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d could not be found. Nov 02 13:58:55.112816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d could not be found. Nov 02 13:58:55.119442 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:58:55.125077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] Returning 404 to user: Instance d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:55.127619 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80d646be-d859-466c-be6f-b3958a2865e7 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389 tempest-FloatingIPsAssociationNegativeTestJSON-1808723389-project] 10.222.0.18 "GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d" status: 404 len: 111 microversion: 2.1 time: 0.105336 Nov 02 13:58:55.134290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2252/3304] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:55 2022] GET /compute/v2.1/servers/d6bdfa61-ddc0-4464-aff5-ee5ac763ac0d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:58:55.138057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-unplugged", "status": "completed", "tag": "e707d585-acad-44e6-9040-e84131462d69"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-unplugged", "status": "completed", "tag": "a6219b37-8b62-4a43-a5a2-c07feff83afb"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-unplugged", "status": "completed", "tag": "b580f924-6265-448a-9b14-4d6a702fe994"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-unplugged", "status": "completed", "tag": "ebfa19ed-8088-41a6-92e6-19f7b9b8fac5"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-unplugged", "status": "completed", "tag": "a4efc2d4-567e-4723-80c8-9c4971601415"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:55.150896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.151460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.151897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.168970 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Creating event network-vif-unplugged:e707d585-acad-44e6-9040-e84131462d69 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:55.169867 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Creating event network-vif-unplugged:a6219b37-8b62-4a43-a5a2-c07feff83afb for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:55.171221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Creating event network-vif-unplugged:b580f924-6265-448a-9b14-4d6a702fe994 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:55.172142 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Creating event network-vif-unplugged:ebfa19ed-8088-41a6-92e6-19f7b9b8fac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:55.176234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] Creating event network-vif-unplugged:a4efc2d4-567e-4723-80c8-9c4971601415 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:55.188120 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-57f6fb01-c4c4-4f4d-992b-44c966678dd7 req-647e6da3-6ec2-4143-9fe0-0cffe96ef478 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.052978 Nov 02 13:58:55.190654 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2253/3305] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:55.201606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:55.202721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:55.210776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.211713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.212398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.213349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:55.214045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:55.214710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:55.984699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:55.994203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46606651-dd62-46f4-8736-eaba5b4689cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 200 len: 1487 microversion: 2.1 time: 0.802211 Nov 02 13:58:56.008606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2254/3306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:55 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 1487 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:56.021482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:56.022471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:56.029447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:56.030238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:56.030926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:56.031940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:56.032556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:56.033102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.065648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:57.084765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:57.086585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:57.088203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb1ecbab-d336-40f1-bf2d-8740b0edd1bd tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2616 microversion: 2.42 time: 1.078284 Nov 02 13:58:57.089335 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2255/3307] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:58:56 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2616 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:57.093995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:57.094871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:57.114912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.115803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.119430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.134141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.134141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.134141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.306296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:57.324582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1a9d507-34ab-46f4-b88a-82c2a969e6fc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1272 microversion: 2.1 time: 0.233588 Nov 02 13:58:57.325612 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2256/3308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:57 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:57.363498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-380647194"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:57.368192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:57.384124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.385382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.386443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.388268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.389352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.391481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.470997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:DELETE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:57.803368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c258ffd-a0a0-4891-9f56-c8d8dc5f729e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1/action" status: 202 len: 0 microversion: 2.1 time: 0.445894 Nov 02 13:58:57.805549 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2257/3309] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:58:57 2022] POST /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 13:58:57.962933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:57.964720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:57.979236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.980172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.980850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:57.989441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:57.990338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:57.991026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:58.807978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:58.817739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62a239df-d79b-40a0-9295-7f9495c59a9c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1309 microversion: 2.1 time: 1.009177 Nov 02 13:58:58.823907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2258/3310] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:57 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1309 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:58.832005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-deleted", "tag": "e707d585-acad-44e6-9040-e84131462d69"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-deleted", "tag": "a4efc2d4-567e-4723-80c8-9c4971601415"}, {"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-deleted", "tag": "b580f924-6265-448a-9b14-4d6a702fe994"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:58.866534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:58.867376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:58.867970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:58.891258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Creating event network-vif-deleted:e707d585-acad-44e6-9040-e84131462d69 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:58.891760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Creating event network-vif-deleted:a4efc2d4-567e-4723-80c8-9c4971601415 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:58.892795 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] Creating event network-vif-deleted:b580f924-6265-448a-9b14-4d6a702fe994 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:58:58.909580 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bd26da65-d66e-463e-930f-ec6a5e412ebb req-161943c9-c7e5-40e8-8807-937bbd8560d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.083966 Nov 02 13:58:58.910215 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2259/3311] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:58.927944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-acb20bdd-c0b5-415f-a4d7-b3d95886fc33 req-ba9fa721-2b25-4357-875a-e060c1c98255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5823a8df-506f-437d-a91d-25fc785d86b4", "name": "network-vif-plugged", "status": "completed", "tag": "cc0c907c-f19c-4138-8736-112dcec5dfda"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:58.949718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-acb20bdd-c0b5-415f-a4d7-b3d95886fc33 req-ba9fa721-2b25-4357-875a-e060c1c98255 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:58.950142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-acb20bdd-c0b5-415f-a4d7-b3d95886fc33 req-ba9fa721-2b25-4357-875a-e060c1c98255 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:58.950759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-acb20bdd-c0b5-415f-a4d7-b3d95886fc33 req-ba9fa721-2b25-4357-875a-e060c1c98255 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:58.974938 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-acb20bdd-c0b5-415f-a4d7-b3d95886fc33 req-ba9fa721-2b25-4357-875a-e060c1c98255 service nova] Creating event network-vif-plugged:cc0c907c-f19c-4138-8736-112dcec5dfda for instance 5823a8df-506f-437d-a91d-25fc785d86b4 on n-h1-858238-3 Nov 02 13:58:58.987944 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-acb20bdd-c0b5-415f-a4d7-b3d95886fc33 req-ba9fa721-2b25-4357-875a-e060c1c98255 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076077 Nov 02 13:58:58.990808 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2260/3312] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:59.000224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-241e6559-7168-46ed-b023-30a1185c6997 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f82163040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:59.133411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-241e6559-7168-46ed-b023-30a1185c6997 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.141066 Nov 02 13:58:59.135552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2261/3313] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:58:58 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:59.142752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:59.144703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:59.170878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:59.174014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:59.174014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:59.174472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:59.177416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:59.178002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:59.178345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:59.586731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:59.604845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:59.610039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:59.612649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee66bcb3-e513-4a0c-b384-7396e3a0b894 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2346 microversion: 2.42 time: 0.475610 Nov 02 13:58:59.643066 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2262/3314] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:58:59 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2346 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:59.652177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:59.653828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:59.666584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:59.667916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:59.668542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:59.670241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:59.670860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:59.672507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.131485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:00.141583 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-239ebc71-0bb7-468c-a36e-afd38d4b0f75 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1314 microversion: 2.1 time: 0.496828 Nov 02 13:59:00.143066 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2263/3315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:58:59 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:00.149388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:00.150312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:00.171393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:00.176133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:00.176554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.177300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:00.177762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:00.178196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.776041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:00.790294 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c68a7d4e-2012-443c-83f8-a04361ef21f3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1309 microversion: 2.1 time: 0.645863 Nov 02 13:59:00.806783 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2264/3316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:00 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1309 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:00.853305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16cc3c9e-d6b9-4ae6-8464-f5ce124423c0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f820cf430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:00.925946 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16cc3c9e-d6b9-4ae6-8464-f5ce124423c0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.117458 Nov 02 13:59:00.927567 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2265/3317] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:00 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:00.933790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:00.934346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:00.949401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:00.949905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:00.950346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.951274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:00.951921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:00.952520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:01.226104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:01.243121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:01.244975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:01.246538 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4feae1db-b095-4120-be57-a1888d1391fe tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 2164 microversion: 2.42 time: 0.317666 Nov 02 13:59:01.250698 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2266/3318] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:00 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 2164 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:01.256757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8ac04763-9d17-4fee-8d7d-d89d1a9d4f70 req-3c84c090-b5ed-470b-abe6-b66772867d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5", "tag": "739d7d43-dde8-4418-b536-7ad691f48958"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:01.283174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8ac04763-9d17-4fee-8d7d-d89d1a9d4f70 req-3c84c090-b5ed-470b-abe6-b66772867d52 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:01.283992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8ac04763-9d17-4fee-8d7d-d89d1a9d4f70 req-3c84c090-b5ed-470b-abe6-b66772867d52 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:01.284771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8ac04763-9d17-4fee-8d7d-d89d1a9d4f70 req-3c84c090-b5ed-470b-abe6-b66772867d52 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:01.312950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8ac04763-9d17-4fee-8d7d-d89d1a9d4f70 req-3c84c090-b5ed-470b-abe6-b66772867d52 service nova] Creating event network-changed:739d7d43-dde8-4418-b536-7ad691f48958 for instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 on n-h1-858238-3 Nov 02 13:59:01.333449 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8ac04763-9d17-4fee-8d7d-d89d1a9d4f70 req-3c84c090-b5ed-470b-abe6-b66772867d52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080555 Nov 02 13:59:01.334532 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2267/3319] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:01.975058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:01.978931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:02.005250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.009212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.011758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.013826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.021110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.024087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.833782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:02.845882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06d0d584-16f3-41ce-9e7a-88633a40bf00 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1314 microversion: 2.1 time: 1.509969 Nov 02 13:59:02.852550 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2268/3320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:01 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1314 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:02.863049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-95f344b6-1a83-40f8-bc4d-1affcf3878b0 req-96a6b4e5-0404-4996-b5b1-bc1d3e4faa43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f", "name": "network-vif-deleted", "tag": "ebfa19ed-8088-41a6-92e6-19f7b9b8fac5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:02.901949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95f344b6-1a83-40f8-bc4d-1affcf3878b0 req-96a6b4e5-0404-4996-b5b1-bc1d3e4faa43 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.902905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95f344b6-1a83-40f8-bc4d-1affcf3878b0 req-96a6b4e5-0404-4996-b5b1-bc1d3e4faa43 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.904370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95f344b6-1a83-40f8-bc4d-1affcf3878b0 req-96a6b4e5-0404-4996-b5b1-bc1d3e4faa43 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.926688 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-95f344b6-1a83-40f8-bc4d-1affcf3878b0 req-96a6b4e5-0404-4996-b5b1-bc1d3e4faa43 service nova] Creating event network-vif-deleted:ebfa19ed-8088-41a6-92e6-19f7b9b8fac5 for instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f on n-h1-858238-3 Nov 02 13:59:02.933264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-95f344b6-1a83-40f8-bc4d-1affcf3878b0 req-96a6b4e5-0404-4996-b5b1-bc1d3e4faa43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079173 Nov 02 13:59:02.934544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2269/3321] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:02.944996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:02.950422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:02.965200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.965904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.966455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.967384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.972022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.972635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:03.435790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:03.449933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7aa9610f-9cfc-4691-ab53-b2d58eadb0e9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1491 microversion: 2.1 time: 0.513797 Nov 02 13:59:03.451292 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2270/3322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:02 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1491 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:03.459992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dbc1dac-0f56-4622-adef-5f7c411c8bec tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81b999d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:03.545257 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4dbc1dac-0f56-4622-adef-5f7c411c8bec tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.091244 Nov 02 13:59:03.546482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2271/3323] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:03 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:03.768067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:03.833446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:03.905128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96ef52c4-3843-4529-a0ee-030cf43853c8 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Action: 'create', calling method: .version_select at 0x7f6f81f8d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-728437646"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:04.625225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96ef52c4-3843-4529-a0ee-030cf43853c8 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.076759 Nov 02 13:59:04.625922 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2272/3324] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Nov 2 13:59:03 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1079 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 13:59:04.639287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:04.642086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:04.672797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:04.683732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:04.684348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:04.685325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:04.686110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:04.691944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:04.937911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:04.984710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:04.988899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:04.996070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bdd52f3c-92df-4f12-a18b-4dd35c52967d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.364596 Nov 02 13:59:05.012636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2273/3325] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:04 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:05.038495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-94900c1d-8b6d-4010-9692-e8f0a13eac4f req-acdf6268-6f5e-4a03-9dd4-7523ab19efcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faabbaf3-73f3-44c4-88cf-73a182ad7bc1", "name": "network-vif-plugged", "status": "completed", "tag": "2fdaa5a4-877c-496b-9b5c-08e91604cf7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:05.077488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94900c1d-8b6d-4010-9692-e8f0a13eac4f req-acdf6268-6f5e-4a03-9dd4-7523ab19efcc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.086752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94900c1d-8b6d-4010-9692-e8f0a13eac4f req-acdf6268-6f5e-4a03-9dd4-7523ab19efcc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.091088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94900c1d-8b6d-4010-9692-e8f0a13eac4f req-acdf6268-6f5e-4a03-9dd4-7523ab19efcc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.155132 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-94900c1d-8b6d-4010-9692-e8f0a13eac4f req-acdf6268-6f5e-4a03-9dd4-7523ab19efcc service nova] Creating event network-vif-plugged:2fdaa5a4-877c-496b-9b5c-08e91604cf7f for instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 on n-h2-858238-3 Nov 02 13:59:05.171088 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-94900c1d-8b6d-4010-9692-e8f0a13eac4f req-acdf6268-6f5e-4a03-9dd4-7523ab19efcc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146963 Nov 02 13:59:05.183117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2274/3326] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:05.214198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-876675131"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:05.227917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:05.243980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.247688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.248498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.249725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.252876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.255599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.391918 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a9f9022-c2ec-4d9b-9e6b-45e12ea2ee38 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "PUT /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1075 microversion: 2.1 time: 0.206907 Nov 02 13:59:05.425224 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2275/3327] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 13:59:05 2022] PUT /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1075 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:05.437591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:05.438802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:05.450290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.451162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.451761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.453084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.453731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.454318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:06.501151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:06.514705 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f294a0a7-ed7f-47af-8251-f3e73e2cb429 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1314 microversion: 2.1 time: 1.085955 Nov 02 13:59:06.518103 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2276/3328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:05 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:06.536569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f47eedec-1c6b-4e94-9dce-c63c53d0d17c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81a9fa60>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:06.620641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f47eedec-1c6b-4e94-9dce-c63c53d0d17c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.099932 Nov 02 13:59:06.622007 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2277/3329] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:06 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:06.629843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc2f449e-bb69-488b-961b-1cf87528194c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81f8d9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:06.720868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc2f449e-bb69-488b-961b-1cf87528194c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 200 len: 345 microversion: 2.1 time: 0.096717 Nov 02 13:59:06.722219 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2278/3330] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:59:06 2022] GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:06.748747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:06.749801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:06.784069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:06.784981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:06.786824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:06.789911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:06.790619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:06.794487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:07.477445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:07.490558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c2a17ed7-ecbf-4686-80b4-40aa18658b60 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1501 microversion: 2.1 time: 0.766724 Nov 02 13:59:07.491063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2279/3331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:06 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1501 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:07.498228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:07.503268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:07.522347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:07.525777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:07.527428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:07.529187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:07.530653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:07.531133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:07.670873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:07.685311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:07.687862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:07.691839 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c88dfd0-c3b3-42e5-88e5-802ec5f68993 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.199303 Nov 02 13:59:07.698029 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2280/3332] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:07 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:07.704660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e82e94e-d8b1-4681-83cc-2d659e957db6 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Action: 'create', calling method: .version_select at 0x7f6f81a9f1f0>, body: {"snapshot": {"volume_id": "f25a8760-9c76-42f3-88c7-e51c83318790", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-839936922"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:08.132733 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e82e94e-d8b1-4681-83cc-2d659e957db6 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.432075 Nov 02 13:59:08.134263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2281/3333] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Nov 2 13:59:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:08.161743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:08.165728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:08.267816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:08.271328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:08.273490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:08.277777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:08.278615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:08.281151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:09.210516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:09.212887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:09.226929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dee7bcfe-58b8-4a6b-bfda-c6a92c843599 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1501 microversion: 2.1 time: 1.091160 Nov 02 13:59:09.241756 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2282/3334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:08 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1501 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:09.246843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:09.262600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:09.287259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:09.288025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:09.288656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:09.289570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:09.290198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:09.290791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.117227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:10.138333 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40f6b916-cc4d-4898-95c7-cbea71a6761f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1314 microversion: 2.1 time: 0.888438 Nov 02 13:59:10.141184 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2283/3335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:09 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:10.158217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb2dd5ff-58b7-43c2-81d4-dfb9dfffe9bc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81b6fca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:10.323817 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb2dd5ff-58b7-43c2-81d4-dfb9dfffe9bc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.181314 Nov 02 13:59:10.328733 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2284/3336] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:10 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:10.349915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2526dc16-c402-41e3-85b1-79aad79a0a96 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81b6fdc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:10.507678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2526dc16-c402-41e3-85b1-79aad79a0a96 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca" status: 200 len: 286 microversion: 2.1 time: 0.174613 Nov 02 13:59:10.508604 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2285/3337] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:59:10 2022] GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:10.516608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:10.518817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:10.543594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.548012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.557526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.560185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.571683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.572423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.309312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:11.333882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:11.346711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:11.352136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8179bcd2-e893-4c84-80c2-8993df56572d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.838622 Nov 02 13:59:11.353371 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2286/3338] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:10 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:11.361787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c290bc70-26ce-4c2a-bcc7-672cf850c7bd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:11.371114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c290bc70-26ce-4c2a-bcc7-672cf850c7bd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.372122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c290bc70-26ce-4c2a-bcc7-672cf850c7bd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.372915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c290bc70-26ce-4c2a-bcc7-672cf850c7bd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.422321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c290bc70-26ce-4c2a-bcc7-672cf850c7bd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:59:11.661392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c290bc70-26ce-4c2a-bcc7-672cf850c7bd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "POST /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4/action" status: 202 len: 0 microversion: 2.1 time: 0.290377 Nov 02 13:59:11.666826 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2287/3339] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:59:11 2022] POST /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:59:11.712125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cb63eafa-c4bc-4231-a014-c2f2726fa3f1 req-9133d895-9f9b-4129-a310-e9050c152671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5", "name": "network-vif-plugged", "status": "completed", "tag": "739d7d43-dde8-4418-b536-7ad691f48958"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:11.771923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb63eafa-c4bc-4231-a014-c2f2726fa3f1 req-9133d895-9f9b-4129-a310-e9050c152671 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.772746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb63eafa-c4bc-4231-a014-c2f2726fa3f1 req-9133d895-9f9b-4129-a310-e9050c152671 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.773499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb63eafa-c4bc-4231-a014-c2f2726fa3f1 req-9133d895-9f9b-4129-a310-e9050c152671 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.865750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cb63eafa-c4bc-4231-a014-c2f2726fa3f1 req-9133d895-9f9b-4129-a310-e9050c152671 service nova] Creating event network-vif-plugged:739d7d43-dde8-4418-b536-7ad691f48958 for instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 on n-h1-858238-3 Nov 02 13:59:11.878780 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cb63eafa-c4bc-4231-a014-c2f2726fa3f1 req-9133d895-9f9b-4129-a310-e9050c152671 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202312 Nov 02 13:59:11.889869 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2288/3340] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:11.929184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd5eb582-6908-4ca6-8de2-28201345376a tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81957c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:12.120989 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd5eb582-6908-4ca6-8de2-28201345376a tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.228833 Nov 02 13:59:12.122032 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2289/3341] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 13:59:11 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:12.152366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:12.171338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:12.229889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.230404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.230851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:12.231629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.232164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.232516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:12.757541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:12.776424 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-624f365b-988d-4f99-a704-ef08ee91f3ca tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1314 microversion: 2.1 time: 0.652831 Nov 02 13:59:12.777031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2290/3342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:12 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:12.790446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23d06096-f097-4c83-9ad5-3ee286275990 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f822a3f70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:12.926594 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23d06096-f097-4c83-9ad5-3ee286275990 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.145896 Nov 02 13:59:12.927708 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2291/3343] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:12 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:12.940293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:12.941714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:12.967790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.968718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.969356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:12.970635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.971132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.971543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.371813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.384618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-767164f0-0768-4e36-8944-1a562ed14ef3 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.455550 Nov 02 13:59:13.385586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2292/3344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:12 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:13.393087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd1f6f3e-7ce6-4dd8-a506-8f65ef99773b tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f85f48e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:13.547365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd1f6f3e-7ce6-4dd8-a506-8f65ef99773b tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca" status: 200 len: 287 microversion: 2.1 time: 0.160435 Nov 02 13:59:13.548958 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2293/3345] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:59:13 2022] GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:13.553821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:13.555016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:13.579930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:13.580582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:13.584131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.584937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:13.585608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:13.586041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.708960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.719392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.721258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.723703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-452ec832-bfbe-42b9-968e-de4551518baa tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.173774 Nov 02 13:59:13.743820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2294/3346] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:13 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:13.987452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b00ab015-2dbe-430d-ae51-a7252870f976 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Calling method '.version_select at 0x7f6f82623430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.018443 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b00ab015-2dbe-430d-ae51-a7252870f976 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] HTTP exception thrown: Image not found. Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b00ab015-2dbe-430d-ae51-a7252870f976 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Request method failure captured: Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/e82dfc67-584d-461d-b7aa-95d983dbebe5/metadata/os_distro HTTP/1.1 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnewZBxyt15pPIRq1m9tuZJdc_Yo4odpPLT1SIyXFTbWkdo2gnax2halu4Y7PVkStrd9kSCrHMPpVYfXGYRg5WC-pd90iXqd9ABcm0aIwC8bNchh28_2LC2NHGv-Vkrk1dtVvnTrqw5Cq2Sn1dReUVp32Uz3XZ5fD4nO9A_qJ344tdg Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bcfa899ffa6472a84fda83dc7eff5a4"}]}] Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 56bbd488d3d0451081e4b7542cabe477 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'image_id': 'e82dfc67-584d-461d-b7aa-95d983dbebe5', 'id': 'os_distro'} Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e82dfc67-584d-461d-b7aa-95d983dbebe5 Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:14.025281 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e82dfc67-584d-461d-b7aa-95d983dbebe5 could not be found. Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b00ab015-2dbe-430d-ae51-a7252870f976 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:14.032316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b00ab015-2dbe-430d-ae51-a7252870f976 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] 10.222.0.18 "DELETE /compute/v2.1/images/e82dfc67-584d-461d-b7aa-95d983dbebe5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.281678 Nov 02 13:59:14.040263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2295/3347] 10.222.0.18 () {58 vars in 1293 bytes} [Wed Nov 2 13:59:13 2022] DELETE /compute/v2.1/images/e82dfc67-584d-461d-b7aa-95d983dbebe5/metadata/os_distro => generated 62 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:14.051524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea128530-de9c-4b83-b38b-dc34422eeda7 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81d08430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.174552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea128530-de9c-4b83-b38b-dc34422eeda7 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca" status: 202 len: 0 microversion: 2.1 time: 0.127362 Nov 02 13:59:14.175190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2296/3348] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Nov 2 13:59:14 2022] DELETE /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:59:14.180910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.185230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:14.207121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.213338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.214154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.215933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.216614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.217284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.482422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:14.490519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-807c5920-671c-4bfb-a831-427032e27b1a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1501 microversion: 2.1 time: 0.313990 Nov 02 13:59:14.497787 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2297/3349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1501 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:14.503131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55852077-1926-48ac-a3d4-7fa2df0b85cf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81b72430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.606907 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55852077-1926-48ac-a3d4-7fa2df0b85cf tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.107945 Nov 02 13:59:14.616153 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2298/3350] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:14.627201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-267e65bc-963e-4697-b716-c912a3bb7388 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Calling method '.version_select at 0x7f6f80b9b700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.676269 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-267e65bc-963e-4697-b716-c912a3bb7388 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] HTTP exception thrown: Image not found. Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-267e65bc-963e-4697-b716-c912a3bb7388 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Request method failure captured: Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/images/6878a546-2da0-4b3e-9d5b-9ad4ae22dbe7/metadata/os_version HTTP/1.1 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnewZBxyt15pPIRq1m9tuZJdc_Yo4odpPLT1SIyXFTbWkdo2gnax2halu4Y7PVkStrd9kSCrHMPpVYfXGYRg5WC-pd90iXqd9ABcm0aIwC8bNchh28_2LC2NHGv-Vkrk1dtVvnTrqw5Cq2Sn1dReUVp32Uz3XZ5fD4nO9A_qJ344tdg Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bcfa899ffa6472a84fda83dc7eff5a4"}]}] Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 56bbd488d3d0451081e4b7542cabe477 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'image_id': '6878a546-2da0-4b3e-9d5b-9ad4ae22dbe7', 'id': 'os_version'} Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6878a546-2da0-4b3e-9d5b-9ad4ae22dbe7 Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:14.678340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6878a546-2da0-4b3e-9d5b-9ad4ae22dbe7 could not be found. Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-267e65bc-963e-4697-b716-c912a3bb7388 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-267e65bc-963e-4697-b716-c912a3bb7388 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] 10.222.0.18 "GET /compute/v2.1/images/6878a546-2da0-4b3e-9d5b-9ad4ae22dbe7/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.062398 Nov 02 13:59:14.685949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2299/3351] 10.222.0.18 () {58 vars in 1293 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/images/6878a546-2da0-4b3e-9d5b-9ad4ae22dbe7/metadata/os_version => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:14.697322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24b62560-57b0-4351-b4d6-2f102002bad5 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f82623430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.788012 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-24b62560-57b0-4351-b4d6-2f102002bad5 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca" status: 200 len: 286 microversion: 2.1 time: 0.100637 Nov 02 13:59:14.788924 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2300/3352] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:14.794912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.795852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:14.812243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.815829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.816580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.817518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.828164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.828164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.106815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:15.115820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6cbd7228-b7e3-4db7-b2c3-ff465eea0674 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.324798 Nov 02 13:59:15.116592 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2301/3353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:15.137620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-31e57134-99e2-4527-bd61-3e5b26707564 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:15.156070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31e57134-99e2-4527-bd61-3e5b26707564 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.156889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31e57134-99e2-4527-bd61-3e5b26707564 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.157542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31e57134-99e2-4527-bd61-3e5b26707564 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.210389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-31e57134-99e2-4527-bd61-3e5b26707564 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:59:15.298828 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-31e57134-99e2-4527-bd61-3e5b26707564 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5/action" status: 202 len: 0 microversion: 2.1 time: 0.169017 Nov 02 13:59:15.299770 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2302/3354] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:59:15 2022] POST /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:59:15.305766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c0e59ec-48cb-41f7-8cb9-e3a6dbc12bb0 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Calling method '.version_select at 0x7f6f821829d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.356593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-5c0e59ec-48cb-41f7-8cb9-e3a6dbc12bb0 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] HTTP exception thrown: Image not found. Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c0e59ec-48cb-41f7-8cb9-e3a6dbc12bb0 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Request method failure captured: Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/images/e7c8438c-a139-435d-a0c6-2273169d7e5f/metadata HTTP/1.1 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnewZBxyt15pPIRq1m9tuZJdc_Yo4odpPLT1SIyXFTbWkdo2gnax2halu4Y7PVkStrd9kSCrHMPpVYfXGYRg5WC-pd90iXqd9ABcm0aIwC8bNchh28_2LC2NHGv-Vkrk1dtVvnTrqw5Cq2Sn1dReUVp32Uz3XZ5fD4nO9A_qJ344tdg Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bcfa899ffa6472a84fda83dc7eff5a4"}]}] Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 56bbd488d3d0451081e4b7542cabe477 Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'image_id': 'e7c8438c-a139-435d-a0c6-2273169d7e5f'} Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e7c8438c-a139-435d-a0c6-2273169d7e5f Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:15.359126 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7c8438c-a139-435d-a0c6-2273169d7e5f could not be found. Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:15.364307 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.369527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c0e59ec-48cb-41f7-8cb9-e3a6dbc12bb0 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:15.370642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c0e59ec-48cb-41f7-8cb9-e3a6dbc12bb0 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] 10.222.0.18 "GET /compute/v2.1/images/e7c8438c-a139-435d-a0c6-2273169d7e5f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069625 Nov 02 13:59:15.378377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2303/3355] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 13:59:15 2022] GET /compute/v2.1/images/e7c8438c-a139-435d-a0c6-2273169d7e5f/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:15.389924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.391125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:15.418094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.418916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.419598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.420575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.421973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.422677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.537074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:15.552234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:15.555239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:15.556702 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-65ebf641-ea16-4bb3-86ac-06773ca49412 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.176888 Nov 02 13:59:15.580552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2304/3356] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:15 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:15.586105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.587035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:15.595510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.621901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.622811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.623815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.630124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.634523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.918780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:15.932358 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c0f771f-b1fa-4c07-8169-55e5289638d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.350515 Nov 02 13:59:15.934271 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2305/3357] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:15 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:15.943382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.943999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:15.959167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.960337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.961031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.962158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.962860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.963819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.261102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:16.273868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-671dc42d-ebc6-469a-9b91-49a559f9a8a4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.338503 Nov 02 13:59:16.277839 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2306/3358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:15 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:16.290699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-beddba36-6f42-49fb-8780-d393c36f1584 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Action: 'update_all', calling method: .version_select at 0x7f6f81a28430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:16.342955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-beddba36-6f42-49fb-8780-d393c36f1584 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] HTTP exception thrown: Image not found. Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-beddba36-6f42-49fb-8780-d393c36f1584 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Request method failure captured: Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/images/95b41741-8204-47d2-8458-67d63ea4da6b/metadata HTTP/1.1 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 57 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnewZBxyt15pPIRq1m9tuZJdc_Yo4odpPLT1SIyXFTbWkdo2gnax2halu4Y7PVkStrd9kSCrHMPpVYfXGYRg5WC-pd90iXqd9ABcm0aIwC8bNchh28_2LC2NHGv-Vkrk1dtVvnTrqw5Cq2Sn1dReUVp32Uz3XZ5fD4nO9A_qJ344tdg Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bcfa899ffa6472a84fda83dc7eff5a4"}]}] Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 56bbd488d3d0451081e4b7542cabe477 Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'image_id': '95b41741-8204-47d2-8458-67d63ea4da6b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 95b41741-8204-47d2-8458-67d63ea4da6b Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:16.346688 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95b41741-8204-47d2-8458-67d63ea4da6b could not be found. Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-beddba36-6f42-49fb-8780-d393c36f1584 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-beddba36-6f42-49fb-8780-d393c36f1584 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] 10.222.0.18 "PUT /compute/v2.1/images/95b41741-8204-47d2-8458-67d63ea4da6b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069256 Nov 02 13:59:16.354595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2307/3359] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:59:16 2022] PUT /compute/v2.1/images/95b41741-8204-47d2-8458-67d63ea4da6b/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:16.364484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9c75cfe-5f87-4766-974e-5ff0e9fef3d1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f821829d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:16.419524 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9c75cfe-5f87-4766-974e-5ff0e9fef3d1 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.063120 Nov 02 13:59:16.429267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2308/3360] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:16 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:16.437836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-650e365d-fb2f-4109-b027-23428f4942c8 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81d08430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:16.477486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-650e365d-fb2f-4109-b027-23428f4942c8 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca" status: 200 len: 286 microversion: 2.1 time: 0.045373 Nov 02 13:59:16.483019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2309/3361] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:59:16 2022] GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:16.490347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:16.491503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:16.498254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.499492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.500192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.501671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.502353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.502951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.807086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:16.824368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b0eb9b2-0650-4233-b013-9e96664c39f5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.339587 Nov 02 13:59:16.832903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2310/3362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:16 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:16.866417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:16.872179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:16.920809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.921678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.922324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.926447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.927211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.927817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.200087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.213826 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-942134af-407e-4a56-a842-d0b9de5ec9a6 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.377923 Nov 02 13:59:17.214845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2311/3363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:16 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:17.226004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f9463c3-3cfb-47d9-8364-12406db5297a tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Action: 'update', calling method: .version_select at 0x7f6f820cf430>, body: {"meta": {"os_distro": "alt"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:17.279285 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3f9463c3-3cfb-47d9-8364-12406db5297a tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] HTTP exception thrown: Image not found. Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f9463c3-3cfb-47d9-8364-12406db5297a tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Request method failure captured: Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/images/805c9fb6-82ab-4c05-9b04-09e0b77b1847/metadata/os_distro HTTP/1.1 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 30 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnewZBxyt15pPIRq1m9tuZJdc_Yo4odpPLT1SIyXFTbWkdo2gnax2halu4Y7PVkStrd9kSCrHMPpVYfXGYRg5WC-pd90iXqd9ABcm0aIwC8bNchh28_2LC2NHGv-Vkrk1dtVvnTrqw5Cq2Sn1dReUVp32Uz3XZ5fD4nO9A_qJ344tdg Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bcfa899ffa6472a84fda83dc7eff5a4"}]}] Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 56bbd488d3d0451081e4b7542cabe477 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: {"meta": {"os_distro": "alt"}} Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'image_id': '805c9fb6-82ab-4c05-9b04-09e0b77b1847', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 805c9fb6-82ab-4c05-9b04-09e0b77b1847 Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:17.281418 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 805c9fb6-82ab-4c05-9b04-09e0b77b1847 could not be found. Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f9463c3-3cfb-47d9-8364-12406db5297a tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f9463c3-3cfb-47d9-8364-12406db5297a tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] 10.222.0.18 "PUT /compute/v2.1/images/805c9fb6-82ab-4c05-9b04-09e0b77b1847/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.066416 Nov 02 13:59:17.293747 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2312/3364] 10.222.0.18 () {60 vars in 1310 bytes} [Wed Nov 2 13:59:17 2022] PUT /compute/v2.1/images/805c9fb6-82ab-4c05-9b04-09e0b77b1847/metadata/os_distro => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:17.299518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:17.299518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:17.313709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.314278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.315905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.316640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.317628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.318993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.359142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:17.431799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.450398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.453090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.454540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67bba959-dfeb-4a83-853e-bb2cc21ec52f tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.169612 Nov 02 13:59:17.471517 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2313/3365] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:17 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:17.482713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:17.484749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:17.505847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.506335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.506780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.513065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.513907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.514505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.838443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.860058 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e13dd03-fbb2-42e7-ab6b-c3ab39414e49 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.387367 Nov 02 13:59:17.861023 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2314/3366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:17 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:17.868003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5310a647-7c43-4bd7-884b-3546d25816a5 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Action: 'create', calling method: .version_select at 0x7f6f80fe9b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:17.919727 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-5310a647-7c43-4bd7-884b-3546d25816a5 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] HTTP exception thrown: Image not found. Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5310a647-7c43-4bd7-884b-3546d25816a5 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Request method failure captured: Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/images/8af1e3b5-7189-47b2-b23c-e36a23f3e79d/metadata HTTP/1.1 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 57 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnewZBxyt15pPIRq1m9tuZJdc_Yo4odpPLT1SIyXFTbWkdo2gnax2halu4Y7PVkStrd9kSCrHMPpVYfXGYRg5WC-pd90iXqd9ABcm0aIwC8bNchh28_2LC2NHGv-Vkrk1dtVvnTrqw5Cq2Sn1dReUVp32Uz3XZ5fD4nO9A_qJ344tdg Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bcfa899ffa6472a84fda83dc7eff5a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bcfa899ffa6472a84fda83dc7eff5a4"}]}] Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1bcfa899ffa6472a84fda83dc7eff5a4 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 56bbd488d3d0451081e4b7542cabe477 Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1701325469-project Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'image_id': '8af1e3b5-7189-47b2-b23c-e36a23f3e79d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8af1e3b5-7189-47b2-b23c-e36a23f3e79d Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:17.922097 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8af1e3b5-7189-47b2-b23c-e36a23f3e79d could not be found. Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5310a647-7c43-4bd7-884b-3546d25816a5 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5310a647-7c43-4bd7-884b-3546d25816a5 tempest-ImagesMetadataNegativeTestJSON-1701325469 tempest-ImagesMetadataNegativeTestJSON-1701325469-project] 10.222.0.18 "POST /compute/v2.1/images/8af1e3b5-7189-47b2-b23c-e36a23f3e79d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061836 Nov 02 13:59:17.927575 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2315/3367] 10.222.0.18 () {60 vars in 1281 bytes} [Wed Nov 2 13:59:17 2022] POST /compute/v2.1/images/8af1e3b5-7189-47b2-b23c-e36a23f3e79d/metadata => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:17.940595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:17.941280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:17.980533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.981181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.981721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.982913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.983770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.984442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:18.356031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:18.368775 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b40d1cb0-c35f-4eb1-9411-924bd679de0c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.442719 Nov 02 13:59:18.369586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2316/3368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:17 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:18.407801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6eebd502-61cf-4d2d-ad8b-d6bd72fa6254 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81d2c8b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:18.510074 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6eebd502-61cf-4d2d-ad8b-d6bd72fa6254 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.117131 Nov 02 13:59:18.512080 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2317/3369] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:18 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:18.518127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c859d880-93c6-4da2-965f-ce11d5e7c7da tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f80fe9ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:18.569419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c859d880-93c6-4da2-965f-ce11d5e7c7da tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] HTTP exception thrown: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c859d880-93c6-4da2-965f-ce11d5e7c7da tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Request method failure captured: Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca HTTP/1.1 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnemz_2VM_sBTnXKFbKgdAxh7b2EQqKqfZcoddk6HWuYpEvFJk64HxsbSIJww0MoNc0JU6VQ-T2oYYffOCr7BUalOM7ZRNCRh8z9tEw-hITLXRu8SkeUeXsyHjQL0xOx3ba-enQieGB6hLwd9Q4MY2dA5RI8X8Nq1b9-2-_wREskgKQ Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1c520b807fe74714974c4f4321fc6ce0"}]}] Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1e3fca12aa1f4c778a26dd9f2d4b4b6f Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: exception: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '87e3cf45-bf86-4b1a-8ea4-f642a4069bca'} Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. (HTTP 404) (Request-ID: req-54245b93-748a-478c-82c1-78263397e74b) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:59:18.582351 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c859d880-93c6-4da2-965f-ce11d5e7c7da tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Returning 404 to user: Snapshot 87e3cf45-bf86-4b1a-8ea4-f642a4069bca could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:18.588758 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c859d880-93c6-4da2-965f-ce11d5e7c7da tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca" status: 404 len: 111 microversion: 2.1 time: 0.071172 Nov 02 13:59:18.596144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2318/3370] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 13:59:18 2022] GET /compute/v2.1/os-snapshots/87e3cf45-bf86-4b1a-8ea4-f642a4069bca => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:18.603159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-80417877"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:18.606738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:18.617562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:18.618365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:18.625898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:18.627844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:18.628564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:18.629394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.114318 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:59:19.115710 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:59:19.125090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e35dc7f-5276-4c3f-b12d-60e9857e45e6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.533367 Nov 02 13:59:19.129732 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2319/3371] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:59:18 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 13:59:19.135828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:19.136597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:19.165441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:19.166166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:19.166889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.180679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:19.187750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:19.188766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.269140 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:59:19.273898 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:59:19.569224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:19.587486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-769462d8-1f4e-4e8a-a600-4080b7e7eb62 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.455961 Nov 02 13:59:19.589361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2320/3372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:19 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:19.622617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:19.623692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:19.655130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:19.656021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:19.656701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.659427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:19.660265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:19.661972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:20.475364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:20.506302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:20.519007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:20.525761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6ab57a8-f329-4096-b38d-666813b5a5c8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.910127 Nov 02 13:59:20.527010 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2321/3373] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:19 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:20.553571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc23ed8c-7c8e-45a9-9700-2b96338e5f76 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f80fe91f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:20.838068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc23ed8c-7c8e-45a9-9700-2b96338e5f76 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 202 len: 0 microversion: 2.1 time: 0.308167 Nov 02 13:59:20.839735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2322/3374] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:59:20 2022] DELETE /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:59:20.856171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:20.858868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:20.906611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:20.913892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:20.913892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:20.913892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:20.940533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:20.940797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:21.408739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:21.424455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc459de3-bdf8-4c93-bfac-f766e24ca1cc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.581382 Nov 02 13:59:21.439744 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2323/3375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:20 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:21.450044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d141d706-ba4a-4a10-aff6-771044aa01a8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81364e50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:21.583067 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d141d706-ba4a-4a10-aff6-771044aa01a8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.137564 Nov 02 13:59:21.586920 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2324/3376] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:21 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:21.615157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:21.622516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:21.670687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:21.671722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:21.672335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:21.673387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:21.674352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:21.681775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.033521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.033521 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f210699-d4df-40b6-a162-21ef50fff861 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.431162 Nov 02 13:59:22.033521 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2325/3377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:21 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:22.033521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-72d32f57-36a1-470b-91e4-7930d9369534 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f821829d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:22.131479 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-72d32f57-36a1-470b-91e4-7930d9369534 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 200 len: 344 microversion: 2.1 time: 0.109337 Nov 02 13:59:22.132333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2326/3378] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:59:22 2022] GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:22.346304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d74d37d-5bd0-492c-9c44-2ad01c41aa9d tempest-ListImageFiltersNegativeTestJSON-1798601170 tempest-ListImageFiltersNegativeTestJSON-1798601170-project] Calling method '.version_select at 0x7f6f81a061f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:22.400077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6d74d37d-5bd0-492c-9c44-2ad01c41aa9d tempest-ListImageFiltersNegativeTestJSON-1798601170 tempest-ListImageFiltersNegativeTestJSON-1798601170-project] HTTP exception thrown: Image not found. Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d74d37d-5bd0-492c-9c44-2ad01c41aa9d tempest-ListImageFiltersNegativeTestJSON-1798601170 tempest-ListImageFiltersNegativeTestJSON-1798601170-project] Request method failure captured: Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/images/cb77b885-8865-42e6-8059-04d8f746a370 HTTP/1.1 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYne5l10cR3kBKY7hwKcs5AIQH5MpITfeJSuFTGBY02TcUbByRlTLrHb14yW6iTb95TzE46wiyVR30eH1fDGq7kx7Zz5nrHbxJapjvjvrEpoJ_FppZ2360WDy-iQlTOEps_HnKB7CShdNmFoxpiMe0aswQNYtOmOEFDz4SRaNsI7GBFg Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1171ba35f8434fc381da4c8cc3cafb8a Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1798601170 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1171ba35f8434fc381da4c8cc3cafb8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1171ba35f8434fc381da4c8cc3cafb8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1171ba35f8434fc381da4c8cc3cafb8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1171ba35f8434fc381da4c8cc3cafb8a"}]}] Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1798601170 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1171ba35f8434fc381da4c8cc3cafb8a Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1798601170 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListImageFiltersNegativeTestJSON-1798601170-project Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1505edcfeb374112a6d4fd9a6484beb8 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1798601170-project Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'cb77b885-8865-42e6-8059-04d8f746a370'} Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cb77b885-8865-42e6-8059-04d8f746a370 Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:59:22.402785 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb77b885-8865-42e6-8059-04d8f746a370 could not be found. Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:59:22.410744 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:22.418090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d74d37d-5bd0-492c-9c44-2ad01c41aa9d tempest-ListImageFiltersNegativeTestJSON-1798601170 tempest-ListImageFiltersNegativeTestJSON-1798601170-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:22.419366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d74d37d-5bd0-492c-9c44-2ad01c41aa9d tempest-ListImageFiltersNegativeTestJSON-1798601170 tempest-ListImageFiltersNegativeTestJSON-1798601170-project] 10.222.0.18 "GET /compute/v2.1/images/cb77b885-8865-42e6-8059-04d8f746a370" status: 404 len: 62 microversion: 2.1 time: 0.285660 Nov 02 13:59:22.420259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2327/3379] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:22 2022] GET /compute/v2.1/images/cb77b885-8865-42e6-8059-04d8f746a370 => generated 62 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:59:22.450402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:22.456570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:22.484921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.486112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.489616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.493195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.500394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.502763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.712981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.738526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.746908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.748348 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67128009-0f32-4a59-b79d-c96a36a7ff32 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.326772 Nov 02 13:59:22.750322 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2328/3380] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:22 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:22.767821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:22.773714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:22.787524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.792102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.792783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.793686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.795308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.796276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:23.071971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:23.094734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c8fd184-4f2e-42b6-9fa8-874c04e3b6ee tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.341229 Nov 02 13:59:23.097060 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2329/3381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:22 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:23.106805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c52bbdca-975e-4b89-9930-2a38c1d66df2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81a060d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:23.262780 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c52bbdca-975e-4b89-9930-2a38c1d66df2 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1409 microversion: 2.1 time: 0.163154 Nov 02 13:59:23.272598 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2330/3382] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:23 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:23.293190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:23.299578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:23.355303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:23.356137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:23.362190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:23.364079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:23.364561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:23.364995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:24.336129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:24.350066 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a657c322-d118-4e9e-a5ad-a5a7de16ff93 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 1.075282 Nov 02 13:59:24.353948 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2331/3383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:23 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:24.395653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-036053dd-5c38-4183-830a-86484a91611b tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81d10dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:24.550596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-036053dd-5c38-4183-830a-86484a91611b tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 200 len: 344 microversion: 2.1 time: 0.188048 Nov 02 13:59:24.551386 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2332/3384] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:59:24 2022] GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:24.570497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:24.573343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:24.597399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:24.597895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:24.598332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:24.599460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:24.599915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:24.604196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:24.829294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:24.847878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:24.849652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:24.856800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-779cd75a-4ab3-43e8-9798-1c2fcf0c2b0d tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.291357 Nov 02 13:59:24.857488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2333/3385] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:24 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:24.885623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:24.886442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:24.896735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:24.897237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:24.897675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:24.898387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:24.898845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:24.903089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:25.205621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:25.222579 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc37dea3-66ea-4ebe-95d8-eeffb9b8ac2e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.361960 Nov 02 13:59:25.225807 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2334/3386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:24 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:25.249860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94a530a9-23f1-463d-8a89-e0abaef6260c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80f09550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:30.481399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94a530a9-23f1-463d-8a89-e0abaef6260c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1418 microversion: 2.1 time: 5.254777 Nov 02 13:59:30.483471 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2335/3387] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:25 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1418 bytes in 5257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:30.498926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:30.508639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:30.524035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=86 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:30.540152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:30.540924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:30.542268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:30.544414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:30.545253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:30.551069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:30.976315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:30.999810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e306fbba-3665-466f-b182-f4d6f6914bc1 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.510558 Nov 02 13:59:31.013220 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2336/3388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:30 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:31.022800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4261dc78-6725-4374-aa90-6e1557ba6b3c req-290af100-85db-4a21-a389-aec6d31ae58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-plugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:31.053430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4261dc78-6725-4374-aa90-6e1557ba6b3c req-290af100-85db-4a21-a389-aec6d31ae58e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.053906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4261dc78-6725-4374-aa90-6e1557ba6b3c req-290af100-85db-4a21-a389-aec6d31ae58e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.067359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4261dc78-6725-4374-aa90-6e1557ba6b3c req-290af100-85db-4a21-a389-aec6d31ae58e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.101432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4261dc78-6725-4374-aa90-6e1557ba6b3c req-290af100-85db-4a21-a389-aec6d31ae58e service nova] Creating event network-vif-plugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 13:59:31.126086 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4261dc78-6725-4374-aa90-6e1557ba6b3c req-290af100-85db-4a21-a389-aec6d31ae58e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114949 Nov 02 13:59:31.136385 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2337/3389] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:31.141753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4b1ee3d-1817-4603-a7aa-c2a5060ff424 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f80f09700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:31.336825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c4b1ee3d-1817-4603-a7aa-c2a5060ff424 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] HTTP exception thrown: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4b1ee3d-1817-4603-a7aa-c2a5060ff424 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Request method failure captured: Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 HTTP/1.1 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnemz_2VM_sBTnXKFbKgdAxh7b2EQqKqfZcoddk6HWuYpEvFJk64HxsbSIJww0MoNc0JU6VQ-T2oYYffOCr7BUalOM7ZRNCRh8z9tEw-hITLXRu8SkeUeXsyHjQL0xOx3ba-enQieGB6hLwd9Q4MY2dA5RI8X8Nq1b9-2-_wREskgKQ Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1c520b807fe74714974c4f4321fc6ce0"}]}] Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1e3fca12aa1f4c778a26dd9f2d4b4b6f Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f25a8760-9c76-42f3-88c7-e51c83318790'} Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. (HTTP 404) (Request-ID: req-42d4197c-1e05-4205-a8a8-9ab02fd456e5) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:59:31.338901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4b1ee3d-1817-4603-a7aa-c2a5060ff424 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Returning 404 to user: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4b1ee3d-1817-4603-a7aa-c2a5060ff424 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 404 len: 109 microversion: 2.1 time: 0.202895 Nov 02 13:59:31.344464 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2338/3390] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:59:31 2022] GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 109 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:31.349575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:31.350002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:31.392627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.396875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.400153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.410879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.426322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.426999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.556612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:31.577372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:31.583250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68a2110734234d558e003a528ee60652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a061e7652b484d27aaf87a4292d768b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:31.585353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c909effb-5706-412d-b44f-00df72905856 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 200 len: 1604 microversion: 2.42 time: 0.242704 Nov 02 13:59:31.586974 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2339/3391] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:31 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:31.601767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:31.604654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:31.614766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.615551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.616360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.617379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.618100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.618682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.623755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:31.861991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:31.886443 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce2424ac-9455-4937-b7dc-298afa853483 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.281406 Nov 02 13:59:31.886443 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2340/3392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:31 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:31.894514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cbfc4168-f77e-40f8-9f2e-9205571a1359 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80eee670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:31.954642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cbfc4168-f77e-40f8-9f2e-9205571a1359 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 200 len: 1418 microversion: 2.1 time: 0.080063 Nov 02 13:59:31.955559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2341/3393] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 13:59:31 2022] GET /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 1418 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:31.960296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f75f1d89-27ca-4e40-a85b-1f6900765f8c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f80f09700>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:32.023415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f75f1d89-27ca-4e40-a85b-1f6900765f8c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] HTTP exception thrown: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f75f1d89-27ca-4e40-a85b-1f6900765f8c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Request method failure captured: Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 HTTP/1.1 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnemz_2VM_sBTnXKFbKgdAxh7b2EQqKqfZcoddk6HWuYpEvFJk64HxsbSIJww0MoNc0JU6VQ-T2oYYffOCr7BUalOM7ZRNCRh8z9tEw-hITLXRu8SkeUeXsyHjQL0xOx3ba-enQieGB6hLwd9Q4MY2dA5RI8X8Nq1b9-2-_wREskgKQ Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1c520b807fe74714974c4f4321fc6ce0"}]}] Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1e3fca12aa1f4c778a26dd9f2d4b4b6f Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f25a8760-9c76-42f3-88c7-e51c83318790'} Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. (HTTP 404) (Request-ID: req-182d26a1-601e-49d4-9921-25f3054cb4ed) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:59:32.025524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f75f1d89-27ca-4e40-a85b-1f6900765f8c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Returning 404 to user: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:32.030582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f75f1d89-27ca-4e40-a85b-1f6900765f8c tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 404 len: 109 microversion: 2.1 time: 0.070584 Nov 02 13:59:32.036842 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2342/3394] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 13:59:31 2022] DELETE /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:32.038013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:32.038936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:32.060057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:32.060527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:32.065378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:32.066371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:32.067007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:32.069418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:32.384512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:32.394465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62987163-b4ce-4c8b-9c8b-32031f56359e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1511 microversion: 2.1 time: 0.362576 Nov 02 13:59:32.408157 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2343/3395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:32 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:32.418505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d7a5d65-540b-4ab6-bd20-7ac479c8eb86 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Calling method '.version_select at 0x7f6f81337430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:32.493997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4d7a5d65-540b-4ab6-bd20-7ac479c8eb86 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] HTTP exception thrown: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d7a5d65-540b-4ab6-bd20-7ac479c8eb86 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Request method failure captured: Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 HTTP/1.1 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnemz_2VM_sBTnXKFbKgdAxh7b2EQqKqfZcoddk6HWuYpEvFJk64HxsbSIJww0MoNc0JU6VQ-T2oYYffOCr7BUalOM7ZRNCRh8z9tEw-hITLXRu8SkeUeXsyHjQL0xOx3ba-enQieGB6hLwd9Q4MY2dA5RI8X8Nq1b9-2-_wREskgKQ Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1c520b807fe74714974c4f4321fc6ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1c520b807fe74714974c4f4321fc6ce0"}]}] Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 1c520b807fe74714974c4f4321fc6ce0 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-4601518 Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1e3fca12aa1f4c778a26dd9f2d4b4b6f Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesSnapshotsTestJSON-4601518-project Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: exception: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f25a8760-9c76-42f3-88c7-e51c83318790'} Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. (HTTP 404) (Request-ID: req-0aa55550-4775-4041-866d-0a06ceb82386) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:59:32.500681 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. Nov 02 13:59:32.505335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:32.513131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d7a5d65-540b-4ab6-bd20-7ac479c8eb86 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] Returning 404 to user: Volume f25a8760-9c76-42f3-88c7-e51c83318790 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:32.514662 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d7a5d65-540b-4ab6-bd20-7ac479c8eb86 tempest-VolumesSnapshotsTestJSON-4601518 tempest-VolumesSnapshotsTestJSON-4601518-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790" status: 404 len: 109 microversion: 2.1 time: 0.104813 Nov 02 13:59:32.516304 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2344/3396] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 13:59:32 2022] GET /compute/v2.1/os-volumes/f25a8760-9c76-42f3-88c7-e51c83318790 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:32.538816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-838851307", "imageRef": "2835a5b9-10a5-4c37-b24a-d4cee0591787", "flavorRef": "452", "networks": [{"uuid": "7e53e086-dd5c-4df9-95b5-9e9382cf5479"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:32.786187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] validate_networks() for [('7e53e086-dd5c-4df9-95b5-9e9382cf5479', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:59:34.706106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:59:34.706973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:59:34.708957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:59:34.709692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:59:34.710554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:59:34.750802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.751363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.751804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.752534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.774463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.775218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.826732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:34.840092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for user 165803256c184acc801878f0cb60cc67 and project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:34.870930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:59:34.873273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2835a5b9-10a5-4c37-b24a-d4cee0591787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:59:34.969206 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e5ff66f-4e1e-4b40-aaa2-9036538b6143 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.450783 Nov 02 13:59:34.976627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2345/3397] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:59:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:59:34.983012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:34.984118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:34.993640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.994433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.995362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.996782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.997530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.998265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:35.017859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] HTTP exception thrown: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Request method failure captured: Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f HTTP/1.1 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYq5oq8Q4xZU05E07ICUvFk2dB1KoPLvy8Sj6bjLHBfGCvHBpMY8_ZziS-0ecJCH9lLtfo8nHQra9V4OWiqjRsn_MOr-8AFfILeocq1VP4dpRZMcitxOKtc5j-tuTju25I4VwRr6EM38EapnyzX2AeVbYjtKOL0YtlgXYm7r-RSRvQ Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a061e7652b484d27aaf87a4292d768b3 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a061e7652b484d27aaf87a4292d768b3"}]}] Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a061e7652b484d27aaf87a4292d768b3 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TaggedBootDevicesTest_v242-559334743-project Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 68a2110734234d558e003a528ee60652 Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TaggedBootDevicesTest_v242-559334743-project Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f'} Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:35.020088 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:35.027877 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:35.030979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Returning 404 to user: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:35.032558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2a1110b-8b40-4fc6-8a4a-b9751961de0e tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 404 len: 111 microversion: 2.42 time: 0.054490 Nov 02 13:59:35.033725 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2346/3398] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:34 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:35.054155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:35.055904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:35.065556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:35.066438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:35.067121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:35.068333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:35.069045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:35.069700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:35.608197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:35.626672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9904c05-4c74-49a2-b6ea-d9c118068fcf tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.590683 Nov 02 13:59:35.632703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2347/3399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:35 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:35.638158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:35.638840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:35.664217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:35.665029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:35.665624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:35.667727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:35.668878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:35.672565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:36.113813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:36.126756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9133a0ad-71ef-4065-ad25-9a86ea852ab9 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1488 microversion: 2.1 time: 0.491009 Nov 02 13:59:36.130503 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2348/3400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:35 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1488 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:36.144682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a7ad792a-dead-4acb-a841-0475ac63cd80 req-f122149e-d883-4bcc-b040-3f1cd5407884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faabbaf3-73f3-44c4-88cf-73a182ad7bc1", "name": "network-vif-unplugged", "status": "completed", "tag": "2fdaa5a4-877c-496b-9b5c-08e91604cf7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:36.170501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a7ad792a-dead-4acb-a841-0475ac63cd80 req-f122149e-d883-4bcc-b040-3f1cd5407884 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:36.171469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a7ad792a-dead-4acb-a841-0475ac63cd80 req-f122149e-d883-4bcc-b040-3f1cd5407884 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:36.172516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a7ad792a-dead-4acb-a841-0475ac63cd80 req-f122149e-d883-4bcc-b040-3f1cd5407884 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:36.193219 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a7ad792a-dead-4acb-a841-0475ac63cd80 req-f122149e-d883-4bcc-b040-3f1cd5407884 service nova] Creating event network-vif-unplugged:2fdaa5a4-877c-496b-9b5c-08e91604cf7f for instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 on n-h2-858238-3 Nov 02 13:59:36.203414 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a7ad792a-dead-4acb-a841-0475ac63cd80 req-f122149e-d883-4bcc-b040-3f1cd5407884 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069618 Nov 02 13:59:36.206551 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2349/3401] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:37.255088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:37.256040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:37.296148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.299740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.304040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.310126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.312598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.313055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.511257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:37.522421 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c66ea0e-a65f-4e1e-92ce-541d7ea34c94 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1259 microversion: 2.1 time: 1.313992 Nov 02 13:59:37.530036 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2350/3402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:36 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1259 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:37.550701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d491d12d-6090-49a8-bd48-1115a2bd22b8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '.version_select at 0x7f6f85f48d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:37.632836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d491d12d-6090-49a8-bd48-1115a2bd22b8 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169287765" status: 204 len: 0 microversion: 2.42 time: 0.101324 Nov 02 13:59:37.643581 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2351/3403] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 13:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169287765 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:59:37.652822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2057113225"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:37.656146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:37.673377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.674213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.675199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.676171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.676802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.677396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.902628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6754fca-801f-4206-b7bd-ecfd07bfe718 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "PUT /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1062 microversion: 2.1 time: 0.256875 Nov 02 13:59:37.904720 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2352/3404] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 13:59:37 2022] PUT /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1062 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:37.920015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:37.920656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:37.942080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.951375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.955004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.960752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.964532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.966598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:38.358398 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:59:38.359016 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 13:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 13:59:38.673913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:38.688824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e5dcff5-b32e-428d-84a1-d48f605ec82f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1511 microversion: 2.1 time: 0.778341 Nov 02 13:59:38.689419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2353/3405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:37 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1511 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:38.694132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:38.694762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:38.729508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:38.729980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:38.730438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:38.731168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:38.731623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:38.732046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:39.816759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:39.854231 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92ffad22-d97e-469e-ab49-6fff1d8adeec tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1489 microversion: 2.1 time: 1.163727 Nov 02 13:59:39.863134 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2354/3406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:38 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1489 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:39.915676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:39.916948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:39.924107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:39.924994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:39.925693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:39.926662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:39.927404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:39.928110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:41.931482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:41.939812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c7937665-8b99-4cf4-8916-04f6a3882580 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1265 microversion: 2.1 time: 2.040663 Nov 02 13:59:41.964436 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2355/3407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:39 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1265 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:41.975542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:41.978440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:41.997810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:42.003584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:42.005117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:42.006505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:42.007438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:42.009844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:42.629107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:42.644395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d4756fe-1f78-4ca1-8167-d923d3e09f4d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1488 microversion: 2.1 time: 0.678713 Nov 02 13:59:42.691609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2356/3408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:41 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1488 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:42.710080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:42.711878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:42.729242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:42.730747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:42.734181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:42.736003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:42.739045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:42.739900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:43.525418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:43.548394 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b8bba5d-0c5b-4ec5-9266-d1e44a576f8d tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1489 microversion: 2.1 time: 0.841292 Nov 02 13:59:43.549546 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2357/3409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:42 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1489 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:43.570085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:43.570085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:43.604760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:43.605261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:43.617428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:43.619550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:43.624468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:43.628440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:43.778354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:59:44.172102 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7c34decd-5d4d-4c23-8257-1b5e85709f85 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 204 len: 0 microversion: 2.1 time: 0.620788 Nov 02 13:59:44.172798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2358/3410] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:59:43 2022] DELETE /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:59:44.195650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:44.197265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:44.240579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:44.241201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:44.241654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:44.252158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:44.252755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:44.253204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:44.800567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:44.852438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:45.983190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:45.995196 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41946e95-d33e-41e8-adcd-e06d52cf2808 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 1.820760 Nov 02 13:59:46.002131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2359/3411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:44 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:46.027049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:46.029195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:46.082506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:46.089935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:46.090897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:46.094302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:46.101917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:46.102600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:46.218473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:46.247291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:59:46.611063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ab1b493-7356-427f-8117-a55488a541c7 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 204 len: 0 microversion: 2.1 time: 0.603729 Nov 02 13:59:46.613996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2360/3412] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:59:46 2022] DELETE /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:59:47.181706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed7f8f21-d0da-4a17-bde1-2f682cb0800e tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Action: 'create', calling method: .version_select at 0x7f6f80fd2c10>, body: {"keypair": {"name": "tempest-keypair-393082435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRi+i2HvHpxSVXSRSJL0wkrTB8K5wgPz7uAcl0+rNNT+FwikA2p5OZxnv2LaZrBCeFYJ10Ja0AQNUnowTKIoG5LOyYV+e0VAp23AwiqJyFXyRDjmgskpBGTskHj7mdirQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:47.248912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-ed7f8f21-d0da-4a17-bde1-2f682cb0800e tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Getting quotas for project 3b85a6df7c1042c1b6b49fe140140cee. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:47.276865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-ed7f8f21-d0da-4a17-bde1-2f682cb0800e tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Getting quotas for user 25403156f6df43ae9791a9d53775aa77 and project 3b85a6df7c1042c1b6b49fe140140cee. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:47.360994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed7f8f21-d0da-4a17-bde1-2f682cb0800e tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.745655 Nov 02 13:59:47.374692 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2361/3413] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 13:59:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:47.384430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:47.385158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:47.424843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:47.425546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:47.426149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:47.427068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:47.427711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:47.439796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.190586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:48.207911 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8643a1f-17c6-4fe5-bf3c-35f13a38789f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 200 len: 1494 microversion: 2.1 time: 0.831403 Nov 02 13:59:48.211372 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2362/3414] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:47 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 1494 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:48.231351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e9d4b9fb-5bee-4ead-9a8b-ac30998a4941 req-fecbaea8-918c-4d6f-9a3a-17851c2f54ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee29ad5-dcea-4b71-ab8e-959031a0842c", "tag": "bd4f7bd2-f953-41aa-9961-40b4b4e926a7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:48.271916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e9d4b9fb-5bee-4ead-9a8b-ac30998a4941 req-fecbaea8-918c-4d6f-9a3a-17851c2f54ba service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.279498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e9d4b9fb-5bee-4ead-9a8b-ac30998a4941 req-fecbaea8-918c-4d6f-9a3a-17851c2f54ba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.280295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e9d4b9fb-5bee-4ead-9a8b-ac30998a4941 req-fecbaea8-918c-4d6f-9a3a-17851c2f54ba service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.363214 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e9d4b9fb-5bee-4ead-9a8b-ac30998a4941 req-fecbaea8-918c-4d6f-9a3a-17851c2f54ba service nova] Creating event network-changed:bd4f7bd2-f953-41aa-9961-40b4b4e926a7 for instance fee29ad5-dcea-4b71-ab8e-959031a0842c on n-h2-858238-3 Nov 02 13:59:48.403664 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e9d4b9fb-5bee-4ead-9a8b-ac30998a4941 req-fecbaea8-918c-4d6f-9a3a-17851c2f54ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190401 Nov 02 13:59:48.408685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2363/3415] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:48.466403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:48.475807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:48.508790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.517315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.517936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.529555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.530051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.530486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:49.888170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:49.899580 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41e063fb-31bf-49d9-b125-ff31cf321041 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1495 microversion: 2.1 time: 1.488809 Nov 02 13:59:49.926678 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2364/3416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:48 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1495 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:49.940564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:49.957579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:49.982886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:49.993588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:50.008682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:50.009800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:50.012438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:50.018038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.553483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:51.574684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f814f2d6-eece-4af5-850a-1b5f481ee99d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 1.645971 Nov 02 13:59:51.577407 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2365/3417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:49 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:51.602121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:51.603910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:51.655949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.658725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.664076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.666393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.667482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.668671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.742311 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 HTTP/1.1 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5'} Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:51.750987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 13:59:51.760975 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:51.763994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:51.765816 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86fca6b6-a166-4474-b12e-9e6bd05446e0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 404 len: 111 microversion: 2.1 time: 0.186874 Nov 02 13:59:51.767415 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2366/3418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:51 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:51.775406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f1bbc0c6-3c45-4df4-808a-7e85cce55cc9 req-eaddc1da-f2c2-4353-a4bd-bced8105a2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5", "name": "network-vif-deleted", "tag": "739d7d43-dde8-4418-b536-7ad691f48958"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:51.794672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f1bbc0c6-3c45-4df4-808a-7e85cce55cc9 req-eaddc1da-f2c2-4353-a4bd-bced8105a2cb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.795602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f1bbc0c6-3c45-4df4-808a-7e85cce55cc9 req-eaddc1da-f2c2-4353-a4bd-bced8105a2cb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.796636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f1bbc0c6-3c45-4df4-808a-7e85cce55cc9 req-eaddc1da-f2c2-4353-a4bd-bced8105a2cb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.832756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f1bbc0c6-3c45-4df4-808a-7e85cce55cc9 req-eaddc1da-f2c2-4353-a4bd-bced8105a2cb service nova] Creating event network-vif-deleted:739d7d43-dde8-4418-b536-7ad691f48958 for instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 on n-h1-858238-3 Nov 02 13:59:51.853362 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f1bbc0c6-3c45-4df4-808a-7e85cce55cc9 req-eaddc1da-f2c2-4353-a4bd-bced8105a2cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083668 Nov 02 13:59:51.862202 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2367/3419] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:51.887034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:51.888662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:51.901663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.903391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.905093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.909008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.910203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.911587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.975813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.979852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.980710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.981537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lazy-loading 'fault' on Instance uuid 5823a8df-506f-437d-a91d-25fc785d86b4 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:59:52.332600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:52.344024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fcfcdba2-7f42-4ee5-92ab-28ce333e7f5b tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 200 len: 1310 microversion: 2.1 time: 0.479575 Nov 02 13:59:52.351290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2368/3420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:51 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 1310 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:52.371204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:52.372121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:52.382668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.386165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.386895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:52.387974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.391279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.392617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:52.432936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] HTTP exception thrown: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Request method failure captured: Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f HTTP/1.1 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYq5oq8Q4xZU05E07ICUvFk2dB1KoPLvy8Sj6bjLHBfGCvHBpMY8_ZziS-0ecJCH9lLtfo8nHQra9V4OWiqjRsn_MOr-8AFfILeocq1VP4dpRZMcitxOKtc5j-tuTju25I4VwRr6EM38EapnyzX2AeVbYjtKOL0YtlgXYm7r-RSRvQ Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a061e7652b484d27aaf87a4292d768b3 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a061e7652b484d27aaf87a4292d768b3"}]}] Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a061e7652b484d27aaf87a4292d768b3 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TaggedBootDevicesTest_v242-559334743-project Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 68a2110734234d558e003a528ee60652 Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TaggedBootDevicesTest_v242-559334743-project Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f'} Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:52.437790 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:52.444504 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:52.449422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Returning 404 to user: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:52.450770 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb8eb211-ff36-42bb-a83d-591ee14ae256 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 404 len: 111 microversion: 2.42 time: 0.097467 Nov 02 13:59:52.452539 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2369/3421] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 13:59:52 2022] DELETE /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:52.470634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:52.483747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:52.503592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:52.506432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.508904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.518619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:52.520416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.521191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.522345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:52.869246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:52.889628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4118fc4-7f5c-4a51-8113-9a33a353a3de tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.421768 Nov 02 13:59:52.893113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2370/3422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:52 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:52.921676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f62adeba-b623-416a-b191-a82b71ac1919 req-3f54d77d-3de7-486d-ad8e-7b838ed65176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5823a8df-506f-437d-a91d-25fc785d86b4", "name": "network-vif-deleted", "tag": "cc0c907c-f19c-4138-8736-112dcec5dfda"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:52.977275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f62adeba-b623-416a-b191-a82b71ac1919 req-3f54d77d-3de7-486d-ad8e-7b838ed65176 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.978320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f62adeba-b623-416a-b191-a82b71ac1919 req-3f54d77d-3de7-486d-ad8e-7b838ed65176 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.978925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f62adeba-b623-416a-b191-a82b71ac1919 req-3f54d77d-3de7-486d-ad8e-7b838ed65176 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:53.013032 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f62adeba-b623-416a-b191-a82b71ac1919 req-3f54d77d-3de7-486d-ad8e-7b838ed65176 service nova] Creating event network-vif-deleted:cc0c907c-f19c-4138-8736-112dcec5dfda for instance 5823a8df-506f-437d-a91d-25fc785d86b4 on n-h1-858238-3 Nov 02 13:59:53.032898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f62adeba-b623-416a-b191-a82b71ac1919 req-3f54d77d-3de7-486d-ad8e-7b838ed65176 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136664 Nov 02 13:59:53.034154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2371/3423] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:53.049170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2056965290", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ed92b811-9416-4e65-ae8b-a456c0ee08d0"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:53.152017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] validate_networks() for [('ed92b811-9416-4e65-ae8b-a456c0ee08d0', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:59:53.831044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:59:53.832158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:59:53.832858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:59:53.833455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:59:53.834130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:59:53.849016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:53.850189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:53.851147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:53.852118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:53.852944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:53.853568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:53.877020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:53.883930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Getting quotas for user af7326d5a5a24263b124c56ee1559d39 and project 5c488935b14d4c5dba47c319dc1e5bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:53.915061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:59:53.917983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:59:53.976526 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15ce2f38-ab18-4e3c-b603-b5f5a9dde0e6 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938590 Nov 02 13:59:53.978122 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2372/3424] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:59:53.983843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:53.985091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] [instance: d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:53.993709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:53.995063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:53.995837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:53.996807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:53.997912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:53.998605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:54.054109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] HTTP exception thrown: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Request method failure captured: Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f HTTP/1.1 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnYq5oq8Q4xZU05E07ICUvFk2dB1KoPLvy8Sj6bjLHBfGCvHBpMY8_ZziS-0ecJCH9lLtfo8nHQra9V4OWiqjRsn_MOr-8AFfILeocq1VP4dpRZMcitxOKtc5j-tuTju25I4VwRr6EM38EapnyzX2AeVbYjtKOL0YtlgXYm7r-RSRvQ Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: a061e7652b484d27aaf87a4292d768b3 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a061e7652b484d27aaf87a4292d768b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a061e7652b484d27aaf87a4292d768b3"}]}] Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: a061e7652b484d27aaf87a4292d768b3 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-559334743 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TaggedBootDevicesTest_v242-559334743-project Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 68a2110734234d558e003a528ee60652 Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TaggedBootDevicesTest_v242-559334743-project Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f'} Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:54.056178 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] Returning 404 to user: Instance d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6348b2c6-3e7e-42d5-ae3f-836cb211ca61 tempest-TaggedBootDevicesTest_v242-559334743 tempest-TaggedBootDevicesTest_v242-559334743-project] 10.222.0.18 "GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f" status: 404 len: 111 microversion: 2.42 time: 0.078125 Nov 02 13:59:54.060866 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2373/3425] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 13:59:53 2022] GET /compute/v2.1/servers/d0d60d2f-9fa7-4b31-a8d3-c2ff2d7ac31f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:54.067084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:54.068703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:54.078413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:54.079993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:54.081367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:54.082726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:54.083511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:54.083989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:54.397043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:54.435920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f3476f0-d71a-407b-ba2a-917a8f0cf951 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 0.373993 Nov 02 13:59:54.437278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2374/3426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:54 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:54.443768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-975101029"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:54.446403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:54.454940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:54.455973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:54.456481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:54.457292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:54.457748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:54.458223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:55.031778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c05cc4d1-b76c-4d89-b45f-372f4085b717 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.592913 Nov 02 13:59:55.033942 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2375/3427] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 13:59:54 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 13:59:55.050383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:55.051085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:55.079983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:55.080485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:55.080922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:55.081654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:55.082090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:55.082511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:55.165422 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 HTTP/1.1 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5823a8df-506f-437d-a91d-25fc785d86b4'} Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:55.178855 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:55.197624 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:55.199346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:55.200274 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7449a6c8-c2aa-4ed1-9420-d2472eef170c tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 404 len: 111 microversion: 2.1 time: 0.163025 Nov 02 13:59:55.201094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2376/3428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:55 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:55.213620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-33e7b6e9-078a-4da1-a6ec-b23d99f41068 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:55.214232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-33e7b6e9-078a-4da1-a6ec-b23d99f41068 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:55.387875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33e7b6e9-078a-4da1-a6ec-b23d99f41068 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:55.398091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-33e7b6e9-078a-4da1-a6ec-b23d99f41068 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1215 microversion: 2.1 time: 0.196407 Nov 02 13:59:55.403701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2377/3429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:55 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:55.429939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1503151700", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dc757b26-4628-45f3-909a-901caa737b32"}], "security_groups": [{"name": "tempest-securitygroup--1340647260"}], "key_name": "tempest-keypair-393082435", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:55.820346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] validate_networks() for [('dc757b26-4628-45f3-909a-901caa737b32', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:59:57.777253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Getting quotas for project 3b85a6df7c1042c1b6b49fe140140cee. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:57.793481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Getting quotas for user 25403156f6df43ae9791a9d53775aa77 and project 3b85a6df7c1042c1b6b49fe140140cee. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:57.916653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:59:57.917104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:59:57.917599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:59:57.918021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:59:57.918447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:59:57.972783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:57.973498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:57.973968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:57.977830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:57.979548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:57.980032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:58.065869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Getting quotas for project 3b85a6df7c1042c1b6b49fe140140cee. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:58.091300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Getting quotas for user 25403156f6df43ae9791a9d53775aa77 and project 3b85a6df7c1042c1b6b49fe140140cee. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:58.158729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:59:58.163873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:59:58.267434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2e7b24d-37b1-4828-838a-f8059d5b01d1 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.851375 Nov 02 13:59:58.287128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2378/3430] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 13:59:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:59:58.308189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:58.316758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:58.345632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:58.347213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:58.347868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:58.351384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:58.352086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:58.352684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:58.417243 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 HTTP/1.1 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5823a8df-506f-437d-a91d-25fc785d86b4'} Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:58.419772 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 13:59:58.428240 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 13:59:58.431784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:58.438609 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7592469e-7de2-4a31-9ff2-4211a13d125f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 404 len: 111 microversion: 2.1 time: 0.142805 Nov 02 13:59:58.439999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2379/3431] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 13:59:58 2022] DELETE /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:58.458556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:58.461848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:58.484526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:58.489686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:58.491924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:58.492804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:58.497751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:58.498224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:59.391978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:59.408433 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c61c89d9-0c2f-427a-b4e8-5ac4dfd85854 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 0.965108 Nov 02 13:59:59.431124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2380/3432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:58 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:59.433600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-fc90edb8-c3e7-411a-ae93-1f928c357372 req-1c669d46-fcbe-462f-8631-4e705968dfdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:59.477066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc90edb8-c3e7-411a-ae93-1f928c357372 req-1c669d46-fcbe-462f-8631-4e705968dfdd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:59.479331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc90edb8-c3e7-411a-ae93-1f928c357372 req-1c669d46-fcbe-462f-8631-4e705968dfdd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:59.480068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc90edb8-c3e7-411a-ae93-1f928c357372 req-1c669d46-fcbe-462f-8631-4e705968dfdd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:59.524838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fc90edb8-c3e7-411a-ae93-1f928c357372 req-1c669d46-fcbe-462f-8631-4e705968dfdd service nova] Creating event network-vif-unplugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 13:59:59.552764 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-fc90edb8-c3e7-411a-ae93-1f928c357372 req-1c669d46-fcbe-462f-8631-4e705968dfdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118993 Nov 02 13:59:59.557952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2381/3433] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 13:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:59.577347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:59.578242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:59.634836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:59.642362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:59.645956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:59.656721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:59.657326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:59.669759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:00.947456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:00.957546 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9aeeac7-9fff-4459-869d-b391c1ebbb6c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1315 microversion: 2.1 time: 1.393615 Nov 02 14:00:00.971595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2382/3434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 13:59:59 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1315 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:00.979391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:00.980344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:00.986373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:00.986857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:00.987355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:00.988480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:00.989102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:00.989696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:00.994368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:01.228242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:01.253347 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee68225b-6d1d-4612-8897-40354383668f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1265 microversion: 2.1 time: 0.279055 Nov 02 14:00:01.254240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2383/3435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:00 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:01.259803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:01.260711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 5823a8df-506f-437d-a91d-25fc785d86b4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:01.268636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:01.269489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:01.270207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:01.275934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:01.276732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:01.277524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:01.295477 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 HTTP/1.1 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5823a8df-506f-437d-a91d-25fc785d86b4'} Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:01.297258 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. Nov 02 14:00:01.302993 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:01.304835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 5823a8df-506f-437d-a91d-25fc785d86b4 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:01.306207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5ec7bca-8fc3-4bc8-a164-2ff2a67d811f tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4" status: 404 len: 111 microversion: 2.1 time: 0.050551 Nov 02 14:00:01.307086 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2384/3436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:01 2022] GET /compute/v2.1/servers/5823a8df-506f-437d-a91d-25fc785d86b4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:01.312431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:01.313478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:01.320833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:01.321734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:01.322439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:01.323429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:01.324122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:01.324781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:01.863138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:01.908160 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98bd951a-5cf3-46db-96d5-c21aff3d2919 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 0.598491 Nov 02 14:00:01.912424 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2385/3437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:01 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:01.927604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:01.928113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:01.976207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:01.978484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:01.979246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:01.980171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:01.986457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:01.993287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:02.048787 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 HTTP/1.1 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'afa9be90-bb3f-4bcd-96e6-92a85c290df0'} Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:02.059438 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:02.064963 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:02.069074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:02.073156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-25974cc9-38ca-4240-a9a0-3802ac2ae2a8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 404 len: 111 microversion: 2.1 time: 0.157060 Nov 02 14:00:02.076514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2386/3438] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:01 2022] DELETE /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:02.094337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-091b58f5-59a1-4d8a-913b-2897b97d0dc4 req-647af14e-8b3d-4e4a-8bb0-fd3192e45608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-plugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:02.134206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-091b58f5-59a1-4d8a-913b-2897b97d0dc4 req-647af14e-8b3d-4e4a-8bb0-fd3192e45608 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:02.134688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-091b58f5-59a1-4d8a-913b-2897b97d0dc4 req-647af14e-8b3d-4e4a-8bb0-fd3192e45608 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:02.135134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-091b58f5-59a1-4d8a-913b-2897b97d0dc4 req-647af14e-8b3d-4e4a-8bb0-fd3192e45608 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:02.214373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-091b58f5-59a1-4d8a-913b-2897b97d0dc4 req-647af14e-8b3d-4e4a-8bb0-fd3192e45608 service nova] Creating event network-vif-plugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 14:00:02.244910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-091b58f5-59a1-4d8a-913b-2897b97d0dc4 req-647af14e-8b3d-4e4a-8bb0-fd3192e45608 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157587 Nov 02 14:00:02.250391 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2387/3439] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:02.278390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:02.287943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:02.303889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:02.307035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:02.307555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:02.309733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:02.313537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:02.314026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:02.980163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:03.005430 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8c7c1d3-9a15-4482-a911-c42c974d81dc tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1315 microversion: 2.1 time: 0.751682 Nov 02 14:00:03.006839 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2388/3440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:02 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:03.019657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:03.020770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: afa9be90-bb3f-4bcd-96e6-92a85c290df0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:03.033462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:03.036341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:03.038413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:03.040963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:03.041761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:03.043730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:03.088034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 HTTP/1.1 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'afa9be90-bb3f-4bcd-96e6-92a85c290df0'} Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:03.094569 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance afa9be90-bb3f-4bcd-96e6-92a85c290df0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:03.099460 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1275135f-559d-4302-9c69-e06664bb77b2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0" status: 404 len: 111 microversion: 2.1 time: 0.089022 Nov 02 14:00:03.100452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2389/3441] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:03 2022] GET /compute/v2.1/servers/afa9be90-bb3f-4bcd-96e6-92a85c290df0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:03.124380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:03.127429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:03.149771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:03.153170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:03.155036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:03.157641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:03.159800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:03.161634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:03.466513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:03.488165 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-27a70199-4798-4bbf-9ac5-b5464977c7ea tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1327 microversion: 2.1 time: 0.381417 Nov 02 14:00:03.490449 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2390/3442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:03 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1327 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:03.499481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:03.500098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:03.531648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:03.532187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:03.532619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:03.533329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:03.533776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:03.543720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.266862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:04.305519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6dec91ba-09ab-4be5-be44-24ee4b02783f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 0.803269 Nov 02 14:00:04.320281 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2391/3443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:03 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:04.338654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e5b0ee06-ffde-49f9-929d-541523a53512 req-87fcf725-0bec-4470-90dc-e36e77a0ceca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c643a278-7f32-4259-a914-83e9b8aa8195", "tag": "de9f9883-67da-4a54-9326-3211b79f59b5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:04.376281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e5b0ee06-ffde-49f9-929d-541523a53512 req-87fcf725-0bec-4470-90dc-e36e77a0ceca service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.385761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e5b0ee06-ffde-49f9-929d-541523a53512 req-87fcf725-0bec-4470-90dc-e36e77a0ceca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.388883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e5b0ee06-ffde-49f9-929d-541523a53512 req-87fcf725-0bec-4470-90dc-e36e77a0ceca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.424709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e5b0ee06-ffde-49f9-929d-541523a53512 req-87fcf725-0bec-4470-90dc-e36e77a0ceca service nova] Creating event network-changed:de9f9883-67da-4a54-9326-3211b79f59b5 for instance c643a278-7f32-4259-a914-83e9b8aa8195 on n-h1-858238-3 Nov 02 14:00:04.440216 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e5b0ee06-ffde-49f9-929d-541523a53512 req-87fcf725-0bec-4470-90dc-e36e77a0ceca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111928 Nov 02 14:00:04.441256 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2392/3444] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:04.455733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:04.460033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:04.488715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.489864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.492240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.493433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.500238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.501771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.534606 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 HTTP/1.1 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7bb483c5-671e-47e1-a125-a0fb95e7f084'} Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:04.536583 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:04.541592 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:04.545266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:04.546498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a30e1af1-039d-4325-9af8-c531fc3bfcdd tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 404 len: 111 microversion: 2.1 time: 0.103843 Nov 02 14:00:04.547699 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2393/3445] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:04 2022] DELETE /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:04.553038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:04.555400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:04.566241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.568728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.569464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.570442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.571163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.571841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:05.683833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:05.695439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22f73cfb-bfeb-4d53-a821-a92d04b4ecf1 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1315 microversion: 2.1 time: 1.146372 Nov 02 14:00:05.699813 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2394/3446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:04 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:05.710094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:05.714082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:05.732320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:05.735633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:05.742410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:05.743677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:05.745993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:05.746688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:06.504062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:06.512651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6356ff28-92cf-44a1-aebc-2e5d1f4feac2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1395 microversion: 2.1 time: 0.808344 Nov 02 14:00:06.513240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2395/3447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:05 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1395 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:06.565122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:06.565773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 7bb483c5-671e-47e1-a125-a0fb95e7f084] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:06.586422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:06.586927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:06.587395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:06.588136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:06.588589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:06.589009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:06.629876 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 HTTP/1.1 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7bb483c5-671e-47e1-a125-a0fb95e7f084'} Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:06.637333 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:06.642158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 7bb483c5-671e-47e1-a125-a0fb95e7f084 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:06.642750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cae0e4fe-8bc8-458b-a01f-fbab0e056788 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084" status: 404 len: 111 microversion: 2.1 time: 0.101262 Nov 02 14:00:06.642991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2396/3448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:06 2022] GET /compute/v2.1/servers/7bb483c5-671e-47e1-a125-a0fb95e7f084 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:06.658990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:06.661948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:06.675292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:06.676426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:06.687643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:06.689894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:06.690547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:06.691199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.167587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:07.183705 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9de27362-e184-4186-92fa-3fb56287c416 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 0.527768 Nov 02 14:00:07.184738 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2397/3449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:06 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:07.189670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a945b057-4b0e-472e-87d8-52119e636822 req-d23cbc1b-98ec-48e8-8a1c-9a2768143448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a7836cc-97f0-43f9-9e7b-427a3b67f31c", "tag": "1b04e04f-9cda-43a3-a28e-60ee00140537"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:07.217305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a945b057-4b0e-472e-87d8-52119e636822 req-d23cbc1b-98ec-48e8-8a1c-9a2768143448 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.232769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a945b057-4b0e-472e-87d8-52119e636822 req-d23cbc1b-98ec-48e8-8a1c-9a2768143448 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.233677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a945b057-4b0e-472e-87d8-52119e636822 req-d23cbc1b-98ec-48e8-8a1c-9a2768143448 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.271726 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a945b057-4b0e-472e-87d8-52119e636822 req-d23cbc1b-98ec-48e8-8a1c-9a2768143448 service nova] Creating event network-changed:1b04e04f-9cda-43a3-a28e-60ee00140537 for instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c on n-h1-858238-3 Nov 02 14:00:07.284561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a945b057-4b0e-472e-87d8-52119e636822 req-d23cbc1b-98ec-48e8-8a1c-9a2768143448 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098287 Nov 02 14:00:07.286544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2398/3450] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:07.294100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cb7d4360-ff09-4613-8865-b9b2cf5ac4ec req-fcfa8321-91e9-4a4c-aa09-1af8d5df6a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee29ad5-dcea-4b71-ab8e-959031a0842c", "name": "network-vif-plugged", "status": "completed", "tag": "bd4f7bd2-f953-41aa-9961-40b4b4e926a7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:07.308919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb7d4360-ff09-4613-8865-b9b2cf5ac4ec req-fcfa8321-91e9-4a4c-aa09-1af8d5df6a41 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.309842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb7d4360-ff09-4613-8865-b9b2cf5ac4ec req-fcfa8321-91e9-4a4c-aa09-1af8d5df6a41 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.310923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb7d4360-ff09-4613-8865-b9b2cf5ac4ec req-fcfa8321-91e9-4a4c-aa09-1af8d5df6a41 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.343541 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cb7d4360-ff09-4613-8865-b9b2cf5ac4ec req-fcfa8321-91e9-4a4c-aa09-1af8d5df6a41 service nova] Creating event network-vif-plugged:bd4f7bd2-f953-41aa-9961-40b4b4e926a7 for instance fee29ad5-dcea-4b71-ab8e-959031a0842c on n-h2-858238-3 Nov 02 14:00:07.350808 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cb7d4360-ff09-4613-8865-b9b2cf5ac4ec req-fcfa8321-91e9-4a4c-aa09-1af8d5df6a41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061725 Nov 02 14:00:07.351888 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2399/3451] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:07.393416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:07.396308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:07.429886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:07.439924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.444983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.449012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.454990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.465643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.469971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.533893 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 HTTP/1.1 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ace70082-6a39-497a-a4be-05b1ca885614'} Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:07.537341 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:07.542342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:07.545893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:07.546810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a848dffe-0ada-4288-972b-bc9778c35997 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 404 len: 111 microversion: 2.1 time: 0.193580 Nov 02 14:00:07.548724 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2400/3452] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:07 2022] DELETE /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:07.554492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:07.555148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:07.562941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.564305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.564987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.565934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.566800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.567598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.993026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:08.002774 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61690f19-0f18-48fd-873a-7ddc0e5b1b4f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1315 microversion: 2.1 time: 0.452964 Nov 02 14:00:08.015541 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2401/3453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:07 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:08.023703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:08.024321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:08.026448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:08.035055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.036049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.036675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.037582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.038226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.038840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.166446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=22 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:08.448989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:08.459033 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d1783f2-7c7d-441a-b605-acef74e16833 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1395 microversion: 2.1 time: 0.442285 Nov 02 14:00:08.558525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2402/3454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:08 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1395 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:08.558525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:08.558525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: ace70082-6a39-497a-a4be-05b1ca885614] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:08.561012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.565134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.565826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.566968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.567702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.568542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.659928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 HTTP/1.1 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ace70082-6a39-497a-a4be-05b1ca885614'} Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:08.661516 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance ace70082-6a39-497a-a4be-05b1ca885614 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:08.666537 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3374f4d-ea3f-43cc-9a85-3551e3ec6eab tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614" status: 404 len: 111 microversion: 2.1 time: 0.187785 Nov 02 14:00:08.682898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2403/3455] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:08 2022] GET /compute/v2.1/servers/ace70082-6a39-497a-a4be-05b1ca885614 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:08.688239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:08.688914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:08.707808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.708759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.709295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.710427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.711164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.712311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:09.129993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:09.140834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c34f591f-5788-4331-90a6-ff86b9bdf437 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1307 microversion: 2.1 time: 0.456555 Nov 02 14:00:09.147872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2404/3456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:08 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:09.160680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:09.175086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:09.197694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:09.205685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:09.213041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:09.217200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:09.223131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:09.224718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:09.273633 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 HTTP/1.1 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3dc30ecf-e7bb-412c-b46a-742ad67a1820'} Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:09.280903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:09.285748 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:09.301036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:09.302443 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fdb4e65-ba71-4b69-82c4-28e0ea4b10c2 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 404 len: 111 microversion: 2.1 time: 0.153042 Nov 02 14:00:09.306977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2405/3457] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:09 2022] DELETE /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:09.314173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:09.315610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:09.334565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:09.338504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:09.339441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:09.341614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:09.343398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:09.344140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.160222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:10.169105 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55a3649e-4c69-4f3a-a344-ce95be29d4e4 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1315 microversion: 2.1 time: 0.860575 Nov 02 14:00:10.197876 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2406/3458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:09 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:10.203369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:10.204817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 3dc30ecf-e7bb-412c-b46a-742ad67a1820] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:10.221558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.222317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.222966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.223904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.224373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.224804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.258109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 HTTP/1.1 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3dc30ecf-e7bb-412c-b46a-742ad67a1820'} Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:10.260067 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. Nov 02 14:00:10.267036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:10.268731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 3dc30ecf-e7bb-412c-b46a-742ad67a1820 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:10.269838 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-748f9b62-9fb3-48d8-a0a5-99bfc0a039b8 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820" status: 404 len: 111 microversion: 2.1 time: 0.070606 Nov 02 14:00:10.270943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2407/3459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:10 2022] GET /compute/v2.1/servers/3dc30ecf-e7bb-412c-b46a-742ad67a1820 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:10.277599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:10.297125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:10.320916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.323251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.324130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.325096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.326005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.328233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.432011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:10.941716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:10.956420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cd319d1-554c-422b-8060-debcdb429443 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1395 microversion: 2.1 time: 0.684112 Nov 02 14:00:10.957338 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2408/3460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:10 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1395 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:10.971514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:10.972571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:10.987559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.988437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.989124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.990630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.991338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.992023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:11.951526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:11.973266 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2c8e71f-e348-4a0c-8057-1337ba991c14 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1486 microversion: 2.1 time: 1.012930 Nov 02 14:00:11.973868 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2409/3461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:10 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1486 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:11.992627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:11.997271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:12.016911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.017724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.018481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.019449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.020076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.020722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.057203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 HTTP/1.1 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'aa8a7b0f-3adb-4756-adcd-73c1a8765e94'} Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:12.065515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:12.072163 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:12.075983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:12.080693 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0c52858-cd96-4a5b-beca-de62aa42f303 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 404 len: 111 microversion: 2.1 time: 0.100531 Nov 02 14:00:12.083487 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2410/3462] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:11 2022] DELETE /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:12.098228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-df8a755a-cf3d-4836-8de9-17345115b19d req-48023bda-8723-497e-b276-94d55f3b7cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c643a278-7f32-4259-a914-83e9b8aa8195", "name": "network-vif-plugged", "status": "completed", "tag": "de9f9883-67da-4a54-9326-3211b79f59b5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:12.134276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-df8a755a-cf3d-4836-8de9-17345115b19d req-48023bda-8723-497e-b276-94d55f3b7cc6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.135268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-df8a755a-cf3d-4836-8de9-17345115b19d req-48023bda-8723-497e-b276-94d55f3b7cc6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.135889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-df8a755a-cf3d-4836-8de9-17345115b19d req-48023bda-8723-497e-b276-94d55f3b7cc6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.172277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-df8a755a-cf3d-4836-8de9-17345115b19d req-48023bda-8723-497e-b276-94d55f3b7cc6 service nova] Creating event network-vif-plugged:de9f9883-67da-4a54-9326-3211b79f59b5 for instance c643a278-7f32-4259-a914-83e9b8aa8195 on n-h1-858238-3 Nov 02 14:00:12.193277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-df8a755a-cf3d-4836-8de9-17345115b19d req-48023bda-8723-497e-b276-94d55f3b7cc6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098262 Nov 02 14:00:12.200620 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2411/3463] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:12.220994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:12.222772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:12.246828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.253173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.255657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.256725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.257194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.273327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.622389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:12.638573 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4eeced7b-3a52-485a-b601-0392ba48a23f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1315 microversion: 2.1 time: 0.429702 Nov 02 14:00:12.639258 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2412/3464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:12 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:12.682254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:12.682877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:12.713572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.714037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.714480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.722288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.723226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.726300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.998192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:13.018117 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9df3956-3042-4a10-9c07-df6a098483c2 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1395 microversion: 2.1 time: 0.374615 Nov 02 14:00:13.026643 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2413/3465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:12 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1395 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:13.031545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:13.032088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:13.057104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.057613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.058186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.058753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.077534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.079066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.136527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:13.301966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c1a903f-96f4-494b-ac63-074289787897 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 204 len: 0 microversion: 2.1 time: 0.273180 Nov 02 14:00:13.307556 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2414/3466] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:13 2022] DELETE /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:13.316472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:13.317728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: aa8a7b0f-3adb-4756-adcd-73c1a8765e94] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:13.325920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.326794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.327450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.328464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.329470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.330234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.362728 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 HTTP/1.1 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'aa8a7b0f-3adb-4756-adcd-73c1a8765e94'} Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:13.367733 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance aa8a7b0f-3adb-4756-adcd-73c1a8765e94 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-069040e3-7c44-42d8-8a21-9835f39a4714 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94" status: 404 len: 111 microversion: 2.1 time: 0.060777 Nov 02 14:00:13.373508 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2415/3467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:13 2022] GET /compute/v2.1/servers/aa8a7b0f-3adb-4756-adcd-73c1a8765e94 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:13.382761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:13.383788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:13.394343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.395164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.395780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.397374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.398011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.398883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.781827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:13.810624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be203aca-db42-48c0-91bb-532689e254cc tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1492 microversion: 2.1 time: 0.433846 Nov 02 14:00:13.829523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2416/3468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:13 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1492 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:13.855819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:13.857898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:13.881273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.887906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.889047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.892692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.894311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.895815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.933109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 HTTP/1.1 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '31c823a6-b44f-427b-88cd-c2f82f438391'} Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:13.935340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:13.940941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:13.944940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:13.947511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac817013-ac4c-4d86-bbdd-ed725cf89124 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 404 len: 111 microversion: 2.1 time: 0.116423 Nov 02 14:00:13.950004 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2417/3469] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:13 2022] DELETE /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:13.979557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:13.984714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:13.996401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.998778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.000152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.002490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:14.004104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.005567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.330820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:14.345483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc754b2b-3ac1-49da-b9e0-240a41833ea3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1502 microversion: 2.1 time: 0.392321 Nov 02 14:00:14.347173 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2418/3470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:13 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:14.352064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:14.359928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 31c823a6-b44f-427b-88cd-c2f82f438391] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:14.373372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:14.374032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.374584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.375471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:14.376630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.387749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.432279 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 HTTP/1.1 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '31c823a6-b44f-427b-88cd-c2f82f438391'} Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:14.434828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 31c823a6-b44f-427b-88cd-c2f82f438391 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ae914fd-a935-4edc-932a-e926930f76ac tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391" status: 404 len: 111 microversion: 2.1 time: 0.088187 Nov 02 14:00:14.444709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2419/3471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:14 2022] GET /compute/v2.1/servers/31c823a6-b44f-427b-88cd-c2f82f438391 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:14.451836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:14.452942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:14.472791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:14.477884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.478489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.479395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:14.479989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.481454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.881215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:14.915385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe5d08ef-a928-477e-a5cb-20d053503e7f tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1395 microversion: 2.1 time: 0.476825 Nov 02 14:00:14.916801 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2420/3472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:14 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1395 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:14.925010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9c69e259-a1d6-4475-9616-5ab266f77d7a req-a5009693-8450-4316-8d9a-8f92746568f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7836cc-97f0-43f9-9e7b-427a3b67f31c", "name": "network-vif-plugged", "status": "completed", "tag": "1b04e04f-9cda-43a3-a28e-60ee00140537"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:15.007699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9c69e259-a1d6-4475-9616-5ab266f77d7a req-a5009693-8450-4316-8d9a-8f92746568f6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.011437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9c69e259-a1d6-4475-9616-5ab266f77d7a req-a5009693-8450-4316-8d9a-8f92746568f6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.011967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9c69e259-a1d6-4475-9616-5ab266f77d7a req-a5009693-8450-4316-8d9a-8f92746568f6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.024546 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9c69e259-a1d6-4475-9616-5ab266f77d7a req-a5009693-8450-4316-8d9a-8f92746568f6 service nova] Creating event network-vif-plugged:1b04e04f-9cda-43a3-a28e-60ee00140537 for instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c on n-h1-858238-3 Nov 02 14:00:15.031655 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9c69e259-a1d6-4475-9616-5ab266f77d7a req-a5009693-8450-4316-8d9a-8f92746568f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112633 Nov 02 14:00:15.033496 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2421/3473] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:15.041527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:15.042511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:15.050454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.051346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.051983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.052959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.053616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.054242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.094051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lazy-loading 'flavor' on Instance uuid c643a278-7f32-4259-a914-83e9b8aa8195 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:00:15.265162 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bca2da87-b1ce-42dc-bd44-bb1da8a7c05c tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "POST /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195/action" status: 202 len: 0 microversion: 2.1 time: 0.229424 Nov 02 14:00:15.278939 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2422/3474] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:00:15 2022] POST /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:00:15.313054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:15.316518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:15.333669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.338831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.339724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.340696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.341388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.342116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.402828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:15.570657 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6dd2e158-d78e-4297-8c6a-e801c16eb941 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 204 len: 0 microversion: 2.1 time: 0.273643 Nov 02 14:00:15.573160 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2423/3475] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:15 2022] DELETE /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:15.581604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:15.583398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:15.590735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.591878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.592648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.594132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.595489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.596285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.629917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:16.443882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:16.453051 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-013e2cf3-18e4-40ee-b8b8-114e74a2915b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1492 microversion: 2.1 time: 0.878294 Nov 02 14:00:16.457807 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2424/3476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:15 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1492 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:16.468017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:16.470931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:16.486765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.489772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.493763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.495227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.495893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.496603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.947298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:16.966513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-89af6cf8-cb3a-47ea-aadd-195c736c3b37 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1493 microversion: 2.1 time: 0.507286 Nov 02 14:00:16.967551 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2425/3477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:16 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1493 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:16.975557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:16.976440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:16.983650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.984459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.985910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.986901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.987667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.988485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.408728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:17.417816 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-303310ec-bd6c-416b-9ac6-aaeebf48c985 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1481 microversion: 2.1 time: 0.448866 Nov 02 14:00:17.422205 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2426/3478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:16 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1481 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:17.436241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:17.436867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:17.446643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.447943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.448664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.450049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.450687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.451316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.770405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:17.782937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1898b808-5966-46dc-be14-eeb4470f4373 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1395 microversion: 2.1 time: 0.359439 Nov 02 14:00:17.796744 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2427/3479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:17 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1395 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:17.809359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:17.810153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:17.818095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.818841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.819481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.820368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.820982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.821567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.859661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:18.054711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94ff3fbe-d0cc-407d-8587-7ac64b1dd480 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 204 len: 0 microversion: 2.1 time: 0.254797 Nov 02 14:00:18.057189 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2428/3480] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:17 2022] DELETE /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:18.080807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-93b2f4d8-77d0-4a69-9012-5c3362d6351c req-54900aca-5a44-427f-aeca-c06d606129ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2484fac4-a923-4c3a-870c-0acfc7e9f715", "name": "network-vif-deleted", "tag": "036fa077-dddc-42a0-b34a-402097028dce"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:18.114687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-93b2f4d8-77d0-4a69-9012-5c3362d6351c req-54900aca-5a44-427f-aeca-c06d606129ce service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.116790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-93b2f4d8-77d0-4a69-9012-5c3362d6351c req-54900aca-5a44-427f-aeca-c06d606129ce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.117241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-93b2f4d8-77d0-4a69-9012-5c3362d6351c req-54900aca-5a44-427f-aeca-c06d606129ce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.161069 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-93b2f4d8-77d0-4a69-9012-5c3362d6351c req-54900aca-5a44-427f-aeca-c06d606129ce service nova] Creating event network-vif-deleted:036fa077-dddc-42a0-b34a-402097028dce for instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 on n-h1-858238-3 Nov 02 14:00:18.176566 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-93b2f4d8-77d0-4a69-9012-5c3362d6351c req-54900aca-5a44-427f-aeca-c06d606129ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111943 Nov 02 14:00:18.179331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2429/3481] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:18.193826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6a55efcb-81da-46ef-a290-09f9364f0047 req-1464a9a5-93be-4107-b1a4-7ad2797dcafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee29ad5-dcea-4b71-ab8e-959031a0842c", "name": "network-vif-deleted", "tag": "bd4f7bd2-f953-41aa-9961-40b4b4e926a7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:18.210234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6a55efcb-81da-46ef-a290-09f9364f0047 req-1464a9a5-93be-4107-b1a4-7ad2797dcafe service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.210883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6a55efcb-81da-46ef-a290-09f9364f0047 req-1464a9a5-93be-4107-b1a4-7ad2797dcafe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.211686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6a55efcb-81da-46ef-a290-09f9364f0047 req-1464a9a5-93be-4107-b1a4-7ad2797dcafe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.227200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6a55efcb-81da-46ef-a290-09f9364f0047 req-1464a9a5-93be-4107-b1a4-7ad2797dcafe service nova] Creating event network-vif-deleted:bd4f7bd2-f953-41aa-9961-40b4b4e926a7 for instance fee29ad5-dcea-4b71-ab8e-959031a0842c on n-h2-858238-3 Nov 02 14:00:18.234754 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6a55efcb-81da-46ef-a290-09f9364f0047 req-1464a9a5-93be-4107-b1a4-7ad2797dcafe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053586 Nov 02 14:00:18.236291 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2430/3482] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:18.244983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:18.244983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:18.252320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.253320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.253873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.254753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.255386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.255909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.332952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.335776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.336786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.337584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lazy-loading 'fault' on Instance uuid fee29ad5-dcea-4b71-ab8e-959031a0842c {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:00:18.422150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:18.441468 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48606864-001e-4f19-b08c-a5ff25de8924 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 200 len: 1297 microversion: 2.1 time: 0.203699 Nov 02 14:00:18.442680 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2431/3483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:18 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:18.473544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:18.475061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:18.493170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.493596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.494143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.494737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.495512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.495921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.885603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:18.901312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b25e98c4-8e76-4ee6-af76-5af57deec9d3 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1499 microversion: 2.1 time: 0.436853 Nov 02 14:00:18.902578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2432/3484] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:18 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1499 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:18.914594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:18.915494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:18.940381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.941189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.942156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.943250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.943893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.945067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.997352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.997903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.998496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.999152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lazy-loading 'fault' on Instance uuid 2484fac4-a923-4c3a-870c-0acfc7e9f715 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:00:19.104756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83d5a681892401eaeb2cf03015aaf67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c416c213c49ceb0c946bd8ca232fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:19.117830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71000d80-8f95-4e4a-969e-faa9ca404050 tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 200 len: 1283 microversion: 2.1 time: 0.213146 Nov 02 14:00:19.119155 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2433/3485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:18 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:19.137436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:19.138195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:19.145961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.146526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.147034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.148086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.148741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.149218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.771954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:19.783906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-903124ec-3178-416c-96a8-ab1811175b00 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1575 microversion: 2.1 time: 0.661655 Nov 02 14:00:19.796935 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2434/3486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:19 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1575 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:19.819052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:19.819720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:19.836505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.837491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.838218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.839288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.839757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.840186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.896567 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c HTTP/1.1 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fee29ad5-dcea-4b71-ab8e-959031a0842c'} Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.899384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-719cec07-eae9-485f-b318-65f670fc0168 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 404 len: 111 microversion: 2.1 time: 0.101733 Nov 02 14:00:19.905883 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2435/3487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:19 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:19.942299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:19.942821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:19.962998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.966589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.968715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.969485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.972640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.973084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:20.111011 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a15a753-f282-46b2-81d8-d4d0ab97d3e8 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205955 Nov 02 14:00:20.120710 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2436/3488] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:00:19 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:20.126402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59943263-af2d-4fb6-b248-c4fadeb7d234 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f81358040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:22.489036 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59943263-af2d-4fb6-b248-c4fadeb7d234 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 204 len: 0 microversion: 2.1 time: 2.367071 Nov 02 14:00:22.493666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2437/3489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:20 2022] DELETE /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 0 bytes in 2372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:22.501916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:22.502826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:22.525022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.525573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.527797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.530276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.538765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.540252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.630425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.632946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.633599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.634230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lazy-loading 'fault' on Instance uuid c643a278-7f32-4259-a914-83e9b8aa8195 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:00:22.876811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7326d5a5a24263b124c56ee1559d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c488935b14d4c5dba47c319dc1e5bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:22.887217 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5b50457f-770e-422d-9c68-b088f54c035e tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 200 len: 1305 microversion: 2.1 time: 0.392039 Nov 02 14:00:22.888488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2438/3490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:22 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 1305 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:22.894563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:22.895800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] [instance: 2484fac4-a923-4c3a-870c-0acfc7e9f715] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:22.904911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:22.908814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.909538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.910157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.911037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.912249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.912913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.942779 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] HTTP exception thrown: Instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 could not be found. Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Request method failure captured: Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 HTTP/1.1 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZscCwQ_7qOYMgDgsFQDx-3DE3YuiU9MVZvV4YUlkvb0JEwy6TXe76ySS3YqwLxMjpmhAA1p5_L8ky9a8RU0uNutscTASIzT6aXsCNe5foD6SJCbO2t0n7Q_3j9aSBaIM2qvjCXVIBRIEuBv01-h3KoCnJgx4qRNWc0O9DGyKY1eWQ Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b7c416c213c49ceb0c946bd8ca232fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b7c416c213c49ceb0c946bd8ca232fd"}]}] Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1426275764 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 0b7c416c213c49ceb0c946bd8ca232fd Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1426275764 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: f83d5a681892401eaeb2cf03015aaf67 Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1426275764-project Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 could not be found. Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2484fac4-a923-4c3a-870c-0acfc7e9f715'} Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 could not be found. Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 could not be found. Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:22.945118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 could not be found. Nov 02 14:00:22.951435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:22.955791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] Returning 404 to user: Instance 2484fac4-a923-4c3a-870c-0acfc7e9f715 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:22.960035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-432deb17-80d9-4125-b7ed-66879b8a350e tempest-ServersTestJSON-1426275764 tempest-ServersTestJSON-1426275764-project] 10.222.0.18 "GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715" status: 404 len: 111 microversion: 2.1 time: 0.069343 Nov 02 14:00:22.973791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2439/3491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:22 2022] GET /compute/v2.1/servers/2484fac4-a923-4c3a-870c-0acfc7e9f715 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:22.985565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1d549bda-b87d-42d9-8391-f1effe1fd162 req-05fae277-c570-494c-a337-b9094c929467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c643a278-7f32-4259-a914-83e9b8aa8195", "name": "network-vif-deleted", "tag": "de9f9883-67da-4a54-9326-3211b79f59b5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:23.012728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1d549bda-b87d-42d9-8391-f1effe1fd162 req-05fae277-c570-494c-a337-b9094c929467 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.015877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1d549bda-b87d-42d9-8391-f1effe1fd162 req-05fae277-c570-494c-a337-b9094c929467 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.016925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1d549bda-b87d-42d9-8391-f1effe1fd162 req-05fae277-c570-494c-a337-b9094c929467 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.058736 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1d549bda-b87d-42d9-8391-f1effe1fd162 req-05fae277-c570-494c-a337-b9094c929467 service nova] Creating event network-vif-deleted:de9f9883-67da-4a54-9326-3211b79f59b5 for instance c643a278-7f32-4259-a914-83e9b8aa8195 on n-h1-858238-3 Nov 02 14:00:23.083521 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1d549bda-b87d-42d9-8391-f1effe1fd162 req-05fae277-c570-494c-a337-b9094c929467 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105762 Nov 02 14:00:23.084911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2440/3492] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:23.104727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:23.105679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:23.120584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.121416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.122180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.123111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.123737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.124330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.194273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:23.290636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:23.407907 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c3cf16b-87c0-4f1d-83e8-9168ed2fa19e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 204 len: 0 microversion: 2.1 time: 0.321252 Nov 02 14:00:23.409302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2441/3493] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:23 2022] DELETE /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:23.415955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:23.416962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:23.448717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.452984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.456717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.459832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.462883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.466682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:24.160870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:24.171629 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90e6bf08-89a1-430b-8293-fb79d7975e04 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1575 microversion: 2.1 time: 0.760635 Nov 02 14:00:24.172299 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2442/3494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:23 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1575 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:24.195178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ef129767-b632-4594-861d-9d941a61fba0 req-e95ce75e-daa6-45bb-9b75-3d2739c93203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a7836cc-97f0-43f9-9e7b-427a3b67f31c", "tag": "1b04e04f-9cda-43a3-a28e-60ee00140537"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:24.236542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ef129767-b632-4594-861d-9d941a61fba0 req-e95ce75e-daa6-45bb-9b75-3d2739c93203 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:24.237082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ef129767-b632-4594-861d-9d941a61fba0 req-e95ce75e-daa6-45bb-9b75-3d2739c93203 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:24.237443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ef129767-b632-4594-861d-9d941a61fba0 req-e95ce75e-daa6-45bb-9b75-3d2739c93203 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:24.296599 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ef129767-b632-4594-861d-9d941a61fba0 req-e95ce75e-daa6-45bb-9b75-3d2739c93203 service nova] Creating event network-changed:1b04e04f-9cda-43a3-a28e-60ee00140537 for instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c on n-h1-858238-3 Nov 02 14:00:24.309645 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ef129767-b632-4594-861d-9d941a61fba0 req-e95ce75e-daa6-45bb-9b75-3d2739c93203 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125760 Nov 02 14:00:24.310290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2443/3495] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:24.325533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1698822802", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7e53e086-dd5c-4df9-95b5-9e9382cf5479"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:24.487432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] validate_networks() for [('7e53e086-dd5c-4df9-95b5-9e9382cf5479', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:00:28.087869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:00:28.088460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:00:28.088767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:00:28.089167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:00:28.089586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:00:28.114328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.114850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.115318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.116251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.116903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.117502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.164018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:00:28.179321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Getting quotas for user 165803256c184acc801878f0cb60cc67 and project 8c0ef7986a0f4b6ca674a7d1bddf68ca. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:00:28.213438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:00:28.216962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:00:28.316997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6c3b9077-3e56-48a1-94b3-88e046dc450b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.005469 Nov 02 14:00:28.317854 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2444/3496] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:00:28.332447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.333347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.360831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.361678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.362289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.363315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.363963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.364561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.436225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 HTTP/1.1 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c643a278-7f32-4259-a914-83e9b8aa8195'} Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:28.441103 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.446541 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.451734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:28.454855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-921fcfbf-d5f2-4cdc-be8c-dd6b96bac83b tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 404 len: 111 microversion: 2.1 time: 0.133136 Nov 02 14:00:28.460851 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2445/3497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:28 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:28.476120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac82239b-b269-4124-9001-72b8fe2e3256 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.477131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac82239b-b269-4124-9001-72b8fe2e3256 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.696409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac82239b-b269-4124-9001-72b8fe2e3256 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:28.709198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac82239b-b269-4124-9001-72b8fe2e3256 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1208 microversion: 2.1 time: 0.246987 Nov 02 14:00:28.713894 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2446/3498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:28 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:28.734360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.735293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.749529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.750258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.751531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.754933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.758016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.758530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.803446 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 HTTP/1.1 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c643a278-7f32-4259-a914-83e9b8aa8195'} Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:28.805039 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6e4c6eb-88eb-4af9-a54b-1ec08fff3d52 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 404 len: 111 microversion: 2.1 time: 0.091101 Nov 02 14:00:28.814691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2447/3499] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:28 2022] DELETE /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:28.819974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.819974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c643a278-7f32-4259-a914-83e9b8aa8195] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.842266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.843290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.844147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.848932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.850994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.853445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.888841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 HTTP/1.1 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c643a278-7f32-4259-a914-83e9b8aa8195'} Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:28.896035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. Nov 02 14:00:28.900984 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:28.915776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance c643a278-7f32-4259-a914-83e9b8aa8195 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:28.916672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a18ecc00-e2a9-4661-ab76-3bc37a286618 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195" status: 404 len: 111 microversion: 2.1 time: 0.104569 Nov 02 14:00:28.926272 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2448/3500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:28 2022] GET /compute/v2.1/servers/c643a278-7f32-4259-a914-83e9b8aa8195 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:28.950880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.951684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.963586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.964105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.970425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.971419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.971828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.972155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.020531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 HTTP/1.1 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5'} Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.025663 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.031455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37bcc5b2-e7c8-4317-bdcf-bc70a629979a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 404 len: 111 microversion: 2.1 time: 0.103225 Nov 02 14:00:29.035688 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2449/3501] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:28 2022] DELETE /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:29.043832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.044446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.081804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.082666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.083306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.084211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.084827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.085397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.101115 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 HTTP/1.1 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5'} Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.103616 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. Nov 02 14:00:29.109765 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.113730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.115312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8cadf7d-2a02-4522-9f66-2e32d81ccf60 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5" status: 404 len: 111 microversion: 2.1 time: 0.075227 Nov 02 14:00:29.117015 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2450/3502] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:29 2022] GET /compute/v2.1/servers/c3fe3e9e-8fd5-4469-b35a-8b67228e1fe5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:00:29.141610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.143679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.167447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.174630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.176187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.190074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.190739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.192387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.237910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d HTTP/1.1 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9270f9e1-f6ae-4560-9cb3-a230e60b490d'} Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.240192 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.244609 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.247387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.248614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f841ea4-4685-4016-92ed-53b29f4cc5d9 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 404 len: 111 microversion: 2.1 time: 0.125108 Nov 02 14:00:29.249820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2451/3503] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:29 2022] DELETE /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:29.256293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-91b0596f-c64d-4d44-aedc-d11bacd87f32 req-1fc442ad-7bd2-4cd6-98c5-7a82c34bb73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faabbaf3-73f3-44c4-88cf-73a182ad7bc1", "name": "network-vif-deleted", "tag": "2fdaa5a4-877c-496b-9b5c-08e91604cf7f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:29.270238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-91b0596f-c64d-4d44-aedc-d11bacd87f32 req-1fc442ad-7bd2-4cd6-98c5-7a82c34bb73d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.270950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-91b0596f-c64d-4d44-aedc-d11bacd87f32 req-1fc442ad-7bd2-4cd6-98c5-7a82c34bb73d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.271876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-91b0596f-c64d-4d44-aedc-d11bacd87f32 req-1fc442ad-7bd2-4cd6-98c5-7a82c34bb73d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.297131 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-91b0596f-c64d-4d44-aedc-d11bacd87f32 req-1fc442ad-7bd2-4cd6-98c5-7a82c34bb73d service nova] Creating event network-vif-deleted:2fdaa5a4-877c-496b-9b5c-08e91604cf7f for instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 on n-h2-858238-3 Nov 02 14:00:29.309618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-91b0596f-c64d-4d44-aedc-d11bacd87f32 req-1fc442ad-7bd2-4cd6-98c5-7a82c34bb73d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056768 Nov 02 14:00:29.311791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2452/3504] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:29.321371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.326319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 9270f9e1-f6ae-4560-9cb3-a230e60b490d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.343295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.345769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.346535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.358485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.360948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.361638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.455822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d HTTP/1.1 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9270f9e1-f6ae-4560-9cb3-a230e60b490d'} Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.466348 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.473249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 9270f9e1-f6ae-4560-9cb3-a230e60b490d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.476417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0f94c2f5-bd32-467b-b5c7-b2d21917777d tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d" status: 404 len: 111 microversion: 2.1 time: 0.163276 Nov 02 14:00:29.480912 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2453/3505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:29 2022] GET /compute/v2.1/servers/9270f9e1-f6ae-4560-9cb3-a230e60b490d => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:29.500464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.505404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.553915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.554889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.555616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.564125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.571969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.572508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.615959 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 HTTP/1.1 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f4faaeab-c604-437e-abea-6ed148068013'} Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.618063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.622640 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.625645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.636286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e4ba8a3-8f68-4e2c-8924-359a64f7c24f tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 404 len: 111 microversion: 2.1 time: 0.148295 Nov 02 14:00:29.642077 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2454/3506] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:29 2022] DELETE /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:29.650197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.662292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: f4faaeab-c604-437e-abea-6ed148068013] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.674419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.677258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.680680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.681937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.682780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.683487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.701265 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 HTTP/1.1 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f4faaeab-c604-437e-abea-6ed148068013'} Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.703793 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. Nov 02 14:00:29.708527 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.710753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance f4faaeab-c604-437e-abea-6ed148068013 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.711895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ef2d02e-8c13-4dec-a680-3cbac0641190 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013" status: 404 len: 111 microversion: 2.1 time: 0.065858 Nov 02 14:00:29.713013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2455/3507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:29 2022] GET /compute/v2.1/servers/f4faaeab-c604-437e-abea-6ed148068013 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:00:29.727755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.728589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.751820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.753407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.754550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.756054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.758646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.774081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.843439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 HTTP/1.1 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1b35a3db-6758-48ea-820f-45beb5e0f762'} Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:29.845853 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:29.850352 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:29.859080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:29.861634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71a3ed82-a4aa-431e-b0c2-876057f650bd tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 404 len: 111 microversion: 2.1 time: 0.143124 Nov 02 14:00:29.866921 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2456/3508] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:29 2022] DELETE /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:29.879345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.884083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.903897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.904881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.905593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.907759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.908913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.909611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.158051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:30.171819 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d0c3c7fb-86da-4821-b82f-2af7d2cea404 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1204 microversion: 2.1 time: 0.300828 Nov 02 14:00:30.193269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2457/3509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:29 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1204 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:30.206058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:30.206672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 1b35a3db-6758-48ea-820f-45beb5e0f762] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:30.225322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:30.229525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:30.231637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.232966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:30.233811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:30.236031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.285696 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 HTTP/1.1 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1b35a3db-6758-48ea-820f-45beb5e0f762'} Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:30.303987 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 1b35a3db-6758-48ea-820f-45beb5e0f762 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6129e4c5-dd78-48a2-9635-2e3b2c0f4376 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762" status: 404 len: 111 microversion: 2.1 time: 0.111215 Nov 02 14:00:30.308962 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2458/3510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:30 2022] GET /compute/v2.1/servers/1b35a3db-6758-48ea-820f-45beb5e0f762 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:31.202832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:31.204296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:31.216420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:31.217800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:31.220174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:31.223040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:31.224533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:31.225167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:31.745705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:31.757036 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-584778b3-438b-498f-ac60-2758c8d0c68c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1278 microversion: 2.1 time: 0.558860 Nov 02 14:00:31.758279 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2459/3511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:31 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1278 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:32.785471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:32.786167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:32.807739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:32.808264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:32.808711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:32.809458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:32.814658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:32.815164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:33.286786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:33.294668 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d253addd-beac-47ad-817a-86e221ed416b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 0.514335 Nov 02 14:00:33.309948 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2460/3512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:32 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:34.340640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:34.343434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:34.367939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:34.367939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:34.367939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:34.367939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:34.367939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:34.367939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:35.387535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:35.402234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e989cbee-8a1a-4f82-b747-00843999a4aa tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 1.066693 Nov 02 14:00:35.427669 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2461/3513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:34 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:35.436281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:35.436925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:35.445252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:35.445742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:35.446226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:35.446997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:35.448155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:35.448583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:35.958777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:35.973306 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e221f439-48e4-4c4b-b8af-cfebd31244a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.540423 Nov 02 14:00:35.974488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2462/3514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:35 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:35.987072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a4521987-22b9-44ac-b383-702ae4f3e4ce req-1b33df17-e50b-459f-b960-05a58f8cd1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe", "tag": "5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:36.022012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a4521987-22b9-44ac-b383-702ae4f3e4ce req-1b33df17-e50b-459f-b960-05a58f8cd1db service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.023600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a4521987-22b9-44ac-b383-702ae4f3e4ce req-1b33df17-e50b-459f-b960-05a58f8cd1db service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.025110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a4521987-22b9-44ac-b383-702ae4f3e4ce req-1b33df17-e50b-459f-b960-05a58f8cd1db service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:36.069518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a4521987-22b9-44ac-b383-702ae4f3e4ce req-1b33df17-e50b-459f-b960-05a58f8cd1db service nova] Creating event network-changed:5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2 for instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe on n-h2-858238-3 Nov 02 14:00:36.081802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a4521987-22b9-44ac-b383-702ae4f3e4ce req-1b33df17-e50b-459f-b960-05a58f8cd1db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105757 Nov 02 14:00:36.086735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2463/3515] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:36.105933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-518923437"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:36.128456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:36.155389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.155934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.156385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:36.164477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.164942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.165431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:36.696197 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a478e1e3-4227-4893-9ea1-23892e64617d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.607514 Nov 02 14:00:36.697367 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2464/3516] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:00:36 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 14:00:36.714685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:36.718449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:36.740899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.742508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.743187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:36.744820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.748659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.750229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:37.825581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:37.849630 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67d57655-eb7c-4702-8109-fb4e0940c0cb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 1.149874 Nov 02 14:00:37.858753 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2465/3517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:36 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:37.873638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:37.874919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:37.901119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:37.902361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:37.908308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:37.909976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:37.910958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:37.911974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.148970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:38.239790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:38.251027 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cc32fd0-7984-4f9b-87f8-ee55d401f039 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.389745 Nov 02 14:00:38.251698 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2466/3518] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:37 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:38.256891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:38.257765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:38.265915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.266837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.267495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.268556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.269219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.269811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.328218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 HTTP/1.1 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e95b31f0-63d4-4394-a173-98421faf4b34'} Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:38.331032 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.337538 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.341736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:38.343627 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57f738fe-3b1d-4e06-8f08-4b787233269a tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 404 len: 111 microversion: 2.1 time: 0.090641 Nov 02 14:00:38.345872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2467/3519] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:38 2022] DELETE /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:38.361508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:38.363293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: e95b31f0-63d4-4394-a173-98421faf4b34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:38.376277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.377149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.377887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.379013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.380178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.381274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.396021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:38.432962 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 HTTP/1.1 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e95b31f0-63d4-4394-a173-98421faf4b34'} Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.437452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance e95b31f0-63d4-4394-a173-98421faf4b34 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5b62b080-2d86-4983-b2d2-492d6f759053 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34" status: 404 len: 111 microversion: 2.1 time: 0.090656 Nov 02 14:00:38.449174 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2468/3520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:38 2022] GET /compute/v2.1/servers/e95b31f0-63d4-4394-a173-98421faf4b34 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:38.453846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:38.454978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:38.466384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.467962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.468598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.470823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.472761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.473406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.511613 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e HTTP/1.1 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '135c9b2c-85e9-4a6e-b482-859be2c3201e'} Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:38.513670 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.519712 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.522165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:38.523221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4dd130d7-6645-4d13-bea6-ee762e1f13a0 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 404 len: 111 microversion: 2.1 time: 0.075375 Nov 02 14:00:38.524275 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2469/3521] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:38 2022] DELETE /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:38.534907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:38.536181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] [instance: 135c9b2c-85e9-4a6e-b482-859be2c3201e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:38.544072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.545783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.547562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.548299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.548770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.552561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.619877 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] HTTP exception thrown: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Request method failure captured: Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e HTTP/1.1 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnZwOLM5hi-HlRlyWLw7SlJ4ESaW7XCzxrW2O1DggYJ3dTmnXnSA7BFgw-Ets4gt9AMDuvjieBeoMWCkvWHl06zgoKcGaQga9BsrzP5EVaIc3GAp34_r4Vrwj0o_tYSJdnH2srxeI1MBqrWGfZPLqnA8om4acSLpiqr2utD5nV8ljKo Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c488935b14d4c5dba47c319dc1e5bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c488935b14d4c5dba47c319dc1e5bd0"}]}] Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c488935b14d4c5dba47c319dc1e5bd0 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-251075436 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: af7326d5a5a24263b124c56ee1559d39 Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-251075436-project Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '135c9b2c-85e9-4a6e-b482-859be2c3201e'} Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:38.625921 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. Nov 02 14:00:38.632257 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:00:38.633838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] Returning 404 to user: Instance 135c9b2c-85e9-4a6e-b482-859be2c3201e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:38.637578 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4049fef8-7ee5-4fa2-b6c5-2f7e397b1721 tempest-DeleteServersTestJSON-251075436 tempest-DeleteServersTestJSON-251075436-project] 10.222.0.18 "GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e" status: 404 len: 111 microversion: 2.1 time: 0.108635 Nov 02 14:00:38.640956 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2470/3522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:38 2022] GET /compute/v2.1/servers/135c9b2c-85e9-4a6e-b482-859be2c3201e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:38.669532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-191e41f5-851f-48a2-a162-d330a86e402e req-722d90f5-9805-4b5f-8385-5c2dff1e89b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:38.690006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-191e41f5-851f-48a2-a162-d330a86e402e req-722d90f5-9805-4b5f-8385-5c2dff1e89b4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.691077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-191e41f5-851f-48a2-a162-d330a86e402e req-722d90f5-9805-4b5f-8385-5c2dff1e89b4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.692473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-191e41f5-851f-48a2-a162-d330a86e402e req-722d90f5-9805-4b5f-8385-5c2dff1e89b4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.721724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:38.728502 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-191e41f5-851f-48a2-a162-d330a86e402e req-722d90f5-9805-4b5f-8385-5c2dff1e89b4 service nova] Creating event network-vif-unplugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 14:00:38.746250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-191e41f5-851f-48a2-a162-d330a86e402e req-722d90f5-9805-4b5f-8385-5c2dff1e89b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081341 Nov 02 14:00:38.750747 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2471/3523] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:38.905591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:38.907299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:38.923211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.924027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.926881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.928066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.928822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.929777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:39.728098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:39.748981 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d96d41e4-3100-486f-ae4a-ffafbf4b485f tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 0.848989 Nov 02 14:00:39.765023 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2472/3524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:38 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:39.772866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:39.773722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:39.808613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:39.813104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:39.816604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:39.819382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:39.824261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:39.826120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:40.579843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:40.601701 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-647aff30-1d5e-498b-81bb-fc168d970d89 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1689 microversion: 2.1 time: 0.834667 Nov 02 14:00:40.606872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2473/3525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:39 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1689 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:40.792151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:40.802820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:40.841726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:40.842403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:40.844055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:40.846545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:40.850037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:40.852061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:41.109596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:41.126348 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7453d3c7-4a89-4877-b2db-82a6e72796d3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 0.351250 Nov 02 14:00:41.130085 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2474/3526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:40 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:41.637817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:41.638992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:41.685730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:41.686552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:41.701731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:41.702957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:41.704327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:41.709268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:42.542036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:42.567659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca3fe49c-42fe-4044-b52c-693148c90f2f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 0.936468 Nov 02 14:00:42.583530 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2475/3527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:41 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:42.608026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:42.608026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:42.649475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:42.652672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:42.653351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:42.670239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:42.675416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:42.677440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:42.986394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:43.001463 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0897856-09b6-4850-84c6-fc090422bb93 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 0.419402 Nov 02 14:00:43.002091 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2476/3528] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:42 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:43.624731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:43.625350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:43.639810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:43.644424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:43.647336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:43.648131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:43.648605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:43.649035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:44.758440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:44.772578 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5bc000f4-3ccb-45a0-a4f4-36f815bcdee8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 1.152387 Nov 02 14:00:44.776743 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2477/3529] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:43 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:44.801598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:44.808239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:44.831226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:44.841363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:44.847897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:44.851289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:44.853245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:44.857759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:44.861174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:46.639305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:46.662593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35dcccd3-92a0-4645-914b-e9d2b33bc7d7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 1.880551 Nov 02 14:00:46.665739 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2478/3530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:44 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:46.697993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-dc420325-929b-417d-8040-6594702e8f3e req-e062c565-bbf9-4a1f-bdb8-1ed2072111c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-plugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:46.744052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dc420325-929b-417d-8040-6594702e8f3e req-e062c565-bbf9-4a1f-bdb8-1ed2072111c6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:46.745009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dc420325-929b-417d-8040-6594702e8f3e req-e062c565-bbf9-4a1f-bdb8-1ed2072111c6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:46.747673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dc420325-929b-417d-8040-6594702e8f3e req-e062c565-bbf9-4a1f-bdb8-1ed2072111c6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:46.811478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-dc420325-929b-417d-8040-6594702e8f3e req-e062c565-bbf9-4a1f-bdb8-1ed2072111c6 service nova] Creating event network-vif-plugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 14:00:46.841404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-dc420325-929b-417d-8040-6594702e8f3e req-e062c565-bbf9-4a1f-bdb8-1ed2072111c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167005 Nov 02 14:00:46.842332 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2479/3531] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:46.858531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:46.864844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:46.885909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:46.891870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:46.894883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:46.895957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:46.898031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:46.899663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:47.571463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:47.592959 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6af67095-efe0-4d12-acd3-c0f5485b4088 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 0.747633 Nov 02 14:00:47.607805 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2480/3532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:46 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:47.695599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:47.703294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:47.718645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:47.720492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:47.726484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:47.731989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:47.732681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:47.734539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:48.137397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:48.166175 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8ca1e35-f863-41d0-a872-7e65bac79496 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 0.468652 Nov 02 14:00:48.168237 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2481/3533] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:47 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:48.626098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:48.627047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:48.639678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:48.640436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:48.643146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:48.645947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:48.646670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:48.647993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:49.631952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:49.646511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e4e66a7-994e-43bf-ba4e-fb2ca8024211 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 1.029248 Nov 02 14:00:49.648123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2482/3534] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:48 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:49.655357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0d8b889a-1633-42fa-b023-65e62c4383b6 req-555c3045-8747-4c14-a155-396b2545a203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:49.699346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d8b889a-1633-42fa-b023-65e62c4383b6 req-555c3045-8747-4c14-a155-396b2545a203 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:49.706583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d8b889a-1633-42fa-b023-65e62c4383b6 req-555c3045-8747-4c14-a155-396b2545a203 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:49.710335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d8b889a-1633-42fa-b023-65e62c4383b6 req-555c3045-8747-4c14-a155-396b2545a203 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:49.750939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0d8b889a-1633-42fa-b023-65e62c4383b6 req-555c3045-8747-4c14-a155-396b2545a203 service nova] Creating event network-vif-plugged:5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2 for instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe on n-h2-858238-3 Nov 02 14:00:49.764194 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0d8b889a-1633-42fa-b023-65e62c4383b6 req-555c3045-8747-4c14-a155-396b2545a203 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114594 Nov 02 14:00:49.769907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2483/3535] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:49.828013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:49.830313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:49.845246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:49.846343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:49.847297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:49.848694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:49.849811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:49.850702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:50.533257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:50.550478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9006ef1b-72de-4a19-8e6b-3d8c877fc3c4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 0.778112 Nov 02 14:00:50.552895 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2484/3536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:49 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:50.679642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:50.680998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:50.694500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:50.700410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:50.702242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:50.704342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:50.705575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:50.707912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:51.117051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:51.130064 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b82b35a-86bb-4b1b-bd41-628cb6f2a56f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 0.454489 Nov 02 14:00:51.130969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2485/3537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:50 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:51.575478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:51.576810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:51.597144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:51.600116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:51.605914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:51.606997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:51.607722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:51.620160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:52.907822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:52.922039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7f32af8-2860-4426-bae8-749a01d0f0a6 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1308 microversion: 2.1 time: 1.350229 Nov 02 14:00:52.932621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2486/3538] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:51 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1308 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:52.972960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:52.977710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:53.002783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:53.003673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:53.005950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:53.007805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:53.011422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:53.015742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:53.463608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:53.491406 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d8084f1-01d0-4088-b56c-77a571595d0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 0.553452 Nov 02 14:00:53.517972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2487/3539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:52 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:53.964224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:53.976549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:54.005889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.007434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.008087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:54.009944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.015586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.018906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:54.812346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:54.817847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:54.837017 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e39cbf23-955e-4b3c-8b7c-e07cd324dda4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1487 microversion: 2.1 time: 0.876995 Nov 02 14:00:54.845724 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2488/3540] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:53 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1487 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:54.863291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:54.869957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:54.905555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.910329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.910855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:54.911630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.915231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.917130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:55.758223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:55.777917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-001a4484-24c6-413f-9ce7-9ce94971134b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 0.927671 Nov 02 14:00:55.780085 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2489/3541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:54 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:55.792903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-25122277"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:55.802975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:55.824120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:55.834659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:55.836396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:55.837993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:55.839611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:55.842437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:05.824545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=25 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:05.930266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=13 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:08.085103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8018c13-f4b6-43f4-a67b-88d0c000b21c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "POST /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe/action" status: 202 len: 0 microversion: 2.1 time: 12.298672 Nov 02 14:01:08.086149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2490/3542] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:00:55 2022] POST /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe/action => generated 0 bytes in 12305 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 14:01:08.114708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:08.142665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:08.145918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Searching by: {'deleted': False, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:01:08.170026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.174250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.176421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:08.179422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.183051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.184122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:08.274528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:01:08.422827 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5d18be5-8185-4281-813e-aac06af2a96a tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.331973 Nov 02 14:01:08.424210 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2491/3543] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 14:01:08 2022] GET /compute/v2.1/servers => generated 334 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:08.450343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:08.461556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:08.514734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.521301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.527731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:08.529760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:08.532943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:08.534104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:09.413021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:09.463290 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8baa3133-476d-4bb9-8c63-9f1b3a06d836 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1684 microversion: 2.1 time: 1.031255 Nov 02 14:01:09.468369 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2492/3544] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:08 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1684 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:10.027637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-560cbf37-1d5b-4fb4-95d1-eda5d3eea241 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'create', calling method: .version_select at 0x7f6f80c44700>, body: {"keypair": {"name": "tempest-keypair-227102037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvkHnGNpVllYzUowvSBwdVxW/dlsfAXavMfLpDbv6XNoaKSlRT9cNCaccyNlF0pUX2ltU+mZtL6JqwcUxPbUu0HUscQQIIPMJJZipvsdftijIh4Z2T88lNaS/pEkYiuJQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:10.110233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-560cbf37-1d5b-4fb4-95d1-eda5d3eea241 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:01:10.134532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-560cbf37-1d5b-4fb4-95d1-eda5d3eea241 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for user 54b21c1bdc9742a084ad3fb5e480bd45 and project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:01:10.234433 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-560cbf37-1d5b-4fb4-95d1-eda5d3eea241 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.757824 Nov 02 14:01:10.236671 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2493/3545] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 14:01:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 767 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 14:01:10.799176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-700537108", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "0b1ab11f-dc48-47cc-910a-8200182b4e1a"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:10.955193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] validate_networks() for [('0b1ab11f-dc48-47cc-910a-8200182b4e1a', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:01:12.786328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:01:12.786956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:01:12.787372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:01:12.788170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:01:12.788764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:01:12.822131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:12.827062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:12.831114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:12.838033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:12.838757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:12.842912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:12.933419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Getting quotas for project 4ae5e4f62dd44154adeeb799b249050b. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:01:12.958817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Getting quotas for user b1ec248842b24145bf87267f4383fd99 and project 4ae5e4f62dd44154adeeb799b249050b. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:01:13.022112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:01:13.025098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:01:13.204915 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e75df77-84f8-43fd-82be-59b5c7bd23b3 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.966271 Nov 02 14:01:13.205583 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2494/3546] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:01:13.215805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-905af8d9-c690-448e-b646-d08619713590 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80c2d3a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:17.975869 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-905af8d9-c690-448e-b646-d08619713590 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4" status: 200 len: 1408 microversion: 2.1 time: 4.769203 Nov 02 14:01:17.977525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2495/3547] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 14:01:13 2022] GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 => generated 1408 bytes in 4771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:17.998423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:18.019335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:18.026713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Searching by: {'deleted': False, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:01:18.053765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:18.059680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:18.060255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:18.066163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:18.066938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:18.075066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:18.190485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:01:18.287267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:18.324049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:18.324525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:18.325117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:19.465363 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a56b3124-a896-4a41-98c6-d9037b942f80 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 1.486559 Nov 02 14:01:19.480501 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2496/3548] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:01:17 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:19.493430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:19.494369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:19.526278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:19.529647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:19.530320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:19.535282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:19.537268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:19.537891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:19.902024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:19.918181 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2545a61-0a6f-4a62-8bfa-5ecb0f1eeafa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.436015 Nov 02 14:01:19.919362 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2497/3549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:19 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:19.933212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:19.934122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:19.955467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:19.955973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:19.956406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:19.957286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:19.958154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:19.962497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:20.330107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:20.343693 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16a55c6d-48a7-4589-a288-b197ce6a6e75 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1316 microversion: 2.1 time: 0.422739 Nov 02 14:01:20.344843 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2498/3550] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:19 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:20.355306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-361985762", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f7f9622-8d61-434b-acac-e9862fb219ae"}], "security_groups": [{"name": "tempest-securitygroup--102956813"}], "key_name": "tempest-keypair-227102037", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:21.466755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] validate_networks() for [('3f7f9622-8d61-434b-acac-e9862fb219ae', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:01:23.699968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:01:23.701326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:01:23.702114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:01:23.703576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:01:23.704403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:01:23.729654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:23.730521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:23.735308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:23.737767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:23.738478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:23.739184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:23.789959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:01:23.803492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for user 54b21c1bdc9742a084ad3fb5e480bd45 and project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:01:23.840346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:01:23.844060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:01:23.971261 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05479558-ac63-48b9-9e0a-2fe0e9227448 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.625203 Nov 02 14:01:23.979035 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2499/3551] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:01:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 3634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:01:23.985740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d42d7c49-96fe-4943-bdfa-d4859b8eb737 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f809e6820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:24.117387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d42d7c49-96fe-4943-bdfa-d4859b8eb737 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4" status: 200 len: 1408 microversion: 2.1 time: 0.136152 Nov 02 14:01:24.118803 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2500/3552] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 14:01:23 2022] GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:24.124228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-69c2c5b1-e5b8-4099-8cef-a24092b2219f req-235237bd-db06-4c2b-a843-d64a63e54a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:24.144259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-69c2c5b1-e5b8-4099-8cef-a24092b2219f req-235237bd-db06-4c2b-a843-d64a63e54a3a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:24.144806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-69c2c5b1-e5b8-4099-8cef-a24092b2219f req-235237bd-db06-4c2b-a843-d64a63e54a3a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:24.145239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-69c2c5b1-e5b8-4099-8cef-a24092b2219f req-235237bd-db06-4c2b-a843-d64a63e54a3a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:24.174085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-69c2c5b1-e5b8-4099-8cef-a24092b2219f req-235237bd-db06-4c2b-a843-d64a63e54a3a service nova] Creating event network-vif-plugged:5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2 for instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe on n-h2-858238-3 Nov 02 14:01:24.185407 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-69c2c5b1-e5b8-4099-8cef-a24092b2219f req-235237bd-db06-4c2b-a843-d64a63e54a3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065289 Nov 02 14:01:24.190657 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2501/3553] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:24.203001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d383a0a4-c119-4b9b-aba3-f64787138e94 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:24.223077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d383a0a4-c119-4b9b-aba3-f64787138e94 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029649 Nov 02 14:01:24.232675 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2502/3554] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 14:01:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:24.247496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:24.248492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:24.268619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:24.274125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:24.274752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:24.276380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:24.278289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:24.279117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:24.763400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:24.790085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e72017f-0b3e-4a0a-8275-64caefdec1b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.554312 Nov 02 14:01:24.790716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2503/3555] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:24 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:24.843967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:24.847662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:24.874933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:24.876020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:24.887188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:24.891752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:24.892967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:24.895570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:25.490391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:25.513006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6196a0e4-802b-44c4-bbe7-d52070fd3a90 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1316 microversion: 2.1 time: 0.711520 Nov 02 14:01:25.515052 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2504/3556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:24 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:25.532146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8a694b3e-bedb-43ba-a716-edd5fff4de18 req-fd580f8a-f978-456b-ada2-83ab651fbcfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71557dc7-61c1-4066-aa03-7a9bcc8b7d46", "tag": "67a1bb7b-c01e-4614-a3b7-c60746b0d11d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:25.563199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8a694b3e-bedb-43ba-a716-edd5fff4de18 req-fd580f8a-f978-456b-ada2-83ab651fbcfc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:25.563811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8a694b3e-bedb-43ba-a716-edd5fff4de18 req-fd580f8a-f978-456b-ada2-83ab651fbcfc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:25.564252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8a694b3e-bedb-43ba-a716-edd5fff4de18 req-fd580f8a-f978-456b-ada2-83ab651fbcfc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:25.589683 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8a694b3e-bedb-43ba-a716-edd5fff4de18 req-fd580f8a-f978-456b-ada2-83ab651fbcfc service nova] Creating event network-changed:67a1bb7b-c01e-4614-a3b7-c60746b0d11d for instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 on n-h1-858238-3 Nov 02 14:01:25.620016 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8a694b3e-bedb-43ba-a716-edd5fff4de18 req-fd580f8a-f978-456b-ada2-83ab651fbcfc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102623 Nov 02 14:01:25.634886 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2505/3557] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:25.661456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:25.662875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:25.691381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:25.692166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:25.695310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:25.696331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:25.698196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:25.702210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:25.868200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:25.891823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:25.896052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:25.898320 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ca5f2c2-b00d-4f01-996e-c89486584cd3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1276 microversion: 2.20 time: 0.259069 Nov 02 14:01:25.900453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2506/3558] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:25 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:25.910609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46bf2ad5-d68f-47ba-800d-44f3b1ed7465 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80d61d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:26.998657 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46bf2ad5-d68f-47ba-800d-44f3b1ed7465 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4" status: 204 len: 0 microversion: 2.1 time: 1.096715 Nov 02 14:01:27.001003 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2507/3559] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:25 2022] DELETE /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:01:27.007641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:27.010598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:27.043610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:27.066110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:27.070576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:27.079491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:27.082109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:27.082562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:27.206347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:27.582519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-327adaee-6fbf-4267-bd11-e870a813375d tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 204 len: 0 microversion: 2.1 time: 0.579856 Nov 02 14:01:27.585337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2508/3560] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:01:27 2022] DELETE /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:01:27.610409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:27.611568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:27.637752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:27.638605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:27.639378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:27.646952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:27.647683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:27.648598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:28.285036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:28.308216 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce07041b-465c-4ad6-8a63-d6c161f7fea5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1316 microversion: 2.1 time: 0.720252 Nov 02 14:01:28.310314 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2509/3561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:27 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:28.332753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ecb43db9-7576-4de3-a3f1-2a94352e7385 req-139ee2d5-8a17-4187-9ed4-a33a0545530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:28.372054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ecb43db9-7576-4de3-a3f1-2a94352e7385 req-139ee2d5-8a17-4187-9ed4-a33a0545530e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:28.372738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ecb43db9-7576-4de3-a3f1-2a94352e7385 req-139ee2d5-8a17-4187-9ed4-a33a0545530e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:28.373528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ecb43db9-7576-4de3-a3f1-2a94352e7385 req-139ee2d5-8a17-4187-9ed4-a33a0545530e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:28.392155 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ecb43db9-7576-4de3-a3f1-2a94352e7385 req-139ee2d5-8a17-4187-9ed4-a33a0545530e service nova] Creating event network-vif-unplugged:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 14:01:28.400860 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ecb43db9-7576-4de3-a3f1-2a94352e7385 req-139ee2d5-8a17-4187-9ed4-a33a0545530e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088923 Nov 02 14:01:28.402144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2510/3562] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:28.409138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:28.410838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:28.438823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:28.444018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:28.451587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:28.455413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:28.456949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:28.457750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:28.826159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:28.830597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:28.844986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:28.846455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:28.847656 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d033ebf-b06a-42fb-b794-d7d8b0e45199 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1338 microversion: 2.20 time: 0.443380 Nov 02 14:01:28.861369 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2511/3563] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:28 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1338 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:28.866474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d739124-3493-4382-8e90-8dc1e100eae0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80c2d040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:28.928836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1d739124-3493-4382-8e90-8dc1e100eae0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Image not found. Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d739124-3493-4382-8e90-8dc1e100eae0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 HTTP/1.1 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '72bc1404-9c6e-4f88-a0a6-d680396ea3b4'} Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 72bc1404-9c6e-4f88-a0a6-d680396ea3b4 Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 14:01:28.931025 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 72bc1404-9c6e-4f88-a0a6-d680396ea3b4 could not be found. Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d739124-3493-4382-8e90-8dc1e100eae0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:28.935834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d739124-3493-4382-8e90-8dc1e100eae0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4" status: 404 len: 62 microversion: 2.1 time: 0.069842 Nov 02 14:01:28.940423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2512/3564] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Nov 2 14:01:28 2022] GET /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:01:28.942333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:28.942953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:28.982761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:28.983388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:28.983839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:28.985145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:28.985613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:28.986044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:30.671391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25403156f6df43ae9791a9d53775aa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b85a6df7c1042c1b6b49fe140140cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:30.680067 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-205aa3ac-a883-4314-92d4-db6774484a56 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 200 len: 1698 microversion: 2.1 time: 1.742006 Nov 02 14:01:30.699817 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2513/3565] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:28 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 1698 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:30.719802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:30.720652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:30.734108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:30.735375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:30.735980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:30.736838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:30.747884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:30.748561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:31.653998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:31.675799 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90480432-f265-4988-a2c8-c11ebe87584f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.971949 Nov 02 14:01:31.678419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2514/3566] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:30 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:31.686223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:31.687439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:31.711189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:31.713253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:31.724025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:31.725194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:31.725839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:31.728078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:33.161025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:33.177315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92f33752-5f83-473f-bce0-324ecb775f72 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1500 microversion: 2.1 time: 1.490207 Nov 02 14:01:33.201836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2515/3567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:31 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1500 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:33.266456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:33.267333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:33.305315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:33.305837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:33.306279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:33.307008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:33.311948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:33.312342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:33.765822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:33.828913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:33.913602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:33.951059 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12d9920c-5082-485a-a78c-e21f3e7dd4af tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1316 microversion: 2.1 time: 0.747627 Nov 02 14:01:33.957742 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2516/3568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:33 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:33.992768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:33.998162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:34.033893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:34.042553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:34.049716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:34.053228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:34.060110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:34.060870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.028931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:35.048536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:35.050894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:35.059262 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3d8c5df2-9f83-486e-b4e7-bd12299f8f05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1405 microversion: 2.20 time: 1.089967 Nov 02 14:01:35.063921 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2517/3569] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:33 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1405 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:35.079857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:35.084630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:35.130373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:35.133144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:35.135188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.140123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:35.143474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:35.147652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.851239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:35.864220 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87664385-a700-43af-9126-13add2591263 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.796668 Nov 02 14:01:35.874105 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2518/3570] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:35 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:35.893491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:35.894125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] [instance: 1a7836cc-97f0-43f9-9e7b-427a3b67f31c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:35.909177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:35.922775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:35.928405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:35.929262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.930589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:35.931301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:35.931962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:35.956122 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] HTTP exception thrown: Instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c could not be found. Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Request method failure captured: Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c HTTP/1.1 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnfPfYLc1o3VmyRH2rjj0Vu3Y3fz2hTsvdcvTHcZzIHLL8TNZsk6ew3IRi6s_n5VrGOIXrObREApLHtKGt2CMLgcXbmM9vG685aISNB9GSSCcj-VPomqbOAiyeaMRcMM6wA24xtIJXk9jz1AGzWV4-aQhKkwCBCBvu3T8BwfVAJzq-Q Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 3b85a6df7c1042c1b6b49fe140140cee Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestJSON-1006634036 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3b85a6df7c1042c1b6b49fe140140cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3b85a6df7c1042c1b6b49fe140140cee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3b85a6df7c1042c1b6b49fe140140cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3b85a6df7c1042c1b6b49fe140140cee"}]}] Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestJSON-1006634036 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 3b85a6df7c1042c1b6b49fe140140cee Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestJSON-1006634036 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestJSON-1006634036-project Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 25403156f6df43ae9791a9d53775aa77 Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestJSON-1006634036-project Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c could not be found. Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1a7836cc-97f0-43f9-9e7b-427a3b67f31c'} Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c could not be found. Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c could not be found. Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:35.958936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c could not be found. Nov 02 14:01:35.962343 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:35.964711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Returning 404 to user: Instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:35.965872 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d22c4d91-37d9-4b8a-93be-324e54700294 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c" status: 404 len: 111 microversion: 2.1 time: 0.087964 Nov 02 14:01:35.967256 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2519/3571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:35 2022] GET /compute/v2.1/servers/1a7836cc-97f0-43f9-9e7b-427a3b67f31c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:01:35.980221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3515f881-34b7-45fd-926c-736083ee4388 req-f3be67de-fc18-4baa-8ce2-0d8cff844331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71557dc7-61c1-4066-aa03-7a9bcc8b7d46", "name": "network-vif-plugged", "status": "completed", "tag": "67a1bb7b-c01e-4614-a3b7-c60746b0d11d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:36.018451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3515f881-34b7-45fd-926c-736083ee4388 req-f3be67de-fc18-4baa-8ce2-0d8cff844331 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.023788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3515f881-34b7-45fd-926c-736083ee4388 req-f3be67de-fc18-4baa-8ce2-0d8cff844331 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.024327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3515f881-34b7-45fd-926c-736083ee4388 req-f3be67de-fc18-4baa-8ce2-0d8cff844331 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.044368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3515f881-34b7-45fd-926c-736083ee4388 req-f3be67de-fc18-4baa-8ce2-0d8cff844331 service nova] Creating event network-vif-plugged:67a1bb7b-c01e-4614-a3b7-c60746b0d11d for instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 on n-h1-858238-3 Nov 02 14:01:36.064901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3515f881-34b7-45fd-926c-736083ee4388 req-f3be67de-fc18-4baa-8ce2-0d8cff844331 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095590 Nov 02 14:01:36.066156 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2520/3572] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:36.079079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:36.080109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:36.093517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.097871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.098622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.099615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.106401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.107459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.791077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:36.805156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94f4fc4f-bc9e-40bb-8f3e-81d71bbaec0c tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1500 microversion: 2.1 time: 0.737552 Nov 02 14:01:36.806705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2521/3573] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:36 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1500 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:36.818936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cf772966-0e43-4aec-b9a2-9b568782c0e3 req-acc5892d-1bb9-46f1-8ebc-0c1728c33c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a7836cc-97f0-43f9-9e7b-427a3b67f31c", "name": "network-vif-deleted", "tag": "1b04e04f-9cda-43a3-a28e-60ee00140537"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:36.858984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf772966-0e43-4aec-b9a2-9b568782c0e3 req-acc5892d-1bb9-46f1-8ebc-0c1728c33c76 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.859885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf772966-0e43-4aec-b9a2-9b568782c0e3 req-acc5892d-1bb9-46f1-8ebc-0c1728c33c76 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.860479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf772966-0e43-4aec-b9a2-9b568782c0e3 req-acc5892d-1bb9-46f1-8ebc-0c1728c33c76 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.890054 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cf772966-0e43-4aec-b9a2-9b568782c0e3 req-acc5892d-1bb9-46f1-8ebc-0c1728c33c76 service nova] Creating event network-vif-deleted:1b04e04f-9cda-43a3-a28e-60ee00140537 for instance 1a7836cc-97f0-43f9-9e7b-427a3b67f31c on n-h1-858238-3 Nov 02 14:01:36.911529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cf772966-0e43-4aec-b9a2-9b568782c0e3 req-acc5892d-1bb9-46f1-8ebc-0c1728c33c76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103281 Nov 02 14:01:36.912723 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2522/3574] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:36.918892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:36.919915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:36.937403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.945406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.950895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:36.954113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:36.954113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:36.954113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:37.456043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:37.466093 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6c1934d-537b-4c4f-bfaa-fa0a32007299 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1316 microversion: 2.1 time: 0.551956 Nov 02 14:01:37.485862 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2523/3575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:36 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:37.507206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:37.508066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:37.521555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:37.522054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:37.522490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:37.523235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:37.523715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:37.524138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:38.104066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:38.123585 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3296383f-40d8-4e93-b1b9-59b558edf0a5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.636370 Nov 02 14:01:38.128676 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2524/3576] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:37 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:38.139240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90b4fa63-bd79-46d3-8bd5-358b0c5362b7 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] Calling method '.version_select at 0x7f6f80c2d0d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:38.201866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90b4fa63-bd79-46d3-8bd5-358b0c5362b7 tempest-ServersTestJSON-1006634036 tempest-ServersTestJSON-1006634036-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393082435" status: 202 len: 0 microversion: 2.1 time: 0.071343 Nov 02 14:01:38.211669 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2525/3577] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 14:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393082435 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:01:38.229925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:38.235721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:38.257583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:38.259280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:38.260256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:38.261704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:38.263485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:38.264522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:38.594964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:38.607017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:38.608754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:38.610131 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-031335a9-3a60-4633-bae0-5fc28a1204ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1405 microversion: 2.20 time: 0.395824 Nov 02 14:01:38.611207 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2526/3578] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:38 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:38.616134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:38.616957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:38.657512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:38.658422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:38.662269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:38.664550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:38.665644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:38.666450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:39.185652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:39.198310 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c7b1815-b0bd-46c6-8437-9eded0a45cdd tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1500 microversion: 2.1 time: 0.583113 Nov 02 14:01:39.198497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2527/3579] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:38 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1500 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:39.219061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:39.224389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:39.237846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:39.238345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:39.238781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:39.240544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:39.241016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:39.241444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:39.440083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74456b30-8266-4cc8-83c2-1d0a974407c9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.233394 Nov 02 14:01:39.445515 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2528/3580] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:01:39 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:01:39.457505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:39.458209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:39.481009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:39.481590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:39.483665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:39.486437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:39.486857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:39.487327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:40.057321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:40.074956 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-293bdeed-7b82-4b96-a8f7-eb9963a764f5 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1504 microversion: 2.1 time: 0.627986 Nov 02 14:01:40.076324 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2529/3581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:39 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1504 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:40.086994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-407c9553-46f2-4bec-9dbf-ecc9f0e08dbe req-af93b01d-7e3b-4983-8fc2-bbbbdac0e5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:40.129898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-407c9553-46f2-4bec-9dbf-ecc9f0e08dbe req-af93b01d-7e3b-4983-8fc2-bbbbdac0e5be service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:40.136197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-407c9553-46f2-4bec-9dbf-ecc9f0e08dbe req-af93b01d-7e3b-4983-8fc2-bbbbdac0e5be service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:40.136611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-407c9553-46f2-4bec-9dbf-ecc9f0e08dbe req-af93b01d-7e3b-4983-8fc2-bbbbdac0e5be service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:40.212264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-407c9553-46f2-4bec-9dbf-ecc9f0e08dbe req-af93b01d-7e3b-4983-8fc2-bbbbdac0e5be service nova] Creating event network-changed:d980ec30-b400-4aee-926a-0adf67991425 for instance b4cea623-4709-4680-9646-d7263f443356 on n-h2-858238-3 Nov 02 14:01:40.239745 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-407c9553-46f2-4bec-9dbf-ecc9f0e08dbe req-af93b01d-7e3b-4983-8fc2-bbbbdac0e5be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153634 Nov 02 14:01:40.246384 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2530/3582] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:40.302653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:40.306742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:40.338147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:40.341900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:40.345983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:40.347564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:40.350905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:40.353033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:41.604767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:41.617001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb09c211-c88f-4609-bdbc-503338a4895a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1673 microversion: 2.1 time: 1.365642 Nov 02 14:01:41.625394 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2531/3583] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:40 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1673 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:41.662008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:41.663085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:41.695544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:41.696274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:41.696848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:41.697693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:41.698285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:41.705994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:41.788461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:42.261768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:42.274313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:42.281482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:42.283035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cfa0fa56-7d2e-4935-a3e2-26ab77e74c76 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1405 microversion: 2.20 time: 0.652926 Nov 02 14:01:42.288365 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2532/3584] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:41 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1405 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:42.321098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:42.327117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:42.339767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:42.340219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:42.340813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:42.342333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:42.343077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:42.344451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:42.392471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b96dff52-35d7-42df-a194-de90f7465880 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46/ips" status: 200 len: 108 microversion: 2.1 time: 0.090843 Nov 02 14:01:42.402447 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2533/3585] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:01:42 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46/ips => generated 108 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:42.408139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:42.408989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:42.416935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:42.417649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:42.418389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:42.419307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:42.419941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:42.421120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:43.427500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:43.453915 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9ff0f8c-73fa-4664-aa2b-97a8acfeadd5 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1500 microversion: 2.1 time: 1.049513 Nov 02 14:01:43.457896 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2534/3586] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:42 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1500 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:43.464473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:43.468586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:43.484922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:43.485418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:43.485857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:43.486562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:43.487018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:43.494055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:43.584258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2af8a4a-efeb-4d14-b8b8-3572d1966988 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46/ips" status: 200 len: 108 microversion: 2.1 time: 0.124989 Nov 02 14:01:43.592557 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2535/3587] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:01:43 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46/ips => generated 108 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:43.614858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:43.615553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:43.666926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:43.669566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:43.675179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:43.677549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:43.679476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:43.681305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:44.058478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:44.077673 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0768364-7673-47bd-8ed8-f5224d21c16e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1678 microversion: 2.1 time: 0.478302 Nov 02 14:01:44.091132 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2536/3588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:43 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1678 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:44.091132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bbe4c8ff-182f-4ba0-afc7-1cf7f9c4d260 req-f7e4f3e4-6f45-49a5-873a-eed2b9fbb2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "name": "network-vif-plugged", "status": "completed", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:44.119476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bbe4c8ff-182f-4ba0-afc7-1cf7f9c4d260 req-f7e4f3e4-6f45-49a5-873a-eed2b9fbb2e4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.119974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bbe4c8ff-182f-4ba0-afc7-1cf7f9c4d260 req-f7e4f3e4-6f45-49a5-873a-eed2b9fbb2e4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.120570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bbe4c8ff-182f-4ba0-afc7-1cf7f9c4d260 req-f7e4f3e4-6f45-49a5-873a-eed2b9fbb2e4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:44.142006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bbe4c8ff-182f-4ba0-afc7-1cf7f9c4d260 req-f7e4f3e4-6f45-49a5-873a-eed2b9fbb2e4 service nova] Creating event network-vif-plugged:d980ec30-b400-4aee-926a-0adf67991425 for instance b4cea623-4709-4680-9646-d7263f443356 on n-h2-858238-3 Nov 02 14:01:44.150395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bbe4c8ff-182f-4ba0-afc7-1cf7f9c4d260 req-f7e4f3e4-6f45-49a5-873a-eed2b9fbb2e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070391 Nov 02 14:01:44.151033 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2537/3589] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:44.158200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:44.159239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:44.171876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.173221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.173870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:44.175148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.175648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.176055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:44.860581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:44.873256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:44.876869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:44.878906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19772504-60ab-4f34-81c2-34376f18fa53 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1405 microversion: 2.20 time: 0.726673 Nov 02 14:01:44.884542 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2538/3590] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:44 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1405 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:44.903910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:44.905206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:44.928556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.931201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.938562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:44.944260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:44.949029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:44.949768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.040282 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3515dfef-4864-4302-a498-df9c8d8f74c6 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46/ips/tempest-ServerAddressesTestJSON-694851196-network" status: 200 len: 93 microversion: 2.1 time: 0.152481 Nov 02 14:01:45.041585 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2539/3591] 10.222.0.18 () {58 vars in 1398 bytes} [Wed Nov 2 14:01:44 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46/ips/tempest-ServerAddressesTestJSON-694851196-network => generated 93 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:01:45.052958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:45.054056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:45.073212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:45.073720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:45.074207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.075979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:45.075979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:45.088796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.407731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:45.423424 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a59caa4-00f6-4238-8d6e-7081f2c6a444 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1500 microversion: 2.1 time: 0.379990 Nov 02 14:01:45.440445 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2540/3592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:45 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1500 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:45.452057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:45.452670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:45.460708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:45.461186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:45.461630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.462441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:45.463411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:45.463411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.517470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:45.702158 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85bdff2c-8567-41b0-84e6-d9282aa34e83 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "DELETE /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 204 len: 0 microversion: 2.1 time: 0.254247 Nov 02 14:01:45.703846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2541/3593] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:01:45 2022] DELETE /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:01:45.710996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:45.713305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:45.722327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:45.723067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:45.723688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:45.725128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:45.726800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:45.727709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.101571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:46.113806 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d07d1f08-6d33-4006-b489-e068d4ecb0ab tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.408571 Nov 02 14:01:46.133206 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2542/3594] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:45 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:46.155958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:46.156801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:46.183191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.183730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.186183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.187559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.188770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.189580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.488480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:46.534317 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-07c61b63-93e0-4226-884c-6eb422e1f8d1 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1510 microversion: 2.1 time: 0.389084 Nov 02 14:01:46.554839 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2543/3595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:46 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:46.571079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:46.572223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:46.585390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.586169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.586777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:46.587683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:46.588278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:46.589021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:47.133477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:47.149274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:47.165403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:47.170276 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9227517-f1c9-48c9-add1-acd87c18ee94 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1405 microversion: 2.20 time: 0.607963 Nov 02 14:01:47.185225 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2544/3596] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:46 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1405 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:47.230734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:47.259499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:47.294368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:47.310422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:47.319756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:47.321935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:47.330396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:47.330658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:47.598297 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac9a2014-50d0-4d39-a74a-21c6853d8269 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 200 len: 322 microversion: 2.1 time: 0.410782 Nov 02 14:01:47.599306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2545/3597] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:01:47 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:47.617775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:47.623968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:47.652039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:47.656059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:47.664656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:47.680884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:47.685985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:47.694217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:48.404001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:48.445924 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e43486d-df1c-46d0-a6e7-2016e0a3dcd3 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1500 microversion: 2.1 time: 0.838066 Nov 02 14:01:48.470161 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2546/3598] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:47 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1500 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:48.489599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:48.489599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:48.493691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:48.493899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:48.494265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:48.494977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:48.495459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:48.495886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:49.293623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ec248842b24145bf87267f4383fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae5e4f62dd44154adeeb799b249050b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:49.318872 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-575115d5-bbf7-4e17-8cd4-8304edfdd3cb tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 200 len: 1510 microversion: 2.1 time: 0.846667 Nov 02 14:01:49.324214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2547/3599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:48 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 1510 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:49.333176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:49.340563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:49.361275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:49.366761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:49.367482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:49.371826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:49.377242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:49.378053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:49.697312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:49.712465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19f5dc51-6d37-42b1-9618-301f705cd957 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.386396 Nov 02 14:01:49.718164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2548/3600] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:49 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:49.746572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:49.747752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:49.760205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:49.763404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:49.766760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:49.772713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:49.773997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:49.774611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:49.787877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:50.259987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:50.270316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:50.272084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:50.273275 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f3aa764-b5d2-4ebf-b772-04dc975f4fc5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1596 microversion: 2.20 time: 0.552339 Nov 02 14:01:50.287553 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2549/3601] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:01:49 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1596 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:01:50.299133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1c3b631a-b65b-4a4f-a26c-c1f5ccecc157 req-b9aa1c8d-ee7d-47f1-8957-2c90891fb687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71557dc7-61c1-4066-aa03-7a9bcc8b7d46", "name": "network-vif-deleted", "tag": "67a1bb7b-c01e-4614-a3b7-c60746b0d11d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:50.316227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1c3b631a-b65b-4a4f-a26c-c1f5ccecc157 req-b9aa1c8d-ee7d-47f1-8957-2c90891fb687 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:50.316801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1c3b631a-b65b-4a4f-a26c-c1f5ccecc157 req-b9aa1c8d-ee7d-47f1-8957-2c90891fb687 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:50.317531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1c3b631a-b65b-4a4f-a26c-c1f5ccecc157 req-b9aa1c8d-ee7d-47f1-8957-2c90891fb687 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:50.336270 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1c3b631a-b65b-4a4f-a26c-c1f5ccecc157 req-b9aa1c8d-ee7d-47f1-8957-2c90891fb687 service nova] Creating event network-vif-deleted:67a1bb7b-c01e-4614-a3b7-c60746b0d11d for instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 on n-h1-858238-3 Nov 02 14:01:50.344590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1c3b631a-b65b-4a4f-a26c-c1f5ccecc157 req-b9aa1c8d-ee7d-47f1-8957-2c90891fb687 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053455 Nov 02 14:01:50.347132 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2550/3602] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:50.357203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:50.358283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:50.369431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:50.370233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:50.371539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:50.372396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:50.373102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:50.373671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:50.774440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:50.825429 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23cae1c9-3453-44dc-b5f7-037d8cdb336d tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1487 microversion: 2.1 time: 0.474572 Nov 02 14:01:50.826362 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2551/3603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:50 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1487 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:50.833087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:50.835554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:50.845108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:50.849417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:50.850174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:50.851055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:50.851745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:50.852318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.401459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:51.422858 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d909d6df-764d-47ab-bf53-c79f8c56cc0f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.594885 Nov 02 14:01:51.424012 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2552/3604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:50 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:51.444643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:51.445396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:51.487630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:51.490506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:51.495851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.496799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:51.497585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:51.498528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.714026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-726a7130-6ece-4e5f-b612-8a3a184f1cdd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.288346 Nov 02 14:01:51.716038 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2553/3605] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 14:01:51 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:01:51.728257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:51.729317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] [instance: 71557dc7-61c1-4066-aa03-7a9bcc8b7d46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:51.750776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:51.753628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:51.755507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.758088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:51.759302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:51.760682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.804648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] HTTP exception thrown: Instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 could not be found. Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Request method failure captured: Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 HTTP/1.1 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngiq_NqnnVvlcfA_E4f0QGWdPrBXCCyjISSvyks2YpkSqYc7zSupNZSDknpujxLzc6MZAKqSSi8ahOX8uin7yPn_4kMoRP-1ws9-35BJbKlR_0HjgFf0Dx72kjO4wmbm1vAwtOKnQ81tuK6TX0d3FLnYksKEWD2MzXQPSXJtQZQR48 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4ae5e4f62dd44154adeeb799b249050b Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerAddressesTestJSON-2026851386 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ae5e4f62dd44154adeeb799b249050b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ae5e4f62dd44154adeeb799b249050b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ae5e4f62dd44154adeeb799b249050b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ae5e4f62dd44154adeeb799b249050b"}]}] Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerAddressesTestJSON-2026851386 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4ae5e4f62dd44154adeeb799b249050b Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2026851386 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerAddressesTestJSON-2026851386-project Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b1ec248842b24145bf87267f4383fd99 Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerAddressesTestJSON-2026851386-project Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 could not be found. Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '71557dc7-61c1-4066-aa03-7a9bcc8b7d46'} Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 could not be found. Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 could not be found. Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:51.813589 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 could not be found. Nov 02 14:01:51.817344 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:51.817762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] Returning 404 to user: Instance 71557dc7-61c1-4066-aa03-7a9bcc8b7d46 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:51.818867 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59323158-72c1-40ba-9529-5e295d2ce109 tempest-ServerAddressesTestJSON-2026851386 tempest-ServerAddressesTestJSON-2026851386-project] 10.222.0.18 "GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46" status: 404 len: 111 microversion: 2.1 time: 0.100881 Nov 02 14:01:51.819508 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2554/3606] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:51 2022] GET /compute/v2.1/servers/71557dc7-61c1-4066-aa03-7a9bcc8b7d46 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:01:51.845673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:51.846484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:51.870071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:51.870657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:51.877856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.878973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:51.879674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:51.882650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:51.982566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:52.172438 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43e6750a-5507-453a-badb-7a55a00351b7 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 204 len: 0 microversion: 2.1 time: 0.346223 Nov 02 14:01:52.177619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2555/3607] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:01:51 2022] DELETE /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:01:52.184002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e18861e5-a07f-4edf-a0f6-c6515d11ab48 req-ff58ae25-e0b6-4cb4-9bf4-2adf0a7900f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe", "name": "network-vif-unplugged", "status": "completed", "tag": "5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:52.197279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e18861e5-a07f-4edf-a0f6-c6515d11ab48 req-ff58ae25-e0b6-4cb4-9bf4-2adf0a7900f9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.198235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e18861e5-a07f-4edf-a0f6-c6515d11ab48 req-ff58ae25-e0b6-4cb4-9bf4-2adf0a7900f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.198765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e18861e5-a07f-4edf-a0f6-c6515d11ab48 req-ff58ae25-e0b6-4cb4-9bf4-2adf0a7900f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.228100 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e18861e5-a07f-4edf-a0f6-c6515d11ab48 req-ff58ae25-e0b6-4cb4-9bf4-2adf0a7900f9 service nova] Creating event network-vif-unplugged:5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2 for instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe on n-h2-858238-3 Nov 02 14:01:52.237312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e18861e5-a07f-4edf-a0f6-c6515d11ab48 req-ff58ae25-e0b6-4cb4-9bf4-2adf0a7900f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057755 Nov 02 14:01:52.244722 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2556/3608] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:52.251213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:52.251861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:52.259604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.260096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.260720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.261963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.262640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.263705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.727630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:52.739750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8379350-95df-4251-b2a0-6d2cd35fb30a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.493399 Nov 02 14:01:52.741590 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2557/3609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:52 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:52.767035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a97c9d0e-f29f-483b-a076-dc4d61741d22 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f8094b8b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:52.822552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a97c9d0e-f29f-483b-a076-dc4d61741d22 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Image not found. Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a97c9d0e-f29f-483b-a076-dc4d61741d22 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 HTTP/1.1 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '72bc1404-9c6e-4f88-a0a6-d680396ea3b4'} Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 72bc1404-9c6e-4f88-a0a6-d680396ea3b4 to delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 72bc1404-9c6e-4f88-a0a6-d680396ea3b4 could not be found. Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.828961 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 14:01:52.832673 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:52.836198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a97c9d0e-f29f-483b-a076-dc4d61741d22 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:52.838808 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a97c9d0e-f29f-483b-a076-dc4d61741d22 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4" status: 404 len: 62 microversion: 2.1 time: 0.095953 Nov 02 14:01:52.840169 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2558/3610] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:52 2022] DELETE /compute/v2.1/images/72bc1404-9c6e-4f88-a0a6-d680396ea3b4 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:01:52.848553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:52.850297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:52.861794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.862589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.863254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.864170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.865009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.866682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:53.976650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:53.994242 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dde9236d-8f7a-4af1-abb8-13282e93f55d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 1.150221 Nov 02 14:01:53.995164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2559/3611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:52 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:54.008476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:54.010457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:54.036120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:54.041497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:54.042491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:54.045343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:54.046203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:54.048763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:54.138804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:54.244566 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Instance is already in deleting state, ignoring this request Nov 02 14:01:54.249392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64d310b2-7abe-4631-b324-581db7301a9b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 204 len: 0 microversion: 2.1 time: 0.249123 Nov 02 14:01:54.251034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2560/3612] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:01:53 2022] DELETE /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:01:54.268262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:54.271148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:54.288138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:54.288821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:54.294702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:54.296120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:54.296972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:54.297935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:55.095697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:55.106511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7c4181b-8bd1-493f-94dd-40c36fdd120b tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1493 microversion: 2.1 time: 0.850199 Nov 02 14:01:55.109250 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2561/3613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:54 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1493 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:55.121130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1933689115", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f846ebbf-8ebf-4f30-afa6-7c615971cecb"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:55.283695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] validate_networks() for [('f846ebbf-8ebf-4f30-afa6-7c615971cecb', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:01:57.694627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:01:57.695263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:01:57.695551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:01:57.696120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:01:57.696678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:01:57.701558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:57.725538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:57.726032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:57.726470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:57.739500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:57.740157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:57.740604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:57.810284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:01:57.825906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for user 53bef65bfa79486a8f0180f2f86eddba and project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:01:57.877038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:01:57.889010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:01:58.071481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-686d1264-0aba-468d-b4b0-4fda2280d6bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.951582 Nov 02 14:01:58.088700 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2562/3614] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:01:58.102309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:58.103225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:58.127243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:58.130127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:58.131595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:58.134063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:58.134559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:58.135002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:58.345079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:58.350102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:58.350697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:58.357137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lazy-loading 'fault' on Instance uuid 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:01:58.510024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165803256c184acc801878f0cb60cc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ef7986a0f4b6ca674a7d1bddf68ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:58.519338 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5877dbd0-7548-45de-8a14-6117e96c53b0 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 200 len: 1385 microversion: 2.1 time: 0.429332 Nov 02 14:01:58.524849 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2563/3615] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:58 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 1385 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:58.553429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0280b9a7-58e9-4eec-a3bc-1b774685f6f4 req-ebe25926-d607-48dd-a4e6-b9b7f78e630b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:58.591086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0280b9a7-58e9-4eec-a3bc-1b774685f6f4 req-ebe25926-d607-48dd-a4e6-b9b7f78e630b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:58.594551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0280b9a7-58e9-4eec-a3bc-1b774685f6f4 req-ebe25926-d607-48dd-a4e6-b9b7f78e630b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:58.596280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0280b9a7-58e9-4eec-a3bc-1b774685f6f4 req-ebe25926-d607-48dd-a4e6-b9b7f78e630b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:58.645010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0280b9a7-58e9-4eec-a3bc-1b774685f6f4 req-ebe25926-d607-48dd-a4e6-b9b7f78e630b service nova] Creating event network-changed:d980ec30-b400-4aee-926a-0adf67991425 for instance b4cea623-4709-4680-9646-d7263f443356 on n-h2-858238-3 Nov 02 14:01:58.666902 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0280b9a7-58e9-4eec-a3bc-1b774685f6f4 req-ebe25926-d607-48dd-a4e6-b9b7f78e630b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138503 Nov 02 14:01:58.668971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2564/3616] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:58.690529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40adc69a-08a5-40fd-b6be-46fd75a63f6e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:58.696108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-40adc69a-08a5-40fd-b6be-46fd75a63f6e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:58.894129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40adc69a-08a5-40fd-b6be-46fd75a63f6e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:58.926684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40adc69a-08a5-40fd-b6be-46fd75a63f6e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1215 microversion: 2.1 time: 0.256165 Nov 02 14:01:58.932959 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2565/3617] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:58 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1215 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:59.545865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:59.546485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:59.565484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:59.568656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:59.569348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:59.570258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:59.573004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:59.573612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:59.616731 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe could not be found. Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe HTTP/1.1 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe could not be found. Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe'} Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe could not be found. Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe could not be found. Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.627586 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.631212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:59.631212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:59.631212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:59.631212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:59.631212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe could not be found. Nov 02 14:01:59.631212 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.633030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:59.634573 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3611d8b9-2d11-4ad7-9fcd-aa9e8097ab8a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe" status: 404 len: 111 microversion: 2.1 time: 0.092654 Nov 02 14:01:59.637915 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2566/3618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:59 2022] GET /compute/v2.1/servers/5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:01:59.651662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:59.652612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:59.666794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:59.668217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:59.674748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:59.675558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:59.676067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:59.676438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:59.709545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c HTTP/1.1 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fee29ad5-dcea-4b71-ab8e-959031a0842c'} Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:59.714524 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.717974 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.721905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:59.723792 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0134e69-60b0-4997-8403-40f6a7dac596 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 404 len: 111 microversion: 2.1 time: 0.082098 Nov 02 14:01:59.727414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2567/3619] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:01:59 2022] DELETE /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:01:59.749214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:59.750576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: fee29ad5-dcea-4b71-ab8e-959031a0842c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:59.786448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:59.787289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:59.802594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:59.819687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:59.820918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:59.821646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:59.932971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c HTTP/1.1 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fee29ad5-dcea-4b71-ab8e-959031a0842c'} Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.936245 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance fee29ad5-dcea-4b71-ab8e-959031a0842c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:59.939531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61746391-b365-4865-a384-758b4de18775 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c" status: 404 len: 111 microversion: 2.1 time: 0.206319 Nov 02 14:01:59.959867 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2568/3620] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:59 2022] GET /compute/v2.1/servers/fee29ad5-dcea-4b71-ab8e-959031a0842c => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:01:59.992056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:59.997139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:00.029734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.030235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.030670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.035819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.036353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.044501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.443466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:00.476651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e00f334c-92ff-409b-b437-712ff488430f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1219 microversion: 2.1 time: 0.515321 Nov 02 14:02:00.477529 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2569/3621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:01:59 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1219 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:00.499383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c058c612-1b19-4979-b3b1-7a0afe676f06 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f80949ee0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:00.565794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c058c612-1b19-4979-b3b1-7a0afe676f06 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Image not found. Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c058c612-1b19-4979-b3b1-7a0afe676f06 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 HTTP/1.1 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2835a5b9-10a5-4c37-b24a-d4cee0591787'} Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2835a5b9-10a5-4c37-b24a-d4cee0591787 to delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2835a5b9-10a5-4c37-b24a-d4cee0591787 could not be found. Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.567724 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c058c612-1b19-4979-b3b1-7a0afe676f06 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c058c612-1b19-4979-b3b1-7a0afe676f06 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787" status: 404 len: 62 microversion: 2.1 time: 0.075050 Nov 02 14:02:00.573619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2570/3622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:00 2022] DELETE /compute/v2.1/images/2835a5b9-10a5-4c37-b24a-d4cee0591787 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:02:00.582118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:00.586037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:00.601230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.602631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.603859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.605294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.606360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.607696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.631436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:00.633507 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 HTTP/1.1 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'faabbaf3-73f3-44c4-88cf-73a182ad7bc1'} Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:00.635558 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.638888 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.644212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:00.645550 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04f2edc4-51e7-40a5-b68a-4d186b111e64 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 404 len: 111 microversion: 2.1 time: 0.071134 Nov 02 14:02:00.646594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2571/3623] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:02:00 2022] DELETE /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:00.662440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:00.664746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: faabbaf3-73f3-44c4-88cf-73a182ad7bc1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:00.680206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.682603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.684700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.687315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.688780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.689341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.709341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 HTTP/1.1 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'faabbaf3-73f3-44c4-88cf-73a182ad7bc1'} Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.711276 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.714926 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.714926 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.714926 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:00.714926 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:00.714926 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. Nov 02 14:02:00.714926 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.719221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance faabbaf3-73f3-44c4-88cf-73a182ad7bc1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:00.720321 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4b485fc-f44d-47b5-b6a7-59c3d34fefb8 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1" status: 404 len: 111 microversion: 2.1 time: 0.068105 Nov 02 14:02:00.721364 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2572/3624] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:00 2022] GET /compute/v2.1/servers/faabbaf3-73f3-44c4-88cf-73a182ad7bc1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:02:00.737905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e465b3c0-08d5-463c-b941-05ffccb409a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f809b10d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:00.825692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e465b3c0-08d5-463c-b941-05ffccb409a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Image not found. Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e465b3c0-08d5-463c-b941-05ffccb409a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 HTTP/1.1 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'cd472180-c01c-4cf8-8f73-77624d80e516'} Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd472180-c01c-4cf8-8f73-77624d80e516 to delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd472180-c01c-4cf8-8f73-77624d80e516 could not be found. Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.830043 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 14:02:00.834203 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:00.836548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e465b3c0-08d5-463c-b941-05ffccb409a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:00.837493 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e465b3c0-08d5-463c-b941-05ffccb409a4 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516" status: 404 len: 62 microversion: 2.1 time: 0.107635 Nov 02 14:02:00.842073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2573/3625] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:00 2022] DELETE /compute/v2.1/images/cd472180-c01c-4cf8-8f73-77624d80e516 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:02:00.855178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5555b0e0-f509-4ff8-9f83-7efcb0c2df5d req-e4fad15a-ab0e-4fb9-b116-8d1650986cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe", "name": "network-vif-deleted", "tag": "5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:00.892462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5555b0e0-f509-4ff8-9f83-7efcb0c2df5d req-e4fad15a-ab0e-4fb9-b116-8d1650986cfe service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.894287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5555b0e0-f509-4ff8-9f83-7efcb0c2df5d req-e4fad15a-ab0e-4fb9-b116-8d1650986cfe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:00.895499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5555b0e0-f509-4ff8-9f83-7efcb0c2df5d req-e4fad15a-ab0e-4fb9-b116-8d1650986cfe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:00.928293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5555b0e0-f509-4ff8-9f83-7efcb0c2df5d req-e4fad15a-ab0e-4fb9-b116-8d1650986cfe service nova] Creating event network-vif-deleted:5fbb4b50-8f58-4eb6-bed7-4b08b7cc2bd2 for instance 5d12d7bc-ce69-4e5d-a2d8-8d12a1a06ebe on n-h2-858238-3 Nov 02 14:02:00.953840 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5555b0e0-f509-4ff8-9f83-7efcb0c2df5d req-e4fad15a-ab0e-4fb9-b116-8d1650986cfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109305 Nov 02 14:02:00.955304 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2574/3626] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:00.966940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:00.968197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:00.982115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:00.996219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.001781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.003551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.004668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.005661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.052881 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 HTTP/1.1 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7e372cb2-6bbd-464c-8e36-a3180d6d6a65'} Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:01.058668 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.063340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.071803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:01.073578 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3bb25a33-106b-4272-8892-992474a6ba65 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 404 len: 111 microversion: 2.1 time: 0.116382 Nov 02 14:02:01.084665 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2575/3627] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:02:00 2022] DELETE /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:01.097922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:01.110922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 7e372cb2-6bbd-464c-8e36-a3180d6d6a65] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:01.139138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.141845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.145455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.147035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.148181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.149198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.188420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 HTTP/1.1 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7e372cb2-6bbd-464c-8e36-a3180d6d6a65'} Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.193145 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.197526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.197526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.197526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:01.197526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:01.197526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. Nov 02 14:02:01.197526 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.199497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance 7e372cb2-6bbd-464c-8e36-a3180d6d6a65 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:01.201208 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be9a4b8d-5b7b-47de-bb6f-044f312228eb tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65" status: 404 len: 111 microversion: 2.1 time: 0.113664 Nov 02 14:02:01.202348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2576/3628] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:01 2022] GET /compute/v2.1/servers/7e372cb2-6bbd-464c-8e36-a3180d6d6a65 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:01.214275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c181956-b714-4039-ad12-098026f50c4e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f809e6670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:01.279731 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7c181956-b714-4039-ad12-098026f50c4e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Image not found. Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c181956-b714-4039-ad12-098026f50c4e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b HTTP/1.1 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b'} Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b to delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b could not be found. Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.283536 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 14:02:01.290077 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.295275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c181956-b714-4039-ad12-098026f50c4e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:01.298545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7c181956-b714-4039-ad12-098026f50c4e tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b" status: 404 len: 62 microversion: 2.1 time: 0.089754 Nov 02 14:02:01.300228 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2577/3629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:01 2022] DELETE /compute/v2.1/images/6ac613c7-ea18-4cf6-ba69-821bc4bf6e5b => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:02:01.332537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:01.338432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:01.371713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.372324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.372778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.374471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.376200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.376642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.429764 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 HTTP/1.1 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'efc10b59-116f-41f9-8a18-3fdae1910ef0'} Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:01.434397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.438550 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.441281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:01.442453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85847543-27b3-46af-b553-031ec830e08a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 404 len: 111 microversion: 2.1 time: 0.135095 Nov 02 14:02:01.442804 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2578/3630] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:02:01 2022] DELETE /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:01.461041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:01.461737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: efc10b59-116f-41f9-8a18-3fdae1910ef0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:01.473028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.481530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.482352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.483718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.485103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.485864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.527936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 HTTP/1.1 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'efc10b59-116f-41f9-8a18-3fdae1910ef0'} Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.529890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance efc10b59-116f-41f9-8a18-3fdae1910ef0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be6a9c05-63c2-45be-ada9-7f7dce77c946 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0" status: 404 len: 111 microversion: 2.1 time: 0.085702 Nov 02 14:02:01.537029 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2579/3631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:01 2022] GET /compute/v2.1/servers/efc10b59-116f-41f9-8a18-3fdae1910ef0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:01.550008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:01.550827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:01.563499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.563991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.564450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:01.565350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:01.565836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:01.566413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:02.564050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:02.587659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15d4acc1-7c5e-4dfa-a66f-51aa8f66dac5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1275 microversion: 2.1 time: 1.051477 Nov 02 14:02:02.589894 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2580/3632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:01 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1275 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:02.612495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f81d9b4-b9fb-4822-9772-cc0a3e0dcf46 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '.version_select at 0x7f6f809904c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:02.664156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2f81d9b4-b9fb-4822-9772-cc0a3e0dcf46 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Image not found. Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f81d9b4-b9fb-4822-9772-cc0a3e0dcf46 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d HTTP/1.1 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: method: Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: exception: Image not found. Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '210972ef-b337-4402-9f63-10763b003b5d'} Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 210972ef-b337-4402-9f63-10763b003b5d to delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 210972ef-b337-4402-9f63-10763b003b5d could not be found. Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.669425 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f81d9b4-b9fb-4822-9772-cc0a3e0dcf46 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Image not found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:02.673458 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f81d9b4-b9fb-4822-9772-cc0a3e0dcf46 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d" status: 404 len: 62 microversion: 2.1 time: 0.080544 Nov 02 14:02:02.682046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2581/3633] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:02 2022] DELETE /compute/v2.1/images/210972ef-b337-4402-9f63-10763b003b5d => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:02:02.709259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:02.752940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:02.790634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:02.791181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:02.791627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:02.792830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:02.793298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:02.793728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:02.833445 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 HTTP/1.1 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9bcbe90f-0c88-4001-974c-5f232a11b7c7'} Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:02.835041 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.838394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:02.839070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d1eba97-4b9c-4a7d-8901-dc0f00817424 tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 404 len: 111 microversion: 2.1 time: 0.154030 Nov 02 14:02:02.839070 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2582/3634] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:02:02 2022] DELETE /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:02.862565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:02.863209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] [instance: 9bcbe90f-0c88-4001-974c-5f232a11b7c7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:02.881083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:02.881664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:02.882103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:02.882812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:02.883291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:02.886624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:02.983824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] HTTP exception thrown: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Request method failure captured: Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 HTTP/1.1 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnaWL_zuNy9_Qp7GH1ByarP85guu1mwjQlFwL-kq-hGlGJs5XF4VKwHC19A6JjZ9pA5LDsK2mIeLVmLPptwPVIRqlO9w_39deOY1ZCiOxNVr8FToR8spIbtKKfSmNNTMil_0BpXY-lBNf_wRKuA8XZ7oOkYdaFhgniLRaM4nOphTnCg Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c0ef7986a0f4b6ca674a7d1bddf68ca"}]}] Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 8c0ef7986a0f4b6ca674a7d1bddf68ca Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ImagesTestJSON-71911093 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 165803256c184acc801878f0cb60cc67 Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ImagesTestJSON-71911093-project Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9bcbe90f-0c88-4001-974c-5f232a11b7c7'} Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:02.988701 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:02.997480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:02.997480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:02.997480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:02.997480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:02.997480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. Nov 02 14:02:02.997480 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:03.000378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] Returning 404 to user: Instance 9bcbe90f-0c88-4001-974c-5f232a11b7c7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:03.003475 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca35812a-fc31-4201-9db9-d3a6dc37a78a tempest-ImagesTestJSON-71911093 tempest-ImagesTestJSON-71911093-project] 10.222.0.18 "GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7" status: 404 len: 111 microversion: 2.1 time: 0.147360 Nov 02 14:02:03.011165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2583/3635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:02 2022] GET /compute/v2.1/servers/9bcbe90f-0c88-4001-974c-5f232a11b7c7 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:03.623426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:03.624523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:03.668456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:03.669609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:03.670561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:03.677655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:03.678717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:03.679748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:04.117755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:04.132737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-186371ba-f8e8-41ae-a22f-028775100e2e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1273 microversion: 2.1 time: 0.510435 Nov 02 14:02:04.133403 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2584/3636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:03 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1273 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:05.168397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:05.170933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:05.205923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:05.214481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:05.214925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:05.216059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:05.217906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:05.218752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:05.885783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:05.896099 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f6289fd-60eb-426c-b6fa-aae00aec46c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1273 microversion: 2.1 time: 0.736764 Nov 02 14:02:05.915436 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2585/3637] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:05 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1273 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:06.924318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:06.928677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:06.956785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:06.959685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:06.965428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:06.970429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:06.974599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:06.976431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:07.662255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:07.672703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-063eecb6-19a2-4169-b941-f36ac2db840c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 0.753660 Nov 02 14:02:07.679352 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2586/3638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:06 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:08.709941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:08.711668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:08.714153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:08.731812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:08.735886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:08.741988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:08.742772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:08.743279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:08.743707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:08.900632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:09.815372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:09.855043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-169e827b-098c-4830-a3b6-89b0ca7bbe00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 1.148235 Nov 02 14:02:09.857018 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2587/3639] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:08 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:10.924060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:10.939511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:10.962974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:10.964906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:10.966520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:10.967771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:10.968991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:10.969853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:12.316136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:12.332325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0be76c82-a7f0-446f-b61b-8480bd9ad4fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 1.445909 Nov 02 14:02:12.332325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2588/3640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:10 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:13.392259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:13.394112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:13.403146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:13.403922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:13.404513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:13.405403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:13.406016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:13.410587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:15.191864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:15.234933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-febd737c-29f4-4a22-9e22-33c037835efd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 1.845674 Nov 02 14:02:15.239143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2589/3641] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:13 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:15.258576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-01d99c69-eea4-469c-a811-df149321b3b7 req-e5a166f9-1e6c-421c-9f68-9f8558e49149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49c5eac-d05c-48be-b4bd-3254cd3ef74a", "tag": "96564291-d990-4f57-ae51-6dd88e66f18f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:15.321549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-01d99c69-eea4-469c-a811-df149321b3b7 req-e5a166f9-1e6c-421c-9f68-9f8558e49149 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:15.324731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-01d99c69-eea4-469c-a811-df149321b3b7 req-e5a166f9-1e6c-421c-9f68-9f8558e49149 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:15.328874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-01d99c69-eea4-469c-a811-df149321b3b7 req-e5a166f9-1e6c-421c-9f68-9f8558e49149 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:15.422369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-01d99c69-eea4-469c-a811-df149321b3b7 req-e5a166f9-1e6c-421c-9f68-9f8558e49149 service nova] Creating event network-changed:96564291-d990-4f57-ae51-6dd88e66f18f for instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a on n-h1-858238-3 Nov 02 14:02:15.431712 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-01d99c69-eea4-469c-a811-df149321b3b7 req-e5a166f9-1e6c-421c-9f68-9f8558e49149 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189352 Nov 02 14:02:15.433865 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2590/3642] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:16.271077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:16.275871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:16.298553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:16.299890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:16.308152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:16.309984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:16.310930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:16.311903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:18.441511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:18.457617 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50530d77-28d7-4ffb-92c3-5bb4b8fad28c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 2.194334 Nov 02 14:02:18.475943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2591/3643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:16 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:19.481473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:19.482026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:19.498543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:19.503485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:19.504071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:19.504856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:19.510886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:19.511493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:20.941403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:20.956249 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6edaecc-f1b7-4472-8bd3-b62cba1f8c21 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 1.478753 Nov 02 14:02:20.968311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2592/3644] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:19 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:21.403820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1225207393", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:21.512979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] validate_networks() for [('a9684cee-6315-4a61-b794-f4af97bb47e1', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:24.569534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:24.571290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:24.573311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:24.575626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:24.576351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:24.619956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.620447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.620876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.621606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.622058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.622479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.669726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Getting quotas for project 29b937e6ef644b4eb79f4e99509fac92. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:24.676060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Getting quotas for user 417ea5da9491429996fe8a9c7153f543 and project 29b937e6ef644b4eb79f4e99509fac92. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:24.713133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:24.719312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:24.826853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79a78c05-8d02-4894-8980-fe5cd1c067d5 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.851530 Nov 02 14:02:24.827813 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2593/3645] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:02:24.839517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:24.840140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:24.856279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.856955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.857546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.858472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.861802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.862474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:25.782155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:25.790293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e35ccbb-e26e-4eba-9a4c-d1a594f26353 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 0.961050 Nov 02 14:02:25.805098 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2594/3646] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:24 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:25.810387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50a78f66-e42f-418b-98d2-2aaf730f6ced tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:25.811003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-50a78f66-e42f-418b-98d2-2aaf730f6ced tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:26.041709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-50a78f66-e42f-418b-98d2-2aaf730f6ced tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:26.050273 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50a78f66-e42f-418b-98d2-2aaf730f6ced tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1224 microversion: 2.1 time: 0.243885 Nov 02 14:02:26.056632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2595/3647] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:25 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1224 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:26.814908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:26.815755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:26.842968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:26.849387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:26.852220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:26.855683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:26.857706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:26.860316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.440331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:27.449534 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23148186-f1a0-47e7-b810-b8000cbc9db7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 0.639184 Nov 02 14:02:27.452043 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2596/3648] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:26 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:27.458376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:27.460170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:27.466796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.467613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.468292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.470104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.470845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.471654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.622547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:27.638966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-99ea16ec-6a53-49ec-a7d7-b170ff596421 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1276 microversion: 2.1 time: 0.181362 Nov 02 14:02:27.639911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2597/3649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:27 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:28.119587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e23bb421-7b5b-420c-b25d-5e333423493f req-9d2ecec2-11df-47c9-a47c-6a9e3ecf99f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49c5eac-d05c-48be-b4bd-3254cd3ef74a", "name": "network-vif-plugged", "status": "completed", "tag": "96564291-d990-4f57-ae51-6dd88e66f18f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:28.153241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:28.155723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e23bb421-7b5b-420c-b25d-5e333423493f req-9d2ecec2-11df-47c9-a47c-6a9e3ecf99f5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.156270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e23bb421-7b5b-420c-b25d-5e333423493f req-9d2ecec2-11df-47c9-a47c-6a9e3ecf99f5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.156676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e23bb421-7b5b-420c-b25d-5e333423493f req-9d2ecec2-11df-47c9-a47c-6a9e3ecf99f5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:28.203558 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e23bb421-7b5b-420c-b25d-5e333423493f req-9d2ecec2-11df-47c9-a47c-6a9e3ecf99f5 service nova] Creating event network-vif-plugged:96564291-d990-4f57-ae51-6dd88e66f18f for instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a on n-h1-858238-3 Nov 02 14:02:28.222857 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e23bb421-7b5b-420c-b25d-5e333423493f req-9d2ecec2-11df-47c9-a47c-6a9e3ecf99f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.580938 Nov 02 14:02:28.235994 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2598/3650] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:28.764327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-20fddc84-b2e0-476d-accf-f0b99a0fc2c9 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Action: 'create', calling method: .version_select at 0x7f6f85f611f0>, body: {"keypair": {"name": "tempest-keypair-936651023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFhK69aP20rA1EAs7a0JF5Qeeti9im812gC6xa956Uwj2/kqOx0jaUDJXFFGUMhWNm8vvpDW1TMun8SEO69nisBCEetutkdo/Dc8sP14svlrP5bongw1ZJqWwpud6R3Cw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:28.819023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-20fddc84-b2e0-476d-accf-f0b99a0fc2c9 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Getting quotas for project 7e964b3dcec04af3a90b2444707ce3c1. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:28.839926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-20fddc84-b2e0-476d-accf-f0b99a0fc2c9 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Getting quotas for user 195bac8af8764feaacf0bbc16780257b and project 7e964b3dcec04af3a90b2444707ce3c1. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:28.916353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-20fddc84-b2e0-476d-accf-f0b99a0fc2c9 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.678679 Nov 02 14:02:28.917213 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2599/3651] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:02:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:28.930708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:28.931469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:28.951060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.951665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.952097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:28.952804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.953806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.954223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.741088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:29.758188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:29.766209 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f9bfb48-8dbe-4095-8102-06f33b0bd89b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1315 microversion: 2.1 time: 0.847738 Nov 02 14:02:29.769585 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2600/3652] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:28 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:29.775489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:29.776448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:29.793414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.793925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.794591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.796505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.798157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.798878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.978141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:29.993863 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-356f693a-e676-453f-b7bf-4d6e51e7e52f tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1282 microversion: 2.1 time: 0.222260 Nov 02 14:02:30.007642 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2601/3653] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:29 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:30.793995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:30.795539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:30.831138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:30.831722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:30.832166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:30.833391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:30.833391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:30.833744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:31.733849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:31.745749 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-787e9da7-13c6-4cab-bb11-d3ae881643b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1503 microversion: 2.1 time: 0.954625 Nov 02 14:02:31.747085 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2602/3654] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:30 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1503 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:31.759480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:31.762696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:31.779598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:31.781728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:31.783597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:31.784577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:31.785232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:31.785884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:32.927056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:32.938762 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fb41e7e-1bff-4721-a6e4-11472171ed68 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1324 microversion: 2.1 time: 1.190336 Nov 02 14:02:32.941745 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2603/3655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:31 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1324 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:32.956196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:32.957133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:32.975761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:32.976575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:32.979833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:32.980990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:32.982870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:32.985865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:33.051663 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b5eb957-a558-4f87-80d0-530f963a9a2a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/ips" status: 200 len: 151 microversion: 2.20 time: 0.103161 Nov 02 14:02:33.052588 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2604/3656] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Nov 2 14:02:32 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/ips => generated 151 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:02:33.073817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c59ee2f-e02f-4b57-b623-d8c93f9982b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:33.101173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c59ee2f-e02f-4b57-b623-d8c93f9982b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:33.103463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c59ee2f-e02f-4b57-b623-d8c93f9982b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:33.105614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c59ee2f-e02f-4b57-b623-d8c93f9982b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:33.188024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c59ee2f-e02f-4b57-b623-d8c93f9982b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:02:33.313204 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c59ee2f-e02f-4b57-b623-d8c93f9982b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a/action" status: 202 len: 0 microversion: 2.1 time: 0.258296 Nov 02 14:02:33.317698 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2605/3657] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:02:33 2022] POST /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:02:33.328914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:33.360368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:33.384558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:33.385150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:33.385810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:33.388753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:33.390098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:33.391820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:34.656700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:34.964041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:34.987050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3871ca5-ffff-475e-8bb1-772d568052a4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1513 microversion: 2.1 time: 1.662089 Nov 02 14:02:34.993181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2606/3658] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:33 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1513 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:35.025383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:35.028890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:35.068401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:35.069755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:35.082208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:35.084098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:35.090391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:35.092550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:36.621655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:36.639193 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4201f1dd-50c5-4e33-842c-18f46b892e08 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1324 microversion: 2.1 time: 1.641975 Nov 02 14:02:36.645517 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2607/3659] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:34 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1324 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:37.294886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5a3e3dd5-683e-4300-88e4-aa0542aed276 req-75478eb1-b089-4202-ad4f-0db80956cb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfe6ff5-9d16-49f1-b190-373c343e0d68", "tag": "d7ea5516-10d2-4818-ad0b-f484b3356b96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:37.319130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5a3e3dd5-683e-4300-88e4-aa0542aed276 req-75478eb1-b089-4202-ad4f-0db80956cb67 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:37.320659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5a3e3dd5-683e-4300-88e4-aa0542aed276 req-75478eb1-b089-4202-ad4f-0db80956cb67 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:37.322554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5a3e3dd5-683e-4300-88e4-aa0542aed276 req-75478eb1-b089-4202-ad4f-0db80956cb67 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:37.359039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5a3e3dd5-683e-4300-88e4-aa0542aed276 req-75478eb1-b089-4202-ad4f-0db80956cb67 service nova] Creating event network-changed:d7ea5516-10d2-4818-ad0b-f484b3356b96 for instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 on n-h2-858238-3 Nov 02 14:02:37.383957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5a3e3dd5-683e-4300-88e4-aa0542aed276 req-75478eb1-b089-4202-ad4f-0db80956cb67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.720719 Nov 02 14:02:37.388454 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2608/3660] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:37.441859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:37.442577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:37.468680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:37.468991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:37.469394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:37.476135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:37.478100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:37.483013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:37.880652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:37.897184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-459132c7-4c10-4ab6-94c3-156aa4d4c82f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1513 microversion: 2.1 time: 0.464868 Nov 02 14:02:37.902138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2609/3661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:37 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1513 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:37.912881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78f7da9f-eec8-43d6-9ddf-0a2c360d1175 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Action: 'create', calling method: .version_select at 0x7f6f809b10d0>, body: {"keypair": {"name": "tempest-keypair-2078066795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWoCDCmHa9Kq+BLdpiWbqYzGRfgK3QfI6zoXk9uSdCLT72/L3DmJEh1AmGFroywe7HCacxFE4p8I5Icr+FSuHxSuv9sn8KYh87vYKeMsg4xu8mTFjRAwedCh/qAZDLUKw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:38.008055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-78f7da9f-eec8-43d6-9ddf-0a2c360d1175 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Getting quotas for project 195705b5a7b543ef8d284ddacae98a0c. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:38.056195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-78f7da9f-eec8-43d6-9ddf-0a2c360d1175 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Getting quotas for user a34fc7bf6ff247e8b9a77d3f505358a4 and project 195705b5a7b543ef8d284ddacae98a0c. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:38.131351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78f7da9f-eec8-43d6-9ddf-0a2c360d1175 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.227640 Nov 02 14:02:38.136106 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2610/3662] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 14:02:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 232 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 14:02:38.172975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:38.178870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:38.214106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:38.219301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:38.220608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:38.222513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:38.224909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:38.227818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:39.131045 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:02:39.133327 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 14:02:39.291767 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:02:39.292215 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 14:02:39.695978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:39.712618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb79228b-7a3d-4374-b7b7-8f4ec08fb735 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1324 microversion: 2.1 time: 1.574112 Nov 02 14:02:39.718184 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2611/3663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:38 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1324 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:39.729294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1254699242", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3d5f478d-60d5-401e-8da0-c62506103a48"}], "security_groups": [{"name": "tempest-securitygroup--1228614794"}], "key_name": "tempest-keypair-936651023", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:40.412302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] validate_networks() for [('3d5f478d-60d5-401e-8da0-c62506103a48', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:42.706586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Getting quotas for project 7e964b3dcec04af3a90b2444707ce3c1. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:42.730733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Getting quotas for user 195bac8af8764feaacf0bbc16780257b and project 7e964b3dcec04af3a90b2444707ce3c1. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:42.766261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:42.766914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:42.767565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:42.768269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:42.768831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:42.787381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:42.793189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:42.793850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:42.794678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:42.795177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:42.795598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:42.839207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Getting quotas for project 7e964b3dcec04af3a90b2444707ce3c1. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:42.855839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Getting quotas for user 195bac8af8764feaacf0bbc16780257b and project 7e964b3dcec04af3a90b2444707ce3c1. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:42.892567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:42.895567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:43.024062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3730cda1-e916-4d8e-b5d0-6197ed5f75ef tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.303746 Nov 02 14:02:43.024976 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2612/3664] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:02:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 3305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:02:43.035863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:43.037071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:43.054299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:43.055027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:43.055685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:43.056689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:43.057395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:43.058052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:43.161673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lazy-loading 'flavor' on Instance uuid b4cea623-4709-4680-9646-d7263f443356 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:02:43.603023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0f2957a4-c6c5-40bc-b6bd-aaaadbabbdc1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/action" status: 202 len: 0 microversion: 2.20 time: 0.576545 Nov 02 14:02:43.621326 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2613/3665] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 14:02:43 2022] POST /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:02:43.653175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:43.655456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:43.681401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:43.684560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:43.685906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:43.687948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:43.690346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:43.692273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.066027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:44.077341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bcd45a2d-dd50-4575-b065-d50eb6b417f3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1513 microversion: 2.1 time: 0.447673 Nov 02 14:02:44.087689 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2614/3666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:43 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:44.102132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:44.106521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:44.118944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.120462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.121196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.122555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.123800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.124455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.592186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:44.601540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0cb2be39-a128-4547-972e-395453e84997 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1324 microversion: 2.1 time: 0.512384 Nov 02 14:02:44.601814 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2615/3667] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:44 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:44.612869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:44.613676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:44.638189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.638792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.642163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.643068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.643812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.644503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.857633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:44.866473 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b6dcef1-2058-4f72-b117-82ce11a158da tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1329 microversion: 2.1 time: 0.257549 Nov 02 14:02:44.879208 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2616/3668] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:44 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1329 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:44.879208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:44.879208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:44.880274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.880933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.881549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.882399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.883203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.883767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.909475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:45.141750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:45.155940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:45.157846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:45.159218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-09abd3e4-5b02-49df-91c4-89770878f79a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 0.290711 Nov 02 14:02:45.160330 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2617/3669] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:02:44 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:02:45.165509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7f3ff3d5-e338-49c2-a448-eedcf153ee80 req-a9503c25-1bd4-4e76-b7c0-c8d3aae364c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfe6ff5-9d16-49f1-b190-373c343e0d68", "name": "network-vif-plugged", "status": "completed", "tag": "d7ea5516-10d2-4818-ad0b-f484b3356b96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:45.176383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7f3ff3d5-e338-49c2-a448-eedcf153ee80 req-a9503c25-1bd4-4e76-b7c0-c8d3aae364c8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:45.177007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7f3ff3d5-e338-49c2-a448-eedcf153ee80 req-a9503c25-1bd4-4e76-b7c0-c8d3aae364c8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:45.177661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7f3ff3d5-e338-49c2-a448-eedcf153ee80 req-a9503c25-1bd4-4e76-b7c0-c8d3aae364c8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:45.196465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7f3ff3d5-e338-49c2-a448-eedcf153ee80 req-a9503c25-1bd4-4e76-b7c0-c8d3aae364c8 service nova] Creating event network-vif-plugged:d7ea5516-10d2-4818-ad0b-f484b3356b96 for instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 on n-h2-858238-3 Nov 02 14:02:45.201734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7f3ff3d5-e338-49c2-a448-eedcf153ee80 req-a9503c25-1bd4-4e76-b7c0-c8d3aae364c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039907 Nov 02 14:02:45.203709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2618/3670] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:45.489055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a7e397f-e21a-4cde-b71a-d3c758b1b7ca tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Action: 'create', calling method: .version_select at 0x7f6f85f61940>, body: {"keypair": {"name": "tempest-keypair-363057902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKbn05rAE6w2b43YzEOmhvd/tCqBN8mDI1x8K04/niCpFTmM3xqVeVvTyB6H+enZfikoX5PJetKPghRxGBAYp9MWARk30sAj1gnErzMtXmMKd2Od/Av1AR0JT/Ua5LwyA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:45.512123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3a7e397f-e21a-4cde-b71a-d3c758b1b7ca tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Getting quotas for project e8162f09f028443a97325693edfe0805. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:45.518755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3a7e397f-e21a-4cde-b71a-d3c758b1b7ca tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Getting quotas for user 2e49ea67ba0441689b266f3fa4834f08 and project e8162f09f028443a97325693edfe0805. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:45.548276 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a7e397f-e21a-4cde-b71a-d3c758b1b7ca tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342956 Nov 02 14:02:45.557183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2619/3671] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:02:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:45.572290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:45.574335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:45.590917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:45.593255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:45.593898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:45.598647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:45.599502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:45.601598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:46.045705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:46.086870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f997a355-3eea-44cd-acc2-c7803bcf0807 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1513 microversion: 2.1 time: 0.534922 Nov 02 14:02:46.089820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2620/3672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:45 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:46.100151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:46.101078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:46.111592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:46.119330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:46.120551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:46.123037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:46.124153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:46.126378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:46.127199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:46.522044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:46.531734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-de2aac94-2db7-4e4c-a261-484323bd960c tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1324 microversion: 2.1 time: 0.440112 Nov 02 14:02:46.536276 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2621/3673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:46 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:46.548204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1385213327", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "273f2f99-46fd-46c0-a505-b734163ad26d"}, {"port": "f4fe9c59-7c79-41b9-a301-d056023a91fd", "tag": "port-1"}, {"port": "cb3cb610-3ac7-4f0c-9319-a8ed27d6ece0", "tag": "port-2"}, {"uuid": "8fa1c21b-32a3-4cc8-b031-d2c5fd090d5f", "tag": "net-1"}, {"uuid": "8fa1c21b-32a3-4cc8-b031-d2c5fd090d5f"}, {"uuid": "eaab9e31-65c3-473a-b8af-b07599b7ff6d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "eaab9e31-65c3-473a-b8af-b07599b7ff6d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c0bf93c3-716b-4eec-8961-63e0229034b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "82dfe6fe-4628-4741-9798-f1d3131be782", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "53903a16-61cb-4688-a43c-0220762f6702", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--297937125"}], "key_name": "tempest-keypair-2078066795", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:46.943386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] validate_networks() for [('273f2f99-46fd-46c0-a505-b734163ad26d', None, None, None, None, None), (None, None, 'f4fe9c59-7c79-41b9-a301-d056023a91fd', None, None, None), (None, None, 'cb3cb610-3ac7-4f0c-9319-a8ed27d6ece0', None, None, None), ('8fa1c21b-32a3-4cc8-b031-d2c5fd090d5f', None, None, None, None, None), ('8fa1c21b-32a3-4cc8-b031-d2c5fd090d5f', None, None, None, None, None), ('eaab9e31-65c3-473a-b8af-b07599b7ff6d', '10.2.2.100', None, None, None, None), ('eaab9e31-65c3-473a-b8af-b07599b7ff6d', '10.2.2.200', None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:52.120353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:52.121403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:52.122009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:52.122425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:52.122837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:52.140133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=31 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:52.141838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:52.142416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:52.142882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:52.143647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:52.147783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:52.150372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:52.211167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Getting quotas for project 195705b5a7b543ef8d284ddacae98a0c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:52.224179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Getting quotas for user a34fc7bf6ff247e8b9a77d3f505358a4 and project 195705b5a7b543ef8d284ddacae98a0c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:52.463344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:52.467567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c0bf93c3-716b-4eec-8961-63e0229034b1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='82dfe6fe-4628-4741-9798-f1d3131be782',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='53903a16-61cb-4688-a43c-0220762f6702',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:52.964701 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e31804c7-7514-4194-ba6d-8db77b52472d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.422821 Nov 02 14:02:52.975073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2622/3674] 10.222.0.18 () {62 vars in 1189 bytes} [Wed Nov 2 14:02:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 6436 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:02:52.992879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:52.993595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:53.017539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.019210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.020308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.021206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.021824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.022579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.288928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:53.303998 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7056a27-3b6b-42a5-848f-a76f66524964 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1403 microversion: 2.1 time: 0.327644 Nov 02 14:02:53.304592 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2623/3675] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:52 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1403 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:53.325487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:53.326336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:53.334469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.335289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.336008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.336880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.337497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.338064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.633418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:53.651441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:53.653324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:53.654709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17620032-1201-4e78-9b4a-0507c199f5f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 0.334286 Nov 02 14:02:53.687989 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2624/3676] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:02:53 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:02:53.693187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:53.700671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:53.719562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.720063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.720507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.721258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.721677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.722098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:54.035644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:54.051889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1aa65cd-0bc0-4a59-aa66-a19985402f58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1513 microversion: 2.1 time: 0.362166 Nov 02 14:02:54.052374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2625/3677] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:53 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:54.058586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:54.059846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:54.072160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:54.072654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:54.073675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:54.074389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:54.076689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:54.077362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:54.292968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:54.304561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5800a7ff-775b-4e13-9c8f-a7f72ad5c956 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1519 microversion: 2.1 time: 0.251271 Nov 02 14:02:54.305163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2626/3678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:54 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:54.315281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f00c2514-c8fb-4ef1-9c91-9adb40db14e3"}], "security_groups": [{"name": "tempest-securitygroup--1139216065"}], "key_name": "tempest-keypair-363057902", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:54.560012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] validate_networks() for [('f00c2514-c8fb-4ef1-9c91-9adb40db14e3', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:55.550854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:55.552464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:55.553892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:55.554551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:55.556243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:55.609239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:55.611029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:55.612061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:55.618892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:55.622985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:55.625138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:55.688951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Getting quotas for project e8162f09f028443a97325693edfe0805. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:55.699940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Getting quotas for user 2e49ea67ba0441689b266f3fa4834f08 and project e8162f09f028443a97325693edfe0805. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:55.722383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:55.724906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:55.783060 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30b953a1-09d5-441e-83d9-53c42108bb36 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.476800 Nov 02 14:02:55.790453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2627/3679] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:02:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:02:55.795689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4a7d1e85-8cea-43a6-8e63-a64071774bc2 req-4e78625b-2abd-43a3-b09c-6495d189dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7a70e1-63a0-4c61-8f90-55831889ea55", "tag": "e952acfb-5d73-4fd3-99e3-1919982de12e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:55.806438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a7d1e85-8cea-43a6-8e63-a64071774bc2 req-4e78625b-2abd-43a3-b09c-6495d189dda5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:55.806929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a7d1e85-8cea-43a6-8e63-a64071774bc2 req-4e78625b-2abd-43a3-b09c-6495d189dda5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:55.807388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a7d1e85-8cea-43a6-8e63-a64071774bc2 req-4e78625b-2abd-43a3-b09c-6495d189dda5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:55.821503 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4a7d1e85-8cea-43a6-8e63-a64071774bc2 req-4e78625b-2abd-43a3-b09c-6495d189dda5 service nova] Creating event network-changed:e952acfb-5d73-4fd3-99e3-1919982de12e for instance ec7a70e1-63a0-4c61-8f90-55831889ea55 on n-h1-858238-3 Nov 02 14:02:55.827203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4a7d1e85-8cea-43a6-8e63-a64071774bc2 req-4e78625b-2abd-43a3-b09c-6495d189dda5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035324 Nov 02 14:02:55.828701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2628/3680] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:55.834846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:55.835790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:55.843613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:55.844400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:55.844986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:55.845850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:55.846458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:55.847500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:56.043383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:56.058651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:56.060559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:56.061597 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc3a4111-5dd9-4c4d-9595-99a5190bdd6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1594 microversion: 2.32 time: 0.231482 Nov 02 14:02:56.062222 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2629/3681] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:02:55 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1594 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:02:56.081024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:56.082015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:56.094397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:56.096487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:56.097321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:56.098636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:56.099700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:56.100422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:56.596137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:56.613885 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06019d1d-11d9-4aa2-87a9-ceca41d109dd tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1403 microversion: 2.1 time: 0.545391 Nov 02 14:02:56.627538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2630/3682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:56 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1403 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:56.635474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-362fce73-fe2d-42e5-a9c1-af52235a09d1 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1888639519", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-362fce73-fe2d-42e5-a9c1-af52235a09d1 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 243 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1888639519", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1888639519', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'a9684cee-6315-4a61-b794-f4af97bb47e1'}]}}} Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:56.639964 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-362fce73-fe2d-42e5-a9c1-af52235a09d1 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-362fce73-fe2d-42e5-a9c1-af52235a09d1 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012775 Nov 02 14:02:56.648183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2631/3683] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:02:56 2022] POST /compute/v2.1/servers => generated 175 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:02:56.667055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:56.667711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:56.688901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:56.689400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:56.689839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:56.690553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:56.691005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:56.691459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:57.130567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:57.146876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:57.148714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:57.150178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c3d570a-a4ee-4582-927f-a539adcebaae tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 0.507329 Nov 02 14:02:57.158866 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2632/3684] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:02:56 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:02:57.701579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:57.703519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:57.719236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:57.720064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:57.720668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:57.721542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:57.722129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:57.722695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:58.133574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:58.150735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-071db252-0008-4c98-aea9-817e2d5bbd01 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1513 microversion: 2.1 time: 0.974154 Nov 02 14:02:58.151591 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2633/3685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:57 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1513 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:58.167268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b4426b41-abe2-40a0-b469-227051ef2af2 req-10553b98-68d6-4a7a-9801-963571031557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec7a70e1-63a0-4c61-8f90-55831889ea55", "name": "network-vif-plugged", "status": "completed", "tag": "e952acfb-5d73-4fd3-99e3-1919982de12e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:58.185453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b4426b41-abe2-40a0-b469-227051ef2af2 req-10553b98-68d6-4a7a-9801-963571031557 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:58.191762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b4426b41-abe2-40a0-b469-227051ef2af2 req-10553b98-68d6-4a7a-9801-963571031557 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:58.192386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b4426b41-abe2-40a0-b469-227051ef2af2 req-10553b98-68d6-4a7a-9801-963571031557 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:58.221833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b4426b41-abe2-40a0-b469-227051ef2af2 req-10553b98-68d6-4a7a-9801-963571031557 service nova] Creating event network-vif-plugged:e952acfb-5d73-4fd3-99e3-1919982de12e for instance ec7a70e1-63a0-4c61-8f90-55831889ea55 on n-h1-858238-3 Nov 02 14:02:58.227587 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b4426b41-abe2-40a0-b469-227051ef2af2 req-10553b98-68d6-4a7a-9801-963571031557 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074572 Nov 02 14:02:58.230314 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2634/3686] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:58.245654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:58.246534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:58.267757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:58.268527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:58.269104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:58.270538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:58.271332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:58.272029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:58.373111 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:02:58.374439 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 14:02:58.508862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:58.524063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f60aca0-54b5-44e6-8c0e-af00e890af1a tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1283 microversion: 2.1 time: 0.289910 Nov 02 14:02:58.524650 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2635/3687] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:58 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1283 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:58.543348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df3aa205-959f-4443-a43f-8f1628c04468 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:58.544103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df3aa205-959f-4443-a43f-8f1628c04468 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: dfd27cb1-274f-4bef-86fe-47e8fcae5484] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:58.555925 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-df3aa205-959f-4443-a43f-8f1628c04468 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] HTTP exception thrown: Instance dfd27cb1-274f-4bef-86fe-47e8fcae5484 could not be found. Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df3aa205-959f-4443-a43f-8f1628c04468 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/dfd27cb1-274f-4bef-86fe-47e8fcae5484/metadata HTTP/1.1 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance dfd27cb1-274f-4bef-86fe-47e8fcae5484 could not be found. Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': 'dfd27cb1-274f-4bef-86fe-47e8fcae5484'} Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd27cb1-274f-4bef-86fe-47e8fcae5484 could not be found. Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd27cb1-274f-4bef-86fe-47e8fcae5484 could not be found. Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:58.588019 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd27cb1-274f-4bef-86fe-47e8fcae5484 could not be found. Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df3aa205-959f-4443-a43f-8f1628c04468 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 404 to user: Instance dfd27cb1-274f-4bef-86fe-47e8fcae5484 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df3aa205-959f-4443-a43f-8f1628c04468 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/dfd27cb1-274f-4bef-86fe-47e8fcae5484/metadata" status: 404 len: 111 microversion: 2.1 time: 0.063856 Nov 02 14:02:58.594073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2636/3688] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 14:02:58 2022] GET /compute/v2.1/servers/dfd27cb1-274f-4bef-86fe-47e8fcae5484/metadata => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:58.600386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:58.603387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:58.630154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:58.630652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:58.644071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:58.650053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:58.650720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:58.651425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:59.626109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:59.654083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:59.659337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:59.664659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a326fa2d-07c2-484d-a1d5-0e9ec67a3f23 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1661 microversion: 2.32 time: 1.072933 Nov 02 14:02:59.665273 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2637/3689] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:02:58 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1661 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:02:59.688449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:59.698209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:59.715359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:59.716032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:59.716579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:59.717424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:59.717983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:59.720713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:00.703883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:00.721225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-855bf83e-f219-4a45-abc9-dd3ff5993d5d tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1403 microversion: 2.1 time: 1.030591 Nov 02 14:03:00.721919 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2638/3690] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:02:59 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1403 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:00.735974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:00.736594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:00.753361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:00.753870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:00.754311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:00.755025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:00.759984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:00.761859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:01.659331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:01.688799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:01.698920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:01.700345 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3841f132-b9a0-469d-be31-2ef72c7c79f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 0.977372 Nov 02 14:03:01.706076 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2639/3691] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:00 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:01.737519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50c83118-3c7e-4b1e-ae6a-8f0473f883f4 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2133203955", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50c83118-3c7e-4b1e-ae6a-8f0473f883f4 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 499 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2133203955", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2133203955', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a9684cee-6315-4a61-b794-f4af97bb47e1'}]}}} Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 14:03:01.759635 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:01.763052 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:01.768299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50c83118-3c7e-4b1e-ae6a-8f0473f883f4 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:01.771083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50c83118-3c7e-4b1e-ae6a-8f0473f883f4 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.063083 Nov 02 14:03:01.772608 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2640/3692] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:03:01 2022] POST /compute/v2.1/servers => generated 687 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:03:01.795786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:01.797664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:01.816470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:01.819950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:01.821271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:01.824625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:01.828162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:01.828872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:01.841170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:02.177418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:02.186556 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5da84f9-e2d4-4419-9e67-542cd550212c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1490 microversion: 2.1 time: 0.401287 Nov 02 14:03:02.190904 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2641/3693] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:01 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1490 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:02.205744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:02.206623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:02.235373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:02.235964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:02.238446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:02.239313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:02.239799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:02.240240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:03.260677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:03.279450 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ebc0c46-e00a-4a0e-bc5f-fce1f78114b8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1351 microversion: 2.1 time: 1.083379 Nov 02 14:03:03.280707 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2642/3694] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:02 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1351 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:03.293835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:03.296027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:03.315483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:03.316371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:03.316974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:03.317852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:03.318468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:03.319048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:04.155630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:04.179418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:04.181572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:04.183699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-132f4caf-e374-4e9a-abee-640b2ec5fa1f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1753 microversion: 2.32 time: 0.901626 Nov 02 14:03:04.184377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2643/3695] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:03 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1753 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:04.199456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:04.200043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:04.228496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:04.229005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:04.230698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:04.231537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:04.232196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:04.232770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:05.016950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:05.035352 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ecbdf753-18a1-4a31-9d5b-3cf3b4b5170f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1590 microversion: 2.1 time: 0.843044 Nov 02 14:03:05.059347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2644/3696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:04 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1590 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:05.072890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-339cce76-12a3-4a63-af61-57d537e75eb3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-203004539", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-339cce76-12a3-4a63-af61-57d537e75eb3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 499 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-203004539", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-203004539', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a9684cee-6315-4a61-b794-f4af97bb47e1'}]}}} Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 14:03:05.091398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:05.094579 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:05.098541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-339cce76-12a3-4a63-af61-57d537e75eb3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:05.100278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-339cce76-12a3-4a63-af61-57d537e75eb3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.039185 Nov 02 14:03:05.104961 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2645/3697] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:03:05 2022] POST /compute/v2.1/servers => generated 689 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:03:05.130764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:05.136281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:05.160343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:05.161226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:05.161857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:05.164105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:05.166450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:05.168178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:05.279182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26c278a6-db46-4bca-9676-b134e70680b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 200 len: 175 microversion: 2.1 time: 0.160564 Nov 02 14:03:05.279905 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2646/3698] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:05 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 175 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:05.291126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:05.292106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:05.309442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:05.310200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:05.310645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:05.322323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:05.323662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:05.327577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:05.652803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:05.715331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=11 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:05.724077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:05.774683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:05.795833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:05.804680 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fdd1dc5-93d9-4a5b-aaa5-d203ed9897b3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1742 microversion: 2.20 time: 0.522628 Nov 02 14:03:05.805685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2647/3699] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:05 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1742 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:05.813687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:05.819677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:05.832588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:05.833442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:05.834111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:05.835057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:05.835755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:05.839578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:06.558540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:06.578903 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46cfd1b3-254b-4a27-8485-e8a2274de4e8 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1351 microversion: 2.1 time: 0.771556 Nov 02 14:03:06.579632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2648/3700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:05 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1351 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:06.591000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:06.603628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:06.628481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:06.630467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:06.633555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:06.637250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:06.642098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:06.642763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:06.873591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38e9c338-9e24-4f0a-92a5-48e4c814d405 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.292726 Nov 02 14:03:06.874386 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2649/3701] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:03:06 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55/os-interface => generated 284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:06.891741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8628ce3-3c8b-44a8-8b3c-5e5b1b762575 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-175366055", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8628ce3-3c8b-44a8-8b3c-5e5b1b762575 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 753 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-175366055", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-175366055', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a9684cee-6315-4a61-b794-f4af97bb47e1'}]}}} Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:03:06.903384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:03:06.905652 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:03:06.908390 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:06.908390 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:06.912333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8628ce3-3c8b-44a8-8b3c-5e5b1b762575 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:06.916336 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8628ce3-3c8b-44a8-8b3c-5e5b1b762575 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.040631 Nov 02 14:03:06.918270 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2650/3702] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:03:06 2022] POST /compute/v2.1/servers => generated 1197 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 14:03:06.939350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:06.957310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:06.985077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:06.986912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:06.989041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:06.989885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:06.992317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:06.993089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:07.379986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:07.418865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:07.428530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:07.429897 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7691dbef-2690-4d1b-aa22-fa8cc4a59295 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1799 microversion: 2.32 time: 0.508034 Nov 02 14:03:07.439498 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2651/3703] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:06 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1799 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:07.444684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:07.445570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:07.467608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:07.468163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:07.468836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:07.469691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:07.470272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:07.470701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:08.225120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:08.251658 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12c12252-fd98-4113-b1d3-b997dfced09a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.810706 Nov 02 14:03:08.252819 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2652/3704] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:07 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:08.259924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7d5bbcc4-a143-4a69-be24-ac4554b7a2bf req-681a9d0d-9f86-4308-b1a2-ff841b0ddff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6213827c-5f45-470e-b090-490d96e96e3f", "tag": "226f50dd-5c10-4f67-9745-03c24a20188b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:08.286827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7d5bbcc4-a143-4a69-be24-ac4554b7a2bf req-681a9d0d-9f86-4308-b1a2-ff841b0ddff7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:08.298977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7d5bbcc4-a143-4a69-be24-ac4554b7a2bf req-681a9d0d-9f86-4308-b1a2-ff841b0ddff7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:08.299620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7d5bbcc4-a143-4a69-be24-ac4554b7a2bf req-681a9d0d-9f86-4308-b1a2-ff841b0ddff7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:08.329715 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7d5bbcc4-a143-4a69-be24-ac4554b7a2bf req-681a9d0d-9f86-4308-b1a2-ff841b0ddff7 service nova] Creating event network-changed:226f50dd-5c10-4f67-9745-03c24a20188b for instance 6213827c-5f45-470e-b090-490d96e96e3f on n-h1-858238-3 Nov 02 14:03:08.341604 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7d5bbcc4-a143-4a69-be24-ac4554b7a2bf req-681a9d0d-9f86-4308-b1a2-ff841b0ddff7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086820 Nov 02 14:03:08.345089 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2653/3705] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:08.354587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:08.361781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:08.383887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:08.384674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:08.385281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:08.386154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:08.386764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:08.387509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:08.966793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:08.989274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:08.990882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:09.000974 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49d164b4-4a59-4354-8fdb-a7ef1b2c399d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.654058 Nov 02 14:03:09.004042 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2654/3706] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:08 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:09.284181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d347bcc-8c9a-4830-95dc-069dc8552fd5 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Action: 'create', calling method: .version_select at 0x7f6f809e64c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1816308707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKrwgj1Amg4X2nfAmS3a1BGSiOZWgdLy0d2Wc6RGZqFf6pZrjPe6x8GeLIbi7AXwkA7RSjLja0z3ri1H+MC3AKncYWVW2HwChbfkz+ixM2a+HwWw55MMffN0OPixxAG6w=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:09.338146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5d347bcc-8c9a-4830-95dc-069dc8552fd5 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Getting quotas for project 2af544c47fd34763a0f4c9db29dc440d. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:09.359930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5d347bcc-8c9a-4830-95dc-069dc8552fd5 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Getting quotas for user 7453e356e6164465af839e2f7d600aca and project 2af544c47fd34763a0f4c9db29dc440d. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:09.377982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:09.424886 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d347bcc-8c9a-4830-95dc-069dc8552fd5 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.417689 Nov 02 14:03:09.427998 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2655/3707] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:03:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:09.444326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48dcaac9-7b4f-45cf-ad9f-da85dad815ad tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1611304204", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48dcaac9-7b4f-45cf-ad9f-da85dad815ad tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 1266 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1611304204", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a9684cee-6315-4a61-b794-f4af97bb47e1"}]}} Nov 02 14:03:09.454724 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1611304204', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a9684cee-6315-4a61-b794-f4af97bb47e1'}]}}} Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.457115 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:03:09.458270 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:03:09.460122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 14:03:09.460122 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:09.461175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48dcaac9-7b4f-45cf-ad9f-da85dad815ad tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:09.462432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48dcaac9-7b4f-45cf-ad9f-da85dad815ad tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.033056 Nov 02 14:03:09.464540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2656/3708] 10.222.0.18 () {60 vars in 1148 bytes} [Wed Nov 2 14:03:09 2022] POST /compute/v2.1/servers => generated 2221 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 14:03:09.473278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:09.475166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:09.483226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:09.484587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:09.485206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:09.486367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:09.486983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:09.487830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:09.918725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:09.928400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d089c2d2-734c-47f5-ade5-ff9c54ebdc3e tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1351 microversion: 2.1 time: 0.461711 Nov 02 14:03:09.929574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2657/3709] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:09 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1351 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:09.939562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:09.946385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:09.961049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:09.961815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:09.962552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:09.966251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:09.966974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:09.967675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:11.319696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:11.336672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9167693b-97e3-485d-8064-474c21c69ec9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 1.403479 Nov 02 14:03:11.337987 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2658/3710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:09 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:11.353777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:11.355553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:11.384543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:11.385422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:11.386083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:11.387082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:11.387811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:11.390798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:12.266896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:12.289639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:12.291404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:12.297246 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4be1e57b-e1dd-4045-b5e4-40bd834e433d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1845 microversion: 2.32 time: 0.956417 Nov 02 14:03:12.300270 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2659/3711] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:11 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1845 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:12.324233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b955e59a-f593-406d-8b5a-0691c5e61756 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:12.324927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b955e59a-f593-406d-8b5a-0691c5e61756 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 1b3e5d51-fe80-4ee1-8ee7-03a056907624] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:12.339498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b955e59a-f593-406d-8b5a-0691c5e61756 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] HTTP exception thrown: Instance 1b3e5d51-fe80-4ee1-8ee7-03a056907624 could not be found. Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b955e59a-f593-406d-8b5a-0691c5e61756 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1b3e5d51-fe80-4ee1-8ee7-03a056907624/metadata/test2 HTTP/1.1 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1b3e5d51-fe80-4ee1-8ee7-03a056907624 could not be found. Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': '1b3e5d51-fe80-4ee1-8ee7-03a056907624', 'id': 'test2'} Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3e5d51-fe80-4ee1-8ee7-03a056907624 could not be found. Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3e5d51-fe80-4ee1-8ee7-03a056907624 could not be found. Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:12.342829 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:12.347803 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:03:12.347803 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:03:12.347803 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3e5d51-fe80-4ee1-8ee7-03a056907624 could not be found. Nov 02 14:03:12.347803 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:12.349093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b955e59a-f593-406d-8b5a-0691c5e61756 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 404 to user: Instance 1b3e5d51-fe80-4ee1-8ee7-03a056907624 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:12.353167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b955e59a-f593-406d-8b5a-0691c5e61756 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/1b3e5d51-fe80-4ee1-8ee7-03a056907624/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.050022 Nov 02 14:03:12.356008 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2660/3712] 10.222.0.18 () {58 vars in 1281 bytes} [Wed Nov 2 14:03:12 2022] GET /compute/v2.1/servers/1b3e5d51-fe80-4ee1-8ee7-03a056907624/metadata/test2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:03:12.371222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e51a7e25-02c9-44c7-b831-240c139f5ef8 req-c1c06204-60bb-4b84-8a62-3b8d7225e230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "name": "network-vif-plugged", "status": "completed", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:12.429036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e51a7e25-02c9-44c7-b831-240c139f5ef8 req-c1c06204-60bb-4b84-8a62-3b8d7225e230 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:12.431351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e51a7e25-02c9-44c7-b831-240c139f5ef8 req-c1c06204-60bb-4b84-8a62-3b8d7225e230 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:12.435621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e51a7e25-02c9-44c7-b831-240c139f5ef8 req-c1c06204-60bb-4b84-8a62-3b8d7225e230 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:12.465291 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e51a7e25-02c9-44c7-b831-240c139f5ef8 req-c1c06204-60bb-4b84-8a62-3b8d7225e230 service nova] Creating event network-vif-plugged:d980ec30-b400-4aee-926a-0adf67991425 for instance b4cea623-4709-4680-9646-d7263f443356 on n-h2-858238-3 Nov 02 14:03:12.485793 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e51a7e25-02c9-44c7-b831-240c139f5ef8 req-c1c06204-60bb-4b84-8a62-3b8d7225e230 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126124 Nov 02 14:03:12.488131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2661/3713] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:12.510161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:12.512573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:12.542752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:12.543674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:12.548737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:12.558756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:12.562304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:12.563330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:13.461429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:13.497543 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a809368-06e8-4cd2-8ecd-7e04f325e26a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1590 microversion: 2.1 time: 0.998574 Nov 02 14:03:13.502290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2662/3714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:12 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1590 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:13.741412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4a9cc006-3f92-4b0b-a603-c167c713f265 req-529f57f4-ccdc-4ad8-9463-35e9b62db2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7a70e1-63a0-4c61-8f90-55831889ea55", "tag": "e952acfb-5d73-4fd3-99e3-1919982de12e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:13.775788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a9cc006-3f92-4b0b-a603-c167c713f265 req-529f57f4-ccdc-4ad8-9463-35e9b62db2cf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:13.776282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a9cc006-3f92-4b0b-a603-c167c713f265 req-529f57f4-ccdc-4ad8-9463-35e9b62db2cf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:13.776720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a9cc006-3f92-4b0b-a603-c167c713f265 req-529f57f4-ccdc-4ad8-9463-35e9b62db2cf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:13.842595 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4a9cc006-3f92-4b0b-a603-c167c713f265 req-529f57f4-ccdc-4ad8-9463-35e9b62db2cf service nova] Creating event network-changed:e952acfb-5d73-4fd3-99e3-1919982de12e for instance ec7a70e1-63a0-4c61-8f90-55831889ea55 on n-h1-858238-3 Nov 02 14:03:13.856953 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4a9cc006-3f92-4b0b-a603-c167c713f265 req-529f57f4-ccdc-4ad8-9463-35e9b62db2cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350363 Nov 02 14:03:13.859283 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2663/3715] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:13.876452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:13.877208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:13.895398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:13.895911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:13.896355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:13.897083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:13.897544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:13.897981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:14.262075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:14.287807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:14.289692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:14.294910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-caa40d84-32a2-4475-ae1b-3c4f182c47b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.431920 Nov 02 14:03:14.296716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2664/3716] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:13 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:14.321304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:14.323455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:14.339270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:14.345981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:14.347424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:14.349081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:14.350311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:14.352120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:14.396155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:14.591868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:14.604511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ff4c338-e3b2-4810-97df-cca6837c0135 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1351 microversion: 2.1 time: 0.306530 Nov 02 14:03:14.605328 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2665/3717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:14 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1351 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:14.634482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:14.635347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:14.651467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:14.651981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:14.652419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:14.653167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:14.653679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:14.654145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:15.059789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:15.080089 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc4cce01-222e-4a52-9a76-d11b2df71dc1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.459730 Nov 02 14:03:15.082724 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2666/3718] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:14 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:15.088737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:15.090668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:15.102291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:15.102917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:15.103532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:15.105796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:15.106469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:15.111313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:15.220184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:03:15.446836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f9abdd5-2acd-4990-9ccc-a47aee7f2395 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 204 len: 0 microversion: 2.1 time: 0.362043 Nov 02 14:03:15.452521 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2667/3719] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:03:15 2022] DELETE /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:03:15.459147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8defb3ca-0edb-4691-9767-4671b5705d5d req-6a2ad0a1-df20-48dd-acfc-3b151dcc59f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "804ef20f-d150-45fe-a7c1-5f7f3504a381"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:15.483729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8defb3ca-0edb-4691-9767-4671b5705d5d req-6a2ad0a1-df20-48dd-acfc-3b151dcc59f4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:15.484232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8defb3ca-0edb-4691-9767-4671b5705d5d req-6a2ad0a1-df20-48dd-acfc-3b151dcc59f4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:15.484685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8defb3ca-0edb-4691-9767-4671b5705d5d req-6a2ad0a1-df20-48dd-acfc-3b151dcc59f4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:15.519106 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8defb3ca-0edb-4691-9767-4671b5705d5d req-6a2ad0a1-df20-48dd-acfc-3b151dcc59f4 service nova] Creating event network-changed:804ef20f-d150-45fe-a7c1-5f7f3504a381 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:15.527689 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8defb3ca-0edb-4691-9767-4671b5705d5d req-6a2ad0a1-df20-48dd-acfc-3b151dcc59f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078135 Nov 02 14:03:15.532218 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2668/3720] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:15.537892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:15.538575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:15.558456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:15.559364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:15.561506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:15.564496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:15.569348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:15.570025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:16.281420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:16.295955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:16.299687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:16.303298 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e350810-c79b-46ec-9d60-bbde3e3bde9a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1866 microversion: 2.32 time: 0.768068 Nov 02 14:03:16.316334 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2669/3721] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:15 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1866 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:16.333546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-626591876", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1816308707", "security_groups": [{"name": "tempest-secgroup-smoke-1745698688"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d146774f-4975-4ed6-89f1-c3e66740f23e"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:16.527453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] validate_networks() for [('d146774f-4975-4ed6-89f1-c3e66740f23e', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:03:17.524489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Getting quotas for project 2af544c47fd34763a0f4c9db29dc440d. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:17.540137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Getting quotas for user 7453e356e6164465af839e2f7d600aca and project 2af544c47fd34763a0f4c9db29dc440d. Resources: dict_keys(['metadata_items']) {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:17.579433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:03:17.579864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:03:17.580347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:03:17.580757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:03:17.581175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:03:17.604419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:17.605176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:17.605796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:17.606685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:17.607329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:17.607908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:17.649409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Getting quotas for project 2af544c47fd34763a0f4c9db29dc440d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:17.663900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Getting quotas for user 7453e356e6164465af839e2f7d600aca and project 2af544c47fd34763a0f4c9db29dc440d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:17.699597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:03:17.713236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:03:17.816591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-994887de-a265-4c31-a4f0-04f53c3876e0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.489411 Nov 02 14:03:17.817541 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2670/3722] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:03:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:03:17.827435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:17.833337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:17.839910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:17.840742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:17.841520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:17.842441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:17.843048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:17.843890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:18.742012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:18.760167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2ab1d17-437f-4165-a006-ec4b3fa95e9f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.940099 Nov 02 14:03:18.764028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2671/3723] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:17 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:18.796988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:18.797641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:18.809127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:18.816503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:18.823782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:18.824906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:18.825669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:18.826301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.363388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:19.375530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:19.379512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:19.381618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-280551be-0427-4ace-a8c6-d8f5b62c80a1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.616235 Nov 02 14:03:19.385754 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2672/3724] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:18 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:19.403138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:19.406526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:19.423355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:19.424188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:19.425642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.431868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:19.437933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:19.438540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.651008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417ea5da9491429996fe8a9c7153f543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b937e6ef644b4eb79f4e99509fac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:19.660526 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6ba2c50-e2dd-48a6-baa1-38f356508fc3 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 200 len: 1483 microversion: 2.1 time: 0.272620 Nov 02 14:03:19.661089 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2673/3725] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:19 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 1483 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:19.667228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:19.668064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:19.675748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:19.676470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:19.677084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.678325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:19.678930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:19.679537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.973571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:19.983847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76c05b6d-7fd8-4b29-a2f6-4ae70175429b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1351 microversion: 2.1 time: 0.320299 Nov 02 14:03:19.984463 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2674/3726] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:19 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:20.010235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2453de7f-2b52-4612-bcb2-70695ca1c2d7 req-f2acc8be-1373-49e8-8edb-6c51b4e5bb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6213827c-5f45-470e-b090-490d96e96e3f", "name": "network-vif-plugged", "status": "completed", "tag": "226f50dd-5c10-4f67-9745-03c24a20188b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:20.041130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2453de7f-2b52-4612-bcb2-70695ca1c2d7 req-f2acc8be-1373-49e8-8edb-6c51b4e5bb77 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.044217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2453de7f-2b52-4612-bcb2-70695ca1c2d7 req-f2acc8be-1373-49e8-8edb-6c51b4e5bb77 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.044977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2453de7f-2b52-4612-bcb2-70695ca1c2d7 req-f2acc8be-1373-49e8-8edb-6c51b4e5bb77 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.073654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2453de7f-2b52-4612-bcb2-70695ca1c2d7 req-f2acc8be-1373-49e8-8edb-6c51b4e5bb77 service nova] Creating event network-vif-plugged:226f50dd-5c10-4f67-9745-03c24a20188b for instance 6213827c-5f45-470e-b090-490d96e96e3f on n-h1-858238-3 Nov 02 14:03:20.087938 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2453de7f-2b52-4612-bcb2-70695ca1c2d7 req-f2acc8be-1373-49e8-8edb-6c51b4e5bb77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080950 Nov 02 14:03:20.089364 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2675/3727] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:20.108698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:20.111664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:20.126201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.128934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.130094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.132491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.133264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.134619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.805247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:20.826342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:20.832085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:20.833514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ba9c8df-2b87-466c-99d4-d12dd43e45b2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1887 microversion: 2.32 time: 0.735347 Nov 02 14:03:20.834671 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2676/3728] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:20 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1887 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:20.840129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bcbbe4f9-2465-4516-beff-302309588e5c req-87680c42-92fe-46e5-9666-e513285eff76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "f4fe9c59-7c79-41b9-a301-d056023a91fd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:20.852711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bcbbe4f9-2465-4516-beff-302309588e5c req-87680c42-92fe-46e5-9666-e513285eff76 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.853443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bcbbe4f9-2465-4516-beff-302309588e5c req-87680c42-92fe-46e5-9666-e513285eff76 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.854017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bcbbe4f9-2465-4516-beff-302309588e5c req-87680c42-92fe-46e5-9666-e513285eff76 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.867315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bcbbe4f9-2465-4516-beff-302309588e5c req-87680c42-92fe-46e5-9666-e513285eff76 service nova] Creating event network-changed:f4fe9c59-7c79-41b9-a301-d056023a91fd for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:20.873795 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bcbbe4f9-2465-4516-beff-302309588e5c req-87680c42-92fe-46e5-9666-e513285eff76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037160 Nov 02 14:03:20.876102 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2677/3729] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:20.882819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:20.884677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:20.892666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.893617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.894227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.895198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.895805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.896437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:21.132555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:21.158665 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a83d951f-823a-4d46-9b77-85238678ffd0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1360 microversion: 2.1 time: 0.280906 Nov 02 14:03:21.174427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2678/3730] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:20 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1360 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:21.186931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cd0fd902-198f-490b-8eb9-83184b656b70 req-56ee0c85-9f9a-4950-99fe-e70452ed8e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "cb3cb610-3ac7-4f0c-9319-a8ed27d6ece0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:21.245665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cd0fd902-198f-490b-8eb9-83184b656b70 req-56ee0c85-9f9a-4950-99fe-e70452ed8e40 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:21.246592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cd0fd902-198f-490b-8eb9-83184b656b70 req-56ee0c85-9f9a-4950-99fe-e70452ed8e40 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:21.252324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cd0fd902-198f-490b-8eb9-83184b656b70 req-56ee0c85-9f9a-4950-99fe-e70452ed8e40 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:21.299072 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cd0fd902-198f-490b-8eb9-83184b656b70 req-56ee0c85-9f9a-4950-99fe-e70452ed8e40 service nova] Creating event network-changed:cb3cb610-3ac7-4f0c-9319-a8ed27d6ece0 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:21.319898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cd0fd902-198f-490b-8eb9-83184b656b70 req-56ee0c85-9f9a-4950-99fe-e70452ed8e40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140732 Nov 02 14:03:21.320598 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2679/3731] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:21.350368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1160345756", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f846ebbf-8ebf-4f30-afa6-7c615971cecb"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:21.477349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] validate_networks() for [('f846ebbf-8ebf-4f30-afa6-7c615971cecb', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:03:23.780945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:03:23.782172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:03:23.782969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:03:23.783705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:03:23.784422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:03:23.808430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:23.808924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:23.809359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:23.810087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:23.810807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:23.811268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:23.882438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:23.913790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for user 53bef65bfa79486a8f0180f2f86eddba and project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:23.963436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:03:23.972987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:03:24.071365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd2d2166-6904-47c6-9f1d-38186ce815a8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.747868 Nov 02 14:03:24.072519 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2680/3732] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:03:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:03:24.078895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:24.079949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:24.096208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:24.096978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:24.097572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:24.098448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:24.116057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:24.116764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:24.556323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:24.572032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:24.573345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:24.574733 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-390f49ef-9fff-46ca-835d-f8ab08121618 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.500904 Nov 02 14:03:24.591951 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2681/3733] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:24 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:24.607016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:24.607664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] [instance: 0cfe6ff5-9d16-49f1-b190-373c343e0d68] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:24.623939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:24.624431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:24.625471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:24.641590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:24.641590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:24.641590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:24.664011 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] HTTP exception thrown: Instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 could not be found. Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Request method failure captured: Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 HTTP/1.1 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhsIBM6iTZyVcv-M-eCl4kKna9eUAX8Bv3mzdlxblOVhrqiMKbHaER8GhXLIuOrSmt3tqZvsmiUwkPy-3-zn69NgAwmCTH5TBaAE6JGr1KBACwaytDdDKAZQVhTjuilQUmZv-RY1cgXXhj5YYN2Un2oQypDtOmN8M4lSh10Hs99RhU Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29b937e6ef644b4eb79f4e99509fac92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29b937e6ef644b4eb79f4e99509fac92"}]}] Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 29b937e6ef644b4eb79f4e99509fac92 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-475872847 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 417ea5da9491429996fe8a9c7153f543 Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-475872847-project Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 could not be found. Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '0cfe6ff5-9d16-49f1-b190-373c343e0d68'} Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 could not be found. Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 could not be found. Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:24.665742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 could not be found. Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] Returning 404 to user: Instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-477e4be5-7e80-4d30-9445-23d19ed60329 tempest-ServerMetadataNegativeTestJSON-475872847 tempest-ServerMetadataNegativeTestJSON-475872847-project] 10.222.0.18 "GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68" status: 404 len: 111 microversion: 2.1 time: 0.074113 Nov 02 14:03:24.669525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2682/3734] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:24 2022] GET /compute/v2.1/servers/0cfe6ff5-9d16-49f1-b190-373c343e0d68 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:03:24.681092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:24.681687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:24.701639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:24.702675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:24.703274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:24.703665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:24.704560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:24.705027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:24.705457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:25.136086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:25.150436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b23c640-16f3-4183-a31b-49ce6646aa8b tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1542 microversion: 2.1 time: 0.481260 Nov 02 14:03:25.151706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2683/3735] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:24 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1542 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:25.167278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:25.168134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:25.179646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:25.180801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:25.183443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:25.186368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:25.187211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:25.187892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:26.175546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:26.204038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:26.208215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:26.213432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8944cb30-1f78-429f-ba2d-c9aad249d489 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1887 microversion: 2.32 time: 1.056666 Nov 02 14:03:26.214646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2684/3736] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:25 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1887 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:26.226349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:26.227248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:26.245759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:26.246511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:26.247125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:26.248801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:26.249520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:26.250105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:26.256694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:27.077716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:27.092163 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5ccc91a-672d-4ce1-8698-5180c457b65c tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1428 microversion: 2.1 time: 0.873283 Nov 02 14:03:27.112684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2685/3737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:26 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1428 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:27.118458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ff4a271d-a7df-4d27-90f6-462bfd0f8a80 req-12e4c1ef-4129-4a05-9dd6-513dbaf6311d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfe6ff5-9d16-49f1-b190-373c343e0d68", "name": "network-vif-deleted", "tag": "d7ea5516-10d2-4818-ad0b-f484b3356b96"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:27.134939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ff4a271d-a7df-4d27-90f6-462bfd0f8a80 req-12e4c1ef-4129-4a05-9dd6-513dbaf6311d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.135752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ff4a271d-a7df-4d27-90f6-462bfd0f8a80 req-12e4c1ef-4129-4a05-9dd6-513dbaf6311d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.136367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ff4a271d-a7df-4d27-90f6-462bfd0f8a80 req-12e4c1ef-4129-4a05-9dd6-513dbaf6311d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.152252 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ff4a271d-a7df-4d27-90f6-462bfd0f8a80 req-12e4c1ef-4129-4a05-9dd6-513dbaf6311d service nova] Creating event network-vif-deleted:d7ea5516-10d2-4818-ad0b-f484b3356b96 for instance 0cfe6ff5-9d16-49f1-b190-373c343e0d68 on n-h2-858238-3 Nov 02 14:03:27.158737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ff4a271d-a7df-4d27-90f6-462bfd0f8a80 req-12e4c1ef-4129-4a05-9dd6-513dbaf6311d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044278 Nov 02 14:03:27.160481 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2686/3738] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:27.167051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "a5539551-be83-4803-9781-fb3190ae7b9d"}, {"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "4c2cb3ef-3e5b-43c6-a04a-cdb499783d05"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:27.187854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.189286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.189895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.204537 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] Creating event network-changed:a5539551-be83-4803-9781-fb3190ae7b9d for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:27.205308 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] Creating event network-changed:4c2cb3ef-3e5b-43c6-a04a-cdb499783d05 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:27.211425 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b740697c-5b2d-4ca1-8dbf-33e2cb2a1976 req-c2c52047-c811-4247-8636-e145bcc470dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049310 Nov 02 14:03:27.212646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2687/3739] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:27.219602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:27.220971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:27.232661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.233545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.234313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.235748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.237544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.238205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.548191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:27.566805 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-298494b1-fe3b-4032-ad00-1e8a030b8887 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1273 microversion: 2.1 time: 0.351859 Nov 02 14:03:27.568290 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2688/3740] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:27 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:27.574795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:27.575610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:27.590367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.591276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.592073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.593084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.593801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.594423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.843862 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d5b57fb-4fcb-49fe-9f37-baf0ed46ecc6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.272300 Nov 02 14:03:27.845923 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2689/3741] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:03:27 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:27.853014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:27.856710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:27.884227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.885055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.885675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.890978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.893301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.894054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.240086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.253247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.254975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.256391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52cc1b74-ca03-44cf-8d01-b404251ce2f2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.409364 Nov 02 14:03:28.257494 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2690/3742] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:27 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:28.262222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:28.263206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:28.272377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.273274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.274037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.274945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.275578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.276141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.566496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.580639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.582089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.590492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6061983f-d962-4a47-b97a-3b45717d1c2e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.328479 Nov 02 14:03:28.591192 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2691/3743] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:28 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:28.599225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:28.601466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:28.617768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.618811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.619512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.622441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.623245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.624375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:29.048200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:29.061653 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fdeb21d2-f162-47a2-b7af-04be5ce54221 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1428 microversion: 2.1 time: 0.468067 Nov 02 14:03:29.061653 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2692/3744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:28 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1428 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:29.071035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:29.071704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:29.086911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:29.087454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:29.091798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:29.091798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:29.092281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:29.092675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:29.783174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:29.801337 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8219a943-dac9-4d61-a590-6bb513a03b04 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1315 microversion: 2.1 time: 0.738842 Nov 02 14:03:29.802500 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2693/3745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:29 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:29.811964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "299b6036-dca6-4c82-92ac-af0f73e5cc45"}, {"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "1c162986-e82f-4c13-98f1-243a8b0bbad7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:29.837531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:29.839276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:29.841734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:29.871605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] Creating event network-changed:299b6036-dca6-4c82-92ac-af0f73e5cc45 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:29.873207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] Creating event network-changed:1c162986-e82f-4c13-98f1-243a8b0bbad7 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:03:29.880979 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0ab4541d-a974-408b-a8cf-013a97b47458 req-8633dad0-8e66-47af-b0d6-9617021d48a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077041 Nov 02 14:03:29.881949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2694/3746] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:29.887333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:29.888041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:29.897476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:29.897987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:29.898429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:29.899229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:29.906999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:29.907669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:30.293218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:30.310794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:30.314828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:30.333167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa10844a-feae-4a5c-9157-36c263fe9392 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.447171 Nov 02 14:03:30.335375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2695/3747] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:29 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:30.348255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-449e3951-95bb-42ef-8770-0dbd8ba38c4d req-f599b3b3-2967-4f8a-929b-cc7f7987c556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cf0f49-acec-445d-b3c1-48dfd1ac2c60", "tag": "0b3968f1-1ad5-49e9-a33a-fefdba7840c7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:30.424072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-449e3951-95bb-42ef-8770-0dbd8ba38c4d req-f599b3b3-2967-4f8a-929b-cc7f7987c556 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:30.431424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-449e3951-95bb-42ef-8770-0dbd8ba38c4d req-f599b3b3-2967-4f8a-929b-cc7f7987c556 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:30.432204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-449e3951-95bb-42ef-8770-0dbd8ba38c4d req-f599b3b3-2967-4f8a-929b-cc7f7987c556 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:30.494444 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-449e3951-95bb-42ef-8770-0dbd8ba38c4d req-f599b3b3-2967-4f8a-929b-cc7f7987c556 service nova] Creating event network-changed:0b3968f1-1ad5-49e9-a33a-fefdba7840c7 for instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 on n-h1-858238-3 Nov 02 14:03:30.509035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-449e3951-95bb-42ef-8770-0dbd8ba38c4d req-f599b3b3-2967-4f8a-929b-cc7f7987c556 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171119 Nov 02 14:03:30.510872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2696/3748] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:30.521255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:30.522110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:30.558095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:30.559606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:30.560412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:30.561661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:30.563036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:30.563713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.321924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:31.342115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:31.348131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:31.350583 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf592e36-ac4f-4ad7-9866-7206e239058d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.836440 Nov 02 14:03:31.351337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2697/3749] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:30 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:31.364929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:31.366830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:31.388180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.388682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.389120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.392937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.393450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.395314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.664214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:31.675958 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e09afc80-a1c3-4e05-b41e-1718b8b11c1f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1428 microversion: 2.1 time: 0.321470 Nov 02 14:03:31.677032 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2698/3750] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:31 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1428 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:31.699319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:31.699994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:31.714694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.715481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.716135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.717051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.718658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.719363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:32.140292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:32.156646 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1185257b-366f-4745-9a8d-333a0848d893 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1315 microversion: 2.1 time: 0.461282 Nov 02 14:03:32.157334 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2699/3751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:31 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:32.162061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:32.162655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:32.177652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:32.178131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:32.178564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:32.179302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:32.179775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:32.183758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:32.968185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:32.993318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:32.994797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:33.001162 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cedcc96-5c33-469b-85dc-24193a6688f4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1737 microversion: 2.20 time: 0.842755 Nov 02 14:03:33.002308 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2700/3752] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:32 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1737 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:33.010909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ea6113ea-500d-4f93-8b0d-28407a024c81 req-2174e5c4-a5de-4a58-b055-83d91b8f5c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6213827c-5f45-470e-b090-490d96e96e3f", "tag": "226f50dd-5c10-4f67-9745-03c24a20188b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:33.040402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ea6113ea-500d-4f93-8b0d-28407a024c81 req-2174e5c4-a5de-4a58-b055-83d91b8f5c71 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:33.040939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ea6113ea-500d-4f93-8b0d-28407a024c81 req-2174e5c4-a5de-4a58-b055-83d91b8f5c71 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:33.041378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ea6113ea-500d-4f93-8b0d-28407a024c81 req-2174e5c4-a5de-4a58-b055-83d91b8f5c71 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:33.058169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ea6113ea-500d-4f93-8b0d-28407a024c81 req-2174e5c4-a5de-4a58-b055-83d91b8f5c71 service nova] Creating event network-changed:226f50dd-5c10-4f67-9745-03c24a20188b for instance 6213827c-5f45-470e-b090-490d96e96e3f on n-h1-858238-3 Nov 02 14:03:33.072244 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ea6113ea-500d-4f93-8b0d-28407a024c81 req-2174e5c4-a5de-4a58-b055-83d91b8f5c71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068523 Nov 02 14:03:33.073458 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2701/3753] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:33.079585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:33.080534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:33.088749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:33.089447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:33.090362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:33.091289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:33.091904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:33.092487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:33.451881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:33.464423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:33.465886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:33.467121 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-793d3fe5-a5a9-4487-9c79-c0fa24950dd0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.392389 Nov 02 14:03:33.473496 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2702/3754] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:33 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:33.483649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:33.485091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:33.499413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:33.500751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:33.501306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:33.501960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:33.502432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:33.502840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:33.861670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:33.903580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:33.929680 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be702f78-4a95-4dab-9597-0e72d3272fe6 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1428 microversion: 2.1 time: 0.454723 Nov 02 14:03:33.931215 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2703/3755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:33 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1428 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:33.938056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-36e0d548-3822-41b0-aeb2-f27d2ce864be req-b2ee96fb-58d0-4df8-8303-d3e217e0919b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107e7aa9-3ba3-4257-8fff-77a14fa2115c", "tag": "9f7af45a-9fcd-4e19-a1e6-b8cd8db58b7b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:33.949306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=20 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:33.952551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-36e0d548-3822-41b0-aeb2-f27d2ce864be req-b2ee96fb-58d0-4df8-8303-d3e217e0919b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:33.953891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-36e0d548-3822-41b0-aeb2-f27d2ce864be req-b2ee96fb-58d0-4df8-8303-d3e217e0919b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:33.954560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-36e0d548-3822-41b0-aeb2-f27d2ce864be req-b2ee96fb-58d0-4df8-8303-d3e217e0919b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:33.983178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-36e0d548-3822-41b0-aeb2-f27d2ce864be req-b2ee96fb-58d0-4df8-8303-d3e217e0919b service nova] Creating event network-changed:9f7af45a-9fcd-4e19-a1e6-b8cd8db58b7b for instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c on n-h2-858238-3 Nov 02 14:03:33.989457 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-36e0d548-3822-41b0-aeb2-f27d2ce864be req-b2ee96fb-58d0-4df8-8303-d3e217e0919b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056626 Nov 02 14:03:33.990784 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2704/3756] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:33.999384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:34.000805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:34.009124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:34.009529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:34.010009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:34.010886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:34.011700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:34.011853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:34.527413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:34.537688 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-303c1419-fbaa-4a47-aae6-2915e733ccb8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1315 microversion: 2.1 time: 0.544448 Nov 02 14:03:34.539518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2705/3757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:33 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:34.545297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-60d25365-e3bc-4dd1-b0cd-6225cc24eb15 req-56651ae6-53f3-4739-82f6-5350bd77de0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cf0f49-acec-445d-b3c1-48dfd1ac2c60", "name": "network-vif-plugged", "status": "completed", "tag": "0b3968f1-1ad5-49e9-a33a-fefdba7840c7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:34.559850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-60d25365-e3bc-4dd1-b0cd-6225cc24eb15 req-56651ae6-53f3-4739-82f6-5350bd77de0e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:34.560435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-60d25365-e3bc-4dd1-b0cd-6225cc24eb15 req-56651ae6-53f3-4739-82f6-5350bd77de0e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:34.561205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-60d25365-e3bc-4dd1-b0cd-6225cc24eb15 req-56651ae6-53f3-4739-82f6-5350bd77de0e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:34.566316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:34.577766 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-60d25365-e3bc-4dd1-b0cd-6225cc24eb15 req-56651ae6-53f3-4739-82f6-5350bd77de0e service nova] Creating event network-vif-plugged:0b3968f1-1ad5-49e9-a33a-fefdba7840c7 for instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 on n-h1-858238-3 Nov 02 14:03:34.583504 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-60d25365-e3bc-4dd1-b0cd-6225cc24eb15 req-56651ae6-53f3-4739-82f6-5350bd77de0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042460 Nov 02 14:03:34.584578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2706/3758] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:34.591182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:34.591976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:34.600638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:34.601387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:34.602019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:34.603697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:34.604243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:34.605141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:35.033239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.043493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.045085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.046292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-423253fc-a58f-488c-8e37-604bc34c77c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1719 microversion: 2.20 time: 0.460389 Nov 02 14:03:35.047123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2707/3759] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:34 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1719 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:35.052690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:35.053485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:35.060585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:35.061576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:35.062633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:35.063799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:35.064462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:35.065106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:35.592865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.616872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.620564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.623124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86c1e308-01ae-439e-b98d-27051524d8a7 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.574480 Nov 02 14:03:35.625385 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2708/3760] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:35 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:35.635362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:35.637667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:35.664436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:35.665254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:35.672486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:35.676587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:35.677243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:35.678011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:35.933715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:35.943373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7dd761c4-b2a1-40ef-a2a4-afc6866d65d8 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1428 microversion: 2.1 time: 0.316175 Nov 02 14:03:35.944159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2709/3761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:35 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1428 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:35.949500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:35.950110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:35.956778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:35.957493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:35.958741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:35.959730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:35.960339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:35.961067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:36.188623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.202313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6cc41898-fd21-4c02-9ea9-7fc387e440db tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1315 microversion: 2.1 time: 0.256235 Nov 02 14:03:36.203837 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2710/3762] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:35 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:36.213416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:36.214388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:36.222099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:36.222912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:36.224440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:36.225448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:36.226144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:36.226790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:36.388998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.402314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.403840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.405113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9dd67816-eeb6-4acc-85b0-a597cac5b443 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1719 microversion: 2.20 time: 0.199602 Nov 02 14:03:36.405697 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2711/3763] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:36 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:36.669535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:36.670724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:36.678086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:36.678578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:36.679271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:36.680225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:36.680688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:36.684280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:36.954818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.966826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.969045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:36.970425 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e02393a0-4f8e-4804-9e02-85fc593c1275 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.305382 Nov 02 14:03:36.983892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2712/3764] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:36 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:37.001123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:37.002337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:37.009408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.009960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.010488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.011267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.011763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.012196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.255835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:37.267792 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ffa771d-d4ba-4c60-b842-fb9e84b1404e tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1608 microversion: 2.1 time: 0.281867 Nov 02 14:03:37.268797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2713/3765] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:36 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1608 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:37.462265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-271760108", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:37.536348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:03:37.536772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:03:37.537251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:03:37.537664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:03:37.538258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:03:37.547448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.547947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.548389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.549241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.549701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.550257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.570670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Getting quotas for project fc5709ac5eeb41cca056b3f0889cdfc5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:37.577523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Getting quotas for user 1f04ddff7975407a81c6090628ef5648 and project fc5709ac5eeb41cca056b3f0889cdfc5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:37.592314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:03:37.594528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:03:37.644559 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-65f8328b-bb55-4c47-bf3f-b4ddb57b1f8b tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.374480 Nov 02 14:03:37.650979 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2714/3766] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:03:37.650979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:37.650979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:37.657531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.658038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.658501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.659270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.659726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.660151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.824839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:37.847921 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aad3d0e2-49e6-4bed-b75b-e6a97baa27e0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1315 microversion: 2.1 time: 0.200839 Nov 02 14:03:37.848636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2715/3767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:37 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:37.857216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:37.858044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:37.865447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.866057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.866564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:37.867441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:37.867932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:37.868509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.130603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.151276 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c51edd9c-2583-4f48-b69f-616fe199a989 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1608 microversion: 2.1 time: 0.296887 Nov 02 14:03:38.152728 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2716/3768] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:37 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1608 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:38.159160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ffc86195-18d3-4359-bb56-0b511b945a9d req-9588f6be-511a-4a88-a3d8-5dca1c8798b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107e7aa9-3ba3-4257-8fff-77a14fa2115c", "name": "network-vif-plugged", "status": "completed", "tag": "9f7af45a-9fcd-4e19-a1e6-b8cd8db58b7b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:38.184000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ffc86195-18d3-4359-bb56-0b511b945a9d req-9588f6be-511a-4a88-a3d8-5dca1c8798b7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.184863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ffc86195-18d3-4359-bb56-0b511b945a9d req-9588f6be-511a-4a88-a3d8-5dca1c8798b7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.185301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ffc86195-18d3-4359-bb56-0b511b945a9d req-9588f6be-511a-4a88-a3d8-5dca1c8798b7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.211367 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ffc86195-18d3-4359-bb56-0b511b945a9d req-9588f6be-511a-4a88-a3d8-5dca1c8798b7 service nova] Creating event network-vif-plugged:9f7af45a-9fcd-4e19-a1e6-b8cd8db58b7b for instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c on n-h2-858238-3 Nov 02 14:03:38.226041 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ffc86195-18d3-4359-bb56-0b511b945a9d req-9588f6be-511a-4a88-a3d8-5dca1c8798b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071131 Nov 02 14:03:38.227215 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2717/3769] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:38.244899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:38.245599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:38.254815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.255715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.256393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.257755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.258416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.259044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.465760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.475446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.477401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.478873 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4afcf6e4-4e82-4d34-8833-5a583373bd68 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1722 microversion: 2.20 time: 0.250318 Nov 02 14:03:38.479555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2718/3770] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:38 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:38.485955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:38.486861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:38.493896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.494455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.495011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.495809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.496698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.497317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.573086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.582625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.584518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.585787 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-055c3494-da46-41f6-b36c-bbe6c7d2b31a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74" status: 200 len: 1273 microversion: 2.47 time: 0.104527 Nov 02 14:03:38.586593 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2719/3771] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:38 2022] GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:38.594195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:38.595242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:38.603655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.604374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.604967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.605830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.606443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.607050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.847970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.863779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.866257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:38.868750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2773844-17b8-48a6-a03c-3ad0e5632a5f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.279767 Nov 02 14:03:38.870000 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2720/3772] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:38 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:38.878437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:38.879468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:38.889403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.889954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.890897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:38.893516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:38.894215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:38.894834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:39.107386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:39.121516 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d8d73b94-f6ae-4d99-9687-83bd85daad62 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1608 microversion: 2.1 time: 0.249345 Nov 02 14:03:39.123967 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2721/3773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:38 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1608 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:39.131779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72a5fc73-bff1-4b7d-98c7-d97f9aa93fd2"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:39.134986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:39.144778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:39.145794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:39.146678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:39.147649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:39.148261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:39.149578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:39.672610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:39.698936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1fb15385-113f-475d-817a-259ef66daa92 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.572146 Nov 02 14:03:39.700123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2722/3774] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Nov 2 14:03:39 2022] POST /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 188 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:03:39.714160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:39.721878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:39.722714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Searching by: {'deleted': False, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:03:39.735694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:39.736208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:39.736682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:39.737941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:39.738509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:39.739024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:39.782614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:03:39.839396 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ca05f9c-b4b1-4b91-9ad6-fdeabd47768b tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.135584 Nov 02 14:03:39.842188 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2723/3775] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 14:03:39 2022] GET /compute/v2.1/servers => generated 340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:39.852941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-226926522", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:39.969034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:03:39.969454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:03:39.969924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:03:39.970328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:03:39.970733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:03:39.982030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:39.982521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:39.982954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:39.983752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:39.984240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:39.984723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.003760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:40.013499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Getting quotas for project fc5709ac5eeb41cca056b3f0889cdfc5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:40.027916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Getting quotas for user 1f04ddff7975407a81c6090628ef5648 and project fc5709ac5eeb41cca056b3f0889cdfc5. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:40.054837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:03:40.058084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:03:40.135716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd9735b3-aa73-47e8-9309-ff51d4149410 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.290128 Nov 02 14:03:40.136377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2724/3776] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:03:40.150458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:40.151337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:40.159632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.159874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.160321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.161029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.161645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.161885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.330791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:40.342167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5efdbce0-43c2-4112-98f9-5e28186e4113 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1502 microversion: 2.1 time: 0.203276 Nov 02 14:03:40.342762 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2725/3777] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:40 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:40.347917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:40.352920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:40.353676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Searching by: {'deleted': False, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:03:40.359860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.360343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.361130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.362369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.362921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.363377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.422185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:03:40.470583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:40.477338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.477785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.478232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.608933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1997e278-9df3-48c6-b326-9b8881e92011 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.264631 Nov 02 14:03:40.615141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2726/3778] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:03:40 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:40.616402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:40.617030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:40.624030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.624556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.624999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.626180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.626578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.627029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.939267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:40.949591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:40.951527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:40.954219 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-375c2e30-18a9-4165-8166-397299edd7f0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.342212 Nov 02 14:03:40.966309 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2727/3779] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:40 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:40.975131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:40.975131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:40.979747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.980249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.980686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:40.981395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:40.981845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:40.982270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.065697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137559) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:03:41.191700 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7e05af1-e908-451e-b3e8-a1870d4a925f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/action" status: 202 len: 0 microversion: 2.20 time: 0.226963 Nov 02 14:03:41.197155 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2728/3780] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 14:03:40 2022] POST /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:03:41.211482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:41.215908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:41.231382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.231382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.231382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.231925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.232427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.233239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.318444 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b6a2f3d5-b98b-4a82-b39a-1e3ed05fd176 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "PUT /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1047 microversion: 2.47 time: 0.120304 Nov 02 14:03:41.322905 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2729/3781] 10.222.0.18 () {62 vars in 1297 bytes} [Wed Nov 2 14:03:41 2022] PUT /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1047 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:41.341799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1079eb4b-b331-409e-bc75-9e248a54e458 req-0a1c5070-ebdd-4c22-911e-16176391cd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "name": "network-vif-unplugged", "status": "completed", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:41.355624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1079eb4b-b331-409e-bc75-9e248a54e458 req-0a1c5070-ebdd-4c22-911e-16176391cd2c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.356312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1079eb4b-b331-409e-bc75-9e248a54e458 req-0a1c5070-ebdd-4c22-911e-16176391cd2c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.356942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1079eb4b-b331-409e-bc75-9e248a54e458 req-0a1c5070-ebdd-4c22-911e-16176391cd2c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.374713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.server_external_events [req-1079eb4b-b331-409e-bc75-9e248a54e458 req-0a1c5070-ebdd-4c22-911e-16176391cd2c service nova] Unable to find a host for instance b4cea623-4709-4680-9646-d7263f443356. Dropping event network-vif-unplugged {{(pid=137559) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 14:03:41.375672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1079eb4b-b331-409e-bc75-9e248a54e458 req-0a1c5070-ebdd-4c22-911e-16176391cd2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050589 Nov 02 14:03:41.376506 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2730/3782] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 14:03:41.384615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:41.387290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:41.396833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.397840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.398394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.399249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.400439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.400971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.628212 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2424e21e-f685-439d-b914-4319812ec454 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.249085 Nov 02 14:03:41.628642 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2731/3783] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:41 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:41.638990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a57ae17d-2851-45c5-bf06-044e9ad906d3 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:41.651960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a57ae17d-2851-45c5-bf06-044e9ad906d3 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022068 Nov 02 14:03:41.653069 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2732/3784] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 14:03:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:41.660776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:41.661969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:41.673346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.673834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.674276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.674986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.675732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.676166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.905150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:41.920019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:41.922473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:41.924815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-68e4011b-ee21-4dc9-9406-adbb473f0c17 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1748 microversion: 2.20 time: 0.270557 Nov 02 14:03:41.925455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2733/3785] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:41 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1748 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:41.931413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:41.932268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:41.943052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.944705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.945372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:41.946279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:41.946912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:41.947609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:42.052085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:42.072187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:42.075420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:42.077010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-692bce54-c176-4274-a849-ae0f21e5fc2e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1335 microversion: 2.47 time: 0.150120 Nov 02 14:03:42.110015 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2734/3786] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:41 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1335 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:42.110015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:42.111079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:42.119289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:42.119931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:42.120622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:42.121491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:42.122128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:42.123113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:42.467002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:42.481125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:42.482575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:42.484287 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef5876c9-39ea-4c03-96b8-b1e80ac806e8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.382938 Nov 02 14:03:42.484854 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2735/3787] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:42 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:42.495678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:42.496974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:42.504931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:42.505514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:42.506143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:42.507209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:42.508130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:42.508992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:42.557536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:03:42.661273 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5027ca12-7e82-41f8-a70c-05cb1248f37f tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 204 len: 0 microversion: 2.1 time: 0.174832 Nov 02 14:03:42.665958 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2736/3788] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:03:42 2022] DELETE /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:03:42.670870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:42.673477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:42.680397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:42.680892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:42.683168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:42.683168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:42.683168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:42.683168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.225614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-27305206-c205-4868-91e5-d73d164a8b25 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.559753 Nov 02 14:03:43.228597 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2737/3789] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:42 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:43.238471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:43.239727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:43.251711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.252720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.253403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.254623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.255709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.256378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.283418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:43.459486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.471580 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b91408a-7d2c-4078-aea8-354f404fa69c tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1715 microversion: 2.1 time: 0.239973 Nov 02 14:03:43.472268 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2738/3790] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:43 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1715 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:43.477409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:43.478041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:43.489416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.489912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.490354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.491071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.491555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.492018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.685351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.696342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.697849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.699136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-566687b8-7aae-44e7-9761-4a9e1f89a1be tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1748 microversion: 2.20 time: 0.225774 Nov 02 14:03:43.699683 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2739/3791] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:43 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1748 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:43.705758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:43.706850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:43.717028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.719037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.719674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.720777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.721505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.722196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.801911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.812529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.814139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:43.815339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8a1912ea-1b42-43cb-aea0-7a8810d62689 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1335 microversion: 2.47 time: 0.114393 Nov 02 14:03:43.816243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2740/3792] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:43 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:43.821257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a6746b1b-8920-405a-82a8-0696da16d8cd req-059c369b-ddd8-45d1-8279-dee6bb223671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cf0f49-acec-445d-b3c1-48dfd1ac2c60", "tag": "0b3968f1-1ad5-49e9-a33a-fefdba7840c7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:43.833499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a6746b1b-8920-405a-82a8-0696da16d8cd req-059c369b-ddd8-45d1-8279-dee6bb223671 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.834766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a6746b1b-8920-405a-82a8-0696da16d8cd req-059c369b-ddd8-45d1-8279-dee6bb223671 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.836580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a6746b1b-8920-405a-82a8-0696da16d8cd req-059c369b-ddd8-45d1-8279-dee6bb223671 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.857314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a6746b1b-8920-405a-82a8-0696da16d8cd req-059c369b-ddd8-45d1-8279-dee6bb223671 service nova] Creating event network-changed:0b3968f1-1ad5-49e9-a33a-fefdba7840c7 for instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 on n-h1-858238-3 Nov 02 14:03:43.863456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a6746b1b-8920-405a-82a8-0696da16d8cd req-059c369b-ddd8-45d1-8279-dee6bb223671 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045461 Nov 02 14:03:43.867211 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2741/3793] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:43.876179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:43.876179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:43.883171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.883680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.884482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:43.885119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:43.885577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:43.886013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:44.198402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:44.209961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:44.217943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:44.221937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4addaa62-264c-445b-bc29-678f83fc3852 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.351817 Nov 02 14:03:44.224254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2742/3794] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:43 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:44.238680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:44.241787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:44.259873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:44.260614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:44.261222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:44.262178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:44.262725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:44.263261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:44.518136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88c50a0f-ffe4-4120-abb5-d788a7367476 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.283650 Nov 02 14:03:44.519374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2743/3795] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:44 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:44.531801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:44.536172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:44.559900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:44.560644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:44.561592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:44.563384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:44.564053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:44.564681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.105025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.113140 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85ba6663-bd42-41c0-ac71-7cbdfcca5e2a tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1715 microversion: 2.1 time: 0.592246 Nov 02 14:03:45.113955 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2744/3796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:44 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1715 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:45.135454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:45.136104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:45.151389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.151916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.152346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.153070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.153533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.153956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.465051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.474133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.475607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.479571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae95b310-1a63-4ffe-ac22-284bc98595a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1750 microversion: 2.20 time: 0.349565 Nov 02 14:03:45.480375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2745/3797] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:45 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1750 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:45.485810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:45.486638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:45.493372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.494513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.495132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.496014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.496604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.497171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.584370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.599402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.601659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.603277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71211673-3963-4b3c-a53d-30e3e7d17639 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1356 microversion: 2.47 time: 0.121250 Nov 02 14:03:45.611595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2746/3798] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:45 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1356 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:45.623645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:45.625221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:45.634343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.634933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.635489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.637133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.637634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.638362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.949860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.959455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.961151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:45.962479 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a72bfe2-ecc3-40e1-92e8-982f1af07600 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.349631 Nov 02 14:03:45.963255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2747/3799] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:45 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:45.969055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:45.971552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:45.979341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.980002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.980582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:45.981453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:45.982195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:45.982765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.036803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11272759-230a-4364-9723-1b8c31b84e07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.072137 Nov 02 14:03:46.040330 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2748/3800] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:45 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:46.050259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:46.061489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:46.083950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.083950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.083950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.083950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.084370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.084905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.236647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:03:46.237121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:03:46.237618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:03:46.238033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:03:46.238445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:03:46.382673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:46.408657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.412921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.416012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.420925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.422388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.427565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.560680 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80af1fbc-5cf6-4520-b0af-115e256fae75 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "POST /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091/action" status: 202 len: 1078 microversion: 2.47 time: 0.521592 Nov 02 14:03:46.563585 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2749/3801] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 14:03:46 2022] POST /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091/action => generated 1078 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 14:03:46.571910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:46.572959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:46.584692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.585639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.586384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.587440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.588048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.588785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.646999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.647769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.648271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.648791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lazy-loading 'fault' on Instance uuid ec7a70e1-63a0-4c61-8f90-55831889ea55 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:03:46.719456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195bac8af8764feaacf0bbc16780257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e964b3dcec04af3a90b2444707ce3c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:46.731328 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46689028-c7a1-4c35-b6ce-0a114270b210 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 200 len: 1367 microversion: 2.1 time: 0.165824 Nov 02 14:03:46.745519 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2750/3802] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:46 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:46.755716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4952ff7a-5315-43a4-b8d0-42083cfac365 req-9fd430b4-371e-4290-87bf-93c0d4cca82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec7a70e1-63a0-4c61-8f90-55831889ea55", "name": "network-vif-deleted", "tag": "e952acfb-5d73-4fd3-99e3-1919982de12e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:46.785208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4952ff7a-5315-43a4-b8d0-42083cfac365 req-9fd430b4-371e-4290-87bf-93c0d4cca82f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.785732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4952ff7a-5315-43a4-b8d0-42083cfac365 req-9fd430b4-371e-4290-87bf-93c0d4cca82f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.786162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4952ff7a-5315-43a4-b8d0-42083cfac365 req-9fd430b4-371e-4290-87bf-93c0d4cca82f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.819992 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4952ff7a-5315-43a4-b8d0-42083cfac365 req-9fd430b4-371e-4290-87bf-93c0d4cca82f service nova] Creating event network-vif-deleted:e952acfb-5d73-4fd3-99e3-1919982de12e for instance ec7a70e1-63a0-4c61-8f90-55831889ea55 on n-h1-858238-3 Nov 02 14:03:46.825855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4952ff7a-5315-43a4-b8d0-42083cfac365 req-9fd430b4-371e-4290-87bf-93c0d4cca82f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078836 Nov 02 14:03:46.826862 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2751/3803] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:46.832374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:46.833073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:46.839777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.840253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.840882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:46.841728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:46.842330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:46.842902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.113030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.127285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.128978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.133763 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fbb74119-07d9-477a-831f-e3221b6f19a0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1750 microversion: 2.20 time: 0.304468 Nov 02 14:03:47.134445 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2752/3804] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:46 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1750 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:47.158882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:47.159627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:47.170077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.170580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.171022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.172468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.172941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.173371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.308186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.325335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.329459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.332486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42961e65-351b-4aed-a807-afeb04f608ea tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.184057 Nov 02 14:03:47.336356 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2753/3805] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:47 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:47.341638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:47.342454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:47.373991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.374927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.375789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.377879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.379295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.380345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.642705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.646889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:47.655889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.657488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:47.659004 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4356898-4cb6-4ea1-a9cd-ad39f9e5020f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.321247 Nov 02 14:03:47.663160 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2754/3806] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:47 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:47.666681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:47.669016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:47.680624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.681483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.682265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.683713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.684620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.685812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.762493 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6f0c8e1e-fdb2-4fe3-8b69-86cb56dac63e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.100053 Nov 02 14:03:47.767825 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2755/3807] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:47 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:47.779966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:47.781116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] [instance: ec7a70e1-63a0-4c61-8f90-55831889ea55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:47.794718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.795631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.796908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.798429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:47.799556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:47.800264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:47.835010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] HTTP exception thrown: Instance ec7a70e1-63a0-4c61-8f90-55831889ea55 could not be found. Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Request method failure captured: Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 HTTP/1.1 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnhz_j-TQcdebaGfLX14DuhfjfYGDh9vJVFf5a3V_s5uRAX8IGnZCsZX5FxUskAJYOPPUEi4e2x6k3jQSDMPpt_oc6dBQNbVcFdNDy5CirJRs8A8st38bDt3zVLV710nr83Et9IVIjZjq5pNTwlZh5IoTRdwHdimakbZZQvP0M2-ijQ Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7e964b3dcec04af3a90b2444707ce3c1 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestManualDisk-847387847 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e964b3dcec04af3a90b2444707ce3c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e964b3dcec04af3a90b2444707ce3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e964b3dcec04af3a90b2444707ce3c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e964b3dcec04af3a90b2444707ce3c1"}]}] Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestManualDisk-847387847 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7e964b3dcec04af3a90b2444707ce3c1 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestManualDisk-847387847 Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestManualDisk-847387847-project Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 195bac8af8764feaacf0bbc16780257b Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestManualDisk-847387847-project Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance ec7a70e1-63a0-4c61-8f90-55831889ea55 could not be found. Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ec7a70e1-63a0-4c61-8f90-55831889ea55'} Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec7a70e1-63a0-4c61-8f90-55831889ea55 could not be found. Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec7a70e1-63a0-4c61-8f90-55831889ea55 could not be found. Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:47.839475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec7a70e1-63a0-4c61-8f90-55831889ea55 could not be found. Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Returning 404 to user: Instance ec7a70e1-63a0-4c61-8f90-55831889ea55 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:47.844491 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-795809ce-49eb-4012-b2ea-1cb398bbf2d0 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55" status: 404 len: 111 microversion: 2.1 time: 0.071148 Nov 02 14:03:47.845589 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2756/3808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:03:47 2022] GET /compute/v2.1/servers/ec7a70e1-63a0-4c61-8f90-55831889ea55 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:03:47.859546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9ec9576-b8b9-46f0-80d8-80a73bcc3b53 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] Calling method '.version_select at 0x7f6f80fe7820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:47.893884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9ec9576-b8b9-46f0-80d8-80a73bcc3b53 tempest-ServersTestManualDisk-847387847 tempest-ServersTestManualDisk-847387847-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936651023" status: 202 len: 0 microversion: 2.1 time: 0.043219 Nov 02 14:03:47.895667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2757/3809] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 14:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936651023 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:03:48.163957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:48.164520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:48.167832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:48.176063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.176658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.177110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.177817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.178267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.178685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.502271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.523689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.525175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.526376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5ecde05-2ff7-4fd8-830e-ed840967eb02 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1750 microversion: 2.20 time: 0.368031 Nov 02 14:03:48.526963 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2758/3810] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:48 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1750 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:03:48.532566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:48.533194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:48.543923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.544758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.545513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.546427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.547838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.548437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.651145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.667398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.672016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:48.675434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5c9ff93-b0aa-46f2-a25d-4fd5a1656330 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.146971 Nov 02 14:03:48.676446 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2759/3811] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:48 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:48.696083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:48.697195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:48.723212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.723948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.724495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:48.725321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:48.726445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:48.727173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.052995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:49.108397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:49.110834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:49.113882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5b0758e9-1ec4-4218-8efc-ed0cd1f911e0 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.426649 Nov 02 14:03:49.113882 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2760/3812] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:48 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:49.135288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:49.138621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:49.153473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.153974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.154422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.155165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.155622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.156202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.214860 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb4b4a1b-38d1-4fb0-a3c1-060f4bbd95e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.092988 Nov 02 14:03:49.220579 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2761/3813] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:49 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:49.557340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:49.558315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:49.567175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.567872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.568469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.569372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.569982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.570588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.073770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.083972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.085630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.086995 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b602666-a2ba-43af-8c3c-9e81a4fabb69 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1750 microversion: 2.20 time: 0.534034 Nov 02 14:03:50.087877 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2762/3814] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:49 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1750 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:50.093017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:50.093668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:50.101670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.102167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.102607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.103343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.103811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.104273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.199389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.213155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.215142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.216582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aebe4cb5-1444-4b78-a0ca-d9c1179116bf tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.127605 Nov 02 14:03:50.227122 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2763/3815] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:50 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:50.227122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:50.227122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:50.243585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.246322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.248934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.252988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.254354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.255359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.370776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:50.466453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=14 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:50.662116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.678224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.681907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:50.682803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a72a8188-adae-4d87-9bf9-00014c30cfa4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.463278 Nov 02 14:03:50.683950 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2764/3816] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:50 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:50.709333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:50.713296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:50.726457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.727443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.728299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.729583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:50.730700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:50.731742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:50.785843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea2aa550-8229-4f63-8234-290301ad2c84 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.096164 Nov 02 14:03:50.786523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2765/3817] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:50 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:51.134432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:51.135370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:51.145004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.145629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.146130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.147000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.147684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.148834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.551607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.586196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.593128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.595513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-07a1d260-3e3a-4a42-b97e-8084cf63929c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.468515 Nov 02 14:03:51.617911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2766/3818] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:51 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:03:51.623180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:51.623714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:51.645652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.647395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.648068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.649029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.649640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.650235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.778318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.794893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.798066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:51.800638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5ec38598-11c9-41e1-8ea6-e83af2e2e80d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.181058 Nov 02 14:03:51.801434 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2767/3819] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:51 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:51.807657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:51.808527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:51.818313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.819205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.819804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:51.820679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:51.821293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:51.821866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:52.143934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:52.165782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:52.167756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:52.169618 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3af2af4-9bca-46ea-8f81-748b18f5c5a1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.366435 Nov 02 14:03:52.170741 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2768/3820] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:51 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:52.188908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:52.192917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:52.200340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:52.201107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:52.201831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:52.202720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:52.203362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:52.204540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:52.254477 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2b82c4fb-c698-4a8b-8426-8f2ed04ae13f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 14 microversion: 2.1 time: 0.081668 Nov 02 14:03:52.256221 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2769/3821] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:52 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:03:52.625873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:52.626663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:52.639269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:52.648330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:52.648959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:52.650627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:52.651304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:52.651899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:53.382669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.403132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.414951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.417300 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3a610f4-135c-4b9c-b462-150433d0b664 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.794760 Nov 02 14:03:53.428104 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2770/3822] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:52 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:03:53.441741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:53.442847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:53.455407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:53.456457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:53.457448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:53.458880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:53.460453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:53.461263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:53.758841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.774643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.782514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:53.787893 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b89fc69-5b94-4542-8f44-4ade3f16a42e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.354161 Nov 02 14:03:53.803627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2771/3823] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:53 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:53.815250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:53.815869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:53.834213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:53.834723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:53.850163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:53.853119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:53.853565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:53.855435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:54.350310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:54.373462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:54.376286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:54.378086 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3c6a3cd-aeb4-4381-b23f-c62a0b9d14d5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.573199 Nov 02 14:03:54.378978 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2772/3824] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:03:53 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:03:54.383980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:54.388487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:54.414913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:54.416035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:54.423263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:54.424374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:54.425144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:54.425825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:04.415071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=30 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:04.491067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:04.805033 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a3c73ba-c53c-468a-9908-c98b07d9078c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action" status: 200 len: 24534 microversion: 2.1 time: 10.424250 Nov 02 14:04:04.813168 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2773/3825] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:03:54 2022] POST /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c/action => generated 24534 bytes in 10433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:04:04.823762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:04.826495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:04.838484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:04.838484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:04.838484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:04.839522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:04.840114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:04.840630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.013460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.026899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.028403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.029608 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a3150078-137f-4e83-bbcc-513619e0cc10 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.214162 Nov 02 14:04:05.030189 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2774/3826] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:04 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:05.034803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:05.035454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:05.041800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.042322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.042734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.043469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.043925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.044350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.130078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.139166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.140641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.141842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79d3a3d2-5682-4f91-9769-d777e3e6e77a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.110682 Nov 02 14:04:05.142418 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2775/3827] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:05 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:05.149247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:05.149247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:05.156784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.157517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.158227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.159479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.160222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.160980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.381248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.397026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.399502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.401464 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e061cc8-90bf-4ce0-b26a-b2681f6b41df tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.257837 Nov 02 14:04:05.402382 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2776/3828] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:05 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:05.684996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6763be82-7355-4a4d-bc3f-158dde609b60 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1874740637", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:05.688876 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6763be82-7355-4a4d-bc3f-158dde609b60 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] HTTP exception thrown: min_count must be <= max_count Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6763be82-7355-4a4d-bc3f-158dde609b60 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Request method failure captured: Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 184 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjOy3sz4jmGNqut_STU0uQnu5Wuc9WBXJOCkjZGG3AwhrF3mLFHBMrBLGqBRS0WCecBO9rRDUDOMYGIblBb7aBTTVTtVW8fes7_v6omvjYyxy-VSEYNh-w3BiYDNEVo6Vzir71JKf-92xJs0R9F8sTWt4_SWTvg8oTDNxagbpA1mrc Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6cd08b49b97489b9208e722dbeae249"}]}] Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c8bcfa2dca14ae3bbff7468270a80ad Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1874740637", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: exception: min_count must be <= max_count Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1874740637', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 14:04:05.690850 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:05.700644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6763be82-7355-4a4d-bc3f-158dde609b60 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Returning 400 to user: min_count must be <= max_count {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:05.700644 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6763be82-7355-4a4d-bc3f-158dde609b60 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.288432 Nov 02 14:04:05.700644 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2777/3829] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:05 2022] POST /compute/v2.1/servers => generated 74 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 14:04:05.700644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:05.700644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:05.709022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.709503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.709927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.710620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.711065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.711534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.860999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:05.869004 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9966fe1-be32-4acd-96c1-67a111973847 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.175177 Nov 02 14:04:05.869586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2778/3830] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:05 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:05.874110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:05.875153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:05.881270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.881747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.882180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.882878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:05.883360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:05.883780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:05.915992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:04:06.004181 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ccfa2526-d5ee-4fb2-9027-bee79d642a95 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 204 len: 0 microversion: 2.1 time: 0.133283 Nov 02 14:04:06.005201 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2779/3831] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:04:05 2022] DELETE /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:04:06.012911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d538cb5-70b2-40cd-b962-1f3092317911 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-849936685", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "max_count": 0}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d538cb5-70b2-40cd-b962-1f3092317911 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Request method failure captured: Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 167 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjOy3sz4jmGNqut_STU0uQnu5Wuc9WBXJOCkjZGG3AwhrF3mLFHBMrBLGqBRS0WCecBO9rRDUDOMYGIblBb7aBTTVTtVW8fes7_v6omvjYyxy-VSEYNh-w3BiYDNEVo6Vzir71JKf-92xJs0R9F8sTWt4_SWTvg8oTDNxagbpA1mrc Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6cd08b49b97489b9208e722dbeae249"}]}] Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c8bcfa2dca14ae3bbff7468270a80ad Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-849936685", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "max_count": 0}} Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-849936685', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'max_count': 0}}} Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 0 Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:04:06.017713 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d538cb5-70b2-40cd-b962-1f3092317911 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d538cb5-70b2-40cd-b962-1f3092317911 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012275 Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2780/3832] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.026054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:06.033170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.033952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.035173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.035764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.036482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.037272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.201923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.210613 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bbdaf8cd-c517-44b0-9158-fa32151e25ff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.189810 Nov 02 14:04:06.211223 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2781/3833] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:06.215828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.216432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:06.223363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.224158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.224789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.225826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.226485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.227215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.399216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.408221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0d82d97-397d-4bc2-9010-0eaab69ffda6 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1667 microversion: 2.1 time: 0.195930 Nov 02 14:04:06.408818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2782/3834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1667 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:06.413611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.414288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:06.420890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.421407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.421840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.423227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.423686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.424138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.594652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.605276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.606737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.608081 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5feb7a3-7950-4881-a1d1-8c954f197d06 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.198325 Nov 02 14:04:06.608672 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2783/3835] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:06.613539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddc93cd9-acb1-42f6-8ecb-843f6bb8a51b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1489011553", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "max_count": 2.5}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddc93cd9-acb1-42f6-8ecb-843f6bb8a51b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Request method failure captured: Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 170 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjOy3sz4jmGNqut_STU0uQnu5Wuc9WBXJOCkjZGG3AwhrF3mLFHBMrBLGqBRS0WCecBO9rRDUDOMYGIblBb7aBTTVTtVW8fes7_v6omvjYyxy-VSEYNh-w3BiYDNEVo6Vzir71JKf-92xJs0R9F8sTWt4_SWTvg8oTDNxagbpA1mrc Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6cd08b49b97489b9208e722dbeae249"}]}] Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c8bcfa2dca14ae3bbff7468270a80ad Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1489011553", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "max_count": 2.5}} Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1489011553', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:04:06.619821 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddc93cd9-acb1-42f6-8ecb-843f6bb8a51b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ddc93cd9-acb1-42f6-8ecb-843f6bb8a51b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011411 Nov 02 14:04:06.627596 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2784/3836] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:04:06.632163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.632163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:06.637726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.638310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.638654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.639451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.640031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.641395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.745815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.759059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.761601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.763568 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aacd0869-da40-4833-834f-a6fb4e35c572 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.139462 Nov 02 14:04:06.765109 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2785/3837] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:06.774573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.775907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:06.786359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.786590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.787172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.788432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:06.789189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:06.789891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:06.980534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:06.990634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c470043d-77f0-4c43-ab42-14acc3e8c64a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.223472 Nov 02 14:04:06.991269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2786/3838] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:06.995959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:06.996571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:07.003600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.004173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.004811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.005497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.006023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.006499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.287085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:07.298836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:07.300507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:07.302591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4bb6d584-2415-43e7-ad54-18110bd6e01f tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.310100 Nov 02 14:04:07.303996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2787/3839] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:06 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:07.312120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0fa76d19-e809-4b2d-b896-eb0fac11913b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-528067706", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 0}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0fa76d19-e809-4b2d-b896-eb0fac11913b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Request method failure captured: Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 167 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjOy3sz4jmGNqut_STU0uQnu5Wuc9WBXJOCkjZGG3AwhrF3mLFHBMrBLGqBRS0WCecBO9rRDUDOMYGIblBb7aBTTVTtVW8fes7_v6omvjYyxy-VSEYNh-w3BiYDNEVo6Vzir71JKf-92xJs0R9F8sTWt4_SWTvg8oTDNxagbpA1mrc Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6cd08b49b97489b9208e722dbeae249"}]}] Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c8bcfa2dca14ae3bbff7468270a80ad Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-528067706", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 0}} Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-528067706', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'min_count': 0}}} Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 0 Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:04:07.319360 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0fa76d19-e809-4b2d-b896-eb0fac11913b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0fa76d19-e809-4b2d-b896-eb0fac11913b tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016148 Nov 02 14:04:07.325562 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2788/3840] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:04:07.332576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.333570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:07.346000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.346769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.347504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.348674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.349415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.350086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.552050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:07.560672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67e71108-0388-4e67-8fc5-fd860917f267 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.235654 Nov 02 14:04:07.561263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2789/3841] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:07.567245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.568777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:07.575366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.575935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.576447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.577223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.578371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.578869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.734717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:07.744202 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12e7a6b9-b309-4f65-bc49-d720f13f0e07 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1667 microversion: 2.1 time: 0.181089 Nov 02 14:04:07.744934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2790/3842] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1667 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:07.752133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9af28a51-e83d-4105-b9f6-92ada8a1cee1 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-367375293", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 2.5}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9af28a51-e83d-4105-b9f6-92ada8a1cee1 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Request method failure captured: Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 169 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjOy3sz4jmGNqut_STU0uQnu5Wuc9WBXJOCkjZGG3AwhrF3mLFHBMrBLGqBRS0WCecBO9rRDUDOMYGIblBb7aBTTVTtVW8fes7_v6omvjYyxy-VSEYNh-w3BiYDNEVo6Vzir71JKf-92xJs0R9F8sTWt4_SWTvg8oTDNxagbpA1mrc Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6cd08b49b97489b9208e722dbeae249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6cd08b49b97489b9208e722dbeae249"}]}] Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f6cd08b49b97489b9208e722dbeae249 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-357934094 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8c8bcfa2dca14ae3bbff7468270a80ad Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-357934094-project Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-367375293", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "min_count": 2.5}} Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-367375293', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:04:07.760100 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 14:04:07.768169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:07.769842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9af28a51-e83d-4105-b9f6-92ada8a1cee1 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:07.771043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9af28a51-e83d-4105-b9f6-92ada8a1cee1 tempest-MultipleCreateNegativeTestJSON-357934094 tempest-MultipleCreateNegativeTestJSON-357934094-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024720 Nov 02 14:04:07.772579 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2791/3843] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:04:07.784895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:07.785975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:07.798723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.799516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.799906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.800644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.801144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.802397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.865788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Locking {{(pid=137559) lock /opt/stack/nova/nova/compute/api.py:4845}} Nov 02 14:04:07.876108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:07.973271 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ecf95e8c-40ab-4c58-97fa-e1044cd77945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.198262 Nov 02 14:04:07.974747 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2792/3844] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:07 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:07.989193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.990620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:08.004073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.005272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.006261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.007881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.012038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.013112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.505901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.533861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.542648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.545250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-839c1e06-fc58-400f-9d3e-04df46f54d42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.568069 Nov 02 14:04:08.546078 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2793/3845] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:08.556768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:08.558231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:08.568454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.568977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.569328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.570173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.570824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.571362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.701225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.713350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.716038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:08.720757 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfe2eb3d-0f05-4493-80a6-15b2b931d26e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.170875 Nov 02 14:04:08.720757 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2794/3846] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:08 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:08.725945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:08.726546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:08.738878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.740132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.740132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.742985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.742985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.742985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:09.240725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:09.260566 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56a31b0e-55c6-4a50-9cc6-2c7d4bf871f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.538635 Nov 02 14:04:09.277832 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2795/3847] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:08 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:09.287768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:09.288765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:09.296561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:09.300610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:09.304474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:09.305422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:09.306019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:09.306560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:09.939032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:09.963639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:09.965130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:09.969083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-665044bd-b4cd-4254-bb53-7d5dcf077f80 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.687260 Nov 02 14:04:09.970383 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2796/3848] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:09 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:09.998537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:10.005010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:10.018862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.023135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.023948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.024764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.025242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.025673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.212766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e49ea67ba0441689b266f3fa4834f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8162f09f028443a97325693edfe0805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.233182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-97141993-f151-4811-b86f-506cedf87196 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 200 len: 1599 microversion: 2.1 time: 0.261277 Nov 02 14:04:10.233905 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2797/3849] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:09 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:10.242240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:10.248925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.249851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.250467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.287426 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] HTTP exception thrown: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 is locked Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Request method failure captured: Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action HTTP/1.1 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 15 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndhdGKUC7D589ajspQB1yE7varO5rOuJ8uCp6LFA88n-7a6CJnNp_xYVdgh1S5kg2U35y0K0ywE-fPsP84zjQg21NU95D5-ohgaVtpj-Z2IQHTbxA-ZL9LOqzPNk-Xfxq1Fzwd331iqtO8K69cnJj7NznkzF70t0qxEcq6A5nzyEsM Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/440bbc53bad84aeda15c454a82450493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_440bbc53bad84aeda15c454a82450493"}]}] Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 53bef65bfa79486a8f0180f2f86eddba Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: {"os-stop": {}} Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 is locked Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3b24d306-b049-4140-b93e-e92a824d8d35', 'body': {'os-stop': {}}} Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 is locked Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 is locked Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 is locked Nov 02 14:04:10.289556 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:10.295261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Returning 409 to user: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 is locked {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:10.296770 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed4dab10-6d5d-4ef9-976a-93e77f2043f1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 409 len: 107 microversion: 2.1 time: 0.061554 Nov 02 14:04:10.297615 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2798/3850] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:10 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 107 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:04:10.307132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:10.308291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:10.319279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.320240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.321169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.322462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.323479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.324694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.743602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.758539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.770099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.772593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73a3aa24-dfb1-4805-bfef-37d128d9597a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.473208 Nov 02 14:04:10.774498 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2799/3851] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:10 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:10.783681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:10.784629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:10.792347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.793176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.793802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.794709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:10.795376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:10.795969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:10.910021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.933871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.948398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:10.951796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2904a139-2f42-40d3-a727-695091e1b09e tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.175493 Nov 02 14:04:10.963315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2800/3852] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:10 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:10.976576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-71fcb73f-08d9-486a-8431-0ece4d090638 req-5a574291-f08e-4f8e-91cf-cee24d254d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6213827c-5f45-470e-b090-490d96e96e3f", "name": "network-vif-deleted", "tag": "226f50dd-5c10-4f67-9745-03c24a20188b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:11.004315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71fcb73f-08d9-486a-8431-0ece4d090638 req-5a574291-f08e-4f8e-91cf-cee24d254d74 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.005945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71fcb73f-08d9-486a-8431-0ece4d090638 req-5a574291-f08e-4f8e-91cf-cee24d254d74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.017287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-71fcb73f-08d9-486a-8431-0ece4d090638 req-5a574291-f08e-4f8e-91cf-cee24d254d74 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.053860 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-71fcb73f-08d9-486a-8431-0ece4d090638 req-5a574291-f08e-4f8e-91cf-cee24d254d74 service nova] Creating event network-vif-deleted:226f50dd-5c10-4f67-9745-03c24a20188b for instance 6213827c-5f45-470e-b090-490d96e96e3f on n-h1-858238-3 Nov 02 14:04:11.063215 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-71fcb73f-08d9-486a-8431-0ece4d090638 req-5a574291-f08e-4f8e-91cf-cee24d254d74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098022 Nov 02 14:04:11.064618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2801/3853] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:11.091835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:11.095362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:11.121972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.122961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.123774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.125677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.129043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.129916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.269462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Unlocking {{(pid=137559) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 14:04:11.445215 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64c97554-6bf8-4e06-b4d8-973ec840e9cc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.378963 Nov 02 14:04:11.445887 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2802/3854] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:11 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:11.455403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:11.458301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:11.478015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.478534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.479069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.483203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.483718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.484725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.803930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:11.827852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:11.829859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:11.831778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7400e7c4-0ebe-4fbf-9d92-12cf16e63c08 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.380534 Nov 02 14:04:11.832710 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2803/3855] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:11 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:11.851897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:11.854879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] [instance: 6213827c-5f45-470e-b090-490d96e96e3f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:11.865090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.865613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.866062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.866815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.870009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.870709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.893581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] HTTP exception thrown: Instance 6213827c-5f45-470e-b090-490d96e96e3f could not be found. Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Request method failure captured: Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f HTTP/1.1 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYniDBYF25H1yjO9H2Jhm8ISiRNzFHqwGOZ3iEAS3fIRQwv5dxRY4ReHqlTkiYSbhBKID8fF996k1Mehmu-jYU8Wkug-iJTRCYzdu1p6r3afzwCk5IeZsV_ZVvq-bgtAZLb569Et0EP6KqW3Xk_x_50TP6XsiURq_Fw5uUtrrvCAQNBY Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e8162f09f028443a97325693edfe0805 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersTestFqdnHostnames-1662464756 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e8162f09f028443a97325693edfe0805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e8162f09f028443a97325693edfe0805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e8162f09f028443a97325693edfe0805"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e8162f09f028443a97325693edfe0805"}]}] Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersTestFqdnHostnames-1662464756 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e8162f09f028443a97325693edfe0805 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1662464756 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersTestFqdnHostnames-1662464756-project Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 2e49ea67ba0441689b266f3fa4834f08 Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersTestFqdnHostnames-1662464756-project Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 6213827c-5f45-470e-b090-490d96e96e3f could not be found. Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6213827c-5f45-470e-b090-490d96e96e3f'} Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6213827c-5f45-470e-b090-490d96e96e3f could not be found. Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6213827c-5f45-470e-b090-490d96e96e3f could not be found. Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:11.896167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6213827c-5f45-470e-b090-490d96e96e3f could not be found. Nov 02 14:04:11.900903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:11.905092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Returning 404 to user: Instance 6213827c-5f45-470e-b090-490d96e96e3f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:11.907931 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4a687b60-0fcd-46b1-9bf7-5d3b44974a31 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f" status: 404 len: 111 microversion: 2.1 time: 0.072716 Nov 02 14:04:11.908842 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2804/3856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:11 2022] GET /compute/v2.1/servers/6213827c-5f45-470e-b090-490d96e96e3f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:04:11.915978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e35c1d9f-fffb-4cb5-bfb5-e8794327d013 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:11.924297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e35c1d9f-fffb-4cb5-bfb5-e8794327d013 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:11.925004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e35c1d9f-fffb-4cb5-bfb5-e8794327d013 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:11.925626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e35c1d9f-fffb-4cb5-bfb5-e8794327d013 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:11.958429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e35c1d9f-fffb-4cb5-bfb5-e8794327d013 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:04:12.030815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e35c1d9f-fffb-4cb5-bfb5-e8794327d013 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.119436 Nov 02 14:04:12.033225 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2805/3857] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:11 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:12.297074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea800f46-0e1c-48a9-bde3-f6d151dd3188 tempest-ComputeTenantNetworksTest-926276736 tempest-ComputeTenantNetworksTest-926276736-project] Calling method '.version_select at 0x7f6f81a985e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:12.577148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea800f46-0e1c-48a9-bde3-f6d151dd3188 tempest-ComputeTenantNetworksTest-926276736 tempest-ComputeTenantNetworksTest-926276736-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.542012 Nov 02 14:04:12.578439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2806/3858] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 14:04:12 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:12.583881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:12.584683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:12.593541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:12.594041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:12.594483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:12.595322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:12.595801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:12.596212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:12.601018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:12.782545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:12.797184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:12.799728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:12.801727 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e690c5d6-2abd-4c29-84f4-a95ab720fbf7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.222064 Nov 02 14:04:12.802687 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2807/3859] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:12 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:12.810601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2e3fb80-285d-484c-ae83-d312b5ccaab9 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] Calling method '.version_select at 0x7f6f81337d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:12.844457 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2e3fb80-285d-484c-ae83-d312b5ccaab9 tempest-ServersTestFqdnHostnames-1662464756 tempest-ServersTestFqdnHostnames-1662464756-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363057902" status: 202 len: 0 microversion: 2.1 time: 0.040061 Nov 02 14:04:12.845504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2808/3860] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 14:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363057902 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:12.857501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:12.858676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:12.868960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:12.870394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:12.871453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:12.872959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:12.873834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:12.875243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:13.510127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:13.531954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:13.536666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:13.538990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03dbf54d-580a-4345-9894-a6d8fdea0157 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.691249 Nov 02 14:04:13.540755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2809/3861] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:12 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:13.554559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:13.559180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:13.566549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:13.567056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:13.567516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:13.568574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:13.569041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:13.569470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:13.795062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:13.804482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4cfde4b0-b5f7-42e7-91cc-546330b1b3b3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.261986 Nov 02 14:04:13.805347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2810/3862] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:13 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:13.810464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a00cf61d-f546-46a0-b9d5-98e091f4f101 tempest-ComputeTenantNetworksTest-926276736 tempest-ComputeTenantNetworksTest-926276736-project] Calling method '.version_select at 0x7f6f80e671f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:14.021209 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a00cf61d-f546-46a0-b9d5-98e091f4f101 tempest-ComputeTenantNetworksTest-926276736 tempest-ComputeTenantNetworksTest-926276736-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks/d16ebc49-e1a2-44b0-a799-779478055dfb" status: 200 len: 139 microversion: 2.1 time: 0.214152 Nov 02 14:04:14.022778 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2811/3863] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 14:04:13 2022] GET /compute/v2.1/os-tenant-networks/d16ebc49-e1a2-44b0-a799-779478055dfb => generated 139 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:14.035518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:14.037237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:14.058824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:14.059707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:14.060428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:14.061329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:14.062788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:14.063429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:15.124202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:15.153290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:15.174635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:15.182402 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6415b10b-68e2-4b51-a74d-8ddc5977726b tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 1.155699 Nov 02 14:04:15.187809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2812/3864] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:14 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:15.212661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:15.218403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:15.269031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:15.276736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:15.280806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:15.287994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:15.293958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:15.297157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:15.822924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:15.833586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:15.835602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:15.837307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b12714f8-7516-404a-9287-4d68fcad40af tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.647372 Nov 02 14:04:15.838166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2813/3865] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:15 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:15.856875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:15.861237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:15.871053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:15.872521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:15.873440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:15.874858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:15.875735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:15.876612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:16.007215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.016374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.018079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.019356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88b97fce-a3f9-4b99-bceb-6abc1a493200 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.179909 Nov 02 14:04:16.019942 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2814/3866] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:15 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:16.046757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:16.048185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:16.055238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:16.055932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:16.056528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:16.057384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:16.057987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:16.058559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:16.346097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.372298 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12c3a450-eaff-4aa9-92c6-886601ddef5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.338411 Nov 02 14:04:16.376131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2815/3867] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:16 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:16.401952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:16.404883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:16.420144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:16.421359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:16.422825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:16.425135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:16.426809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:16.428367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:16.832337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.856993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.858475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:16.882650 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61b46a5f-5508-4bf2-bbba-6d4539f79404 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.504021 Nov 02 14:04:16.883358 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2816/3868] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:16 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:16.891739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:16.897509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:16.921209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:16.922490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:16.926982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:16.928521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:16.929440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:16.930055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.208859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.225895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.232950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.234340 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7bd1f1b-fb52-4f4f-b003-1f582c9b5800 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.349990 Nov 02 14:04:17.241120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2817/3869] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:16 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:17.253751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:17.254383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:17.278791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.279572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.280345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.282029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.285153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.285784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.460039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.477223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.479943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.482940 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48c6ca8b-b067-4feb-b68e-ec2944c46754 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.240272 Nov 02 14:04:17.485323 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2818/3870] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:17 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:17.503577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:17.508873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:17.534922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.535903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.536706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.538891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.539869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.540779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.899820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:17.928428 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac13e678-f247-4cc2-a287-1b662d888377 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.430736 Nov 02 14:04:17.930242 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2819/3871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:17 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:17.948832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:17.949856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:17.962201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.963053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.963847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:17.965061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:17.966697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:17.967463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:18.599924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:18.616121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:18.621761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:18.631514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3985110a-6403-47ab-8cb9-f526fe7836e9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.699478 Nov 02 14:04:18.635856 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2820/3872] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:17 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:18.652053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:18.653666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:18.674120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:18.676282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:18.676909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:18.679053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:18.681430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:18.682220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:19.178718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.210704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.221834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.228028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0bdf7c09-fec1-4969-ab0e-bb2ea73d5979 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.589906 Nov 02 14:04:19.231538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2821/3873] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:18 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:19.242357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:19.243357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:19.253922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:19.254700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:19.255396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:19.256348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:19.256940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:19.257669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:19.535981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.559669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.564944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:19.568930 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-526d0c56-6481-4a09-ac41-5b0da81bebb2 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.334510 Nov 02 14:04:19.570519 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2822/3874] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:19 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:19.592024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:19.593902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:19.608093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:19.609820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:19.610501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:19.611946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:19.612602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:19.613197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:20.042892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:20.058358 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bccd92d2-5bac-4a5c-a766-58019172ecee tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.485558 Nov 02 14:04:20.063207 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2823/3875] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:19 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:20.067824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:20.072292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:20.106029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:20.109752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:20.112748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:20.118595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:20.123457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:20.126484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:21.168179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.198950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.204224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.206770 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-845fc7ba-7a38-4215-9d8f-e5902894ff11 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 1.145936 Nov 02 14:04:21.208245 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2824/3876] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:20 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:21.221199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:21.222809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:21.231531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.232971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.233917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:21.235218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.236216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.240022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:21.720891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.734780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:21.770095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.784394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:21.788149 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a0da842-5b8c-4794-8519-8db56f0a6b0f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.577244 Nov 02 14:04:21.789549 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2825/3877] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:21 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:21.842421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:21.852515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:21.867337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:21.876866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.877695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.878413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:21.879892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:21.880894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:21.881829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:22.279819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:22.321600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:22.325470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:22.329271 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4d3d529-3926-4e2c-aad8-fc6ff5769365 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.500688 Nov 02 14:04:22.340234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2826/3878] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:21 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:22.360240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:22.360735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:22.390842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:22.397077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:22.399053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:22.403036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:22.409575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:22.410666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:23.104352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:23.141772 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58079642-bd6c-47f0-b3e6-c591c30c871e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.799459 Nov 02 14:04:23.143577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2827/3879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:22 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:23.152724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:23.154168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:23.165306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:23.166103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:23.167039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:23.169231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:23.170618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:23.171590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:23.569697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:23.609300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:23.612543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:23.615301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd8070c6-612f-44da-aa23-38249aa20b68 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.469441 Nov 02 14:04:23.616955 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2828/3880] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:23 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:23.627689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:23.629242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:23.639295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:23.641081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:23.642066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:23.643524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:23.644608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:23.645619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:23.978859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:23.993456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.006298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.007509 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2ee5a53-07f4-4aa6-b212-f48148e4e317 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.388937 Nov 02 14:04:24.008113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2829/3881] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:23 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:24.047916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:24.050712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:24.075864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.080843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.082566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.084957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.085982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.086879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.211148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.245182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.247565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.248819 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-999396f5-7125-48be-885c-04316d9a5c29 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.212895 Nov 02 14:04:24.250285 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2830/3882] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:24 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:24.263496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:24.264257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:24.280223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.280784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.281230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.281964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.282421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.282847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.345854 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea06025f-c132-4015-9fec-58fc199042c0 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.094079 Nov 02 14:04:24.349341 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2831/3883] 10.222.0.18 () {58 vars in 1293 bytes} [Wed Nov 2 14:04:24 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60/os-server-password => generated 116 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:24.365112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:24.366320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:24.375659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.376389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.377453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.378489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:24.379141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:24.380151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:24.901552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:24.914310 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8624854-e3fa-4244-94ca-8eb02adad1ae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.563435 Nov 02 14:04:24.945732 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2832/3884] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:24 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:24.967566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-def933f7-ae48-4e4c-b272-53f1c22edce2 req-907feae3-9a47-4d7b-b59f-9b2a08bb7123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "cb3cb610-3ac7-4f0c-9319-a8ed27d6ece0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:25.003531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-def933f7-ae48-4e4c-b272-53f1c22edce2 req-907feae3-9a47-4d7b-b59f-9b2a08bb7123 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:25.004032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-def933f7-ae48-4e4c-b272-53f1c22edce2 req-907feae3-9a47-4d7b-b59f-9b2a08bb7123 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:25.004467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-def933f7-ae48-4e4c-b272-53f1c22edce2 req-907feae3-9a47-4d7b-b59f-9b2a08bb7123 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:25.063847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-def933f7-ae48-4e4c-b272-53f1c22edce2 req-907feae3-9a47-4d7b-b59f-9b2a08bb7123 service nova] Creating event network-vif-plugged:cb3cb610-3ac7-4f0c-9319-a8ed27d6ece0 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:25.082404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-def933f7-ae48-4e4c-b272-53f1c22edce2 req-907feae3-9a47-4d7b-b59f-9b2a08bb7123 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132650 Nov 02 14:04:25.083385 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2833/3885] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:25.091918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:25.093918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:25.111362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:25.112661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:25.115385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:25.116418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:25.117962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:25.118634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:25.564414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:25.588104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:25.591776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:25.599555 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5eb3e434-795d-49c4-be08-38953fbbbb01 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.514865 Nov 02 14:04:25.611289 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2834/3886] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:25 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:25.645119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:25.645919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:25.653441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:25.654275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:25.654997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:25.656836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:25.657527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:25.658148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:25.981957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:25.998121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:26.005021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:26.006856 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5811b06-e5dc-4ce8-ac84-f7ebe1fa240e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.378894 Nov 02 14:04:26.007731 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2835/3887] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:25 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:26.017195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:26.017818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:26.035796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:26.038321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:26.038778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:26.039569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:26.040029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:26.040455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:26.544460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:26.559564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:26.564257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:26.568164 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21e0defc-e74a-468f-a885-195b98093298 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1365 microversion: 2.47 time: 0.558417 Nov 02 14:04:26.570025 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2836/3888] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:26 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1365 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:26.578114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:26.579596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:26.593917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:26.594434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:26.595801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:26.596629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:26.597246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:26.600479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:26.924076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:26.934753 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5824a2e9-7804-498d-8018-e02ebe7cdc6d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.363380 Nov 02 14:04:26.935617 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2837/3889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:26 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:26.963529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:26.964917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:26.987448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:26.990823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:26.995978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:26.996695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:26.997196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:26.997601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:27.395200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:27.436112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:27.444744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:27.447437 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ffda771-f62e-448a-a24f-6163c278ee64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.498081 Nov 02 14:04:27.449814 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2838/3890] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:26 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:27.462143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:27.463299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:27.487353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:27.488158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:27.488814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:27.489724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:27.490365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:27.490976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:27.895127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:27.916412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:27.925614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:27.931071 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9cedffe3-dc45-4a5d-a849-5212636ff383 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.475869 Nov 02 14:04:27.932378 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2839/3891] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:27 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:27.941814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "1c162986-e82f-4c13-98f1-243a8b0bbad7"}, {"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "a5539551-be83-4803-9781-fb3190ae7b9d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:27.964384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:27.965349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:27.966408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:27.984436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] Creating event network-vif-plugged:1c162986-e82f-4c13-98f1-243a8b0bbad7 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:27.985365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] Creating event network-vif-plugged:a5539551-be83-4803-9781-fb3190ae7b9d for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:27.996581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-70d5148f-8c10-4e6d-b8d0-0ac526471d2b req-05ef4660-3260-4278-a6b8-757dcce6bd77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060937 Nov 02 14:04:27.998431 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2840/3892] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:28.352014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1114620404", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "d2a3f578-9c1b-4ee2-ace0-f51b8fb4f549"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:28.437867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] validate_networks() for [('d2a3f578-9c1b-4ee2-ace0-f51b8fb4f549', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:04:29.202208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:04:29.204595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:04:29.205612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:04:29.206465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:04:29.207357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:04:29.225771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.227609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.228869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.230372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.231569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.232742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.263480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Getting quotas for project b59221833cf348fb832f00a68f7a4bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:29.275399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Getting quotas for user 78bd93775c6c41b98c21095eea1dfe02 and project b59221833cf348fb832f00a68f7a4bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:29.297497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:04:29.301625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:04:29.403621 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-695c9ace-076c-4984-9f03-0791d06b607f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402649 Nov 02 14:04:29.404573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2841/3893] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:04:29.412544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:29.414074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:29.445546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.453611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.454268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.455142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.455687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.456196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.610959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:29.621647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:29.623372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:29.625324 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6146d9a-d414-4eab-a31a-e75dcf988661 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1371 microversion: 2.47 time: 0.218816 Nov 02 14:04:29.626075 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2842/3894] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:29 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:29.631206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:29.632277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:29.640785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.641854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.642596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.643747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.644505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.645152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.978683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:30.016843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7edde35d-8de5-44e2-b393-9afa2e913d3b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1658 microversion: 2.1 time: 0.389553 Nov 02 14:04:30.022249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2843/3895] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:29 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1658 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:30.033826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:30.035819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:30.054772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:30.057081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:30.058004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:30.058999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:30.061670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:30.064929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:30.630125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:30.635946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:30.647923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:30.650783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:30.652842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9aae7508-dee3-466b-9118-e25984f98b4e tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.629047 Nov 02 14:04:30.653752 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2844/3896] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:30 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:30.683314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:30.685405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:30.721664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:30.727879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:30.744282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:30.746169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:30.749988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:30.751862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:31.016402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:31.029689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:31.031608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:31.033791 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19a8167d-ca02-4bb2-8f68-e3f10d926a6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.355688 Nov 02 14:04:31.035056 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2845/3897] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:30 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:31.160992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-707438aa-0998-448c-ae7f-936b59fa429a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: .version_select at 0x7f6f812a0ee0>, body: {"keypair": {"name": "tempest-keypair-91316864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyvgRYkIccXpElwBT61GwlMkfJfYFWuvS+SfNzSrFjcvTC+fZvvTsGxkdeXxIrNdVyaycvUr7XUfPlGTnEkLck9PcEkKTuCjBbM3G81IzKupv/jTH5HXApywHboh5Metw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:31.193026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-707438aa-0998-448c-ae7f-936b59fa429a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for project 4109b13b99644609bedb98d8e28c8e59. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:31.225079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-707438aa-0998-448c-ae7f-936b59fa429a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for user a01f842614b24924bcc2196332cb5f35 and project 4109b13b99644609bedb98d8e28c8e59. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:31.274269 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-707438aa-0998-448c-ae7f-936b59fa429a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.237763 Nov 02 14:04:31.275023 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2846/3898] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:04:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:31.295612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-7508143", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "d2a3f578-9c1b-4ee2-ace0-f51b8fb4f549"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:31.438862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] validate_networks() for [('d2a3f578-9c1b-4ee2-ace0-f51b8fb4f549', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:04:33.016179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:04:33.017174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:04:33.017604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:04:33.018337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:04:33.018878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:04:33.035597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.042021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.042651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.043706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.044558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.045284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.090082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Getting quotas for project b59221833cf348fb832f00a68f7a4bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:33.101265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Getting quotas for user 78bd93775c6c41b98c21095eea1dfe02 and project b59221833cf348fb832f00a68f7a4bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:33.135740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:04:33.141338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:04:33.230128 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1daf7ef3-cd96-45d9-99fe-01e1d0386fc6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.953531 Nov 02 14:04:33.231690 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2847/3899] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:04:33.237665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc2342c8-f18c-41e3-8234-3b3eb55ad0b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:33.289679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2342c8-f18c-41e3-8234-3b3eb55ad0b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.291480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2342c8-f18c-41e3-8234-3b3eb55ad0b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.291992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2342c8-f18c-41e3-8234-3b3eb55ad0b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.337208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc2342c8-f18c-41e3-8234-3b3eb55ad0b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Going to try to start instance {{(pid=137559) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:04:33.446964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc2342c8-f18c-41e3-8234-3b3eb55ad0b2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.211371 Nov 02 14:04:33.448689 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2848/3900] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:33 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:33.471763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "f4fe9c59-7c79-41b9-a301-d056023a91fd"}, {"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "4c2cb3ef-3e5b-43c6-a04a-cdb499783d05"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:33.507933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.509813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.510539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.541502 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] Creating event network-vif-plugged:f4fe9c59-7c79-41b9-a301-d056023a91fd for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:33.545194 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] Creating event network-vif-plugged:4c2cb3ef-3e5b-43c6-a04a-cdb499783d05 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:33.560547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ab078039-1307-447b-a411-ef28d2377f10 req-cb5b30bb-c87b-46da-ab56-91b17f9054d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107487 Nov 02 14:04:33.565245 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2849/3901] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:33.576815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:33.579564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:33.597527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.600378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.601092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.603430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.606304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.607641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.794379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:33.807365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:33.808875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:33.818982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74adb4e8-f9d5-469a-8027-dce82388fce5 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1356 microversion: 2.47 time: 0.252165 Nov 02 14:04:33.835572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2850/3902] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:33 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1356 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:33.869151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:33.869773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:33.876801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.877423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.877860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.878580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.879038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.879625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:34.540970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:34.565678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:34.569907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:34.571210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a334e2f3-aa7c-43b8-b41c-aea9fa9a9adf tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.734513 Nov 02 14:04:34.594368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2851/3903] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:33 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:34.604548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:34.606031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:34.629392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:34.630277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:34.631058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:34.632265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:34.633226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:34.634156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:35.263373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:35.275722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:35.278325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:35.279847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3b68526-bbef-4872-85b6-16445fc2162c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.684100 Nov 02 14:04:35.281005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2852/3904] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:34 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:35.285906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1670032495", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "451", "networks": [{"uuid": "d2a3f578-9c1b-4ee2-ace0-f51b8fb4f549"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:35.385625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] validate_networks() for [('d2a3f578-9c1b-4ee2-ace0-f51b8fb4f549', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:04:36.966795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:04:36.967802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:04:36.968655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:04:36.969443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:04:36.970265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:04:36.999164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:37.003529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:37.004524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:37.012917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:37.014083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:37.015767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:37.086519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Getting quotas for project b59221833cf348fb832f00a68f7a4bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:37.114723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Getting quotas for user 78bd93775c6c41b98c21095eea1dfe02 and project b59221833cf348fb832f00a68f7a4bb7. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:37.122422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:37.163824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:04:37.180056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:04:37.288574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88405aa6-0e7d-42e3-a37f-a27e0612c982 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.005897 Nov 02 14:04:37.290468 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2853/3905] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:04:37.301313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:37.302820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:37.316629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:37.319333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:37.320346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:37.322218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:37.323273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:37.324504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:37.906806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:37.932521 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-18b00217-7ed1-40c5-8ced-bc4ebc94b0fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.639800 Nov 02 14:04:37.936723 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2854/3906] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:37 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:37.966328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:37.995325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:38.002158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Searching by: {'deleted': False, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:04:38.025428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:38.027049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:38.028815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:38.032140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:38.034012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:38.035281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:38.537237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:04:38.978099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:38.996235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:39.001614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:39.002705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:39.051164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:39.055045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:39.153240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49cb43f0-c56a-4f62-94e1-ed13f16dc355 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 1.209011 Nov 02 14:04:39.154346 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2855/3907] 10.222.0.18 () {60 vars in 1187 bytes} [Wed Nov 2 14:04:37 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:39.184215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-805055905", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8953a4e0-ba10-40e7-a67b-cb505e4ca121"}], "security_groups": [{"name": "tempest-securitygroup--383933155"}], "key_name": "tempest-keypair-91316864", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:39.554754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] validate_networks() for [('8953a4e0-ba10-40e7-a67b-cb505e4ca121', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:04:40.339740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:04:40.340699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:04:40.340699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:04:40.341675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:04:40.342281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:04:40.354030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:40.354574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:40.355396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:40.356686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:40.359489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:40.361251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:40.412576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for project 4109b13b99644609bedb98d8e28c8e59. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:40.425313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for user a01f842614b24924bcc2196332cb5f35 and project 4109b13b99644609bedb98d8e28c8e59. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:40.454954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:04:40.459717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:04:40.545679 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3843f73e-fa50-41e1-b346-33f79f71d1c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.388678 Nov 02 14:04:40.547073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2856/3908] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:04:40.556558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:40.558529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:40.571512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:40.572378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:40.572565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:40.573201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:40.573660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:40.574086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:40.944835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:40.962106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:40.968904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:40.972456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd68ecc1-7759-4d63-b53a-d11865ca8b6c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.421683 Nov 02 14:04:40.975383 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2857/3909] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:40 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:40.985877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "299b6036-dca6-4c82-92ac-af0f73e5cc45"}, {"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-plugged", "status": "completed", "tag": "804ef20f-d150-45fe-a7c1-5f7f3504a381"}, {"server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "name": "network-vif-plugged", "status": "completed", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:41.009366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.013662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.014488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.047455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Creating event network-vif-plugged:299b6036-dca6-4c82-92ac-af0f73e5cc45 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:41.052043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Creating event network-vif-plugged:804ef20f-d150-45fe-a7c1-5f7f3504a381 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:41.052813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] Creating event network-vif-plugged:d980ec30-b400-4aee-926a-0adf67991425 for instance b4cea623-4709-4680-9646-d7263f443356 on n-h2-858238-3 Nov 02 14:04:41.067045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-54dad343-3445-405e-b45b-2bfa54451aac req-1c9cc139-d1bc-4acd-a50b-7ba551ad9ea7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090060 Nov 02 14:04:41.068333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2858/3910] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:41.075932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:41.076876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:41.085920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.088058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.089082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.094074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.095344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.097200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.381841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:41.395540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:41.403535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:41.405093 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4bde6a03-45bd-48f5-bb05-ff2fdd91084f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.335289 Nov 02 14:04:41.423522 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2859/3911] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:41 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:41.434073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:41.434876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:41.443028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.443727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.444304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.445176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.445792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.446374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.572137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:41.581780 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b653a5ff-32de-4c45-8f6e-68ff898058c9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1279 microversion: 2.1 time: 0.156770 Nov 02 14:04:41.582357 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2860/3912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:41 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:41.613525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6ddd4cce-17b9-44d9-9207-b243be48710a req-ce9a1c7e-eacd-4446-a02f-f2e5aa6e68bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006bd0d9-4b8f-4af7-a75a-7ca7157e9b78", "tag": "93873357-e86e-4baf-ba9f-80aea462c0f0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:41.627390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ddd4cce-17b9-44d9-9207-b243be48710a req-ce9a1c7e-eacd-4446-a02f-f2e5aa6e68bb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.628312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ddd4cce-17b9-44d9-9207-b243be48710a req-ce9a1c7e-eacd-4446-a02f-f2e5aa6e68bb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.628904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ddd4cce-17b9-44d9-9207-b243be48710a req-ce9a1c7e-eacd-4446-a02f-f2e5aa6e68bb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.645448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6ddd4cce-17b9-44d9-9207-b243be48710a req-ce9a1c7e-eacd-4446-a02f-f2e5aa6e68bb service nova] Creating event network-changed:93873357-e86e-4baf-ba9f-80aea462c0f0 for instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 on n-h1-858238-3 Nov 02 14:04:41.652596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6ddd4cce-17b9-44d9-9207-b243be48710a req-ce9a1c7e-eacd-4446-a02f-f2e5aa6e68bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046562 Nov 02 14:04:41.654142 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2861/3913] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:41.660530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:41.661599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:41.668286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.669459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.670067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.671369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.671988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.672569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.166148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:42.184762 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5145a649-0892-41ec-985e-b1ae2c2bc0c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.529246 Nov 02 14:04:42.188333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2862/3914] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:41 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:42.196442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:42.196962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:42.214412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.214921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.215396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.217198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.217675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.218133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.277896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:04:42.342081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:42.446814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-154ef517-d836-404b-a3c1-e7f068d98865 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 204 len: 0 microversion: 2.47 time: 0.257012 Nov 02 14:04:42.447843 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2863/3915] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:04:42 2022] DELETE /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:04:42.453584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:42.454397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:42.461572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.462236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.462866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.464236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.464714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.465548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.571167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:42.585464 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8803436-10e6-49d6-bbbd-2c4dd21dc41c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1287 microversion: 2.1 time: 0.135598 Nov 02 14:04:42.585709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2864/3916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:42 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:42.591635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bb2c9942-d000-44fc-866f-eaec484bd7d7 req-8c32d9a2-368d-4512-b499-566d687eb109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a22b68-9cc3-403e-beb6-538a422c9471", "tag": "157bbb9b-6a0a-475e-985a-60380b4a0077"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:42.606137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bb2c9942-d000-44fc-866f-eaec484bd7d7 req-8c32d9a2-368d-4512-b499-566d687eb109 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.606936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bb2c9942-d000-44fc-866f-eaec484bd7d7 req-8c32d9a2-368d-4512-b499-566d687eb109 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.608033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bb2c9942-d000-44fc-866f-eaec484bd7d7 req-8c32d9a2-368d-4512-b499-566d687eb109 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.632971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bb2c9942-d000-44fc-866f-eaec484bd7d7 req-8c32d9a2-368d-4512-b499-566d687eb109 service nova] Creating event network-changed:157bbb9b-6a0a-475e-985a-60380b4a0077 for instance 40a22b68-9cc3-403e-beb6-538a422c9471 on n-h1-858238-3 Nov 02 14:04:42.641271 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bb2c9942-d000-44fc-866f-eaec484bd7d7 req-8c32d9a2-368d-4512-b499-566d687eb109 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053979 Nov 02 14:04:42.642319 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2865/3917] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:42.666577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:42.670006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:42.687899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.688591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.689155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.690013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.690584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.691209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.060655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.075895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.077364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.079393 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a3f0d080-0d1b-4dfa-8857-b742c4e34acd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1875 microversion: 2.32 time: 0.435365 Nov 02 14:04:43.080163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2866/3918] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:42 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1875 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:43.098545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:43.102167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:43.113991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:43.114724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:43.115476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.116734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:43.117570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:43.120773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.247343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Unlocking {{(pid=137559) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 14:04:43.324369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9133721b-e71f-4f7a-98f4-b0d00b47bd7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.237791 Nov 02 14:04:43.325190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2867/3919] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:43 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:43.330687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:43.331571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:43.338171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:43.338931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:43.339587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.340313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:43.340766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:43.341200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.942621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.979506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.981476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.983085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b38adf77-cc28-482d-a15a-8732f20b8f7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.656736 Nov 02 14:04:43.989200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2868/3920] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:43 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:43.996563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:43.997432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:44.014992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:44.023937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:44.024749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:44.025732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:44.026403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:44.027051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:44.266505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:44.275790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:44.286506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:44.288227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93a9dd92-2a91-4437-852f-5ad8a27d6a4d tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1362 microversion: 2.47 time: 0.297891 Nov 02 14:04:44.302053 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2869/3921] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:43 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:44.313205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:44.315841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:44.351129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:44.360293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:44.360833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:44.364817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:44.365471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:44.369451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.042436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:45.060983 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e558fac-9611-4b7d-8efa-d0605853bdf8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.756854 Nov 02 14:04:45.062278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2870/3922] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:44 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:45.073647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:45.076804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:45.111222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.113798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.114626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.118107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.120124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.120967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.567917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:45.587176 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1074e70e-ecf8-48e5-ab24-5cb2ce05d34f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.522621 Nov 02 14:04:45.601401 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2871/3923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:45 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:45.638845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:45.640716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:45.655617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.657340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.658240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.659877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.660980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.662349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.802381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:45.817430 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4a8107a-8fd8-4745-ad2d-c313c1f0680f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1293 microversion: 2.1 time: 0.196259 Nov 02 14:04:45.818865 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2872/3924] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:45 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1293 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:45.826599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:45.827503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:45.836138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.836911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.837431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.838207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.839063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.840147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:46.296410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:46.320304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:46.324134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:46.328374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f65f47a2-727f-4657-a3b8-baefbbe96a51 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2827 microversion: 2.32 time: 0.504148 Nov 02 14:04:46.328374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2873/3925] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:45 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2827 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:46.345010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c2eca867-7ef1-493d-a1e4-d408c86041b6 req-62e85f56-6540-415a-b6fa-117afd2c3f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006bd0d9-4b8f-4af7-a75a-7ca7157e9b78", "name": "network-vif-plugged", "status": "completed", "tag": "93873357-e86e-4baf-ba9f-80aea462c0f0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:46.370644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2eca867-7ef1-493d-a1e4-d408c86041b6 req-62e85f56-6540-415a-b6fa-117afd2c3f15 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:46.372665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2eca867-7ef1-493d-a1e4-d408c86041b6 req-62e85f56-6540-415a-b6fa-117afd2c3f15 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:46.374154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2eca867-7ef1-493d-a1e4-d408c86041b6 req-62e85f56-6540-415a-b6fa-117afd2c3f15 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:46.402483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c2eca867-7ef1-493d-a1e4-d408c86041b6 req-62e85f56-6540-415a-b6fa-117afd2c3f15 service nova] Creating event network-vif-plugged:93873357-e86e-4baf-ba9f-80aea462c0f0 for instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 on n-h1-858238-3 Nov 02 14:04:46.413389 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c2eca867-7ef1-493d-a1e4-d408c86041b6 req-62e85f56-6540-415a-b6fa-117afd2c3f15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086082 Nov 02 14:04:46.414671 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2874/3926] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:46.427378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:46.428447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:46.447573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:46.449304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:46.450324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:46.453611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:46.456532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:46.458862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.122902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.133148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.134925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.136412 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a3e3531-432f-4b7d-9510-f6286bef0f8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1806 microversion: 2.20 time: 0.719947 Nov 02 14:04:47.151948 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2875/3927] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:46 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1806 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:47.166156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:47.167686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:47.180109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.181386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.182426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.184071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.185193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.186244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.427302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.438040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.439854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.441979 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10098c6e-5390-4089-ab41-c1f5f226132a tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1362 microversion: 2.47 time: 0.288621 Nov 02 14:04:47.442995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2876/3928] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:47 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:47.462115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c34c036c-80f2-4788-a48f-b505d87d342e req-64887a31-555c-4641-a337-9b76335f4647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d21756-e902-4a1b-a76b-32247ffaa378", "tag": "25dc10ff-00b3-40c2-9b8e-a30b3409a427"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:47.489081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c34c036c-80f2-4788-a48f-b505d87d342e req-64887a31-555c-4641-a337-9b76335f4647 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.489995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c34c036c-80f2-4788-a48f-b505d87d342e req-64887a31-555c-4641-a337-9b76335f4647 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.491925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c34c036c-80f2-4788-a48f-b505d87d342e req-64887a31-555c-4641-a337-9b76335f4647 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.515991 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c34c036c-80f2-4788-a48f-b505d87d342e req-64887a31-555c-4641-a337-9b76335f4647 service nova] Creating event network-changed:25dc10ff-00b3-40c2-9b8e-a30b3409a427 for instance 53d21756-e902-4a1b-a76b-32247ffaa378 on n-h2-858238-3 Nov 02 14:04:47.525845 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c34c036c-80f2-4788-a48f-b505d87d342e req-64887a31-555c-4641-a337-9b76335f4647 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077083 Nov 02 14:04:47.527313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2877/3929] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:47.541611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:47.543714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:47.557062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.558295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.559332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.560862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.562023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.563364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.849020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.865037 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5fc3932-3dac-4875-b86a-c0c45cd997fa tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.335451 Nov 02 14:04:47.866923 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2878/3930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:47 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:47.872339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:47.873194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:47.900411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.900903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.901337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.902044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.902502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.902920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.934576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:48.222237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:48.243556 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9cca5f19-b5aa-4dda-9320-32bfa0fba720 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.374669 Nov 02 14:04:48.244957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2879/3931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:47 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:48.256242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:48.257377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:48.268996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:48.271248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:48.279796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:48.282528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:48.285216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:48.287021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:48.568387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77669578-4734-4186-aaf9-10ed31824509 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.321305 Nov 02 14:04:48.570173 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2880/3932] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 14:04:48 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6/os-interface => generated 1832 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:48.582935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:48.584247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:48.596903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:48.598147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:48.599299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:48.600767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:48.601777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:48.602811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:48.966600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:48.976566 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ae91225-07c3-4db0-b4a2-614a7bc4cea7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1360 microversion: 2.1 time: 0.404358 Nov 02 14:04:48.991633 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2881/3933] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:48 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1360 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:48.998145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:48.999187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.006553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.007478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.007792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.008934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.009808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.010386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.322282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.342868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4617a7b-624e-4e99-af19-095a9b88c097 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.349522 Nov 02 14:04:49.355138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2882/3934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:48 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:49.375328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.376458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.395766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.396481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.397533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.399054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.400444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.401656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.654844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.671916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.673490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.675253 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3a85abc-bda4-4a1c-926d-89abe40ab364 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1793 microversion: 2.20 time: 0.320914 Nov 02 14:04:49.676054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2883/3935] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1793 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:49.681204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-31eeee96-07e7-448d-9e12-0ad7dc0e7cb4 req-84ef29df-8087-4a71-ab01-23578c51e268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a22b68-9cc3-403e-beb6-538a422c9471", "name": "network-vif-plugged", "status": "completed", "tag": "157bbb9b-6a0a-475e-985a-60380b4a0077"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:49.693233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-31eeee96-07e7-448d-9e12-0ad7dc0e7cb4 req-84ef29df-8087-4a71-ab01-23578c51e268 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.693805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-31eeee96-07e7-448d-9e12-0ad7dc0e7cb4 req-84ef29df-8087-4a71-ab01-23578c51e268 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.694298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-31eeee96-07e7-448d-9e12-0ad7dc0e7cb4 req-84ef29df-8087-4a71-ab01-23578c51e268 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.719147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-31eeee96-07e7-448d-9e12-0ad7dc0e7cb4 req-84ef29df-8087-4a71-ab01-23578c51e268 service nova] Creating event network-vif-plugged:157bbb9b-6a0a-475e-985a-60380b4a0077 for instance 40a22b68-9cc3-403e-beb6-538a422c9471 on n-h1-858238-3 Nov 02 14:04:49.728136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-31eeee96-07e7-448d-9e12-0ad7dc0e7cb4 req-84ef29df-8087-4a71-ab01-23578c51e268 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049986 Nov 02 14:04:49.729692 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2884/3936] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:49.739587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.741166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.755976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.755976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.756435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.757657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.758469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.759635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.825897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.826749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.827829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.828876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lazy-loading 'fault' on Instance uuid d7fb9921-760d-4963-bdc1-cd6f0a3d3091 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:04:49.891284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.908053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.910603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.912914 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-550f06d7-8419-4750-acaa-47a9cbb47b77 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 200 len: 1367 microversion: 2.47 time: 0.181261 Nov 02 14:04:49.914131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2885/3937] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:49.929696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b516f3d8-3f54-43c9-87ad-d9cd86a879da req-3268ac87-c824-4f87-a08a-e32816274d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40ffe3c-33e5-44a6-a7ff-23606f1275a7", "tag": "f9bc5cf6-eede-4706-9096-a8e8dbabfae5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:49.949818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b516f3d8-3f54-43c9-87ad-d9cd86a879da req-3268ac87-c824-4f87-a08a-e32816274d3b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.950725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b516f3d8-3f54-43c9-87ad-d9cd86a879da req-3268ac87-c824-4f87-a08a-e32816274d3b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.951570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b516f3d8-3f54-43c9-87ad-d9cd86a879da req-3268ac87-c824-4f87-a08a-e32816274d3b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.974095 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b516f3d8-3f54-43c9-87ad-d9cd86a879da req-3268ac87-c824-4f87-a08a-e32816274d3b service nova] Creating event network-changed:f9bc5cf6-eede-4706-9096-a8e8dbabfae5 for instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 on n-h1-858238-3 Nov 02 14:04:49.985958 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b516f3d8-3f54-43c9-87ad-d9cd86a879da req-3268ac87-c824-4f87-a08a-e32816274d3b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069404 Nov 02 14:04:49.988461 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2886/3938] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:50.002648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:50.004642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:50.010113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:50.020033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.020948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.021975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.023554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.024649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.025650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.370792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:50.384981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:50.391703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0e11126-caf7-435b-9c7d-cb5d04cae9ae tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.400082 Nov 02 14:04:50.393977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2887/3939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:50.437074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:50.438338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:50.448167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=30 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:50.452292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.453140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.453874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.455057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.455890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.456904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.623751 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a054281-4718-46b3-8cfa-3df4f22de9cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.227230 Nov 02 14:04:50.624963 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2888/3940] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:50 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:50.640722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:50.642591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:50.654394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.656488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.658531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.659791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.660912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.661956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.985105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:51.009024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53fecdd7-185d-4a1f-b4ec-ccfa44ad43e9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1360 microversion: 2.1 time: 0.381045 Nov 02 14:04:51.011971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2889/3941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:50 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1360 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:51.029411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-486b89a6-68b4-4cdc-8ae7-37f341d69e4b req-7c3d6571-6357-4a25-94ce-dc918c1942a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "tag": "804ef20f-d150-45fe-a7c1-5f7f3504a381"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:51.050153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-486b89a6-68b4-4cdc-8ae7-37f341d69e4b req-7c3d6571-6357-4a25-94ce-dc918c1942a7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.051007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-486b89a6-68b4-4cdc-8ae7-37f341d69e4b req-7c3d6571-6357-4a25-94ce-dc918c1942a7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.051778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-486b89a6-68b4-4cdc-8ae7-37f341d69e4b req-7c3d6571-6357-4a25-94ce-dc918c1942a7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.070470 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-486b89a6-68b4-4cdc-8ae7-37f341d69e4b req-7c3d6571-6357-4a25-94ce-dc918c1942a7 service nova] Creating event network-changed:804ef20f-d150-45fe-a7c1-5f7f3504a381 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:04:51.077309 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-486b89a6-68b4-4cdc-8ae7-37f341d69e4b req-7c3d6571-6357-4a25-94ce-dc918c1942a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062139 Nov 02 14:04:51.078619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2890/3942] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:51.084640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:51.085361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:51.092785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.093819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.094999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.095770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.096239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.097454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.464986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:51.553141 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-173351cf-4bf0-44c3-a836-c8ca22a009c0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1656 microversion: 2.1 time: 0.465664 Nov 02 14:04:51.557733 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2891/3943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:51 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1656 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:51.577268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:51.579280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: d7fb9921-760d-4963-bdc1-cd6f0a3d3091] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:51.590879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.591392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.592468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.594234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.594892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.595525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.612996 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] HTTP exception thrown: Instance d7fb9921-760d-4963-bdc1-cd6f0a3d3091 could not be found. Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Request method failure captured: Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 HTTP/1.1 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYni5--WpHAWOZpszuvwdqaGBWmSnxM6ga9vMDjJGxI1INQEc0nL-asrLXOyOz5cvTO8gdSJOgV_t137unv_fMqNpbAJ2O0tje5m6jSPtKL-UtHpOx7dPGqcEbQ5WNnVkx5tehF6FHXjc_auuk2ZaenahckTpTgfw-jtR_G0KYpoS85o Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: fc5709ac5eeb41cca056b3f0889cdfc5 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerShowV247Test-770513386 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc5709ac5eeb41cca056b3f0889cdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc5709ac5eeb41cca056b3f0889cdfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc5709ac5eeb41cca056b3f0889cdfc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc5709ac5eeb41cca056b3f0889cdfc5"}]}] Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerShowV247Test-770513386 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: fc5709ac5eeb41cca056b3f0889cdfc5 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerShowV247Test-770513386 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerShowV247Test-770513386-project Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1f04ddff7975407a81c6090628ef5648 Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerShowV247Test-770513386-project Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d7fb9921-760d-4963-bdc1-cd6f0a3d3091 could not be found. Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd7fb9921-760d-4963-bdc1-cd6f0a3d3091'} Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fb9921-760d-4963-bdc1-cd6f0a3d3091 could not be found. Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fb9921-760d-4963-bdc1-cd6f0a3d3091 could not be found. Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:51.615374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fb9921-760d-4963-bdc1-cd6f0a3d3091 could not be found. Nov 02 14:04:51.620265 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:51.623266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Returning 404 to user: Instance d7fb9921-760d-4963-bdc1-cd6f0a3d3091 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:51.625098 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61f117c6-aef2-45f8-bf96-f3469c6098f7 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091" status: 404 len: 111 microversion: 2.47 time: 0.062748 Nov 02 14:04:51.625898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2892/3944] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:51 2022] GET /compute/v2.1/servers/d7fb9921-760d-4963-bdc1-cd6f0a3d3091 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:04:51.632564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:51.633553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:51.642912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.643702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.644334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.645370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.646024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.646586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.055192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:52.065323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ccef678-6324-4bb7-bfa5-00c105fb6d45 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.437562 Nov 02 14:04:52.067715 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2893/3945] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:51 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:52.079212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:52.079957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:52.097321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.097828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.098267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.098986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.099484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.099888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.231254 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db979a0d-cffe-45b7-b6c6-7e029e32acbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.161941 Nov 02 14:04:52.235872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2894/3946] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:04:52 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:04:52.248709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:52.249375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:52.259834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.260329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.260836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.261677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.262340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.262884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.292432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:04:52.334522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:52.454373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d37f24b1-ff12-4e2c-944e-25c73a0cf3f1 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "DELETE /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74" status: 204 len: 0 microversion: 2.47 time: 0.215352 Nov 02 14:04:52.456554 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2895/3947] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:04:52 2022] DELETE /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:04:52.470940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:52.473574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:52.488881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.490909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.493436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.495438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.496513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.497565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.856389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:52.870441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5995fd94-b5f8-4b52-985c-5606a871e5c2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1360 microversion: 2.1 time: 0.410888 Nov 02 14:04:52.871275 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2896/3948] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:52 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1360 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:52.897325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:52.904825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:52.916351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.917008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.917562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.918465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.919701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.920398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.115848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.129680 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6adc1d2-aaee-413e-9733-d8bf251113ba tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.252742 Nov 02 14:04:53.130726 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2897/3949] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:52 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:53.138524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:53.139707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:53.152650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.153529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.153987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.155139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.155971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.156674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.253378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.263575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.265785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.267370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c3d2767-64a6-4f43-aa4d-c51bd744071c tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74" status: 200 len: 1362 microversion: 2.47 time: 0.135271 Nov 02 14:04:53.267943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2898/3950] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:53 2022] GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74 => generated 1362 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:53.284989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:53.286152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:53.299202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.300113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.301029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.302446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.303039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.303733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.508356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.521095 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b558bf3-0995-4cd6-838c-605e87229491 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.252126 Nov 02 14:04:53.521804 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2899/3951] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:53 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:53.536507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:53.540009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:53.553892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.554662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.555297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.556171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.556764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.557362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.736285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.750410 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fcd839e-856a-4fdb-8f5f-7d7966db0972 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.226117 Nov 02 14:04:53.751423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2900/3952] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:53 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:53.790355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:53.796135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:53.807763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.808437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.809137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.810299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.811059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.811826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.094302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.114480 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-679dd788-cc65-4d62-b38d-f81b9964b6e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.328650 Nov 02 14:04:54.117069 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2901/3953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:53 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:04:54.126700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:54.128008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:54.141266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.142488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.143363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.144735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.145782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.146835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.430254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.440011 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d113c6d-a53b-4dec-9f98-493b3ae29223 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1360 microversion: 2.1 time: 0.320880 Nov 02 14:04:54.463799 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2902/3954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:54 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:54.474212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:54.475593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:54.487555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.488054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.488487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.490045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.490503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.490930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.753781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.777482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2652d7d7-47a4-4eb8-ac47-a13b0fc76477 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.311132 Nov 02 14:04:54.778727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2903/3955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:54 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:54.787420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:54.788776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:54.803726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.804569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.805339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.806614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.807453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.808197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.858719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.859501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.860111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.860692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lazy-loading 'fault' on Instance uuid db82b5c7-82d5-432f-b9e2-880a7bad3c74 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:04:54.908373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.916572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.918022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f04ddff7975407a81c6090628ef5648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc5709ac5eeb41cca056b3f0889cdfc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.919314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9763dae-62df-4f90-afdb-1bccb0d10f30 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74" status: 200 len: 1367 microversion: 2.47 time: 0.138892 Nov 02 14:04:54.919950 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2904/3956] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:54 2022] GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74 => generated 1367 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:04:54.924371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-84c055ee-7ac3-49ff-bd97-4066702a6eb0 req-c8e05282-3769-429f-a23f-281651f91037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40ffe3c-33e5-44a6-a7ff-23606f1275a7", "name": "network-vif-plugged", "status": "completed", "tag": "f9bc5cf6-eede-4706-9096-a8e8dbabfae5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:54.933829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-84c055ee-7ac3-49ff-bd97-4066702a6eb0 req-c8e05282-3769-429f-a23f-281651f91037 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.934319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-84c055ee-7ac3-49ff-bd97-4066702a6eb0 req-c8e05282-3769-429f-a23f-281651f91037 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.934732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-84c055ee-7ac3-49ff-bd97-4066702a6eb0 req-c8e05282-3769-429f-a23f-281651f91037 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.946725 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-84c055ee-7ac3-49ff-bd97-4066702a6eb0 req-c8e05282-3769-429f-a23f-281651f91037 service nova] Creating event network-vif-plugged:f9bc5cf6-eede-4706-9096-a8e8dbabfae5 for instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 on n-h1-858238-3 Nov 02 14:04:54.951981 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-84c055ee-7ac3-49ff-bd97-4066702a6eb0 req-c8e05282-3769-429f-a23f-281651f91037 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Nov 02 14:04:54.953200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2905/3957] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:54.958199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:54.958900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:54.965443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.965926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.966361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.967058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.967571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.967992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:55.449212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:55.457596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a7b52cb-dc84-404a-aee0-9a0e3802a9df tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.503281 Nov 02 14:04:55.458175 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2906/3958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:54 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:55.462708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:55.463315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:55.470193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:55.470680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:55.471214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:55.471914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:55.472375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:55.472870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:55.608198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:55.616678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9bca05cf-9ece-417c-8118-4a14c5e392f7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.157541 Nov 02 14:04:55.617251 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2907/3959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:55 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:55.754300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1726075756", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "c841ddc2-4a1d-499b-abb6-8bf42fc484c1"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:55.814930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] validate_networks() for [('c841ddc2-4a1d-499b-abb6-8bf42fc484c1', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:04:56.201965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:04:56.202393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:04:56.203554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:04:56.203969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:04:56.204391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:04:56.213336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.213817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.214249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.214974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.215456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.215882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.235242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Getting quotas for project ff4f594b83524a91a086bbf4c4ede022. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:56.241157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Getting quotas for user 608ba6ec35d74d11ad32f1992687c8b4 and project ff4f594b83524a91a086bbf4c4ede022. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:56.254933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:04:56.257452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:04:56.306924 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-111cc53a-6722-488f-999a-5c09870ceb5e tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688618 Nov 02 14:04:56.307601 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2908/3960] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:04:56.312683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:56.313546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:56.321475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.322166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.322717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.323738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.324286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.324886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.520541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:56.538698 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38d87c87-0616-4597-80b1-a7bb4ae2991f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1360 microversion: 2.1 time: 0.229757 Nov 02 14:04:56.540082 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2909/3961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:56 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:56.554196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:56.554813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:56.563630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.564484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.565133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.566450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.567553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.568295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.762944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:56.771176 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4324387-5763-4b40-b79a-1dc83574e4df tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.221856 Nov 02 14:04:56.772123 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2910/3962] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:56 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:56.776956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:56.777774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] [instance: db82b5c7-82d5-432f-b9e2-880a7bad3c74] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:56.787365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.788166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.788749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.789619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.790232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.790991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.814926 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] HTTP exception thrown: Instance db82b5c7-82d5-432f-b9e2-880a7bad3c74 could not be found. Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Request method failure captured: Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74 HTTP/1.1 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYni5--WpHAWOZpszuvwdqaGBWmSnxM6ga9vMDjJGxI1INQEc0nL-asrLXOyOz5cvTO8gdSJOgV_t137unv_fMqNpbAJ2O0tje5m6jSPtKL-UtHpOx7dPGqcEbQ5WNnVkx5tehF6FHXjc_auuk2ZaenahckTpTgfw-jtR_G0KYpoS85o Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: fc5709ac5eeb41cca056b3f0889cdfc5 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerShowV247Test-770513386 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc5709ac5eeb41cca056b3f0889cdfc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc5709ac5eeb41cca056b3f0889cdfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc5709ac5eeb41cca056b3f0889cdfc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc5709ac5eeb41cca056b3f0889cdfc5"}]}] Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerShowV247Test-770513386 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: fc5709ac5eeb41cca056b3f0889cdfc5 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerShowV247Test-770513386 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerShowV247Test-770513386-project Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 1f04ddff7975407a81c6090628ef5648 Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerShowV247Test-770513386-project Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance db82b5c7-82d5-432f-b9e2-880a7bad3c74 could not be found. Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'db82b5c7-82d5-432f-b9e2-880a7bad3c74'} Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db82b5c7-82d5-432f-b9e2-880a7bad3c74 could not be found. Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db82b5c7-82d5-432f-b9e2-880a7bad3c74 could not be found. Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:56.818096 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db82b5c7-82d5-432f-b9e2-880a7bad3c74 could not be found. Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:04:56.825686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] Returning 404 to user: Instance db82b5c7-82d5-432f-b9e2-880a7bad3c74 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:56.827202 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a2d9389-3832-48a4-bcb1-3c3b52dc2684 tempest-ServerShowV247Test-770513386 tempest-ServerShowV247Test-770513386-project] 10.222.0.18 "GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74" status: 404 len: 111 microversion: 2.47 time: 0.052849 Nov 02 14:04:56.828217 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2911/3963] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:04:56 2022] GET /compute/v2.1/servers/db82b5c7-82d5-432f-b9e2-880a7bad3c74 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:04:56.837134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5ff3be0-76f5-46a8-a48e-82b8fbbdb063 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:56.838421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5ff3be0-76f5-46a8-a48e-82b8fbbdb063 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:56.930765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b5ff3be0-76f5-46a8-a48e-82b8fbbdb063 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:56.941767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5ff3be0-76f5-46a8-a48e-82b8fbbdb063 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1214 microversion: 2.1 time: 0.111927 Nov 02 14:04:56.943022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2912/3964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:56 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:56.951932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:56.953777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:56.966016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.967319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.968847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.970205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.971437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.972969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.218779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:57.232601 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c0250d1-d7fc-4e00-be57-2ca71de17c74 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.288004 Nov 02 14:04:57.233325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2913/3965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:56 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:57.238853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4b7861c1-b849-4475-95df-ea1369884686 req-f4243ab6-e77e-4ae4-95f4-d7b441839138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d21756-e902-4a1b-a76b-32247ffaa378", "name": "network-vif-plugged", "status": "completed", "tag": "25dc10ff-00b3-40c2-9b8e-a30b3409a427"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:57.249096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4b7861c1-b849-4475-95df-ea1369884686 req-f4243ab6-e77e-4ae4-95f4-d7b441839138 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.249617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4b7861c1-b849-4475-95df-ea1369884686 req-f4243ab6-e77e-4ae4-95f4-d7b441839138 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.250046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4b7861c1-b849-4475-95df-ea1369884686 req-f4243ab6-e77e-4ae4-95f4-d7b441839138 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.263433 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4b7861c1-b849-4475-95df-ea1369884686 req-f4243ab6-e77e-4ae4-95f4-d7b441839138 service nova] Creating event network-vif-plugged:25dc10ff-00b3-40c2-9b8e-a30b3409a427 for instance 53d21756-e902-4a1b-a76b-32247ffaa378 on n-h2-858238-3 Nov 02 14:04:57.269387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4b7861c1-b849-4475-95df-ea1369884686 req-f4243ab6-e77e-4ae4-95f4-d7b441839138 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033948 Nov 02 14:04:57.270000 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2914/3966] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:57.579959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:57.582462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:57.596846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.597860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.598710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.600014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.600849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.601571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.609900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:57.819066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:57.831132 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60be4bb4-7d08-4041-bd51-e8269ea34c24 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1547 microversion: 2.1 time: 0.258913 Nov 02 14:04:57.831656 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2915/3967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:57 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1547 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:04:57.867613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:57.868502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:57.881645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.882528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.883318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.884652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.885447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.886203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:58.005061 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfcaf95e-119e-408d-b95f-3d8ac17fc418 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146429 Nov 02 14:04:58.005683 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2916/3968] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:04:57 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:04:58.018778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:58.019458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:58.030181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:58.030181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:58.030181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:58.030181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:58.030181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:58.030181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:58.120968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:58.129848 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7f8446f-a82b-48b1-8c8c-4e7a3c81a68d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1266 microversion: 2.1 time: 0.123106 Nov 02 14:04:58.130709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2917/3969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:58 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:58.264411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:58.265762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:58.276584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:58.277449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:58.278262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:58.279563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:58.280348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:58.281162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:58.515206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:58.525555 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-768e6ebc-d005-47f3-81ce-78ed00dd7b16 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.268466 Nov 02 14:04:58.526766 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2918/3970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:58 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:04:58.881955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2837ee9d-5c8b-4a1a-902f-178fe04c0f12 tempest-ExtensionsTest-398158386 tempest-ExtensionsTest-398158386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:58.885642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2837ee9d-5c8b-4a1a-902f-178fe04c0f12 tempest-ExtensionsTest-398158386 tempest-ExtensionsTest-398158386-project] 10.222.0.18 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.187684 Nov 02 14:04:58.886637 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2919/3971] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 14:04:58 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:04:58.901914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04152f06-7b12-4d08-af6c-45f5b92730e4 tempest-ExtensionsTest-398158386 tempest-ExtensionsTest-398158386-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:58.905339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04152f06-7b12-4d08-af6c-45f5b92730e4 tempest-ExtensionsTest-398158386 tempest-ExtensionsTest-398158386-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009865 Nov 02 14:04:58.908056 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2920/3972] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Nov 2 14:04:58 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:04:59.159358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:59.160291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:59.172597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:59.173952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:59.175059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:59.176633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:59.177742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:59.178729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:59.285015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:59.296236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa253b87-8a9a-41a4-a7fc-cb20ef947090 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1272 microversion: 2.1 time: 0.145745 Nov 02 14:04:59.309053 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2921/3973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:59 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:04:59.501299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-997930aa-edd9-4da5-beb9-ff21d0e2b568 req-aedcad94-a8de-4522-8616-04fa9ce300ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40ffe3c-33e5-44a6-a7ff-23606f1275a7", "tag": "f9bc5cf6-eede-4706-9096-a8e8dbabfae5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:59.516402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-997930aa-edd9-4da5-beb9-ff21d0e2b568 req-aedcad94-a8de-4522-8616-04fa9ce300ca service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:59.517159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-997930aa-edd9-4da5-beb9-ff21d0e2b568 req-aedcad94-a8de-4522-8616-04fa9ce300ca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:59.517577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-997930aa-edd9-4da5-beb9-ff21d0e2b568 req-aedcad94-a8de-4522-8616-04fa9ce300ca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:59.548755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-997930aa-edd9-4da5-beb9-ff21d0e2b568 req-aedcad94-a8de-4522-8616-04fa9ce300ca service nova] Creating event network-changed:f9bc5cf6-eede-4706-9096-a8e8dbabfae5 for instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 on n-h1-858238-3 Nov 02 14:04:59.563919 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-997930aa-edd9-4da5-beb9-ff21d0e2b568 req-aedcad94-a8de-4522-8616-04fa9ce300ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065859 Nov 02 14:04:59.565190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2922/3974] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:04:59.581198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:59.582292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:59.593446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:59.594296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:59.599776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:59.600857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:59.601525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:59.602148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:00.180071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:00.201648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee1142c2-7ca2-43dd-8039-0b6939edc495 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1321 microversion: 2.1 time: 0.634891 Nov 02 14:05:00.202746 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2923/3975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:04:59 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:00.330012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:00.330868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:00.338972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:00.339944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:00.340531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:00.341457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:00.342110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:00.342701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:00.893938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:00.904739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2f9c4a4-80bb-45ff-a529-e4ece4cbf46c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.580569 Nov 02 14:05:00.905970 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2924/3976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:00 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:01.231884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:01.233182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:01.248071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.248923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.250278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:01.251542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.261542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.262179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:01.552189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:01.582624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be0ceb83-53fe-4fa4-b423-bcae11b114db tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1511 microversion: 2.1 time: 0.357186 Nov 02 14:05:01.584621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2925/3977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:01 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:01.629255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:01.630665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:01.641479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.642301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.643082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:01.644509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.645426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.647885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:01.873155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:01.884638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a592f885-5cdd-47bd-ae28-d6bdc5ee9aa9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1512 microversion: 2.1 time: 0.261863 Nov 02 14:05:01.885806 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2926/3978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:01 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:01.892443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1152a49b-396f-43d4-8687-631d3f422e3f req-ac01dfc6-eda1-4870-bf7b-f3337784291d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55572815-8936-4624-9cab-cde8c525204a", "tag": "4fa7071b-066c-489b-b4d2-6f65d76536f2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:01.899747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:01.905280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1152a49b-396f-43d4-8687-631d3f422e3f req-ac01dfc6-eda1-4870-bf7b-f3337784291d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.906396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1152a49b-396f-43d4-8687-631d3f422e3f req-ac01dfc6-eda1-4870-bf7b-f3337784291d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.907027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1152a49b-396f-43d4-8687-631d3f422e3f req-ac01dfc6-eda1-4870-bf7b-f3337784291d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:01.923266 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1152a49b-396f-43d4-8687-631d3f422e3f req-ac01dfc6-eda1-4870-bf7b-f3337784291d service nova] Creating event network-changed:4fa7071b-066c-489b-b4d2-6f65d76536f2 for instance 55572815-8936-4624-9cab-cde8c525204a on n-h2-858238-3 Nov 02 14:05:01.929928 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1152a49b-396f-43d4-8687-631d3f422e3f req-ac01dfc6-eda1-4870-bf7b-f3337784291d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041982 Nov 02 14:05:01.931303 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2927/3979] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:01.941279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:01.942205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:01.949356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.950045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.950549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:01.951604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:01.952372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:01.953469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.167490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:02.186086 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3c8ef2d-115f-4246-b8e3-81ab6a02e502 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 200 len: 1509 microversion: 2.1 time: 0.252096 Nov 02 14:05:02.197943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2928/3980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:01 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:02.207832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:02.208817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:02.225210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.225854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.226404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.227608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.228138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.228800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.438975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:02.459067 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9235498-4020-497f-b5ee-d637f7eeb850 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.259684 Nov 02 14:05:02.465591 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2929/3981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:02 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:02.468828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:02.474432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:02.475688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:02.497833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.498602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.499044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.500443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.500917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.501430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.640435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:02.747013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:02.753769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.754264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.754689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.915304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f508d71-fcdf-4fc7-b0f7-5bff90e4075c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.452862 Nov 02 14:05:02.916181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2930/3982] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 14:05:02 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:02.948027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:02.953375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:02.954193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1114620404', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:02.965829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.966667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.967456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:02.969296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:02.969988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:02.971023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.098621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:03.177201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:03.183890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.184444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.184882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.341518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54364181-1f86-43c6-841a-34d4a7342862 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1114620404" status: 200 len: 1515 microversion: 2.1 time: 0.397024 Nov 02 14:05:03.342763 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2931/3983] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 14:05:02 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1114620404 => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:03.367775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:03.372589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:03.373388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:03.379462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.379936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.380366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.381078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.381558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.381975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.514683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:03.601302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:03.611359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.612097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.612775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.813458 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-58c8c194-3b00-44ec-b0a8-55b25f500be1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.449051 Nov 02 14:05:03.814624 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2932/3984] 10.222.0.18 () {58 vars in 1173 bytes} [Wed Nov 2 14:05:03 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:03.825069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:03.826212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:03.853572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.854223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.854802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.855929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.856777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.857558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.880782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:04.055408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.065148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d387a7a-d351-4173-b9ac-f5911ce50d1d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.249000 Nov 02 14:05:04.065784 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2933/3985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:03 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:04.070610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:04.075683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.076135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.servers [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Removing options 'limit' from query {{(pid=137559) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 14:05:04.076902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:04.083472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.083810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.084237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.085138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.085873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.086371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.125623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.131150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.131632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.132056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.313654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-63e9ee2f-8194-498c-aaf3-1efae1def9c7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.246117 Nov 02 14:05:04.315166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2934/3986] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 14:05:04 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:04.341738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:04.350204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.351607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:04.360913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.361647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.362330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.363224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.364002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.364712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.418358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:04.484873 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-403c72c3-97df-4aaa-8d41-341d20ae8ee4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.147514 Nov 02 14:05:04.485899 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2935/3987] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:05:04 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:04.505094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:04.510854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.511580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.servers [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Removing options 'limit' from query {{(pid=137559) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 14:05:04.512652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:04.521734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.522819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.523323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.524592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.525449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.526246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.576889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:04.624148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ccaad958-8f4c-464c-9412-a8d0a4b9b620 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.123027 Nov 02 14:05:04.625252 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2936/3988] 10.222.0.18 () {58 vars in 1150 bytes} [Wed Nov 2 14:05:04 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:04.638773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:04.643654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.644314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:04.650011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.650440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.650877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.651644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.652092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.653040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.692262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:04.735674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fbbe2f1f-dedd-45b6-81fb-f2961ac843af tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.101908 Nov 02 14:05:04.737383 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2937/3989] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 14:05:04 2022] GET /compute/v2.1/servers => generated 1009 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:04.760473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:04.767201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.767887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:04.781494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.781967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.782395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.783160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.783601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.784025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.893354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:05.004995 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3999e3bc-f40d-4e8b-bb71-b4ab286dbcef tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.252186 Nov 02 14:05:05.005727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2938/3990] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:05:04 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:05.029775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:05.036323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:05.036977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.servers [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Removing options 'limit' from query {{(pid=137559) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 14:05:05.037896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:05.048256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.049545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.050325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.051589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.052393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.053181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.091772 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4db1a1f-a0d4-42b1-aedf-e33502333d54 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.067614 Nov 02 14:05:05.092420 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2939/3991] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 14:05:05 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:05.098841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:05.099914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:05.111824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.112448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.112984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.113776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.114434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.115043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.283984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:05.297448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bce27148-d93e-4d54-b75b-916514ae19dd tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.203640 Nov 02 14:05:05.298486 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2940/3992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:05 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:05.304297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:05.309048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:05.309693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1114620404', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:05.316613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.317227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.317743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.318627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.319383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.319925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.468072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:05.541510 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6a31fc6-58fe-4ea7-a8d1-a031116b98d7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1114620404" status: 200 len: 346 microversion: 2.1 time: 0.241502 Nov 02 14:05:05.542398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2941/3993] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 14:05:05 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1114620404 => generated 346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:05.563864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a70551d-ad21-4b6a-86fb-8cfed8b796f2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:05.574981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a70551d-ad21-4b6a-86fb-8cfed8b796f2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.576383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a70551d-ad21-4b6a-86fb-8cfed8b796f2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.577600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a70551d-ad21-4b6a-86fb-8cfed8b796f2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.604255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a70551d-ad21-4b6a-86fb-8cfed8b796f2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:05:05.654475 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a70551d-ad21-4b6a-86fb-8cfed8b796f2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "POST /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78/action" status: 202 len: 0 microversion: 2.1 time: 0.097168 Nov 02 14:05:05.655298 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2942/3994] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:05:05 2022] POST /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:05:05.673210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:05.674112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:05.684043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.685071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.685985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.687562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.688487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.689075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.940687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:05.951931 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcbbc87a-5842-4acd-b6a8-d47596dc9902 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.290962 Nov 02 14:05:05.952820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2943/3995] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:05 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:06.330752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:06.331631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:06.341868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:06.344331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:06.345231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:06.346580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:06.347140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:06.347699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:06.613475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:06.629499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca8e8372-43f1-4d0f-83fb-2f64d18899a0 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.306804 Nov 02 14:05:06.630650 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2944/3996] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:06 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:06.977186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:06.978154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:06.986807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:06.987637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:06.988299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:06.989124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:06.989773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:06.990396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:07.223671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:07.232410 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8ed76c9-0aba-4f3f-8853-5a1428793e40 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.259142 Nov 02 14:05:07.233019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2945/3997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:06 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:07.659137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:07.660616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:07.670585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:07.672495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:07.673305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:07.674512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:07.675437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:07.676061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:07.874008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:07.888687 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c10cd34f-3e9f-433f-b4cb-4a3cf32587c9 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.237839 Nov 02 14:05:07.889564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2946/3998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:07 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:08.258797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:08.259510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:08.267636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.268184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.268782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:08.269486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.269997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.270482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:08.455076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:08.463454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac96e2d1-0603-4a2a-998a-1c5246f4732a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.208520 Nov 02 14:05:08.464049 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2947/3999] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:08 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:08.669976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4a05594f-50cf-4b64-b5af-4e042bdcbbb1 req-1888838e-163a-4b80-bdd0-fd7e41e40027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55572815-8936-4624-9cab-cde8c525204a", "name": "network-vif-plugged", "status": "completed", "tag": "4fa7071b-066c-489b-b4d2-6f65d76536f2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:08.688592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a05594f-50cf-4b64-b5af-4e042bdcbbb1 req-1888838e-163a-4b80-bdd0-fd7e41e40027 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.689231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a05594f-50cf-4b64-b5af-4e042bdcbbb1 req-1888838e-163a-4b80-bdd0-fd7e41e40027 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.689729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4a05594f-50cf-4b64-b5af-4e042bdcbbb1 req-1888838e-163a-4b80-bdd0-fd7e41e40027 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:08.701478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:08.705250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4a05594f-50cf-4b64-b5af-4e042bdcbbb1 req-1888838e-163a-4b80-bdd0-fd7e41e40027 service nova] Creating event network-vif-plugged:4fa7071b-066c-489b-b4d2-6f65d76536f2 for instance 55572815-8936-4624-9cab-cde8c525204a on n-h2-858238-3 Nov 02 14:05:08.713085 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4a05594f-50cf-4b64-b5af-4e042bdcbbb1 req-1888838e-163a-4b80-bdd0-fd7e41e40027 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046803 Nov 02 14:05:08.715025 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2948/4000] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:08.917497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:08.918681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:08.932456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.933113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.933841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:08.935226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.936180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.936916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:09.150338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:09.165890 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb0b81bf-f171-4f0a-93f9-f3505d7eab97 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.256043 Nov 02 14:05:09.167159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2949/4001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:08 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:09.489112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:09.489728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:09.497167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:09.497650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:09.498127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:09.498822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:09.499322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:09.499753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:09.711572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:09.727526 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b933a036-fde7-4575-947d-3129df266bd6 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.242919 Nov 02 14:05:09.728638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2950/4002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:09 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:10.209404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:10.210344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:10.217561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:10.218918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:10.219662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:10.220537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:10.221103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:10.221633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:10.459056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:10.474752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-196134e0-ceb2-40bd-8d4a-dfd8d465cfc6 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1314 microversion: 2.1 time: 0.269464 Nov 02 14:05:10.476996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2951/4003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:10 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:10.769885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:10.772355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:10.783430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:10.784288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:10.784959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:10.785793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:10.786437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:10.787138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:11.107753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:11.122161 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2653053-cd92-4118-9a7a-557e58def2ba tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.359604 Nov 02 14:05:11.123367 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2952/4004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:10 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:11.501384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:11.502491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:11.511238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:11.512070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:11.513227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:11.514406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:11.516300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:11.516984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:11.712970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:11.721342 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-581b86fd-c5cb-4bd8-a542-ae0ecfcc310c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1497 microversion: 2.1 time: 0.225966 Nov 02 14:05:11.721936 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2953/4005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:11 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:12.160574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:12.161608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:12.177269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:12.177887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:12.178393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:12.186252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:12.187308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:12.191301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:12.456608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:12.470548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee8f99f1-57ce-402f-b3eb-ae38c59c2cf7 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.325012 Nov 02 14:05:12.471507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2954/4006] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:12 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:13.510928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:13.511946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:13.522784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:13.523529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:13.524156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:13.525183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:13.525704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:13.526197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:13.730628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:13.741862 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-138cbe7e-6244-4618-8c33-a889fede633e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.237403 Nov 02 14:05:13.742455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2955/4007] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:13 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:14.778790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:14.778790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:14.778790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:14.781179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:14.782261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:14.784018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:14.785584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:14.786674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:14.787786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:15.044527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:15.060321 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3aab7a32-4321-4209-b042-74952fce856a tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.297817 Nov 02 14:05:15.062432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2956/4008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:14 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:15.931429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:15.932323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:15.935493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=22 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:15.948336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:15.949212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:15.949989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:15.951068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:15.951901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:15.952707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:15.996912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:16.106272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4a417b05-8a97-4223-b830-496d656778e7 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "DELETE /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 204 len: 0 microversion: 2.1 time: 0.181490 Nov 02 14:05:16.107331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2957/4009] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:05:15 2022] DELETE /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:05:16.119045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:16.120701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:16.131540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:16.132373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:16.133680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:16.135411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:16.136189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:16.137148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:16.339428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:16.357344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4380e76-3ba6-498d-b72e-4f742a6179e4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.248452 Nov 02 14:05:16.358325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2958/4010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:16 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:16.365539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:16.366595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:16.377241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:16.378347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:16.382266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:16.383792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:16.384820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:16.385541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:16.586586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:16.598882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9de94e5f-57d5-4f2a-b04d-96a5c1bffd7d tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1503 microversion: 2.1 time: 0.238499 Nov 02 14:05:16.599635 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2959/4011] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:16 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:17.399182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:17.400216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:17.410300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:17.413943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:17.414560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:17.415424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:17.415971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:17.416603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:17.600169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:17.613624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e16b82ec-9f07-4c9b-adde-75085dfe68b3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.223572 Nov 02 14:05:17.614561 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2960/4012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:17 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:17.641577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:17.643609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:17.654685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:17.656043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:17.656809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:17.658088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:17.658916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:17.659707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:17.866358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:17.879323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-65877674-eec3-4cc5-9eeb-7bae5d7dbd8b tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1503 microversion: 2.1 time: 0.244987 Nov 02 14:05:17.880376 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2961/4013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:17 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:18.653516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:18.654642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:18.663968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:18.669583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:18.669583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:18.669583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:18.669583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:18.669583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:18.870605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:18.882581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-99d70cbd-af7f-4a9a-9ef5-bc399d0d818d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.238789 Nov 02 14:05:18.884404 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2962/4014] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:18 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:18.923233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7418ea47-7a29-4534-b9bb-b21dd4a9baae req-94e334f3-459d-41f3-92f7-c067273d2971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55572815-8936-4624-9cab-cde8c525204a", "name": "network-vif-deleted", "tag": "4fa7071b-066c-489b-b4d2-6f65d76536f2"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:18.942093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7418ea47-7a29-4534-b9bb-b21dd4a9baae req-94e334f3-459d-41f3-92f7-c067273d2971 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:18.942795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7418ea47-7a29-4534-b9bb-b21dd4a9baae req-94e334f3-459d-41f3-92f7-c067273d2971 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:18.943337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7418ea47-7a29-4534-b9bb-b21dd4a9baae req-94e334f3-459d-41f3-92f7-c067273d2971 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:18.968731 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7418ea47-7a29-4534-b9bb-b21dd4a9baae req-94e334f3-459d-41f3-92f7-c067273d2971 service nova] Creating event network-vif-deleted:4fa7071b-066c-489b-b4d2-6f65d76536f2 for instance 55572815-8936-4624-9cab-cde8c525204a on n-h2-858238-3 Nov 02 14:05:18.974649 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7418ea47-7a29-4534-b9bb-b21dd4a9baae req-94e334f3-459d-41f3-92f7-c067273d2971 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065442 Nov 02 14:05:18.975649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2963/4015] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:18.984906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:18.985799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:18.998017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:18.999215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:19.000907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:19.004151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:19.004959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:19.005588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:19.034608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:19.124512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608ba6ec35d74d11ad32f1992687c8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff4f594b83524a91a086bbf4c4ede022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:19.142024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f858e6dd-5e06-40c6-afd4-8e97f00eaa5c tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 200 len: 1299 microversion: 2.1 time: 0.162375 Nov 02 14:05:19.147987 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2964/4016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:18 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:19.924992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:19.928361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:19.936574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:19.938200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:19.939170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:19.940195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:19.940899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:19.941529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:20.198798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:20.216177 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1b3e7a3-d2c7-4d10-94f3-b0543529c1e1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.300505 Nov 02 14:05:20.232319 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2965/4017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:19 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:20.268909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:20.270386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] [instance: 55572815-8936-4624-9cab-cde8c525204a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:20.280547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:20.281442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:20.282375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:20.285429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:20.287361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:20.288274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:20.318582 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] HTTP exception thrown: Instance 55572815-8936-4624-9cab-cde8c525204a could not be found. Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Request method failure captured: Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a HTTP/1.1 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnkEn1NdaOveCVpUkLZNW-9s8TrkOA-nDk5BjMUq3wAhUWkaMTRRgGzwOQqM3adUQF-qJSmvOpgA8_Kd_YFl7pfIkHw7UsK2RWo_s-aB_IGJOn3FUqUZ0nG7jOiDVXausrj0SsoKZ3HVqiP70-tqR-xllbVlD9R2TJ7w572z-Fnj41k Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ff4f594b83524a91a086bbf4c4ede022 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesActionsTest-2128042698 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff4f594b83524a91a086bbf4c4ede022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ff4f594b83524a91a086bbf4c4ede022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ff4f594b83524a91a086bbf4c4ede022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ff4f594b83524a91a086bbf4c4ede022"}]}] Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesActionsTest-2128042698 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ff4f594b83524a91a086bbf4c4ede022 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesActionsTest-2128042698 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesActionsTest-2128042698-project Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 608ba6ec35d74d11ad32f1992687c8b4 Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesActionsTest-2128042698-project Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 55572815-8936-4624-9cab-cde8c525204a could not be found. Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '55572815-8936-4624-9cab-cde8c525204a'} Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55572815-8936-4624-9cab-cde8c525204a could not be found. Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55572815-8936-4624-9cab-cde8c525204a could not be found. Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:20.322936 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55572815-8936-4624-9cab-cde8c525204a could not be found. Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] Returning 404 to user: Instance 55572815-8936-4624-9cab-cde8c525204a could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c2c1a27-c93c-4ce9-9b6f-6f5616d61079 tempest-VolumesActionsTest-2128042698 tempest-VolumesActionsTest-2128042698-project] 10.222.0.18 "GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a" status: 404 len: 111 microversion: 2.1 time: 0.081004 Nov 02 14:05:20.335468 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2966/4018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:20 2022] GET /compute/v2.1/servers/55572815-8936-4624-9cab-cde8c525204a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:05:21.273737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:21.274951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:21.304522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:21.305397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:21.306018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:21.307137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:21.307817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:21.308422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:21.609851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:21.634281 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49120ca5-c725-4628-80aa-dc389ffb3e2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.366592 Nov 02 14:05:21.637244 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2967/4019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:21 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:22.681482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:22.682445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:22.690877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:22.697530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:22.698102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:22.698645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:22.699564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:22.700320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:22.700919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:22.915611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:22.930426 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2cb8dfb-a4d2-405c-ab81-6bf413163b5f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.256174 Nov 02 14:05:22.931590 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2968/4020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:22 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:23.968665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:23.971731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:23.983326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:23.984765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:23.985547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:23.987327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:23.988122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:23.988691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.217001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:24.229987 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b83501db-76f0-4fc7-a603-b9718473ca7f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.271119 Nov 02 14:05:24.230608 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2969/4021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:23 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:25.261984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:25.263161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:25.272577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:25.273072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:25.273529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:25.274300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:25.275179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:25.275801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:25.469315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:25.481169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-429e0b95-c420-4bd2-9bc9-9ada84ab4aa4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1522 microversion: 2.1 time: 0.225060 Nov 02 14:05:25.482267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2970/4022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:25 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:26.520722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:26.521785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:26.532982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:26.533618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:26.534076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:26.534984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:26.535730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:26.536382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:26.779868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:26.796997 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0436517-9824-4764-80e0-96535936097f tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1499 microversion: 2.1 time: 0.282206 Nov 02 14:05:26.797864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2971/4023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:26 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1499 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:26.823295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:26.828850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:26.829781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:26.836418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:26.837331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:26.838110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:26.839197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:26.839663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:26.840210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:26.920063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:27.003517 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-820cca55-d5ec-4d41-aa05-df337d80440e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.184441 Nov 02 14:05:27.006128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2972/4024] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Nov 2 14:05:26 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:27.023440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37300953-82a5-4fa9-8c74-12ecc8da9d56 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:27.032821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37300953-82a5-4fa9-8c74-12ecc8da9d56 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:27.034023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37300953-82a5-4fa9-8c74-12ecc8da9d56 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:27.035080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37300953-82a5-4fa9-8c74-12ecc8da9d56 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:27.072057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37300953-82a5-4fa9-8c74-12ecc8da9d56 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Going to try to start instance {{(pid=137559) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:05:27.216801 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37300953-82a5-4fa9-8c74-12ecc8da9d56 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "POST /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78/action" status: 202 len: 0 microversion: 2.1 time: 0.200721 Nov 02 14:05:27.237681 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2973/4025] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:05:27 2022] POST /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:05:27.259565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:27.260683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:27.276809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:27.277416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:27.277958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:27.278979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:27.279675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:27.280103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:27.767050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:27.776637 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c009090d-7534-4e08-8755-8bed19238d67 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1508 microversion: 2.1 time: 0.536141 Nov 02 14:05:27.777704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2974/4026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:27 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:28.813214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:28.814631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:28.822595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:28.822917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:28.823389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:28.824180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:28.824630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:28.825056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:29.030617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:29.042597 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-373e4c6e-2660-4ab4-b8cc-d4e2532410f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1508 microversion: 2.1 time: 0.234726 Nov 02 14:05:29.044128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2975/4027] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:28 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:30.075226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:30.076316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:30.089097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.089643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.090087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.090805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.091478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.091921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.324829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:30.332440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08d81e4c-14e9-4868-8942-edc5756fb19b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1512 microversion: 2.1 time: 0.266349 Nov 02 14:05:30.333347 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2976/4028] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:30 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:30.376184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:30.381501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:30.381952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.servers [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Removing options 'limit' from query {{(pid=137559) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 14:05:30.382730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:30.384433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.384975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.385561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.386304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.386767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.387218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.388595 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8c21c633-e85e-48a2-baef-569602e8123c tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018421 Nov 02 14:05:30.389188 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2977/4029] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 14:05:30 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:05:30.404099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:30.404726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:30.413016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.413825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.414730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.415917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.417189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.417836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.615855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:30.625006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8680a837-81a7-41b4-b1fc-a192e448e82b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1512 microversion: 2.1 time: 0.224250 Nov 02 14:05:30.629814 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2978/4030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:30 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:30.658430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:30.659275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:30.666989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.667559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.668004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.668710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.669167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.669587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.883065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:30.895257 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c975810-cfe0-4946-8afe-0b5d7ad3d875 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 200 len: 1509 microversion: 2.1 time: 0.241884 Nov 02 14:05:30.915130 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2979/4031] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:30 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:30.934402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:30.935694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:30.946784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.948149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.949170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.950928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.951688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.952711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:31.168102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:31.182216 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a996ae6-aee4-453f-9266-d7b92ea9f7ed tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1511 microversion: 2.1 time: 0.256293 Nov 02 14:05:31.183750 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2980/4032] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:30 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:31.223171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:31.230893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:31.231886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:31.378064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:31.378751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:31.379534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:31.380945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:31.383007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:31.385923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.014272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:32.026077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:32.112728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG neutronclient.v2_0.client [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=137558) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 14:05:32.113878 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 500 len: 0 microversion: 2.1 time: 900.752662 Nov 02 14:05:32.147249 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ac20057-132b-4fa1-a86b-d31da07a66be tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 343 microversion: 2.1 time: 0.932812 Nov 02 14:05:32.148070 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2981/4033] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Nov 2 14:05:31 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 343 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:32.164659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:32.165498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack Traceback (most recent call last): Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack raise client_exc(message=error_message, Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-9db03dab-992c-4cd8-90a6-2fc63665b02d'] Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack Traceback (most recent call last): Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return req.get_response(self.application) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack self._log_req(req, res, start) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack self.force_reraise() Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack raise self.value Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack res = req.get_response(self.application) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return request.get_response(self.application) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack response = req.get_response(self._app) Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Nov 02 14:05:32.170553 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack response = self.app(environ, start_response) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return resp(environ, start_response) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return method(req=request, **action_args) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return func.func(self, *args, **kwargs) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return f(*args, **kwargs) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 226, in create Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack group_ref = security_group_api.create_security_group( Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 236, in create_security_group Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack security_group = neutron.create_security_group( Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1052, in create_security_group Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self.post(self.security_groups_path, body=body) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 361, in post Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack return self.do_request("POST", action, body=body, Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack raise exception.Unauthorized() Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Nov 02 14:05:32.179072 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack Nov 02 14:05:32.188248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.188248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.188248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.188248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.188248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.188248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.189518 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] http://10.222.0.18/compute/v2.1/os-security-groups returned with HTTP 401 Nov 02 14:05:32.192553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:32.193843 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.18) !!! Nov 02 14:05:32.193843 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:05:32 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-security-groups (10.222.0.18) Nov 02 14:05:32.195511 n-d-858238-3 devstack@n-api.service[137558]: CRITICAL nova [None req-d8f26723-7efa-44f8-9ef1-57c5640a4602 tempest-SecurityGroupsTestJSON-361849226 tempest-SecurityGroupsTestJSON-361849226-project] Unhandled error: OSError: write error Nov 02 14:05:32.195511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova OSError: write error Nov 02 14:05:32.195511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova Nov 02 14:05:32.195827 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1053/4034] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 13:50:31 2022] POST /compute/v2.1/os-security-groups => generated 0 bytes in 900835 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Nov 02 14:05:32.415935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:32.430692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9469a9e0-c9d8-447f-a915-15da10b9a6c4 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1512 microversion: 2.1 time: 0.270155 Nov 02 14:05:32.440755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2982/4035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:32 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:32.463787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:32.464578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:32.472035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.472665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.474706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.474706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.474706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.475281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.715568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:32.734372 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8411dda7-3a5e-464c-939a-3e61ac8e4ac1 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 200 len: 1509 microversion: 2.1 time: 0.275575 Nov 02 14:05:32.736604 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1054/4036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:32 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:32.771390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:32.772375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:32.783002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.783571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.784020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.784904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.785365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.785913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:33.027642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:33.041794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a985ff4-f009-4c68-b88d-498cb9a58d83 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1511 microversion: 2.1 time: 0.274352 Nov 02 14:05:33.042856 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2983/4037] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:32 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:33.070151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:33.075415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:33.076358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:33.083276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:33.083763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:33.084414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:33.085340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:33.085797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:33.086224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:33.127075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:33.177658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:33.186800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:33.187472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:33.188057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:33.967144 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce684c28-2e1f-497f-bb8e-831d0c380304 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.900890 Nov 02 14:05:33.979318 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1055/4038] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:05:33 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:34.014830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:34.028061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:34.031910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:34.222108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:34.223067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:34.223635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:34.224490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:34.225426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:34.225967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:34.273261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:34.334007 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e84d4373-65e7-43de-8db4-409e349f70bc tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.323823 Nov 02 14:05:34.335593 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2984/4039] 10.222.0.18 () {58 vars in 1150 bytes} [Wed Nov 2 14:05:34 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:34.361896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:34.373017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:34.374660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:34.383341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:34.384456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:34.385011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:34.386245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:34.387258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:34.388269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:34.581268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:34.724986 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1fbc8d50-d8d0-45d3-b203-c809c7c8f814 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.368805 Nov 02 14:05:34.727022 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1056/4040] 10.222.0.18 () {58 vars in 1212 bytes} [Wed Nov 2 14:05:34 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:34.742038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:34.750269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:34.752459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:34.760260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:34.761896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:34.762538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:34.763515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:34.764160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:34.764760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:34.933557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:35.014012 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37d5643f-64f9-498d-8105-c205aabe8ffd tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.277298 Nov 02 14:05:35.015934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2985/4041] 10.222.0.18 () {58 vars in 1196 bytes} [Wed Nov 2 14:05:34 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:35.030805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:35.036657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:35.037601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': '1114620404', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:35.043532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.044198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.044878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.045285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.046016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.046917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.172333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:35.244939 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53c853cb-95aa-4787-baa8-47fa47d940ad tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?name=1114620404" status: 200 len: 346 microversion: 2.1 time: 0.218078 Nov 02 14:05:35.245976 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1057/4042] 10.222.0.18 () {58 vars in 1156 bytes} [Wed Nov 2 14:05:35 2022] GET /compute/v2.1/servers?name=1114620404 => generated 346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:35.264390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:35.280083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:35.280851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137559) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:35.288661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.289487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.290238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.291397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.292016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.292646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.431547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.multi_cell_list [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137559) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:35.583177 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a87eacb3-4dfa-435a-9870-513cc36f3a6e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.322677 Nov 02 14:05:35.589688 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2986/4043] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Nov 2 14:05:35 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:35.596811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:35.602571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:35.603298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-111462040', 'deleted': False, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:05:35.610509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.611337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.611936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.613066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.613530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.614260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.808122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:05:35.957277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-433118b0-bb6e-4b97-afe9-da59dc78a027 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111462040" status: 200 len: 346 microversion: 2.1 time: 0.351423 Nov 02 14:05:35.957277 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1058/4044] 10.222.0.18 () {58 vars in 1228 bytes} [Wed Nov 2 14:05:35 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111462040 => generated 346 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:35.969086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:35.969817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:35.983157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.983157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.983157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:35.983157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:35.983857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:35.984141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:36.017299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:36.153849 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd218e78-26c4-4e7d-b521-28e22d65e182 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "DELETE /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 204 len: 0 microversion: 2.1 time: 0.189072 Nov 02 14:05:36.159165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2987/4045] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:05:35 2022] DELETE /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:05:36.175574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:36.177114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:36.190130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:36.190949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:36.191733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:36.193527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:36.194319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:36.195446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:36.399997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:36.410021 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d939421f-9e13-4709-8362-6d41943dd420 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1517 microversion: 2.1 time: 0.239666 Nov 02 14:05:36.410879 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1059/4046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:36 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:37.435760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:37.437514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:37.446508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:37.447678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:37.448233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:37.449119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:37.449704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:37.450289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:37.731722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:37.762624 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b2d96c2-a624-4c9d-8cbd-08a27949aee0 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1517 microversion: 2.1 time: 0.331930 Nov 02 14:05:37.763607 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2988/4047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:37 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1517 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:38.237412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:38.241771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:38.255439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:38.256282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:38.257064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:38.258051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:38.258513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:38.259141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:38.387612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ed3aea6-914e-4dfd-a89f-a2669ee018a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.155977 Nov 02 14:05:38.393187 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1060/4048] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:05:38 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:05:38.404981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:38.406347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:38.419211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:38.420660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:38.424723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:38.426516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:38.427787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:38.429004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:38.800040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:38.802530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:38.819246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:38.820599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:38.821515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:38.822961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:38.824009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:38.825110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:38.991718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:39.001478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b314a4f-99c6-4e3d-a3c5-b1cd84e810c4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1673 microversion: 2.1 time: 0.604969 Nov 02 14:05:39.002818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2989/4049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:38 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1673 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:39.377314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-85a342c1-ed7c-4923-bf91-67ea9ea0c9df req-49b348de-8b63-4f8d-9741-b3c0920125db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d21756-e902-4a1b-a76b-32247ffaa378", "name": "network-vif-deleted", "tag": "25dc10ff-00b3-40c2-9b8e-a30b3409a427"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:39.399239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-85a342c1-ed7c-4923-bf91-67ea9ea0c9df req-49b348de-8b63-4f8d-9741-b3c0920125db service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:39.400322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-85a342c1-ed7c-4923-bf91-67ea9ea0c9df req-49b348de-8b63-4f8d-9741-b3c0920125db service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:39.401250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-85a342c1-ed7c-4923-bf91-67ea9ea0c9df req-49b348de-8b63-4f8d-9741-b3c0920125db service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:39.445043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-85a342c1-ed7c-4923-bf91-67ea9ea0c9df req-49b348de-8b63-4f8d-9741-b3c0920125db service nova] Creating event network-vif-deleted:25dc10ff-00b3-40c2-9b8e-a30b3409a427 for instance 53d21756-e902-4a1b-a76b-32247ffaa378 on n-h2-858238-3 Nov 02 14:05:39.461320 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-85a342c1-ed7c-4923-bf91-67ea9ea0c9df req-49b348de-8b63-4f8d-9741-b3c0920125db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088590 Nov 02 14:05:39.462875 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2990/4050] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:39.668591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:39.687610 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-12e78768-5695-4a0c-aed0-4f56886f2b6b tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1517 microversion: 2.1 time: 0.897194 Nov 02 14:05:39.690347 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1061/4051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:38 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1517 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:40.029039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:40.040151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:40.059655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.061415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.062106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.063341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.064946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.065387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.712471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:40.721717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:40.722506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:40.729960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-505b9cea-d0da-4b00-952d-dbedf6e9e072 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1673 microversion: 2.1 time: 0.705208 Nov 02 14:05:40.730909 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2991/4052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:40 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1673 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:40.738894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.739521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.740054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.740860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.741411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.741940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.803307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:40.804051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:40.804762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:40.806405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lazy-loading 'fault' on Instance uuid 53d21756-e902-4a1b-a76b-32247ffaa378 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:05:41.271903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:41.286638 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bb38b2fb-6710-4f13-9c1b-4cf657728ae8 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 200 len: 1311 microversion: 2.1 time: 0.569060 Nov 02 14:05:41.288239 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1062/4053] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:40 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 1311 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:41.767913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:41.769316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:41.780408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:41.781457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:41.781900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:41.782632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:41.783113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:41.783567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.097929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:42.122349 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2d29f57-aa8f-41ed-970e-fff58f27e68b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.354327 Nov 02 14:05:42.122349 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2992/4054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:41 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:42.330349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:42.331422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 53d21756-e902-4a1b-a76b-32247ffaa378] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:42.340646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:42.341297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:42.341945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.343592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:42.344142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:42.344643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.362334 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] HTTP exception thrown: Instance 53d21756-e902-4a1b-a76b-32247ffaa378 could not be found. Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Request method failure captured: Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 HTTP/1.1 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnjrYSh_11lWaZk4cXhsgenmWuYKcP3HaaLrIZXQM8xpXAE0mEoZvNZg99ic9crvtaqJnxGxbww0IzCiCDPJLFptkeBNbw9AuV9peY5vDI6xrZVb4DqZjV-_Nyi2jfANeSw15esdLytSpJUfoT184Y3lyfme_5EXaHcL5MAW272j6hg Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b59221833cf348fb832f00a68f7a4bb7 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b59221833cf348fb832f00a68f7a4bb7"}]}] Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b59221833cf348fb832f00a68f7a4bb7 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ListServerFiltersTestJSON-1913459929-project Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 78bd93775c6c41b98c21095eea1dfe02 Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ListServerFiltersTestJSON-1913459929-project Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 53d21756-e902-4a1b-a76b-32247ffaa378 could not be found. Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '53d21756-e902-4a1b-a76b-32247ffaa378'} Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d21756-e902-4a1b-a76b-32247ffaa378 could not be found. Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d21756-e902-4a1b-a76b-32247ffaa378 could not be found. Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:42.364333 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d21756-e902-4a1b-a76b-32247ffaa378 could not be found. Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Returning 404 to user: Instance 53d21756-e902-4a1b-a76b-32247ffaa378 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bfc87f16-65ca-40f2-af51-ed2d9f5361a2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378" status: 404 len: 111 microversion: 2.1 time: 0.040168 Nov 02 14:05:42.374110 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1063/4055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:42 2022] GET /compute/v2.1/servers/53d21756-e902-4a1b-a76b-32247ffaa378 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:05:42.379640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:42.380964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:42.391223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:42.392136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:42.392787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.393894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:42.394587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:42.395339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.437555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:42.564011 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86fc8b24-c074-4a47-9d77-e7001f383cf5 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "DELETE /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 204 len: 0 microversion: 2.1 time: 0.191561 Nov 02 14:05:42.565095 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2993/4056] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:05:42 2022] DELETE /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:05:42.575903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:42.576312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:42.585812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:42.586733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:42.587410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.588350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:42.590210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:42.590867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:42.951126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:42.966466 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-485466e4-ea03-46ee-8daf-d554ec1265f3 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 200 len: 1515 microversion: 2.1 time: 0.395087 Nov 02 14:05:42.968694 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1064/4057] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:42 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:43.752291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:43.753014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:43.762383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:43.763352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:43.764107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:43.765999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:43.766999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:43.767830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:43.786347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:43.812759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bdaef75f-874d-4aff-ba28-ade06748a376 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/ips" status: 200 len: 147 microversion: 2.1 time: 0.065374 Nov 02 14:05:43.814139 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2994/4058] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:05:43 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/ips => generated 147 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:44.012858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:44.013801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:44.023053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:44.031057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:44.031820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:44.032909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:44.034276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:44.035227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:44.035762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:44.410207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:44.420483 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2e2c38f-79ea-4c1f-a0be-ca0de3d05df2 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 200 len: 1515 microversion: 2.1 time: 0.414286 Nov 02 14:05:44.435762 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1065/4059] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:44 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:45.138012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-a93d25bc-b9f5-415b-849f-00e512440a5b req-d7e75045-a7e9-4c8a-8f2b-33041f287a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a22b68-9cc3-403e-beb6-538a422c9471", "name": "network-vif-deleted", "tag": "157bbb9b-6a0a-475e-985a-60380b4a0077"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:45.191708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a93d25bc-b9f5-415b-849f-00e512440a5b req-d7e75045-a7e9-4c8a-8f2b-33041f287a29 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:45.197345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a93d25bc-b9f5-415b-849f-00e512440a5b req-d7e75045-a7e9-4c8a-8f2b-33041f287a29 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:45.199065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-a93d25bc-b9f5-415b-849f-00e512440a5b req-d7e75045-a7e9-4c8a-8f2b-33041f287a29 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:45.245179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-a93d25bc-b9f5-415b-849f-00e512440a5b req-d7e75045-a7e9-4c8a-8f2b-33041f287a29 service nova] Creating event network-vif-deleted:157bbb9b-6a0a-475e-985a-60380b4a0077 for instance 40a22b68-9cc3-403e-beb6-538a422c9471 on n-h1-858238-3 Nov 02 14:05:45.264322 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-a93d25bc-b9f5-415b-849f-00e512440a5b req-d7e75045-a7e9-4c8a-8f2b-33041f287a29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135028 Nov 02 14:05:45.265361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2995/4060] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:45.453270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:45.454438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:45.469121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:45.469622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:45.470069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:45.470793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:45.471295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:45.471727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:45.535798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:45.544315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:45.544912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:45.552170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lazy-loading 'fault' on Instance uuid 40a22b68-9cc3-403e-beb6-538a422c9471 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:05:45.645974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:45.662934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5c858d6-3c7a-4571-83b3-e7c254cdae1d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 200 len: 1308 microversion: 2.1 time: 0.214487 Nov 02 14:05:45.663631 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1066/4061] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:45 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:46.248881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:46.250155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:46.252813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:46.278817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.279606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.280228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.281198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.281867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.282451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.336176 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-868fd7dc-6f02-4c2f-9acd-cfd3643b091c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments/72a5fc73-bff1-4b7d-98c7-d97f9aa93fd2" status: 200 len: 194 microversion: 2.20 time: 0.092082 Nov 02 14:05:46.337598 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2996/4062] 10.222.0.18 () {60 vars in 1454 bytes} [Wed Nov 2 14:05:46 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments/72a5fc73-bff1-4b7d-98c7-d97f9aa93fd2 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:05:46.521228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:46.522942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:46.525911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:46.536215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.537195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.537905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.539476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.540417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.541361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.676958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:46.680074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lazy-loading 'services' on Instance uuid b4cea623-4709-4680-9646-d7263f443356 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:05:46.729565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:46.733222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 40a22b68-9cc3-403e-beb6-538a422c9471] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:46.759681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.761898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.763438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.765240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.766381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.767605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.805786 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] HTTP exception thrown: Instance 40a22b68-9cc3-403e-beb6-538a422c9471 could not be found. Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Request method failure captured: Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 HTTP/1.1 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjrYSh_11lWaZk4cXhsgenmWuYKcP3HaaLrIZXQM8xpXAE0mEoZvNZg99ic9crvtaqJnxGxbww0IzCiCDPJLFptkeBNbw9AuV9peY5vDI6xrZVb4DqZjV-_Nyi2jfANeSw15esdLytSpJUfoT184Y3lyfme_5EXaHcL5MAW272j6hg Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b59221833cf348fb832f00a68f7a4bb7 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b59221833cf348fb832f00a68f7a4bb7"}]}] Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b59221833cf348fb832f00a68f7a4bb7 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ListServerFiltersTestJSON-1913459929-project Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 78bd93775c6c41b98c21095eea1dfe02 Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ListServerFiltersTestJSON-1913459929-project Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 40a22b68-9cc3-403e-beb6-538a422c9471 could not be found. Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '40a22b68-9cc3-403e-beb6-538a422c9471'} Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a22b68-9cc3-403e-beb6-538a422c9471 could not be found. Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a22b68-9cc3-403e-beb6-538a422c9471 could not be found. Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:46.812528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a22b68-9cc3-403e-beb6-538a422c9471 could not be found. Nov 02 14:05:46.818578 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:05:46.820599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Returning 404 to user: Instance 40a22b68-9cc3-403e-beb6-538a422c9471 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:46.823676 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98c5708b-bade-4940-80e0-0530196c44a9 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471" status: 404 len: 111 microversion: 2.1 time: 0.104856 Nov 02 14:05:46.825613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2997/4063] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:46 2022] GET /compute/v2.1/servers/40a22b68-9cc3-403e-beb6-538a422c9471 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:05:46.839075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:46.840119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:46.854398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.855347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.856272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.857519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.858422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:46.859815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:46.892795 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1d14e658-e41e-492e-bbdd-7e86435c2b3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments/72a5fc73-bff1-4b7d-98c7-d97f9aa93fd2" status: 202 len: 0 microversion: 2.20 time: 0.383925 Nov 02 14:05:46.901735 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1067/4064] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Nov 2 14:05:46 2022] DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments/72a5fc73-bff1-4b7d-98c7-d97f9aa93fd2 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:05:46.919732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:46.937793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:46.994738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:46.994738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.007249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:47.009896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.013194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:47.013870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.014377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.122448 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a9619de1-0711-41f5-8596-71bedc15bca4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.212839 Nov 02 14:05:47.125648 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1068/4065] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:46 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:05:47.244117 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c44ec97c-1a84-4c1a-8764-7bdc76b0d965 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "DELETE /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 204 len: 0 microversion: 2.1 time: 0.412075 Nov 02 14:05:47.246007 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2998/4066] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:05:46 2022] DELETE /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:05:47.256049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:47.258148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:47.265459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:47.267872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.267872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.267872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:47.267872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:47.268449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:47.493801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:47.506949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31e3490a-7229-40b9-b9a0-ac51077de3ff tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1518 microversion: 2.1 time: 0.255867 Nov 02 14:05:47.507558 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1069/4067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:47 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:48.102035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91d5a1d9-c7c0-42ac-a674-433e06f19bd0"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:48.105688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:48.137409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:48.139662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:48.146077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.146572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.147000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.150180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.150653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.151089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.157030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.157528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.159313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.160254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.160726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.161160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.239011 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c4aee4d-57eb-45ee-817e-11c2d391843e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105478 Nov 02 14:05:48.241955 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1070/4068] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:48 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:05:48.534587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:48.535672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:48.545669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.546871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.547585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.549073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:48.550071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:48.550665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:48.704456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:48.719582 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-429e31f4-0609-44d4-8da2-6da261b47f38 tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1518 microversion: 2.1 time: 0.189751 Nov 02 14:05:48.721292 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1071/4069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:48 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:48.964146 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39d7465b-fa30-4608-afe7-f7a04af38267 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867111 Nov 02 14:05:48.965539 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 2999/4070] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:05:48 2022] POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:49.252934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:49.255947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:49.270464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:49.273417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:49.274131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:49.275134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:49.279979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:49.280781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:49.331895 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cdbe4738-738a-43a5-9e9b-2ac34f506735 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083624 Nov 02 14:05:49.337770 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1072/4071] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:49 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:05:49.718466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7d79f276-e033-450a-8b7e-df048d7e270a req-f354995b-4b36-45c3-8be3-f38e3676b546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006bd0d9-4b8f-4af7-a75a-7ca7157e9b78", "name": "network-vif-deleted", "tag": "93873357-e86e-4baf-ba9f-80aea462c0f0"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:49.771427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:49.773348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:49.777246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7d79f276-e033-450a-8b7e-df048d7e270a req-f354995b-4b36-45c3-8be3-f38e3676b546 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:49.781142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7d79f276-e033-450a-8b7e-df048d7e270a req-f354995b-4b36-45c3-8be3-f38e3676b546 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:49.781629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7d79f276-e033-450a-8b7e-df048d7e270a req-f354995b-4b36-45c3-8be3-f38e3676b546 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:49.787314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:49.788528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:49.789535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:49.791030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:49.792351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:49.793509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:49.808319 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7d79f276-e033-450a-8b7e-df048d7e270a req-f354995b-4b36-45c3-8be3-f38e3676b546 service nova] Creating event network-vif-deleted:93873357-e86e-4baf-ba9f-80aea462c0f0 for instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 on n-h1-858238-3 Nov 02 14:05:49.818711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7d79f276-e033-450a-8b7e-df048d7e270a req-f354995b-4b36-45c3-8be3-f38e3676b546 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123353 Nov 02 14:05:49.819339 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3000/4072] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:49.997598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78bd93775c6c41b98c21095eea1dfe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59221833cf348fb832f00a68f7a4bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:50.006216 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf1cf58c-0e02-4364-945d-e327ff74ec2e tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 200 len: 1306 microversion: 2.1 time: 0.258177 Nov 02 14:05:50.007168 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1073/4073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:49 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 1306 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:50.348895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:50.352116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:50.361710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:50.362727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:50.363222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:50.363942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:50.364994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:50.365440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:50.409500 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62cba214-80c1-4ba6-ad93-75c4921cb3b7 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067477 Nov 02 14:05:50.416518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3001/4074] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:50 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:05:51.029923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:51.030712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] [instance: 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:51.038437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:51.038922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:51.039384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:51.040083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:51.040547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:51.041011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:51.056940 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] HTTP exception thrown: Instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 could not be found. Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Request method failure captured: Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 HTTP/1.1 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnjrYSh_11lWaZk4cXhsgenmWuYKcP3HaaLrIZXQM8xpXAE0mEoZvNZg99ic9crvtaqJnxGxbww0IzCiCDPJLFptkeBNbw9AuV9peY5vDI6xrZVb4DqZjV-_Nyi2jfANeSw15esdLytSpJUfoT184Y3lyfme_5EXaHcL5MAW272j6hg Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b59221833cf348fb832f00a68f7a4bb7 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b59221833cf348fb832f00a68f7a4bb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b59221833cf348fb832f00a68f7a4bb7"}]}] Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b59221833cf348fb832f00a68f7a4bb7 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1913459929 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ListServerFiltersTestJSON-1913459929-project Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 78bd93775c6c41b98c21095eea1dfe02 Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ListServerFiltersTestJSON-1913459929-project Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 could not be found. Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '006bd0d9-4b8f-4af7-a75a-7ca7157e9b78'} Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 could not be found. Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 could not be found. Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:51.058602 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 could not be found. Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] Returning 404 to user: Instance 006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-83ec6e9a-e4fa-47a2-82c0-46464a43071d tempest-ListServerFiltersTestJSON-1913459929 tempest-ListServerFiltersTestJSON-1913459929-project] 10.222.0.18 "GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78" status: 404 len: 111 microversion: 2.1 time: 0.034029 Nov 02 14:05:51.064205 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1074/4075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:05:51 2022] GET /compute/v2.1/servers/006bd0d9-4b8f-4af7-a75a-7ca7157e9b78 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:05:51.423608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:51.425684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:51.433159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:51.433654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:51.434095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:51.434795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:51.435586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:51.435990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:51.470970 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f863639c-d3c8-4d33-a20c-bd1d079e0467 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051927 Nov 02 14:05:51.471881 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3002/4076] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:51 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:05:52.485357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:52.487720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:52.496267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:52.496865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:52.497390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:52.498201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:52.498744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:52.499299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:52.537236 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ab3e689b-9cff-4f3c-b1b7-c67a262d0ce4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055923 Nov 02 14:05:52.542351 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1075/4077] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:52 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:05:53.553917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:53.556793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:53.580018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:53.581898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:53.582738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:53.583688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:53.586182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:53.587744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:53.588352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:53.630920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfb9b142-25e7-4020-9000-d19baf515970 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082661 Nov 02 14:05:53.637763 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3003/4078] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:05:53 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:53.710309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:53.711448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:53.721025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:53.721737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:53.722367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:53.723248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:53.723846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:53.724415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:53.754374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:53.947467 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-908b157c-b145-4ecb-9b76-0d4581983992 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 204 len: 0 microversion: 2.20 time: 0.240960 Nov 02 14:05:53.948890 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1076/4079] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:05:53 2022] DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 14:05:53.961433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:53.962289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:53.984534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:53.985836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:53.987321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:53.989479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:53.990110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:53.990706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:54.569803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:54.585118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:54.589770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:54.592515 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e9bdcb41-3d00-494b-b1b7-c5bda0e5c456 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 0.637383 Nov 02 14:05:54.593766 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3004/4080] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:05:53 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:05:55.632582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:55.633297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:55.659219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:55.660138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:55.660657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:55.661504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:55.661967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:55.664178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:56.792784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:56.793682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:56.808502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:56.811178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:56.812991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:56.814283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:56.817001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:56.817784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:56.843881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:56.859467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:56.860944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:56.880460 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c3dee09b-dcb2-4b11-9f15-e49dd8f67e3f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 1.254065 Nov 02 14:05:56.881608 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1077/4081] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:05:55 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:05:57.545633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:57.569444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:57.574207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:57.576488 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0141d502-a59e-4159-80f4-c4c95348f05d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2946 microversion: 2.32 time: 0.789224 Nov 02 14:05:57.581124 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3005/4082] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:05:56 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2946 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:05:57.613474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:57.613988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:57.627505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:57.629685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:57.630735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:57.632220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:57.635408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:57.636410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:57.923025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:57.923804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:57.937354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:57.937996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:57.939002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:57.940640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:57.941413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:57.942140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:57.978417 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-586c57e6-ec5d-4041-b4ed-c03bc4e9beb2 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.371247 Nov 02 14:05:57.990848 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1078/4083] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 14:05:57 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6/os-interface => generated 1832 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:05:58.296346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:58.330769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:58.332830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:58.340655 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13995605-7eec-4013-97a0-3843b1ce182f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1721 microversion: 2.20 time: 0.423851 Nov 02 14:05:58.344924 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3006/4084] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:05:57 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1721 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:05:59.375771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:59.377165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:59.394674 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:05:59.396388 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 (ip 10.222.0.18) !!! Nov 02 14:05:59.455028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3109558e-0c21-4d4a-b339-f04855a14e8d req-2cca001c-c8f8-489a-8919-9209f50dfaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cea623-4709-4680-9646-d7263f443356", "name": "network-vif-deleted", "tag": "d980ec30-b400-4aee-926a-0adf67991425"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:59.466258 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:05:59.471438 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 (ip 10.222.0.18) !!! Nov 02 14:05:59.479717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:59.484950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:59.485827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:59.487081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:59.498662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:59.501172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:59.504840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:59.516218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3109558e-0c21-4d4a-b339-f04855a14e8d req-2cca001c-c8f8-489a-8919-9209f50dfaa3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:59.533544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3109558e-0c21-4d4a-b339-f04855a14e8d req-2cca001c-c8f8-489a-8919-9209f50dfaa3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:59.534358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3109558e-0c21-4d4a-b339-f04855a14e8d req-2cca001c-c8f8-489a-8919-9209f50dfaa3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:59.654722 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3109558e-0c21-4d4a-b339-f04855a14e8d req-2cca001c-c8f8-489a-8919-9209f50dfaa3 service nova] Creating event network-vif-deleted:d980ec30-b400-4aee-926a-0adf67991425 for instance b4cea623-4709-4680-9646-d7263f443356 on n-h2-858238-3 Nov 02 14:05:59.700252 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3109558e-0c21-4d4a-b339-f04855a14e8d req-2cca001c-c8f8-489a-8919-9209f50dfaa3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263707 Nov 02 14:05:59.701896 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3007/4085] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:59.767458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:59.772886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:59.773343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:59.781282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lazy-loading 'fault' on Instance uuid b4cea623-4709-4680-9646-d7263f443356 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:05:59.903482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:59.920717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:59.922747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:59.923991 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76c6667e-1bee-4170-a57f-69cc3b155cad tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 200 len: 1370 microversion: 2.20 time: 0.554756 Nov 02 14:05:59.924562 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1079/4086] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:05:59 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 1370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:00.991250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:00.992624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:01.006005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:01.009806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:01.011820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:01.018587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:01.019464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:01.020075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:01.082307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] HTTP exception thrown: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Request method failure captured: Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 HTTP/1.1 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngad1o9rlay4YgDarPBJ2nKYn0a3xZorq-Z0kX1XuJYagc4jd-9Phwwb9Q6cawhIOFMKDIIRzgKgy40xW6zGnoMYoIwI8w8_zKaPrlq_XE-_QgrvcfN1oDhytO3GSOPvKs9bfRFSeXUiS9813nd3qVv9k65Yj-oHRhYQBLaf2nJaXY Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edee2f45a1d2435d83d8e9e19fa53ea8"}]}] Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54b21c1bdc9742a084ad3fb5e480bd45 Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'b4cea623-4709-4680-9646-d7263f443356'} Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:01.087716 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Returning 404 to user: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:01.096717 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-731f55ca-13e4-4ba8-99a2-ebb71fc27e42 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 404 len: 111 microversion: 2.20 time: 0.109486 Nov 02 14:06:01.099527 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3008/4087] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:00 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:06:01.104185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-06b292c0-e440-4d01-986b-b47a4be47a3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '.version_select at 0x7f6f81c39d30>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:01.160613 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-06b292c0-e440-4d01-986b-b47a4be47a3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227102037" status: 204 len: 0 microversion: 2.20 time: 0.060681 Nov 02 14:06:01.163173 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1080/4088] 10.222.0.18 () {60 vars in 1259 bytes} [Wed Nov 2 14:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227102037 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:06:03.333402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8800bffb-7e4b-4697-a7a0-8cee55f1365c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'create', calling method: .version_select at 0x7f6f85e68b80>, body: {"keypair": {"name": "tempest-keypair-1150853030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKp0fDZcyK0eXjSYgwvwK90y33kOxPf1RQZQIgKkGfQndw8/h47nG+UGnRIRpv98g20OBywnEVcle6UpwdCuswbrupcMRJ2EDXPzulxKcxsXZMpSoDcHwB33J43lmawDSA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:03.378338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-8800bffb-7e4b-4697-a7a0-8cee55f1365c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:03.398606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-8800bffb-7e4b-4697-a7a0-8cee55f1365c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for user 54b21c1bdc9742a084ad3fb5e480bd45 and project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:03.480485 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8800bffb-7e4b-4697-a7a0-8cee55f1365c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.160083 Nov 02 14:06:03.481526 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3009/4089] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 14:06:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 14:06:06.456565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a1d86b0-c419-4527-95b4-159ab128fcf6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Action: 'create', calling method: .version_select at 0x7f6f8116fc10>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2058854825", "policies": ["affinity"]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:06.517256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2a1d86b0-c419-4527-95b4-159ab128fcf6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:06.536771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2a1d86b0-c419-4527-95b4-159ab128fcf6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:06.651360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2a1d86b0-c419-4527-95b4-159ab128fcf6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:06.658295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2a1d86b0-c419-4527-95b4-159ab128fcf6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:06.675803 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a1d86b0-c419-4527-95b4-159ab128fcf6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.471570 Nov 02 14:06:06.677014 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1081/4090] 10.222.0.18 () {60 vars in 1174 bytes} [Wed Nov 2 14:06:06 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:06.695134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b496e10-b1fc-4462-90b5-23d4f02e9bbe tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Action: 'create', calling method: .version_select at 0x7f6f85df7a60>, body: {"server_group": {"name": "tempest-server-group-600245010", "policies": ["affinity"]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:06.725235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5b496e10-b1fc-4462-90b5-23d4f02e9bbe tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:06.732568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5b496e10-b1fc-4462-90b5-23d4f02e9bbe tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:06.805976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5b496e10-b1fc-4462-90b5-23d4f02e9bbe tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:06.816709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-5b496e10-b1fc-4462-90b5-23d4f02e9bbe tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:06.832942 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5b496e10-b1fc-4462-90b5-23d4f02e9bbe tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.148036 Nov 02 14:06:06.849220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fa25d7d2-e6b0-4a40-8899-5b7ea9090e18 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Action: 'create', calling method: .version_select at 0x7f6f85e4b790>, body: {"server_group": {"name": "tempest-server-group-600245010", "policies": ["affinity"]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:06.854960 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3010/4091] 10.222.0.18 () {60 vars in 1173 bytes} [Wed Nov 2 14:06:06 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:06.870428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fa25d7d2-e6b0-4a40-8899-5b7ea9090e18 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:06.891936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fa25d7d2-e6b0-4a40-8899-5b7ea9090e18 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:06.946928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fa25d7d2-e6b0-4a40-8899-5b7ea9090e18 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:06.954317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-fa25d7d2-e6b0-4a40-8899-5b7ea9090e18 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:06.972547 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fa25d7d2-e6b0-4a40-8899-5b7ea9090e18 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.130885 Nov 02 14:06:06.973312 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1082/4092] 10.222.0.18 () {60 vars in 1173 bytes} [Wed Nov 2 14:06:06 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:06.986548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fdc9bb66-6bae-4ad3-9970-fc4fce5ac0b4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.016967 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fdc9bb66-6bae-4ad3-9970-fc4fce5ac0b4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/2e5755ec-1be2-44a8-9418-a1a454a13616" status: 204 len: 0 microversion: 2.1 time: 0.034396 Nov 02 14:06:07.018164 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3011/4093] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:06 2022] DELETE /compute/v2.1/os-server-groups/2e5755ec-1be2-44a8-9418-a1a454a13616 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:06:07.028088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8efa8497-0425-44e6-acae-a283ac7d93ed tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.052115 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8efa8497-0425-44e6-acae-a283ac7d93ed tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.027667 Nov 02 14:06:07.060549 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1083/4094] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:06:07 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:07.065662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-324e9828-3ba9-4a71-b12f-a71f7caed911 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.096448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-324e9828-3ba9-4a71-b12f-a71f7caed911 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/93a30e05-e1e0-4635-8b1f-414d83e7725f" status: 204 len: 0 microversion: 2.1 time: 0.035254 Nov 02 14:06:07.097977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3012/4095] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:07 2022] DELETE /compute/v2.1/os-server-groups/93a30e05-e1e0-4635-8b1f-414d83e7725f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:06:07.108288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce09843c-c74b-4992-9113-5f8d1437184f tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.125323 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce09843c-c74b-4992-9113-5f8d1437184f tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022404 Nov 02 14:06:07.136954 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1084/4096] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:06:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:07.139482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6abf14cb-0c1c-4d37-8957-298f67748f0b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Action: 'create', calling method: .version_select at 0x7f6f81365f70>, body: {"server_group": {"name": "tempest-server-group-513136671", "policies": ["affinity"]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:07.159933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6abf14cb-0c1c-4d37-8957-298f67748f0b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:07.168104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6abf14cb-0c1c-4d37-8957-298f67748f0b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:07.229392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-945291927", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f7f9622-8d61-434b-acac-e9862fb219ae"}], "security_groups": [{"name": "tempest-securitygroup--219776952"}], "key_name": "tempest-keypair-1150853030", "user_data": "}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:07.277767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6abf14cb-0c1c-4d37-8957-298f67748f0b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:07.295285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6abf14cb-0c1c-4d37-8957-298f67748f0b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:07.332617 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6abf14cb-0c1c-4d37-8957-298f67748f0b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.194505 Nov 02 14:06:07.334710 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3013/4097] 10.222.0.18 () {60 vars in 1173 bytes} [Wed Nov 2 14:06:07 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:07.345494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61f039ce-2e83-4b2d-a147-c4cfb092503d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.382025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:07.396227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61f039ce-2e83-4b2d-a147-c4cfb092503d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/8678aac7-901b-4305-8e76-cb5ffb8d5b87" status: 204 len: 0 microversion: 2.1 time: 0.055380 Nov 02 14:06:07.397152 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3014/4098] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:07 2022] DELETE /compute/v2.1/os-server-groups/8678aac7-901b-4305-8e76-cb5ffb8d5b87 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:06:07.410156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca5712a2-2932-45d3-80ca-887d58bfa03c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.426557 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca5712a2-2932-45d3-80ca-887d58bfa03c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022212 Nov 02 14:06:07.427403 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3015/4099] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:06:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:07.440247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34aca0c8-3caf-46df-84d4-bef3abc11d94 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Action: 'create', calling method: .version_select at 0x7f6f81b6f040>, body: {"server_group": {"name": "tempest-server-group-580642921", "policies": ["anti-affinity"]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:07.491777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] validate_networks() for [('3f7f9622-8d61-434b-acac-e9862fb219ae', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:07.502289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-34aca0c8-3caf-46df-84d4-bef3abc11d94 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:07.550541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-34aca0c8-3caf-46df-84d4-bef3abc11d94 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:07.618793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-34aca0c8-3caf-46df-84d4-bef3abc11d94 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:07.628561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-34aca0c8-3caf-46df-84d4-bef3abc11d94 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_groups'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:07.649353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34aca0c8-3caf-46df-84d4-bef3abc11d94 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.213009 Nov 02 14:06:07.650315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3016/4100] 10.222.0.18 () {60 vars in 1173 bytes} [Wed Nov 2 14:06:07 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:07.663723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d46de268-f8e8-4eb8-a854-c9a4d1a25e23 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.729824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d46de268-f8e8-4eb8-a854-c9a4d1a25e23 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/4a4d3f60-18e0-4a58-a54b-a17c19f12e29" status: 204 len: 0 microversion: 2.1 time: 0.072400 Nov 02 14:06:07.730424 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3017/4101] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:07 2022] DELETE /compute/v2.1/os-server-groups/4a4d3f60-18e0-4a58-a54b-a17c19f12e29 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:06:07.739200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66f5237f-aff2-44c7-8690-38302ea993e0 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.767374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66f5237f-aff2-44c7-8690-38302ea993e0 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032412 Nov 02 14:06:07.771207 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3018/4102] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:06:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:08.022644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19eef551-cc76-4d8d-a636-cae4da903ad2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:08.031681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19eef551-cc76-4d8d-a636-cae4da903ad2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.032571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19eef551-cc76-4d8d-a636-cae4da903ad2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.033235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19eef551-cc76-4d8d-a636-cae4da903ad2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:08.063646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19eef551-cc76-4d8d-a636-cae4da903ad2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:06:08.125446 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19eef551-cc76-4d8d-a636-cae4da903ad2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action" status: 202 len: 0 microversion: 2.1 time: 0.107376 Nov 02 14:06:08.127271 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3019/4103] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:06:08 2022] POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:06:08.133233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1653012188", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "792eba8b-7635-48d6-9220-2607b5176bd6"}]}, "os:scheduler_hints": {"group": "f333ee67-af86-4170-9721-719c558bdb2a"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:08.544980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] validate_networks() for [('792eba8b-7635-48d6-9220-2607b5176bd6', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:08.571418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:08.572527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:08.573564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:08.574251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:08.574914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:08.591305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.592407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.596061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:08.599217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.600015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.601702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:08.651369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:08.659050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Getting quotas for user 54b21c1bdc9742a084ad3fb5e480bd45 and project edee2f45a1d2435d83d8e9e19fa53ea8. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:08.674267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:08.677642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:08.771544 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4363e14a-d648-43eb-9d60-27a8971e5c05 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.555114 Nov 02 14:06:08.772727 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1085/4104] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:06:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:06:08.785431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:08.786157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:08.815581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.816084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.816524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:08.817361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.817838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.818979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:09.136028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.150887 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-32d50814-059e-4507-bc9f-0b6f7fb4de6b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.376780 Nov 02 14:06:09.156437 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1086/4105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:08 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:09.166378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eab00ead-37b1-476a-a605-8129af73cc4f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:09.170068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eab00ead-37b1-476a-a605-8129af73cc4f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:09.277592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eab00ead-37b1-476a-a605-8129af73cc4f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.294254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eab00ead-37b1-476a-a605-8129af73cc4f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.302125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eab00ead-37b1-476a-a605-8129af73cc4f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.306197 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eab00ead-37b1-476a-a605-8129af73cc4f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1281 microversion: 2.20 time: 0.148409 Nov 02 14:06:09.308978 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1087/4106] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:09 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1281 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:09.323863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:09.324404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:09.325034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:09.325458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:09.325875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:09.362476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:09.363011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:09.364083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:09.367512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:09.367998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:09.368436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:09.443572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:09.455672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:09.484490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:09.489181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:09.596911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:09.621484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:09.684549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:09.694467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Getting quotas for user 627941d120f149329e6643891ce7326a and project 5b58d111d9564d2a928f4583e9cbbe81. Resources: {'server_group_members'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:09.741191 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06047145-4bfd-4259-8f6b-3dc2c684686e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610008 Nov 02 14:06:09.743193 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3020/4107] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:06:09.759573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57b1c74d-e863-4cf8-9cb8-c533b4b74080 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:09.760523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-57b1c74d-e863-4cf8-9cb8-c533b4b74080 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:09.878521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-57b1c74d-e863-4cf8-9cb8-c533b4b74080 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.917794 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57b1c74d-e863-4cf8-9cb8-c533b4b74080 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1213 microversion: 2.1 time: 0.165826 Nov 02 14:06:09.918706 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1088/4108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:09 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:10.183522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:10.184143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:10.200064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.202855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.203427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.205923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.206477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.206927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.307848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:10.768168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:10.792884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6c68c35-c211-41f1-97e0-a8a7b62e609b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.613589 Nov 02 14:06:10.810514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3021/4109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:10 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:10.891046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:10.892297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:10.904219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.905307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.905982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.907427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.908284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.908886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.945284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:10.946165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:10.969368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.970198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.970832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.971829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.972585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.973175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:11.224953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:11.242575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad281eb8-c9e6-4d65-a466-2ecf18acc9d6 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1217 microversion: 2.1 time: 0.301738 Nov 02 14:06:11.243604 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3022/4110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:10 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:11.321932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:11.335283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:11.341959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:11.346988 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a23a045-41bb-45d4-8d42-79d27cae586e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1341 microversion: 2.20 time: 1.001572 Nov 02 14:06:11.347869 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1089/4111] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:10 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1341 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:06:11.828461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:11.829223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:11.837116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:11.838134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:11.838769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:11.840244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:11.841086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:11.842428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.229262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:12.240358 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61e9507a-2c3a-4282-a5c4-ff75acd007a6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.418686 Nov 02 14:06:12.259956 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3023/4112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:11 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:12.278896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:12.281934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:12.289498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.291021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.291869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.292848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.293539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.294329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.347283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:12.381690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:12.382615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:12.391710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.394655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.397491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.398396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.399475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.399475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.465307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:12.482674 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7866133d-2a2f-4683-bbf9-18d49ff7c2b8 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1271 microversion: 2.1 time: 0.208480 Nov 02 14:06:12.487645 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1090/4113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:12 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:12.549671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:12.562605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:12.565386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:12.567056 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d4adaf6-cdea-4dac-ae20-e564600d2863 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1339 microversion: 2.20 time: 0.194698 Nov 02 14:06:12.568146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3024/4114] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:12 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:12.925725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Calling method '.version_select at 0x7f6f81c39430>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:12.927391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.928107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.928796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.951384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.952293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.952776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.964265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:12.966984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.967695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.968340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.978130 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-14e8ad28-c284-43bf-b3ee-7255765813e7 tempest-PortsAdminExtendedAttrsTestJSON-449483278 tempest-PortsAdminExtendedAttrsTestJSON-449483278-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.381669 Nov 02 14:06:12.987847 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1091/4115] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:06:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:13.269636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:13.270919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:13.281489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.282446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.283156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.283951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.284475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.285502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.512146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:13.514408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:13.530073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.531919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.533101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.534236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.535852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.538657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.847526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:13.860055 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e710c02-2827-4195-832f-2a972d65d31a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.594639 Nov 02 14:06:13.860907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3025/4116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:13 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:13.866356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:13.867249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:13.875251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.875920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.876517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.877398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.877854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.878286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.095603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:14.106147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56ec2ea0-2a88-494e-a92f-ec45ac63526c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1313 microversion: 2.1 time: 0.599632 Nov 02 14:06:14.125128 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1092/4117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:13 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:14.131542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-15deade1-293c-400b-9523-4f285a4c24ed req-93b3a138-65ea-43bc-a056-4e5d6f3174d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635303a6-4b50-4f2a-9294-68cd6997c8c1", "tag": "427097c7-ae6e-4784-84ae-87440242fb37"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:14.145027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-15deade1-293c-400b-9523-4f285a4c24ed req-93b3a138-65ea-43bc-a056-4e5d6f3174d2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.145822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-15deade1-293c-400b-9523-4f285a4c24ed req-93b3a138-65ea-43bc-a056-4e5d6f3174d2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.146361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-15deade1-293c-400b-9523-4f285a4c24ed req-93b3a138-65ea-43bc-a056-4e5d6f3174d2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.159787 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-15deade1-293c-400b-9523-4f285a4c24ed req-93b3a138-65ea-43bc-a056-4e5d6f3174d2 service nova] Creating event network-changed:427097c7-ae6e-4784-84ae-87440242fb37 for instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 on n-h1-858238-3 Nov 02 14:06:14.165894 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-15deade1-293c-400b-9523-4f285a4c24ed req-93b3a138-65ea-43bc-a056-4e5d6f3174d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038585 Nov 02 14:06:14.166839 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1093/4118] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:14.677213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:14.691463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:14.695659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:14.703358 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef1bf8f8-afff-43b6-81bd-b4a288d62dc0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1406 microversion: 2.20 time: 0.835697 Nov 02 14:06:14.704280 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3026/4119] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:13 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1406 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:14.888266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:14.889734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:14.904606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.905122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.906479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.906975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.907451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.908026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.134828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:15.136522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:15.153775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.156125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.160474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.161316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.162741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.164879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.239251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:15.253318 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b12adc09-26db-4149-a1e9-b23ee59dc6f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.371548 Nov 02 14:06:15.274530 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1094/4120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:14 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:15.280541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-097575c6-5379-4b6d-92b7-ecab6a40b27d req-9f0033c4-d45e-41c2-bc8f-538ddbea7fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:15.294760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-097575c6-5379-4b6d-92b7-ecab6a40b27d req-9f0033c4-d45e-41c2-bc8f-538ddbea7fde service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.295407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-097575c6-5379-4b6d-92b7-ecab6a40b27d req-9f0033c4-d45e-41c2-bc8f-538ddbea7fde service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.295831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-097575c6-5379-4b6d-92b7-ecab6a40b27d req-9f0033c4-d45e-41c2-bc8f-538ddbea7fde service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.309263 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-097575c6-5379-4b6d-92b7-ecab6a40b27d req-9f0033c4-d45e-41c2-bc8f-538ddbea7fde service nova] Creating event network-changed:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h1-858238-3 Nov 02 14:06:15.316238 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-097575c6-5379-4b6d-92b7-ecab6a40b27d req-9f0033c4-d45e-41c2-bc8f-538ddbea7fde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039654 Nov 02 14:06:15.317069 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1095/4121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:15.391396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:15.403588 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2656ca9a-90c1-421f-a2b5-57fef02dde9d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1313 microversion: 2.1 time: 0.277919 Nov 02 14:06:15.404204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3027/4122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:15 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:15.730921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:15.731670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:15.746245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.748525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.750812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:15.752404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:15.754296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:15.756372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.082550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.096499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.098177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.100028 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6ed19a6-ce7e-4e91-925b-3016cb90c47e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1406 microversion: 2.20 time: 0.373873 Nov 02 14:06:16.101639 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1096/4123] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:15 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:16.281745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:16.282448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:16.286604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:16.292456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.293187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.293821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.294752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.295508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.296198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.429758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:16.430633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:16.441405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.441907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.442338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.443086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.444108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.444565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.524242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.539727 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49a6c438-232d-4b2e-82f1-94211dd9cb6e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.259764 Nov 02 14:06:16.551127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3028/4124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:16 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:16.704090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.716072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3fcda8b0-547d-4dff-90f9-e9bb7b93c43b tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1313 microversion: 2.1 time: 0.290650 Nov 02 14:06:16.716880 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1097/4125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:16 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:17.140277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:17.141534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:17.153052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.153818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.154501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.155470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.156101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.156706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.401027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:17.410250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:17.411843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:17.412985 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55eeade7-46cb-4e11-aa65-124d5e5ce1eb tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1406 microversion: 2.20 time: 0.288479 Nov 02 14:06:17.413774 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3029/4126] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:17 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:17.566448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:17.567030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:17.574045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.574526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.574956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.575693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.576203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.576614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.740971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:17.741684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:17.749442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.749942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.750377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.751120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.751581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.752355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.755285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:17.765072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9a2db8da-e4b2-44fa-b381-24dbbabe8cfe tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.203117 Nov 02 14:06:17.765743 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1098/4127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:17 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:17.821711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-499548493", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "c67836ff-58d9-4a08-a255-5b7eef7b5458"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:17.878744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] validate_networks() for [('c67836ff-58d9-4a08-a255-5b7eef7b5458', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:18.028841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:18.037436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-904cf08b-26aa-4978-a855-1a2023801e55 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1313 microversion: 2.1 time: 0.301063 Nov 02 14:06:18.038025 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3030/4128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:17 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:18.374731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:18.375309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:18.376013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:18.376447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:18.376967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:18.386214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.386700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.387162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.387912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.388369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.388901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.417500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Getting quotas for project eef504bfdf464c10a0f8d8a9732fd595. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:18.427481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Getting quotas for user cf3497b0d8954811b4682ec55d17488e and project eef504bfdf464c10a0f8d8a9732fd595. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:18.439479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:18.440958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:18.442713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:18.445089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:18.448708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.449418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.450024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.450869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.451493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.452064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.501502 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40260439-089b-4d9b-989c-4360105389e4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683820 Nov 02 14:06:18.502186 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1099/4129] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:06:18.515560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-85f64e8f-0f24-44c7-a90a-032c0f97a19d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:18.516426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-85f64e8f-0f24-44c7-a90a-032c0f97a19d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:18.617013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-85f64e8f-0f24-44c7-a90a-032c0f97a19d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:18.628374 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-85f64e8f-0f24-44c7-a90a-032c0f97a19d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1213 microversion: 2.1 time: 0.117658 Nov 02 14:06:18.629056 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1100/4130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:18 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:18.731772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:18.747928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:18.751509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:18.753576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74c3267b-945b-4744-89fb-3de9de0f51bf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1406 microversion: 2.20 time: 0.318642 Nov 02 14:06:18.755766 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3031/4131] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:18 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:18.790443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:18.791222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:18.813025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.824494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.825333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.826329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.827019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.827769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.888512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cf814eb6-7525-4fe7-ae2e-fbf6073898fd req-dddcbc2e-b557-46dd-955d-c4bbe3583d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635303a6-4b50-4f2a-9294-68cd6997c8c1", "name": "network-vif-plugged", "status": "completed", "tag": "427097c7-ae6e-4784-84ae-87440242fb37"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:18.908358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf814eb6-7525-4fe7-ae2e-fbf6073898fd req-dddcbc2e-b557-46dd-955d-c4bbe3583d82 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.910420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf814eb6-7525-4fe7-ae2e-fbf6073898fd req-dddcbc2e-b557-46dd-955d-c4bbe3583d82 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.911379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cf814eb6-7525-4fe7-ae2e-fbf6073898fd req-dddcbc2e-b557-46dd-955d-c4bbe3583d82 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.944090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cf814eb6-7525-4fe7-ae2e-fbf6073898fd req-dddcbc2e-b557-46dd-955d-c4bbe3583d82 service nova] Creating event network-vif-plugged:427097c7-ae6e-4784-84ae-87440242fb37 for instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 on n-h1-858238-3 Nov 02 14:06:18.953170 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cf814eb6-7525-4fe7-ae2e-fbf6073898fd req-dddcbc2e-b557-46dd-955d-c4bbe3583d82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069897 Nov 02 14:06:18.954096 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3032/4132] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:19.051893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:19.061900 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b9ec4c0b-64f5-4059-86db-b6b285329577 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.275565 Nov 02 14:06:19.062972 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1101/4133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:18 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:19.066390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:19.068466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:19.080090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.080704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.081143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.082063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.082997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.083722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.290288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:19.301388 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-024c0ec6-54eb-4dd5-a5ac-11add24fc841 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1313 microversion: 2.1 time: 0.242697 Nov 02 14:06:19.302240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3033/4134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:19 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:19.658163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:19.658818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:19.668053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.668681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.669119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.669832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.670281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.670707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.753265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:19.763365 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-34071a64-bd90-4b35-bf3a-c1f3c87e1f75 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1265 microversion: 2.1 time: 0.109986 Nov 02 14:06:19.763931 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1102/4135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:19 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:19.783731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:19.784365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:19.786499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:19.788411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=42 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:19.795076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.795586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.796017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.796785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.797291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.797686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.018007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.029541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.033065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.034638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ff4f23d-8b0a-45b2-a9b6-4d580f69f0e3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1406 microversion: 2.20 time: 0.255755 Nov 02 14:06:20.035597 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3034/4136] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:19 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:20.093839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:20.094613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:20.101142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.101881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.102604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.103463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.104021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.104636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.325960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:20.326899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:20.333232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.333983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.334573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.335509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.336133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.336724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.397675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.428891 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-496e6df2-56c0-48af-8ea1-af53fe8e2513 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.344192 Nov 02 14:06:20.443283 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1103/4137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:20 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:20.653068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.668047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-182f2afd-a981-42f5-8ad7-62feb9ac2770 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1313 microversion: 2.1 time: 0.345737 Nov 02 14:06:20.680800 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3035/4138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:20 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:20.787976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:20.788584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:20.802588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.803333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.803693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.804605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.805262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.805646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.918672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.927623 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cca0f1ee-9e88-4592-a8f1-606bb770cfab tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1271 microversion: 2.1 time: 0.143608 Nov 02 14:06:20.928538 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1104/4139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:20 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:20.986861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ab571c88-b751-4f4c-af23-9dea76e502b4 req-7ad62c09-4297-4e93-b217-de86ee2da751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "name": "network-vif-plugged", "status": "completed", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:21.006654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ab571c88-b751-4f4c-af23-9dea76e502b4 req-7ad62c09-4297-4e93-b217-de86ee2da751 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.007352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ab571c88-b751-4f4c-af23-9dea76e502b4 req-7ad62c09-4297-4e93-b217-de86ee2da751 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.007934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ab571c88-b751-4f4c-af23-9dea76e502b4 req-7ad62c09-4297-4e93-b217-de86ee2da751 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.024369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ab571c88-b751-4f4c-af23-9dea76e502b4 req-7ad62c09-4297-4e93-b217-de86ee2da751 service nova] Creating event network-vif-plugged:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h1-858238-3 Nov 02 14:06:21.030397 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ab571c88-b751-4f4c-af23-9dea76e502b4 req-7ad62c09-4297-4e93-b217-de86ee2da751 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053914 Nov 02 14:06:21.036717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3036/4140] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:21.060606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:21.061403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:21.075925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.076426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.076863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.086442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.088368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.088844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.234229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:21.236068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:21.251752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.253214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.254802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.255780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.256397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.256976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.661248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:21.669692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:21.672087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:21.673502 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-74cdc25f-01d7-42ce-a486-618fd29f93c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1406 microversion: 2.20 time: 0.617254 Nov 02 14:06:21.674155 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1105/4141] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:21 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:21.684508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:21.686068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:21.697152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:21.697337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.697781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.698221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.698942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.700164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.700549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.710932 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-457db5cd-ac28-4110-8ed0-79c10398c5f2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.484576 Nov 02 14:06:21.711595 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3037/4142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:21 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:21.724392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:21.725026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:21.742114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.742608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.743266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.747844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.748335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.748762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.061578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.070630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.072747 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e0d69050-cdd2-4674-b2f2-5a1ff9e127eb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.397231 Nov 02 14:06:22.073260 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1106/4143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:21 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:22.078264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.080139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:22.087334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-115d5213-9161-45a3-ba24-3ade0f01f781 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1497 microversion: 2.1 time: 0.374494 Nov 02 14:06:22.088523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.089340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.089770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.090470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.091076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.091723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.102259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3038/4144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:21 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1497 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:22.114544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.115193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:22.122710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.123499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.124010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.124770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.125259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.125683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.130446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:22.729015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.739035 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cad8f675-1351-4bb1-a328-7d410f5a7053 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.664349 Nov 02 14:06:22.739907 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1107/4145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:22.745541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cefec868-ac80-4d96-afb9-10ebdf308e3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.761640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.server_groups [None req-cefec868-ac80-4d96-afb9-10ebdf308e3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Querying cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) for 1 instances {{(pid=137558) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 14:06:22.762652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cefec868-ac80-4d96-afb9-10ebdf308e3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.763154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cefec868-ac80-4d96-afb9-10ebdf308e3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.763587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cefec868-ac80-4d96-afb9-10ebdf308e3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.777743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.783445 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cefec868-ac80-4d96-afb9-10ebdf308e3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/f333ee67-af86-4170-9721-719c558bdb2a" status: 200 len: 222 microversion: 2.1 time: 0.042186 Nov 02 14:06:22.788630 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0f4618ed-0381-40c1-8048-508acf97bf36 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.685100 Nov 02 14:06:22.790423 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1108/4146] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/os-server-groups/f333ee67-af86-4170-9721-719c558bdb2a => generated 222 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:22.797251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.798164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:22.804131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3039/4147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:22.805729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.806496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.807089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.807965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.808575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.809028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:22.809330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.809641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:22.820167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.820792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.821260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.822007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:22.822887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:22.824183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.140918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.143173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.153000 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee39558e-d7dc-4935-aea2-d04a55ef32d8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.347543 Nov 02 14:06:23.153646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3040/4148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:23.168562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.172191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.173521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.173866 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0eaf4a46-edcd-41d3-bf7f-9d48ea1a47f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1597 microversion: 2.20 time: 0.382014 Nov 02 14:06:23.174462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.181116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.181831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.182275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.183020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.183601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.184132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.191199 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1109/4149] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:22 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1597 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:23.196163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.197354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.210850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.211560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.212142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.213024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.213625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.213748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:06:23.214320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.236042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:23.325846 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-858501a8-ec36-44a6-baa5-96f17f1a4822 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 204 len: 0 microversion: 2.1 time: 0.170332 Nov 02 14:06:23.326791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3041/4150] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:06:23 2022] DELETE /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:06:23.332507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.333562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.339665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.340135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.340576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.341280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.341917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.342345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.478742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.492107 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e99d5c6-3b59-4bf3-9ccf-537879d15a60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.299736 Nov 02 14:06:23.492693 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1110/4151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:23 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:23.502309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.504161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.513634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.514699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.515402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.516178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.516846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.517475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.651496 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-878e6da4-5aa1-4b90-8ca5-b68166528d8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.154923 Nov 02 14:06:23.652495 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1111/4152] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 14:06:23 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:06:23.666354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.667178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.674218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.674835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.675369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.676122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.676640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.677144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.705160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.716535 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eda33f31-ea36-4515-9682-95a08d020b5a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.388149 Nov 02 14:06:23.718533 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3042/4153] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:23 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:23.736314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0e8dbb9a-1e12-4dd6-a724-9eb4f6fbd1fb req-09f037d4-3290-4221-a5f2-dc0e2ffb5274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174bc333-dc14-4152-865e-4fb4e13e044d", "tag": "91dc6dbf-5845-4101-9d7f-9c0e5457795a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:23.751363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e8dbb9a-1e12-4dd6-a724-9eb4f6fbd1fb req-09f037d4-3290-4221-a5f2-dc0e2ffb5274 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.752269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e8dbb9a-1e12-4dd6-a724-9eb4f6fbd1fb req-09f037d4-3290-4221-a5f2-dc0e2ffb5274 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.752705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0e8dbb9a-1e12-4dd6-a724-9eb4f6fbd1fb req-09f037d4-3290-4221-a5f2-dc0e2ffb5274 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.766474 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0e8dbb9a-1e12-4dd6-a724-9eb4f6fbd1fb req-09f037d4-3290-4221-a5f2-dc0e2ffb5274 service nova] Creating event network-changed:91dc6dbf-5845-4101-9d7f-9c0e5457795a for instance 174bc333-dc14-4152-865e-4fb4e13e044d on n-h2-858238-3 Nov 02 14:06:23.783303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0e8dbb9a-1e12-4dd6-a724-9eb4f6fbd1fb req-09f037d4-3290-4221-a5f2-dc0e2ffb5274 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063317 Nov 02 14:06:23.784168 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3043/4154] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:23.821605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.822903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.834305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.835628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.837020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.838934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.849201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.849950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.052859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:24.061969 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d037f3cd-c6ee-4ef8-a8b9-eeb00bd0bd3d tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1503 microversion: 2.1 time: 0.406910 Nov 02 14:06:24.078830 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1112/4155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:23 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:24.084072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1343891267", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f846ebbf-8ebf-4f30-afa6-7c615971cecb"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:24.146870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] validate_networks() for [('f846ebbf-8ebf-4f30-afa6-7c615971cecb', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:24.249938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:24.260926 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4e27adb6-a4fc-45fb-a85a-8492be3d4be3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.444075 Nov 02 14:06:24.262577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3044/4156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:23 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:24.522569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.523910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:24.530867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.532542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.533531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.534528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.535224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.536066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.814893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:24.827210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfd634db-3195-4d87-b7c8-53788e7a2d2a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.314547 Nov 02 14:06:24.828555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3045/4157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:24 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:24.841039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:24.848434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:24.848434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:24.848434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:24.848434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:24.857621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.858102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.859084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.861293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.861760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.862202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.882304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:24.889469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for user 53bef65bfa79486a8f0180f2f86eddba and project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:24.904703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:24.906925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:24.960923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1360f8a-6db9-47da-b0b3-b62cec422b8f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880566 Nov 02 14:06:24.961942 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1113/4158] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:06:24.975185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b5934ea-82be-438c-9322-7b5e6222e7b8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.976104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b5934ea-82be-438c-9322-7b5e6222e7b8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:25.070318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b5934ea-82be-438c-9322-7b5e6222e7b8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:25.083899 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b5934ea-82be-438c-9322-7b5e6222e7b8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1215 microversion: 2.1 time: 0.114217 Nov 02 14:06:25.086101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:25.087302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:25.088154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3046/4159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:24 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:25.098140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.099111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.099549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.100884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.101537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.102135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.289507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:25.290433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:25.310596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.312560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.315064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.321165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.322009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.323612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.330056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:25.339916 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b89af548-a561-4a15-90a9-48568a634d66 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1503 microversion: 2.1 time: 0.257546 Nov 02 14:06:25.341432 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1114/4160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:25 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:25.411947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e112fc65-f7dd-4da7-a6e4-05b809c01ff6 req-c5148e4d-e24e-4d31-9255-7b4e94a58255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:25.437138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e112fc65-f7dd-4da7-a6e4-05b809c01ff6 req-c5148e4d-e24e-4d31-9255-7b4e94a58255 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.438502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e112fc65-f7dd-4da7-a6e4-05b809c01ff6 req-c5148e4d-e24e-4d31-9255-7b4e94a58255 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.439515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e112fc65-f7dd-4da7-a6e4-05b809c01ff6 req-c5148e4d-e24e-4d31-9255-7b4e94a58255 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.464944 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e112fc65-f7dd-4da7-a6e4-05b809c01ff6 req-c5148e4d-e24e-4d31-9255-7b4e94a58255 service nova] Creating event network-changed:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h1-858238-3 Nov 02 14:06:25.479624 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e112fc65-f7dd-4da7-a6e4-05b809c01ff6 req-c5148e4d-e24e-4d31-9255-7b4e94a58255 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080601 Nov 02 14:06:25.482165 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1115/4161] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:25.727162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:25.735970 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-145b8447-04e0-4861-9862-8d1822dcef53 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.454270 Nov 02 14:06:25.751137 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3047/4162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:25 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:25.856013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:25.856726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:25.867716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.868202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.868634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.872125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.879530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.879984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.111455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:26.112378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:26.129003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.129823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.130783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.131761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.132456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.134104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.237128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:26.248405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1676abfe-a301-480f-90c9-ff784b62a9b6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1267 microversion: 2.1 time: 0.142501 Nov 02 14:06:26.250573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3048/4163] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:26 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:26.373798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:26.375028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:26.381257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.381742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.382172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.382885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.383366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.383827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.434927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.435446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.435876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.436324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lazy-loading 'fault' on Instance uuid 635303a6-4b50-4f2a-9294-68cd6997c8c1 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:06:26.554088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:26.566542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627941d120f149329e6643891ce7326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b58d111d9564d2a928f4583e9cbbe81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:26.580902 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5edb488-b595-4a14-8409-2a197b52634c tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 200 len: 1303 microversion: 2.1 time: 0.210878 Nov 02 14:06:26.581535 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3049/4164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:26 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:26.585771 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-72f70ec3-d124-4690-a175-c1808a503b0f tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.733763 Nov 02 14:06:26.586736 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1116/4165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:25 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:26.764034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:26.764752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:26.777329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.778058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.778743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.779744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.780310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.781381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.274127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.274809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:27.284187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.285016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.285844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.286801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.287618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.288335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.625525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:27.644463 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ebfdd10-60c6-48b1-8e20-d3335423ff54 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.884839 Nov 02 14:06:27.645063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3050/4166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:26 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:27.649864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-5e919c02-cbc9-4ad5-b97b-31963055f68c req-826f768a-b497-4e76-8012-01b1e7bb9d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635303a6-4b50-4f2a-9294-68cd6997c8c1", "name": "network-vif-deleted", "tag": "427097c7-ae6e-4784-84ae-87440242fb37"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:27.669792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5e919c02-cbc9-4ad5-b97b-31963055f68c req-826f768a-b497-4e76-8012-01b1e7bb9d9c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.673987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5e919c02-cbc9-4ad5-b97b-31963055f68c req-826f768a-b497-4e76-8012-01b1e7bb9d9c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.674600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-5e919c02-cbc9-4ad5-b97b-31963055f68c req-826f768a-b497-4e76-8012-01b1e7bb9d9c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.690308 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-5e919c02-cbc9-4ad5-b97b-31963055f68c req-826f768a-b497-4e76-8012-01b1e7bb9d9c service nova] Creating event network-vif-deleted:427097c7-ae6e-4784-84ae-87440242fb37 for instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 on n-h1-858238-3 Nov 02 14:06:27.696483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-5e919c02-cbc9-4ad5-b97b-31963055f68c req-826f768a-b497-4e76-8012-01b1e7bb9d9c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050010 Nov 02 14:06:27.697903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3051/4167] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:27.704917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.705731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:27.712421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.713045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.713724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.714528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.715233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.715757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.731189 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 HTTP/1.1 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '635303a6-4b50-4f2a-9294-68cd6997c8c1'} Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:27.733297 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83409406-5156-432f-9fdf-794cf201987a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 404 len: 111 microversion: 2.1 time: 0.036082 Nov 02 14:06:27.742063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3052/4168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:27 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:27.747221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.747933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:27.754896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.755972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.756568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.757480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.758021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.758451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.869418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:27.878611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47613fa8-cfd3-473d-ac35-6c6a177e7ef1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.608573 Nov 02 14:06:27.894140 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1117/4169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:27 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:27.899298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d89df773-cada-436e-abe7-fdbf66a6b434 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.914719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.server_groups [None req-d89df773-cada-436e-abe7-fdbf66a6b434 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Querying cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) for 1 instances {{(pid=137558) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 14:06:27.915752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d89df773-cada-436e-abe7-fdbf66a6b434 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.916201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d89df773-cada-436e-abe7-fdbf66a6b434 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.916630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d89df773-cada-436e-abe7-fdbf66a6b434 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.928739 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d89df773-cada-436e-abe7-fdbf66a6b434 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033004 Nov 02 14:06:27.929416 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1118/4170] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:06:27 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:27.941714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d13afe27-4e9c-4204-ab98-9f3ef909c602 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.956177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.server_groups [None req-d13afe27-4e9c-4204-ab98-9f3ef909c602 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Querying cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) for 1 instances {{(pid=137558) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 14:06:27.957160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d13afe27-4e9c-4204-ab98-9f3ef909c602 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.957708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d13afe27-4e9c-4204-ab98-9f3ef909c602 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.958214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d13afe27-4e9c-4204-ab98-9f3ef909c602 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.970087 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d13afe27-4e9c-4204-ab98-9f3ef909c602 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/f333ee67-af86-4170-9721-719c558bdb2a" status: 200 len: 184 microversion: 2.1 time: 0.033061 Nov 02 14:06:27.971613 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1119/4171] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 14:06:27 2022] GET /compute/v2.1/os-server-groups/f333ee67-af86-4170-9721-719c558bdb2a => generated 184 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:27.985108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.986194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:27.993509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.994364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.995007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.995958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.996704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.997340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.016619 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 HTTP/1.1 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '635303a6-4b50-4f2a-9294-68cd6997c8c1'} Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:28.018232 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d786cd1-2a7a-479a-861f-17e07b3456cc tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 404 len: 111 microversion: 2.1 time: 0.040668 Nov 02 14:06:28.024338 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1120/4172] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:06:27 2022] DELETE /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:06:28.027875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:28.030097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.031375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] [instance: 635303a6-4b50-4f2a-9294-68cd6997c8c1] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:28.037395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.037996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.038379 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d9aef3c-2736-419a-9ba8-f464aec38020 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.296732 Nov 02 14:06:28.038591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.039405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.039826 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3053/4173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:27 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:28.044895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.044895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.057197 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 HTTP/1.1 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '635303a6-4b50-4f2a-9294-68cd6997c8c1'} Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.058916 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance 635303a6-4b50-4f2a-9294-68cd6997c8c1 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-560f94d2-1eae-44f2-9b12-16cebe2cd64e tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1" status: 404 len: 111 microversion: 2.1 time: 0.034240 Nov 02 14:06:28.064456 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1121/4174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:28 2022] GET /compute/v2.1/servers/635303a6-4b50-4f2a-9294-68cd6997c8c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:28.069727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-492124cf-abd4-4995-a636-d3828bd27399 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.076472 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-492124cf-abd4-4995-a636-d3828bd27399 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance group 4a4d3f60-18e0-4a58-a54b-a17c19f12e29 could not be found. Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-492124cf-abd4-4995-a636-d3828bd27399 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-server-groups/4a4d3f60-18e0-4a58-a54b-a17c19f12e29 HTTP/1.1 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance group 4a4d3f60-18e0-4a58-a54b-a17c19f12e29 could not be found. Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '4a4d3f60-18e0-4a58-a54b-a17c19f12e29'} Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4a4d3f60-18e0-4a58-a54b-a17c19f12e29 could not be found. Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4a4d3f60-18e0-4a58-a54b-a17c19f12e29 could not be found. Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.117114 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4a4d3f60-18e0-4a58-a54b-a17c19f12e29 could not be found. Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-492124cf-abd4-4995-a636-d3828bd27399 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance group 4a4d3f60-18e0-4a58-a54b-a17c19f12e29 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:28.122074 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-492124cf-abd4-4995-a636-d3828bd27399 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/4a4d3f60-18e0-4a58-a54b-a17c19f12e29" status: 404 len: 117 microversion: 2.1 time: 0.055534 Nov 02 14:06:28.122836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3054/4175] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:28 2022] DELETE /compute/v2.1/os-server-groups/4a4d3f60-18e0-4a58-a54b-a17c19f12e29 => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:28.130720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-067c011d-8fc2-4bb5-8cbf-a08b6b90ffd2 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.137387 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-067c011d-8fc2-4bb5-8cbf-a08b6b90ffd2 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance group 8678aac7-901b-4305-8e76-cb5ffb8d5b87 could not be found. Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-067c011d-8fc2-4bb5-8cbf-a08b6b90ffd2 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/os-server-groups/8678aac7-901b-4305-8e76-cb5ffb8d5b87 HTTP/1.1 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance group 8678aac7-901b-4305-8e76-cb5ffb8d5b87 could not be found. Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '8678aac7-901b-4305-8e76-cb5ffb8d5b87'} Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8678aac7-901b-4305-8e76-cb5ffb8d5b87 could not be found. Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8678aac7-901b-4305-8e76-cb5ffb8d5b87 could not be found. Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.145137 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8678aac7-901b-4305-8e76-cb5ffb8d5b87 could not be found. Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-067c011d-8fc2-4bb5-8cbf-a08b6b90ffd2 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance group 8678aac7-901b-4305-8e76-cb5ffb8d5b87 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-067c011d-8fc2-4bb5-8cbf-a08b6b90ffd2 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/8678aac7-901b-4305-8e76-cb5ffb8d5b87" status: 404 len: 117 microversion: 2.1 time: 0.020103 Nov 02 14:06:28.150962 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1122/4176] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:28 2022] DELETE /compute/v2.1/os-server-groups/8678aac7-901b-4305-8e76-cb5ffb8d5b87 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:28.156715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26cd41af-c4fa-45ab-84a1-b5236cab02c4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.163876 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-26cd41af-c4fa-45ab-84a1-b5236cab02c4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance group 93a30e05-e1e0-4635-8b1f-414d83e7725f could not be found. Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26cd41af-c4fa-45ab-84a1-b5236cab02c4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/os-server-groups/93a30e05-e1e0-4635-8b1f-414d83e7725f HTTP/1.1 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance group 93a30e05-e1e0-4635-8b1f-414d83e7725f could not be found. Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '93a30e05-e1e0-4635-8b1f-414d83e7725f'} Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 93a30e05-e1e0-4635-8b1f-414d83e7725f could not be found. Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 93a30e05-e1e0-4635-8b1f-414d83e7725f could not be found. Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.165469 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 93a30e05-e1e0-4635-8b1f-414d83e7725f could not be found. Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26cd41af-c4fa-45ab-84a1-b5236cab02c4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance group 93a30e05-e1e0-4635-8b1f-414d83e7725f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26cd41af-c4fa-45ab-84a1-b5236cab02c4 tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/93a30e05-e1e0-4635-8b1f-414d83e7725f" status: 404 len: 117 microversion: 2.1 time: 0.015827 Nov 02 14:06:28.170642 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3055/4177] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:28 2022] DELETE /compute/v2.1/os-server-groups/93a30e05-e1e0-4635-8b1f-414d83e7725f => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:06:28.178392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aecc6455-86eb-4cbf-941a-c0684082853a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.180690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:28.188078 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-aecc6455-86eb-4cbf-941a-c0684082853a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] HTTP exception thrown: Instance group 2e5755ec-1be2-44a8-9418-a1a454a13616 could not be found. Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aecc6455-86eb-4cbf-941a-c0684082853a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Request method failure captured: Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/os-server-groups/2e5755ec-1be2-44a8-9418-a1a454a13616 HTTP/1.1 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnlO5_K12na4FF4nvzjlZNrIjxIT2MdQigytaeK6udjwTBhbtVCeivPpzacRYSJZedOpWtiInrFPJVdXuxCV9mkpOcI6zsFc58_Zh-b63trDAprA5bh2qtPL4ixNa4XBG-0ZHUK6bRjfKd1Ku6-PUCwYpaDnxf1yNelrCKSX7qo4_vg Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5b58d111d9564d2a928f4583e9cbbe81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5b58d111d9564d2a928f4583e9cbbe81"}]}] Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5b58d111d9564d2a928f4583e9cbbe81 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerGroupTestJSON-139522654 Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 627941d120f149329e6643891ce7326a Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerGroupTestJSON-139522654-project Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance group 2e5755ec-1be2-44a8-9418-a1a454a13616 could not be found. Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2e5755ec-1be2-44a8-9418-a1a454a13616'} Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2e5755ec-1be2-44a8-9418-a1a454a13616 could not be found. Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2e5755ec-1be2-44a8-9418-a1a454a13616 could not be found. Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.189666 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2e5755ec-1be2-44a8-9418-a1a454a13616 could not be found. Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aecc6455-86eb-4cbf-941a-c0684082853a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Returning 404 to user: Instance group 2e5755ec-1be2-44a8-9418-a1a454a13616 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aecc6455-86eb-4cbf-941a-c0684082853a tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/2e5755ec-1be2-44a8-9418-a1a454a13616" status: 404 len: 117 microversion: 2.1 time: 0.016968 Nov 02 14:06:28.194446 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1123/4178] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:28 2022] DELETE /compute/v2.1/os-server-groups/2e5755ec-1be2-44a8-9418-a1a454a13616 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:28.201383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-909d9f04-41a6-44e5-b5a8-90faa5359bec tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.227525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-909d9f04-41a6-44e5-b5a8-90faa5359bec tempest-ServerGroupTestJSON-139522654 tempest-ServerGroupTestJSON-139522654-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/f333ee67-af86-4170-9721-719c558bdb2a" status: 204 len: 0 microversion: 2.1 time: 0.030025 Nov 02 14:06:28.228133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3056/4179] 10.222.0.18 () {58 vars in 1266 bytes} [Wed Nov 2 14:06:28 2022] DELETE /compute/v2.1/os-server-groups/f333ee67-af86-4170-9721-719c558bdb2a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:06:28.668442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.669054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:28.676706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.677458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.677890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.678815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.679647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.679768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.908094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.911162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:28.921394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.921568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:28.922638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.923337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.924418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.925080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.925740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.932239 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b9c14e36-d729-41c9-b6b0-af5c2f958cbc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.268172 Nov 02 14:06:28.932824 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1124/4180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:28 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:29.067452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:29.068076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:29.074731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.075499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.075926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:29.076790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.078013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.078599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:29.190921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:29.200056 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dbec9b9f-945b-4a45-a73d-ea18aea548c2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.301380 Nov 02 14:06:29.200717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3057/4181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:28 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:29.365939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:29.385877 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-78947fcf-e83e-466e-ab26-1f4954eb1669 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.321652 Nov 02 14:06:29.388653 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1125/4182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:29 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:29.743656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c722f7b2-1a3f-4e64-9c3c-171dc0dfba98 req-4e27ccd2-ebf5-408c-b735-acd2735ba3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993beae9-f515-42d1-aee4-da8abb40512d", "tag": "9653e393-b388-4d57-aac3-af97e267c746"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:29.754860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c722f7b2-1a3f-4e64-9c3c-171dc0dfba98 req-4e27ccd2-ebf5-408c-b735-acd2735ba3f4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.755690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c722f7b2-1a3f-4e64-9c3c-171dc0dfba98 req-4e27ccd2-ebf5-408c-b735-acd2735ba3f4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.756311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c722f7b2-1a3f-4e64-9c3c-171dc0dfba98 req-4e27ccd2-ebf5-408c-b735-acd2735ba3f4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:29.769682 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c722f7b2-1a3f-4e64-9c3c-171dc0dfba98 req-4e27ccd2-ebf5-408c-b735-acd2735ba3f4 service nova] Creating event network-changed:9653e393-b388-4d57-aac3-af97e267c746 for instance 993beae9-f515-42d1-aee4-da8abb40512d on n-h2-858238-3 Nov 02 14:06:29.778140 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c722f7b2-1a3f-4e64-9c3c-171dc0dfba98 req-4e27ccd2-ebf5-408c-b735-acd2735ba3f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036872 Nov 02 14:06:29.782853 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3058/4183] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:29.957372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:29.957915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:29.964892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.965377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.965808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:29.966499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.966944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.967400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.228571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:30.229399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:30.238089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:30.238610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:30.239017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.240014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:30.240712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:30.241204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.251511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:30.260229 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8fb220e2-a7e5-48c7-97f8-7bbad38d94dc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.306838 Nov 02 14:06:30.261384 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1126/4184] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:29 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:30.429352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:30.429982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:30.438660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:30.439204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:30.443038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.443861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:30.444381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:30.444820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.625527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:30.637244 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a90a7f61-4b0d-4efd-b7ed-58e265503e65 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.416392 Nov 02 14:06:30.640863 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3059/4185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:30 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:30.790949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:30.806189 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ec7f0b7-83cc-4743-8015-7bfccb23d5df tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.394422 Nov 02 14:06:30.820022 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1127/4186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:30 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:31.054041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7321e149-db7a-4061-b3a1-4972cbea46f5 req-b5e65ab5-f6c7-41a3-a7a8-37be2430281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174bc333-dc14-4152-865e-4fb4e13e044d", "name": "network-vif-plugged", "status": "completed", "tag": "91dc6dbf-5845-4101-9d7f-9c0e5457795a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:31.075755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7321e149-db7a-4061-b3a1-4972cbea46f5 req-b5e65ab5-f6c7-41a3-a7a8-37be2430281e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.076259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7321e149-db7a-4061-b3a1-4972cbea46f5 req-b5e65ab5-f6c7-41a3-a7a8-37be2430281e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.076682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7321e149-db7a-4061-b3a1-4972cbea46f5 req-b5e65ab5-f6c7-41a3-a7a8-37be2430281e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.111643 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7321e149-db7a-4061-b3a1-4972cbea46f5 req-b5e65ab5-f6c7-41a3-a7a8-37be2430281e service nova] Creating event network-vif-plugged:91dc6dbf-5845-4101-9d7f-9c0e5457795a for instance 174bc333-dc14-4152-865e-4fb4e13e044d on n-h2-858238-3 Nov 02 14:06:31.117050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7321e149-db7a-4061-b3a1-4972cbea46f5 req-b5e65ab5-f6c7-41a3-a7a8-37be2430281e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066850 Nov 02 14:06:31.118343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3060/4187] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:31.284076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:31.297375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:31.315541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.318541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.322251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.324976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.325818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.327849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.587524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:31.598415 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2e6196a5-2fce-42ee-93f0-dba67d647e87 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.318273 Nov 02 14:06:31.599616 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1128/4188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:31 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:31.665526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:31.666399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:31.673271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.673908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.674438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.675431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.676014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.676537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.682047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:31.832251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:31.833286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:31.840709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.841230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.841755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.842830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.843455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.843976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.942970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:31.953284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4dd770b2-7710-4ae3-ba2f-059126bec60f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.292314 Nov 02 14:06:31.964635 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3061/4189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:31 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:32.055507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:32.068022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2ec8b6a2-a7ac-41bc-aee3-5a1f6ddb1232 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.240299 Nov 02 14:06:32.076587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1129/4190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:31 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:32.621808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:32.622850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:32.656143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:32.659279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:32.661499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:32.662582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:32.663045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:32.663500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:32.977341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:32.977965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:32.984776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:32.985336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:32.985865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:32.986557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:32.987009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:32.995762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:33.340139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:33.348277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9081d1fd-306e-46e7-95aa-a4f93d50a5d9 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1313 microversion: 2.1 time: 0.730558 Nov 02 14:06:33.348912 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3062/4191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:32 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:33.366448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:33.367976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:33.377149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:33.378174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:33.379073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:33.380781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:33.381600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:33.382472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:33.564040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:33.583371 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfc4976b-09dd-40b4-bdb2-99eefcef75a2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.607532 Nov 02 14:06:33.599438 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1130/4192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:32 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:33.663043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:33.672365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4cf72931-4eca-486f-b26e-1de4b38c1ff2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1722 microversion: 2.1 time: 0.314981 Nov 02 14:06:33.673148 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3063/4193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:33 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:34.379326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:34.380462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:34.388546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:34.389288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:34.390643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:34.392078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:34.392641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:34.393183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:34.612228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:34.622822 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2065a46b-9a8a-4a63-9eaa-7fb4164a6f11 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1498 microversion: 2.1 time: 0.253209 Nov 02 14:06:34.635607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:34.635607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:34.637140 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1131/4194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:34 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:34.643653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:34.644582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:34.645420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:34.646644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:34.648162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:34.649494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:34.698439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:34.699067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:34.710143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:34.710648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:34.711084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:34.711819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:34.713695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:34.715959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:34.871798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:34.898549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=40 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:34.961881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:34.970529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0b3e551-f9f6-4e15-a2af-92dd18569c88 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.353501 Nov 02 14:06:34.971128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3064/4195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:34 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:35.016712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1d6eeff4-8a8b-4cbc-b5d6-c20747a8c819 req-9509fe70-b696-4d27-9f23-27c03308e850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993beae9-f515-42d1-aee4-da8abb40512d", "name": "network-vif-plugged", "status": "completed", "tag": "9653e393-b388-4d57-aac3-af97e267c746"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:35.041856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1d6eeff4-8a8b-4cbc-b5d6-c20747a8c819 req-9509fe70-b696-4d27-9f23-27c03308e850 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.042357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1d6eeff4-8a8b-4cbc-b5d6-c20747a8c819 req-9509fe70-b696-4d27-9f23-27c03308e850 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.042846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1d6eeff4-8a8b-4cbc-b5d6-c20747a8c819 req-9509fe70-b696-4d27-9f23-27c03308e850 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.045056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:35.057537 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45ebb7ea-9bd2-43b9-b1c1-8318774d3acb tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1699 microversion: 2.1 time: 0.362854 Nov 02 14:06:35.059295 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1132/4196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:34 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1699 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:35.079729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:35.084842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1d6eeff4-8a8b-4cbc-b5d6-c20747a8c819 req-9509fe70-b696-4d27-9f23-27c03308e850 service nova] Creating event network-vif-plugged:9653e393-b388-4d57-aac3-af97e267c746 for instance 993beae9-f515-42d1-aee4-da8abb40512d on n-h2-858238-3 Nov 02 14:06:35.090490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f2b8c14-9085-4432-b96f-2e90a9c5e609 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:35.100925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c14-9085-4432-b96f-2e90a9c5e609 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.101270 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1d6eeff4-8a8b-4cbc-b5d6-c20747a8c819 req-9509fe70-b696-4d27-9f23-27c03308e850 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096808 Nov 02 14:06:35.101884 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3065/4197] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:35.102162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c14-9085-4432-b96f-2e90a9c5e609 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.102832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2b8c14-9085-4432-b96f-2e90a9c5e609 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.183366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:35.193854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f2b8c14-9085-4432-b96f-2e90a9c5e609 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Going to try to start instance {{(pid=137558) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:06:35.263496 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f2b8c14-9085-4432-b96f-2e90a9c5e609 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action" status: 202 len: 0 microversion: 2.1 time: 0.179137 Nov 02 14:06:35.268084 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1133/4198] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:06:35 2022] POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:06:35.272097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:35.273005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:35.282778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:35.284316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:35.286455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.286954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.287437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.288213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.291361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.291914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.292354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.292851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.293282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.294143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.294875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.295512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.351122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:06:35.479219 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e81ac148-e38e-42dc-aab6-6ab1a8fad284 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "DELETE /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 204 len: 0 microversion: 2.1 time: 0.211359 Nov 02 14:06:35.480398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3066/4199] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:06:35 2022] DELETE /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:06:35.492145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:35.492861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:35.496313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:35.501581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.502249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.502681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.503477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.503920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.504515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.789781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:35.799398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0a3487f8-e2f7-42ff-a20c-278df32bc960 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1708 microversion: 2.1 time: 0.529480 Nov 02 14:06:35.799998 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1134/4200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:35 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1708 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:35.921353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:35.931377 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83beab76-9413-4e41-9382-3f8caa946c5f tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1504 microversion: 2.1 time: 0.445481 Nov 02 14:06:35.941664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-939172359", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:35.942481 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3067/4201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:35 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:35.997200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:35.998171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:36.004550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:36.005088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.005481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:36.005598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.006006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.006686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:36.006802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.007204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.007634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.007964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:36.008386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:36.019735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.020347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.020797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.021520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.022324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.022757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.043026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Getting quotas for project d45a553706284719bc495d91f7fd7c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:36.049149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Getting quotas for user 317c830b25e64d25b558cb6b88a42558 and project d45a553706284719bc495d91f7fd7c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:36.064113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:36.066667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:36.128817 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2888a160-e1e5-4755-8392-9dde520bf9f8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.327342 Nov 02 14:06:36.129799 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1135/4202] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:06:36.143549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-43468ea2-871c-46f7-9f96-1cfe1cc8173b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:36.144180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-43468ea2-871c-46f7-9f96-1cfe1cc8173b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:36.280129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-43468ea2-871c-46f7-9f96-1cfe1cc8173b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:36.300279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-43468ea2-871c-46f7-9f96-1cfe1cc8173b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:36.302427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-43468ea2-871c-46f7-9f96-1cfe1cc8173b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:36.303644 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-43468ea2-871c-46f7-9f96-1cfe1cc8173b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1277 microversion: 2.54 time: 0.165012 Nov 02 14:06:36.304246 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1136/4203] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:36 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:36.369993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:36.380181 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ad2100d-b783-413d-9bd8-167dfdc2afc6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.389275 Nov 02 14:06:36.381329 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3068/4204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:35 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:36.840450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:36.842465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:36.850660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.851229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.851667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.852678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.853326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.853979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.957920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:36.962379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:36.977149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.986793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.987305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:36.992286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:36.994343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:36.994992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:37.068829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:37.078185 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b62814d-6e8b-477a-b82a-e68d2742bef8 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1708 microversion: 2.1 time: 0.243006 Nov 02 14:06:37.079280 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1137/4205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:36 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1708 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:37.177995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:37.186274 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea4e9215-52b0-4bcf-8587-e3d456433be1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1504 microversion: 2.1 time: 0.234854 Nov 02 14:06:37.186906 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3069/4206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:36 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:37.334368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:37.335068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:37.342437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:37.342811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:37.345255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:37.346402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:37.347035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:37.347640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:37.414594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:37.415618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:37.438265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:37.439229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:37.440289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:37.441482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:37.442912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:37.443976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:37.444895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:37.458854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:37.462550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:37.465330 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a50e74e5-ec9b-48e4-9ca4-a5c708af0767 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1329 microversion: 2.54 time: 0.134506 Nov 02 14:06:37.466656 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1138/4207] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:37 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1329 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:37.628998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:37.638175 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45b87e17-9269-4a4e-b9d8-8a970dfff97f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1315 microversion: 2.1 time: 0.235404 Nov 02 14:06:37.639401 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3070/4208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:37 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:38.104108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:38.104727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:38.111571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.112053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.112511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.113197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.113654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.114092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.210081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:38.212006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:38.225778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.226254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.227183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.228253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.228916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.229669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.266783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:38.280154 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4f787c4c-56b6-4443-818e-b191a6fca619 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1712 microversion: 2.1 time: 0.179794 Nov 02 14:06:38.281215 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1139/4209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:38 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1712 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:38.333655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:38.342335 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9d357a9-deed-46d8-89e8-df8ea95b456d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 200 len: 1462 microversion: 2.1 time: 0.136516 Nov 02 14:06:38.343581 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3071/4210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:38 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:38.399284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-42c65d26-f5ce-40ac-bd27-3c27f42e1f9a req-1f02324a-e838-4188-b654-1ca900e37b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174bc333-dc14-4152-865e-4fb4e13e044d", "name": "network-vif-deleted", "tag": "91dc6dbf-5845-4101-9d7f-9c0e5457795a"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:38.413332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-42c65d26-f5ce-40ac-bd27-3c27f42e1f9a req-1f02324a-e838-4188-b654-1ca900e37b64 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.413819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-42c65d26-f5ce-40ac-bd27-3c27f42e1f9a req-1f02324a-e838-4188-b654-1ca900e37b64 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.414251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-42c65d26-f5ce-40ac-bd27-3c27f42e1f9a req-1f02324a-e838-4188-b654-1ca900e37b64 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.430190 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-42c65d26-f5ce-40ac-bd27-3c27f42e1f9a req-1f02324a-e838-4188-b654-1ca900e37b64 service nova] Creating event network-vif-deleted:91dc6dbf-5845-4101-9d7f-9c0e5457795a for instance 174bc333-dc14-4152-865e-4fb4e13e044d on n-h2-858238-3 Nov 02 14:06:38.438592 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-42c65d26-f5ce-40ac-bd27-3c27f42e1f9a req-1f02324a-e838-4188-b654-1ca900e37b64 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044238 Nov 02 14:06:38.440715 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1140/4211] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:38.507032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:38.507842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:38.516045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.516633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.517228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.517995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.518454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.518876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.601810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:38.612920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:38.614579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:38.615770 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b246519-485d-4b07-865a-e554a5c35130 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1335 microversion: 2.54 time: 0.113243 Nov 02 14:06:38.616353 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3072/4212] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:38 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:38.663065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:38.663807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:38.670360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.670854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.671888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.672598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.673060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.673487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.834005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:38.842632 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-94dbf40c-1b02-49aa-bbd5-c30e58988bf3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1502 microversion: 2.1 time: 0.183475 Nov 02 14:06:38.844148 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1141/4213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:38 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:38.867046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:38.867743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:38.874241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.875202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.876834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:38.876834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:38.876834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:38.877343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.027289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Removing security group 6f64e62a-5020-494a-9bbc-5c6ca90451c0 from port 9653e393-b388-4d57-aac3-af97e267c746 Nov 02 14:06:39.367309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:39.367916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 174bc333-dc14-4152-865e-4fb4e13e044d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:39.376557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.377077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.377522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.378316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.379271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.380073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.398892 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] HTTP exception thrown: Instance 174bc333-dc14-4152-865e-4fb4e13e044d could not be found. Nov 02 14:06:39.401813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dc20da1d-9679-4122-9c79-8d9c4e0d17cd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d/action" status: 202 len: 0 microversion: 2.1 time: 0.538630 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Request method failure captured: Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d HTTP/1.1 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnlXGkTMBabs-g2Dm2imwjzwrvBCoxCA-ymqY8ql8D4iR4inPGnNtE_shSE8Wg9apYwc_CQ8AplC2g5pSBXEXwpQ9s7xv1BLsp_RXAF2nYgqM6XFz2kR2VfMPTiRKI3o2RDDnoi-BTJO0KGrWGdw_nozN6hIwaPDZ7Ji7CkxYOP16Co Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eef504bfdf464c10a0f8d8a9732fd595 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-VolumesActionsTest-47994958 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eef504bfdf464c10a0f8d8a9732fd595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eef504bfdf464c10a0f8d8a9732fd595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eef504bfdf464c10a0f8d8a9732fd595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eef504bfdf464c10a0f8d8a9732fd595"}]}] Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-VolumesActionsTest-47994958 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eef504bfdf464c10a0f8d8a9732fd595 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-VolumesActionsTest-47994958 Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-VolumesActionsTest-47994958-project Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: cf3497b0d8954811b4682ec55d17488e Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-VolumesActionsTest-47994958-project Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 174bc333-dc14-4152-865e-4fb4e13e044d could not be found. Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '174bc333-dc14-4152-865e-4fb4e13e044d'} Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174bc333-dc14-4152-865e-4fb4e13e044d could not be found. Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174bc333-dc14-4152-865e-4fb4e13e044d could not be found. Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:39.402385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174bc333-dc14-4152-865e-4fb4e13e044d could not be found. Nov 02 14:06:39.409172 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:06:39.410464 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3073/4214] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:06:38 2022] POST /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:06:39.412768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Returning 404 to user: Instance 174bc333-dc14-4152-865e-4fb4e13e044d could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:39.413637 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-64c2f8cf-5758-4e84-80ee-39f898839ae3 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d" status: 404 len: 111 microversion: 2.1 time: 0.050527 Nov 02 14:06:39.414554 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1142/4215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:39 2022] GET /compute/v2.1/servers/174bc333-dc14-4152-865e-4fb4e13e044d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:39.432044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:39.439528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:39.444072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b747afd1-cba7-45b6-ad99-3641102eeb53 req-deb87e2f-bb5a-47ec-b81f-487bdd843813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993beae9-f515-42d1-aee4-da8abb40512d", "tag": "9653e393-b388-4d57-aac3-af97e267c746"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:39.455271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b747afd1-cba7-45b6-ad99-3641102eeb53 req-deb87e2f-bb5a-47ec-b81f-487bdd843813 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.456162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b747afd1-cba7-45b6-ad99-3641102eeb53 req-deb87e2f-bb5a-47ec-b81f-487bdd843813 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.456831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b747afd1-cba7-45b6-ad99-3641102eeb53 req-deb87e2f-bb5a-47ec-b81f-487bdd843813 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.460072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.461461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.461989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.462784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.463358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.465093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.470147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b747afd1-cba7-45b6-ad99-3641102eeb53 req-deb87e2f-bb5a-47ec-b81f-487bdd843813 service nova] Creating event network-changed:9653e393-b388-4d57-aac3-af97e267c746 for instance 993beae9-f515-42d1-aee4-da8abb40512d on n-h2-858238-3 Nov 02 14:06:39.478370 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b747afd1-cba7-45b6-ad99-3641102eeb53 req-deb87e2f-bb5a-47ec-b81f-487bdd843813 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062317 Nov 02 14:06:39.478975 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1143/4216] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:39.556455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1236837196", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "c67836ff-58d9-4a08-a255-5b7eef7b5458"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:39.625057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:39.643040 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-779fae43-b54c-4a8a-b403-0ffe1bbeea58 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1460 microversion: 2.1 time: 0.231817 Nov 02 14:06:39.643691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3074/4217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:39 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1460 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:39.649279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:39.650089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:39.656618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.657411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.658087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.659035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.659797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.660502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.678491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] validate_networks() for [('c67836ff-58d9-4a08-a255-5b7eef7b5458', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:39.775298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:39.786900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:39.793045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:39.796714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9877b6c-ebeb-43b9-b108-cfc6cfe32654 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1335 microversion: 2.54 time: 0.150467 Nov 02 14:06:39.800589 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3075/4218] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:39 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:39.806199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:39.812433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:39.830824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.831807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.833140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:39.833983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:39.837909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:39.838483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.105634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:40.115120 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfa16aa0-658c-4ed7-85be-1077d7fea945 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.313109 Nov 02 14:06:40.115735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3076/4219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:39 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:40.140785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:40.141707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:40.148183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.148694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.149133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.149854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.150531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.151607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.157761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:40.326897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:40.327681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:40.328309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:40.329078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:40.329693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:40.340600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.341290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.341815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.342446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.342899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.343870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.365665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:40.368022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Getting quotas for project eef504bfdf464c10a0f8d8a9732fd595. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:40.377695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aac56f6a-a47d-48fd-b42e-70434cd19a0c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.240678 Nov 02 14:06:40.388193 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3077/4220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:40 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:40.388457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Getting quotas for user cf3497b0d8954811b4682ec55d17488e and project eef504bfdf464c10a0f8d8a9732fd595. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:40.401214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:40.409665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:40.420249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:40.425498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.426164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.426627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.427621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.428126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.428460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:40.428662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.505585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e267b4d-b7f2-4c62-8261-47e7b66f1fcc tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954675 Nov 02 14:06:40.514377 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1144/4221] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:06:40.536906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-10a1b656-93bc-4d9e-a111-b545f98131c1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:40.538689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-10a1b656-93bc-4d9e-a111-b545f98131c1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:40.642744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-10a1b656-93bc-4d9e-a111-b545f98131c1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:40.644920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:40.653123 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-10a1b656-93bc-4d9e-a111-b545f98131c1 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1214 microversion: 2.1 time: 0.136647 Nov 02 14:06:40.653512 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-18e02a9d-a1b8-473e-bea1-07bfea12f8af tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.256168 Nov 02 14:06:40.654332 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1145/4222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:40 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:40.655125 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3078/4223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:40 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:40.682158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:40.683404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:40.690487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.691589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.692239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.693141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.693787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.694404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.832954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:40.833572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:40.842704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.847899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.848562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.849751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:40.850441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:40.851199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:40.884487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:40.896946 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-80570d73-4abb-4d8a-9d40-ad2ab97ab5bc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.219177 Nov 02 14:06:40.898689 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1146/4224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:40 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:40.988901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.000390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.002111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.004269 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5559ecb9-140d-4dbc-8afa-661c598c99e2 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1356 microversion: 2.54 time: 0.175955 Nov 02 14:06:41.016414 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3079/4225] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:40 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:06:41.041559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8b08e8d6-8462-4645-ab93-23ead00c354f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Action: 'create', calling method: .version_select at 0x7f6f81047550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1534814807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsgjO2fV4luSi1R7q/nDOR9xENN/ueqPWpTT9w9yBV7PG2iL2KCVF7E0lVk0Ai0lVXEv3LRK7dn8+jpaRsWO4zlS71P4DSUHEpb1Iwhyy6yDvJFVLqKI4a3h0prNZZ2DQ=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:41.062219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-8b08e8d6-8462-4645-ab93-23ead00c354f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Getting quotas for project d45a553706284719bc495d91f7fd7c3b. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:41.074210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-980656001", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "f846ebbf-8ebf-4f30-afa6-7c615971cecb"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:41.076513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-8b08e8d6-8462-4645-ab93-23ead00c354f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Getting quotas for user 317c830b25e64d25b558cb6b88a42558 and project d45a553706284719bc495d91f7fd7c3b. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:41.117553 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8b08e8d6-8462-4645-ab93-23ead00c354f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.080680 Nov 02 14:06:41.119357 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1147/4226] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 14:06:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 14:06:41.131177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1534814807", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:41.134405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:41.142649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.143487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.144395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.145601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.146216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.146785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.161841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] validate_networks() for [('f846ebbf-8ebf-4f30-afa6-7c615971cecb', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:41.315830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:41.316510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:41.316987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:41.317396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:41.319828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:41.429294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:41.438308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.439074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.439536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.440250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.440694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.441554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.483358 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-36fe2334-d57d-417a-a2de-f4e025d1ae5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "POST /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37/action" status: 202 len: 1139 microversion: 2.54 time: 0.356967 Nov 02 14:06:41.500054 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1148/4227] 10.222.0.18 () {62 vars in 1320 bytes} [Wed Nov 2 14:06:41 2022] POST /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37/action => generated 1139 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 14:06:41.507411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:41.508035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:41.511194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:41.515546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.516297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.517242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.518364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.519033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.519849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.624814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.635260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.635823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.637355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae666259-6919-4c1e-8b39-2769fdaa125c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.135839 Nov 02 14:06:41.638816 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1149/4228] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:41 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:41.679537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:41.680162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:41.687313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.687816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.688259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.689096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.689562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.689985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.807596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:41.823921 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e2d79c1e-7fc3-4bcd-8700-5f85216928f4 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1266 microversion: 2.1 time: 0.149503 Nov 02 14:06:41.829591 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1150/4229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:41 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:41.846059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:41.847119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:41.847776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:41.848389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:41.848797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:41.860461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.861505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.862507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.863897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:41.864597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:41.865345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:41.887651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:41.892237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Getting quotas for user 53bef65bfa79486a8f0180f2f86eddba and project 440bbc53bad84aeda15c454a82450493. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:41.907529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:41.909896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:41.964854 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c095dae-1ff0-4169-a5de-deb84a213c31 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895288 Nov 02 14:06:41.966361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3080/4230] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:06:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:06:41.983421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e47674f3-d2da-49fb-86f4-ad916df8d924 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:41.984036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e47674f3-d2da-49fb-86f4-ad916df8d924 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:42.083568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e47674f3-d2da-49fb-86f4-ad916df8d924 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:42.092134 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e47674f3-d2da-49fb-86f4-ad916df8d924 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1214 microversion: 2.1 time: 0.113493 Nov 02 14:06:42.093687 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1151/4231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:41 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:42.666851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:42.668066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:42.679596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:42.680530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:42.681133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:42.682079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:42.683886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:42.684535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:42.827522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:42.838548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:42.842985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:42.844853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c76e74a0-f09d-4ac6-b03c-fe5bf7f6a873 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.183316 Nov 02 14:06:42.845955 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3081/4232] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:42 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:06:42.866300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:42.867532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:42.884825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:42.886716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:42.888188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:42.891275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:42.892083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:42.894812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:43.007883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:43.021381 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-db9970e7-de73-4f6f-b02b-5177eec8dd3a tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1272 microversion: 2.1 time: 0.174063 Nov 02 14:06:43.022788 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1152/4233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:42 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:43.117005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:43.118189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:43.128284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:43.129882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:43.130979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:43.133095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:43.133707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:43.134759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:43.547575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:43.564881 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-887fb288-11dc-4f6f-8e59-64747b890afb tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1266 microversion: 2.1 time: 0.452498 Nov 02 14:06:43.566555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3082/4234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:43 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1266 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:43.873783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:43.876756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:43.889663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:43.893241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:43.894030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:43.895040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:43.896212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:43.897365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:44.010324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:44.022957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:44.025243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:44.026943 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38ef5651-eead-4b8f-bb21-9115108c2487 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.157769 Nov 02 14:06:44.029276 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1153/4235] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:43 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:44.056361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:44.057233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:44.065588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:44.066346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:44.067193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:44.067908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:44.068558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:44.069035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:44.154926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7e2f7c75-d47d-4c57-9cf2-23468b1cf582 req-1dd08dd9-250f-4a3f-bd8c-132e79ac011f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3789e6-be95-47d9-b29f-08bd151a85c4", "tag": "63e49144-f4d1-4b2d-9eb6-edd83cbed51e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:44.214570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7e2f7c75-d47d-4c57-9cf2-23468b1cf582 req-1dd08dd9-250f-4a3f-bd8c-132e79ac011f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:44.215869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7e2f7c75-d47d-4c57-9cf2-23468b1cf582 req-1dd08dd9-250f-4a3f-bd8c-132e79ac011f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:44.216586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7e2f7c75-d47d-4c57-9cf2-23468b1cf582 req-1dd08dd9-250f-4a3f-bd8c-132e79ac011f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:44.221275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:44.237640 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7e2f7c75-d47d-4c57-9cf2-23468b1cf582 req-1dd08dd9-250f-4a3f-bd8c-132e79ac011f service nova] Creating event network-changed:63e49144-f4d1-4b2d-9eb6-edd83cbed51e for instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 on n-h2-858238-3 Nov 02 14:06:44.247809 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7e2f7c75-d47d-4c57-9cf2-23468b1cf582 req-1dd08dd9-250f-4a3f-bd8c-132e79ac011f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101273 Nov 02 14:06:44.248994 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1154/4236] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:06:44.554258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:44.567994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3d2ef45-7126-4271-93da-7a7ef7dca90b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.520809 Nov 02 14:06:44.578589 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3083/4237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:44 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:44.591583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:44.592784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:44.608189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:44.610968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:44.611640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:44.612573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:44.614893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:44.615567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:44.716627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:44.727361 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0055c4bd-c056-4f03-bf7b-4e3d758af4ef tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1272 microversion: 2.1 time: 0.140564 Nov 02 14:06:44.744997 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1155/4238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:44 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:45.060538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:45.061388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:45.071864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:45.072715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:45.073373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:45.074429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:45.075428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:45.076344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:45.208485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:45.221246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:45.225474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:45.227009 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc2be3d5-2c7f-4ac5-ba26-08e542512030 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.171574 Nov 02 14:06:45.231206 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3084/4239] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:45 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:45.603693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:45.612112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:45.628739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:45.631333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:45.632670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:45.634286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:45.635639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:45.638629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:45.755439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:45.756557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:45.762827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:45.763313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:45.763749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:45.764448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:45.764924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:45.765570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:46.063395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:46.071938 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ab28efc1-31c4-4f78-9bd7-240b836535ad tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.479646 Nov 02 14:06:46.079380 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1156/4240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:45 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:46.192199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:46.208772 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-933b0329-a11e-484f-bf4e-f3e545df7e03 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1314 microversion: 2.1 time: 0.457248 Nov 02 14:06:46.209804 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3085/4241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:45 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:46.257744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:46.258360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:46.265281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:46.266046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:46.266477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:46.267364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:46.267983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:46.268407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:46.437388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:46.453522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:46.455412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:46.456874 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54964981-49a8-47a3-8945-315e8666c028 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.203742 Nov 02 14:06:46.470584 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1157/4242] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:46 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:46.727853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2e09b7e2-6802-4ad9-b9a6-84a0c16e6a59 req-083edc6f-83d7-4e4d-8d6e-588ea9d47127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2871afe-6f23-4e73-aa6a-9a6da7a76411", "tag": "18a12a24-c374-4699-b315-2e07f286ac03"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:46.774702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e09b7e2-6802-4ad9-b9a6-84a0c16e6a59 req-083edc6f-83d7-4e4d-8d6e-588ea9d47127 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:46.775351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e09b7e2-6802-4ad9-b9a6-84a0c16e6a59 req-083edc6f-83d7-4e4d-8d6e-588ea9d47127 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:46.775612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e09b7e2-6802-4ad9-b9a6-84a0c16e6a59 req-083edc6f-83d7-4e4d-8d6e-588ea9d47127 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:46.794666 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2e09b7e2-6802-4ad9-b9a6-84a0c16e6a59 req-083edc6f-83d7-4e4d-8d6e-588ea9d47127 service nova] Creating event network-changed:18a12a24-c374-4699-b315-2e07f286ac03 for instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 on n-h1-858238-3 Nov 02 14:06:46.800012 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2e09b7e2-6802-4ad9-b9a6-84a0c16e6a59 req-083edc6f-83d7-4e4d-8d6e-588ea9d47127 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077470 Nov 02 14:06:46.800910 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3086/4243] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:47.095977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:47.096595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:47.103961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:47.104448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:47.104885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:47.105599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:47.106055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:47.106480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:47.238702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:47.239367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:47.245943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:47.246437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:47.246892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:47.247644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:47.248092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:47.248738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:47.367272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:47.377695 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-58a8fcdb-018c-49af-840d-5ff103c44ac6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.286795 Nov 02 14:06:47.380907 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1158/4244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:47 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:47.435975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:47.448881 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f56f77f9-a404-405d-bd36-c0ea13590be5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1314 microversion: 2.1 time: 0.216266 Nov 02 14:06:47.449581 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3087/4245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:47 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:47.491574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:47.492616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:47.503512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:47.504364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:47.505133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:47.506345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:47.507174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:47.507919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:47.579240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:47.587384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:47.588829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:47.590086 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d6a68595-494a-4898-ab20-06ed385e5f10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.106230 Nov 02 14:06:47.590620 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1159/4246] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:47 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:48.402734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:48.403705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:48.411508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:48.412074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:48.412586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:48.413401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:48.413934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:48.414490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:48.472054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:48.472818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:48.480302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:48.480549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:48.480943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:48.481868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:48.482520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:48.482945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:48.613770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:48.622746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d0f8db1-f615-4d2e-b5ea-7069ec960a61 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.223847 Nov 02 14:06:48.625993 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3088/4247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:48 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:48.631146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:48.632016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:48.646241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:48.647033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:48.647499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:48.648207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:48.648655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:48.651143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:48.752685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:48.753180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:48.766196 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-35026c7f-aff6-41a7-93d0-e5116a8921d0 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1314 microversion: 2.1 time: 0.297894 Nov 02 14:06:48.768079 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1160/4248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:48 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:48.774349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:48.776920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:48.779316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-602aadc7-a786-439e-935b-a8fbde635c5c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.151929 Nov 02 14:06:48.782171 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3089/4249] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:48 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:49.656215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:49.658133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:49.666911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:49.667569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:49.668010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:49.668942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:49.669718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:49.670612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:49.789027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:49.789792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:49.797211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:49.797714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:49.798368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:49.804107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:49.804864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:49.805732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:49.884167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:49.901859 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-708f62c0-370a-41ae-a102-9d45ea88cfb6 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.252654 Nov 02 14:06:49.904236 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1161/4250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:49 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:49.921351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:49.923417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:49.934313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:49.935896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:49.937866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:49.939303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:49.941770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:49.942664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:50.004210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:50.014169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-733fe9d7-df6a-4477-8278-8a536b7bd9e5 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1314 microversion: 2.1 time: 0.228927 Nov 02 14:06:50.015605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3090/4251] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:49 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:50.031205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:50.039577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:50.041015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:50.042171 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb314479-3fe5-4f18-9e86-33f5944e4d64 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.136343 Nov 02 14:06:50.042730 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1162/4252] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:49 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:50.712292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-22f9c5ef-8d14-4f6e-bb75-c20688059f74 req-da8708ad-81d0-4e88-a685-41fc4828c61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2871afe-6f23-4e73-aa6a-9a6da7a76411", "name": "network-vif-plugged", "status": "completed", "tag": "18a12a24-c374-4699-b315-2e07f286ac03"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:50.728708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-22f9c5ef-8d14-4f6e-bb75-c20688059f74 req-da8708ad-81d0-4e88-a685-41fc4828c61e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:50.729517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-22f9c5ef-8d14-4f6e-bb75-c20688059f74 req-da8708ad-81d0-4e88-a685-41fc4828c61e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:50.730028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-22f9c5ef-8d14-4f6e-bb75-c20688059f74 req-da8708ad-81d0-4e88-a685-41fc4828c61e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:50.745828 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-22f9c5ef-8d14-4f6e-bb75-c20688059f74 req-da8708ad-81d0-4e88-a685-41fc4828c61e service nova] Creating event network-vif-plugged:18a12a24-c374-4699-b315-2e07f286ac03 for instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 on n-h1-858238-3 Nov 02 14:06:50.752935 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-22f9c5ef-8d14-4f6e-bb75-c20688059f74 req-da8708ad-81d0-4e88-a685-41fc4828c61e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044594 Nov 02 14:06:50.754249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3091/4253] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:50.927390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:50.928247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:50.934441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:50.937607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:50.940427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:50.941010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:50.945685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:50.946448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:50.947137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:51.046465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:51.047526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:51.058486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:51.059254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:51.059976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:51.061033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:51.061741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:51.062574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:51.169524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:51.178930 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2df9fa82-713b-4edf-876e-c57dbd074af8 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.257854 Nov 02 14:06:51.191588 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1163/4254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:50 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:51.191588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:51.191588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:51.192422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:51.193292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:51.193692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:51.194496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:51.195384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:51.195550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:51.243941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:51.252951 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14d43549-14ba-424d-8136-dcc47ec0e260 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1314 microversion: 2.1 time: 0.215660 Nov 02 14:06:51.267673 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3092/4255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:51 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:51.280375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:51.289431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:51.290868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:51.292612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c300c57-6ce4-4cf1-8ef1-2ef4ec52b261 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.111494 Nov 02 14:06:51.293266 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1164/4256] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:51 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:52.202913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:52.204300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:52.206600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:52.207570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:52.215488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.216397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.216890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.217741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.218816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.219503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.279508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:52.281964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:52.291195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=22 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:52.292772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.293421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.294202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.294918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.295414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.295837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.408557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:52.418098 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-68b3dbae-4110-4ea2-8b87-a5ab0cbc231e tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.219207 Nov 02 14:06:52.419074 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3093/4257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:52 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:52.432533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:52.434199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:52.447428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.448819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.450676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.455398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.457703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.458783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.527066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:52.542465 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-12276c0d-4914-4c29-9907-bc36a846dbbc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1314 microversion: 2.1 time: 0.269338 Nov 02 14:06:52.543229 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1165/4258] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:52 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:52.570779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:52.582124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:52.584371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:52.585925 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f634af9e-04ee-4733-8d1c-f5f3c7d531a8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.165467 Nov 02 14:06:52.587036 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3094/4259] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:52 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:52.770389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f4218138-0863-40ce-bb9e-00447224dd08 req-2cfcecd7-fa26-4f07-84ca-4963beb75171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3789e6-be95-47d9-b29f-08bd151a85c4", "name": "network-vif-plugged", "status": "completed", "tag": "63e49144-f4d1-4b2d-9eb6-edd83cbed51e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:52.779983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f4218138-0863-40ce-bb9e-00447224dd08 req-2cfcecd7-fa26-4f07-84ca-4963beb75171 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:52.781310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f4218138-0863-40ce-bb9e-00447224dd08 req-2cfcecd7-fa26-4f07-84ca-4963beb75171 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:52.781741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f4218138-0863-40ce-bb9e-00447224dd08 req-2cfcecd7-fa26-4f07-84ca-4963beb75171 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:52.792688 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f4218138-0863-40ce-bb9e-00447224dd08 req-2cfcecd7-fa26-4f07-84ca-4963beb75171 service nova] Creating event network-vif-plugged:63e49144-f4d1-4b2d-9eb6-edd83cbed51e for instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 on n-h2-858238-3 Nov 02 14:06:52.798042 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f4218138-0863-40ce-bb9e-00447224dd08 req-2cfcecd7-fa26-4f07-84ca-4963beb75171 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Nov 02 14:06:52.798834 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1166/4260] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:53.442401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:53.442999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:53.450024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:53.450505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:53.450935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:53.451646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:53.452104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:53.452562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:53.574638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:53.575581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:53.582876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:53.583558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:53.584115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:53.584853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:53.585929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:53.586379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.019813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:54.022402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:54.030278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4896439e-67d5-47ed-befb-7602b74978e5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1314 microversion: 2.1 time: 0.592329 Nov 02 14:06:54.033070 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3095/4261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:53 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:54.039360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:54.040755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:54.047643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:54.048453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:54.049120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.050053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:54.050729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:54.051390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.061719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:54.070287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b428c867-014f-4a09-928f-1f521e83c026 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1501 microversion: 2.1 time: 0.503652 Nov 02 14:06:54.071062 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1167/4262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:53 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:54.095674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:54.096121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:54.102346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:54.102845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:54.103307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.104198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:54.104661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:54.105081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.137804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:54.150466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:54.151966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:54.153161 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ca22781-b134-4dde-a350-d1c29f7d158c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.118887 Nov 02 14:06:54.153724 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3096/4263] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:54 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:54.200639 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-677829a8-7e16-4337-a1b9-35d1b121dc14 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411/action" status: 202 len: 0 microversion: 2.1 time: 0.109409 Nov 02 14:06:54.201443 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1168/4264] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:06:54 2022] POST /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:06:54.210315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:54.210942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:54.219943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:54.220439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:54.220923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.221814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:54.222718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:54.223203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:54.388030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:54.399732 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e424f7f0-5ecb-4261-82fd-4140677f12d1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1506 microversion: 2.1 time: 0.193221 Nov 02 14:06:54.400488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3097/4265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:54 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:55.067561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:55.068847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.079456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.080327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.081112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.082340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.083188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.083967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.182685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:55.183590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.192725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.193594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.195886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.197080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.198522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.199447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.326140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:55.329499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:55.336523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:55.337955 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d28b3486-0faf-44ab-b00d-6cf3d37f240d tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1498 microversion: 2.1 time: 0.279966 Nov 02 14:06:55.338482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:55.339343 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1169/4266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:55 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:55.357577 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-846f38b0-54ed-404b-b7ac-9e8b3c1a4106 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.180511 Nov 02 14:06:55.358295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3098/4267] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:55 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:06:55.427298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:55.430086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.439475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.440285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.441113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.444218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.445119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.446394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.648139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:55.663320 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cdd89dcf-9cd6-4870-93cb-7e4b87d7bc16 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1486 microversion: 2.1 time: 0.238214 Nov 02 14:06:55.663320 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1170/4268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:55 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1486 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:55.681270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:55.681819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.688558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.689275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.690049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.690896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.691800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.692373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.721578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lazy-loading 'flavor' on Instance uuid a2871afe-6f23-4e73-aa6a-9a6da7a76411 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:06:55.852916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:55.853433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.859459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.859958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.860396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.861085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.861728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.862139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.866280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:55.891069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:06:55.936289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ae7ac78-cd83-46b7-9d7e-67473b541140 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411/action" status: 202 len: 0 microversion: 2.1 time: 0.258610 Nov 02 14:06:55.937747 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3099/4269] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:06:55 2022] POST /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:06:55.947750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:55.948925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.956397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.956992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.957520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.958259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.958743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.959273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.011622 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-890bc543-9e10-4210-bfc7-49fc1fcc0c13 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 204 len: 0 microversion: 2.1 time: 0.161624 Nov 02 14:06:56.013469 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1171/4270] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:06:55 2022] DELETE /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:06:56.023245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:56.023962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:56.031187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:56.031924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:56.032524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.033387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:56.033990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:56.034669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.183970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:56.193536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cbd3c1d8-8d0f-4a1e-9a4f-fb797c480fff tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1492 microversion: 2.1 time: 0.250910 Nov 02 14:06:56.194145 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3100/4271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:55 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1492 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:56.224855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:56.233469 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cafc7bfb-fbed-4382-9961-64f3a0b0448b tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1504 microversion: 2.1 time: 0.215456 Nov 02 14:06:56.235141 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1172/4272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:56 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:56.398673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:56.399380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:56.406075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:56.406553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:56.407246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.408260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:56.408921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:56.409511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.501655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:56.516710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:56.518972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:56.520243 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4cdff55-1298-456d-994a-e2e7a730bb69 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.126982 Nov 02 14:06:56.520817 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3101/4273] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:56 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:57.220277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:57.221253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:57.229138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.229761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.230064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.230781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.231224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.231634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.259455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:57.260277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:57.270792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.273276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.273836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.276211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.277350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.278352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.457196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:57.474099 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cbd11a59-b323-4fa6-97ff-43af5bae4450 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1513 microversion: 2.1 time: 0.259954 Nov 02 14:06:57.476313 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1173/4274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:57 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:57.518842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:57.527780 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-390fe9c2-ee0f-4283-81e3-7b81faa00b41 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1504 microversion: 2.1 time: 0.272172 Nov 02 14:06:57.528698 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3102/4275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:57 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:57.547431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:57.549662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:57.556698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.557798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.558274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.559024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.559524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.559934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.659666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:57.669805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:57.671910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:57.673871 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-535c6d34-3e87-424a-9a0e-c871dcc5efaa tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.130424 Nov 02 14:06:57.683147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1174/4276] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:57 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:58.288694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ed5c8f35-abe6-4890-8539-f0f74e14d10d req-867c2469-f1df-4f5e-ab67-f776c859f081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3789e6-be95-47d9-b29f-08bd151a85c4", "name": "network-vif-deleted", "tag": "63e49144-f4d1-4b2d-9eb6-edd83cbed51e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:58.315243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ed5c8f35-abe6-4890-8539-f0f74e14d10d req-867c2469-f1df-4f5e-ab67-f776c859f081 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.315901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ed5c8f35-abe6-4890-8539-f0f74e14d10d req-867c2469-f1df-4f5e-ab67-f776c859f081 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.316398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ed5c8f35-abe6-4890-8539-f0f74e14d10d req-867c2469-f1df-4f5e-ab67-f776c859f081 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.334870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ed5c8f35-abe6-4890-8539-f0f74e14d10d req-867c2469-f1df-4f5e-ab67-f776c859f081 service nova] Creating event network-vif-deleted:63e49144-f4d1-4b2d-9eb6-edd83cbed51e for instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 on n-h2-858238-3 Nov 02 14:06:58.340945 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ed5c8f35-abe6-4890-8539-f0f74e14d10d req-867c2469-f1df-4f5e-ab67-f776c859f081 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057898 Nov 02 14:06:58.346622 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3103/4277] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:58.513522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:58.515375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:58.524249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.524929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.525387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.539143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.545076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.545635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.562624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:58.562624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:58.570565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.571145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.574269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.575747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.576372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.577095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.621379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.622194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.623019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.624102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lazy-loading 'fault' on Instance uuid 6d3789e6-be95-47d9-b29f-08bd151a85c4 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:06:58.796704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3497b0d8954811b4682ec55d17488e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef504bfdf464c10a0f8d8a9732fd595', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:58.807145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5fa79303-607f-4a8b-90fb-b44dd50003db tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 200 len: 1304 microversion: 2.1 time: 0.252180 Nov 02 14:06:58.808713 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3104/4278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:58 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:58.814714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:58.815795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:58.824327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.825170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.825885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.826838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.828187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.828859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.953791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:58.965262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf1f3937-057b-4b19-8015-3176375cb338 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.456670 Nov 02 14:06:58.966136 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1175/4279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:58 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:58.985558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3db95151-7747-40f2-b3c4-3e805b714a83 req-375fc053-cecd-4486-860d-85f140685bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2871afe-6f23-4e73-aa6a-9a6da7a76411", "name": "network-vif-plugged", "status": "completed", "tag": "18a12a24-c374-4699-b315-2e07f286ac03"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:58.996791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3db95151-7747-40f2-b3c4-3e805b714a83 req-375fc053-cecd-4486-860d-85f140685bfc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.997639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3db95151-7747-40f2-b3c4-3e805b714a83 req-375fc053-cecd-4486-860d-85f140685bfc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.998391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3db95151-7747-40f2-b3c4-3e805b714a83 req-375fc053-cecd-4486-860d-85f140685bfc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:59.021144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:59.036500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:59.040448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:59.042326 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-953219cc-bc23-4da8-a552-a8b4ccd91989 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.232312 Nov 02 14:06:59.049518 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3db95151-7747-40f2-b3c4-3e805b714a83 req-375fc053-cecd-4486-860d-85f140685bfc service nova] Creating event network-vif-plugged:18a12a24-c374-4699-b315-2e07f286ac03 for instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 on n-h1-858238-3 Nov 02 14:06:59.059793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3105/4280] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:06:58 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:06:59.065925 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3db95151-7747-40f2-b3c4-3e805b714a83 req-375fc053-cecd-4486-860d-85f140685bfc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095984 Nov 02 14:06:59.066840 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1176/4281] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:59.855756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:59.857389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] [instance: 6d3789e6-be95-47d9-b29f-08bd151a85c4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:59.867060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:59.867911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:59.869140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:59.870284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:59.870984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:59.871875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:59.895641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] HTTP exception thrown: Instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 could not be found. Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Request method failure captured: Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 HTTP/1.1 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnlXGkTMBabs-g2Dm2imwjzwrvBCoxCA-ymqY8ql8D4iR4inPGnNtE_shSE8Wg9apYwc_CQ8AplC2g5pSBXEXwpQ9s7xv1BLsp_RXAF2nYgqM6XFz2kR2VfMPTiRKI3o2RDDnoi-BTJO0KGrWGdw_nozN6hIwaPDZ7Ji7CkxYOP16Co Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: eef504bfdf464c10a0f8d8a9732fd595 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesActionsTest-47994958 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eef504bfdf464c10a0f8d8a9732fd595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eef504bfdf464c10a0f8d8a9732fd595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eef504bfdf464c10a0f8d8a9732fd595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eef504bfdf464c10a0f8d8a9732fd595"}]}] Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesActionsTest-47994958 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: eef504bfdf464c10a0f8d8a9732fd595 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesActionsTest-47994958 Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesActionsTest-47994958-project Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: cf3497b0d8954811b4682ec55d17488e Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesActionsTest-47994958-project Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 could not be found. Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6d3789e6-be95-47d9-b29f-08bd151a85c4'} Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 could not be found. Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 could not be found. Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:59.897773 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 could not be found. Nov 02 14:06:59.901915 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:06:59.904273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] Returning 404 to user: Instance 6d3789e6-be95-47d9-b29f-08bd151a85c4 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:59.905404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1e7b671-c2f6-424b-8062-aa7d8eab69d5 tempest-VolumesActionsTest-47994958 tempest-VolumesActionsTest-47994958-project] 10.222.0.18 "GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4" status: 404 len: 111 microversion: 2.1 time: 0.058840 Nov 02 14:06:59.907906 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3106/4282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:59 2022] GET /compute/v2.1/servers/6d3789e6-be95-47d9-b29f-08bd151a85c4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:59.991876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:59.993312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:00.003748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:00.005009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:00.006143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:00.007702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:00.008386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:00.008988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:00.073075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:00.073708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:00.086832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:00.087679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:00.088286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:00.089183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:00.089802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:00.090422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:00.210202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:00.244965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:00.246717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:00.247960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9eddc01-f832-4d51-8a39-7eb4ac7c36c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.179278 Nov 02 14:07:00.248533 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3107/4283] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:00 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:00.297050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:00.307863 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bfaecb68-f60e-4d5a-b91e-c8be9fb5feb3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.321861 Nov 02 14:07:00.309029 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1177/4284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:06:59 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:01.279654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:01.281345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:01.291483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:01.292287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:01.292909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:01.293836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:01.298205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:01.299411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:01.339470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:01.340746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:01.362157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:01.374751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:01.378043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:01.378996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:01.379867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:01.380724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:01.418607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:01.435700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:01.439111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:01.440747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba38b7e9-e69c-4e36-8fcc-8ca9af7c09d0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.165344 Nov 02 14:07:01.464888 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3108/4285] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:01 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:01.748711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:01.759307 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9273cf5d-82be-428f-b1fc-349de24a2592 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.423792 Nov 02 14:07:01.775547 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1178/4286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:01 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:02.470268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:02.472088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:02.498968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:02.508881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:02.513192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:02.519297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:02.521270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:02.525061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:02.526030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:02.771136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:02.790211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:02.792849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:02.794287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:02.798078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:02.799367 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-809c74a2-3378-441d-b914-9a6c15d14260 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.333393 Nov 02 14:07:02.800836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3109/4287] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:02 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:02.804840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:02.805553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:02.805883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:02.807596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:02.808153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:02.808800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:03.224123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:03.254855 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b1b6895-0a47-439a-b7b0-ed1c03803083 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.465780 Nov 02 14:07:03.257018 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1179/4288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:02 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:03.834752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:03.836188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:03.859029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:03.875768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:03.877630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:03.884850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:03.886485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:03.888642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:04.068549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:04.092571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:04.099790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:04.109095 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b3fe2ac-7416-464c-8d97-91ffec90fe10 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.277333 Nov 02 14:07:04.113689 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3110/4289] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:03 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:04.290127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:04.292508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:04.314576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:04.315683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:04.317100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:04.321084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:04.322049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:04.322654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:04.668221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:04.713082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4785a08e-22c4-4df9-8722-4a1fa43129cf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.435756 Nov 02 14:07:04.714052 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1180/4290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:04 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:05.147786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:05.149579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:05.171698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:05.172689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:05.175252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:05.178955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:05.179699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:05.180294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:05.208183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:05.281596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:05.291432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:05.293150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:05.294529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-abc51403-5afd-46af-b09e-19d80dc6f70c tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.151553 Nov 02 14:07:05.295636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3111/4291] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:05 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:05.754336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:05.755820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:05.768974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:05.772335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:05.774603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:05.775652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:05.778478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:05.779241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:06.038454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:06.049578 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2fcb272-123e-454d-b901-88f494dc3f7e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.299439 Nov 02 14:07:06.055902 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1181/4292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:05 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:06.329099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:06.331024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:06.368291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:06.369532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:06.371368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:06.375186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:06.381870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:06.383531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:06.592820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:06.610296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:06.611932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:06.615982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c10e7e9b-c29c-4335-85f0-6d0fa0f0f155 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.295429 Nov 02 14:07:06.617976 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3112/4293] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:06 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:07.124904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:07.125611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:07.143417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:07.143923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:07.149469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:07.150644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:07.151317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:07.151965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:07.467647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:07.482080 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-65bc43ff-7d6a-43b5-af01-d6bca8d9c042 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.376727 Nov 02 14:07:07.486255 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1182/4294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:07 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:07.664469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:07.665778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:07.673864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:07.674642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:07.675384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:07.676394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:07.677099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:07.677803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:07.824157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:07.835623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:07.837331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:07.838744 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a404fa5e-6fdf-4529-8ea5-7b2de0586132 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.178213 Nov 02 14:07:07.839882 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3113/4295] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:07 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:08.513493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:08.514941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:08.529576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:08.530363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:08.531533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:08.532435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:08.535063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:08.535726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:08.873100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:08.874374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:08.884699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:08.898477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:08.898929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:08.899714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:08.900173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:08.900599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:09.063986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:09.080304 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-70c96942-6aa7-4701-bc9d-fffed858c12e tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.570570 Nov 02 14:07:09.081728 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1183/4296] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:08 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:09.130052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:09.143516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:09.144995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:09.146232 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-35cfe576-0b0d-4e82-95f9-ab1307477539 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.278211 Nov 02 14:07:09.150035 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3114/4297] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:08 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:09.607427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:09.608716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:09.623611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:09.625377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:09.626115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:09.628447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:09.633067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:09.634796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:09.721440 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5618cd02-c580-4bfb-8146-dc2b453c9853 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/ips" status: 200 len: 151 microversion: 2.20 time: 0.118450 Nov 02 14:07:09.730088 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1184/4298] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Nov 2 14:07:09 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/ips => generated 151 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:07:10.109353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:10.110000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:10.131563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:10.133740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:10.134198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:10.135981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:10.137906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:10.138298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:10.178848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:10.179708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:10.192207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:10.192807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:10.200561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:10.201358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:10.206144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:10.206587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:10.637574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:10.657908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:10.661691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:10.667144 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dfd21731-645a-4b95-a786-ca561a7601d9 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.490925 Nov 02 14:07:10.671526 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1185/4299] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:10 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:10.829973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:10.840534 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a62fb257-d9ae-4ad3-a7c0-871419969ad9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.736808 Nov 02 14:07:10.844104 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3115/4300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:10 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:11.700473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:11.703144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:11.715155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:11.789768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:11.793086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:11.796198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:11.798547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:11.805095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:11.809286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:11.873456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:11.876735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:11.914766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:11.918781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:11.926258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:11.927418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:11.928619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:11.930348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:12.158615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:12.178918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:12.185027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:12.192323 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-63938c50-0dc5-4cad-93bf-91922604e323 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.496780 Nov 02 14:07:12.196500 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1186/4301] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:11 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:12.463022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:12.485333 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d0222c9-7f3e-499a-ba66-9091c422b4a3 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.614337 Nov 02 14:07:12.487753 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3116/4302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:11 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:13.224264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:13.224886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:13.233186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:13.234244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:13.234683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:13.235421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:13.235884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:13.236311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:13.376034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:13.517563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:13.518845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:13.538552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:13.540083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:13.541277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:13.542669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:13.551898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:13.552657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:13.700097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:13.715828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:13.717474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:13.732032 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-122b6af9-f47f-470d-b88e-58621e628108 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1408 microversion: 2.54 time: 0.511389 Nov 02 14:07:13.747505 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1187/4303] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:13 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1408 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:13.958319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:13.976370 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f286f9b1-d88c-4021-a3a3-6789b70e56e7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.462650 Nov 02 14:07:13.977684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3117/4304] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:13 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:14.239977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:14.240647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:14.260749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.263657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.266732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.269683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.270463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.273443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.362130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lazy-loading 'flavor' on Instance uuid 77537b96-c4e1-4711-8be3-903a2b7824e8 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:14.766791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:14.767839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:14.803798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.804665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.805409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.806366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.807076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.809327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:15.007263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.017735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.020004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.024050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a36e3e11-0380-4f78-96ae-f2f5b18ded5b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1414 microversion: 2.54 time: 0.263077 Nov 02 14:07:15.053298 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3118/4305] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:14 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1414 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:15.063157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:15.070981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:15.101003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:15.103855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:15.104838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:15.106662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:15.108259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:15.112007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:15.377919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.392341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-988cd672-472c-4ecb-9b24-82cfb477ac4f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1508 microversion: 2.1 time: 0.335138 Nov 02 14:07:15.416518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3119/4306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:15 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:15.582994 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4467501b-0eaa-4bec-a687-c9882d752276 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/action" status: 202 len: 0 microversion: 2.20 time: 1.347494 Nov 02 14:07:15.583691 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1188/4307] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 14:07:14 2022] POST /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/action => generated 0 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:07:15.592754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:15.594181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:15.601719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:15.602641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:15.603330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:15.604403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:15.605110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:15.605764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:15.839186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.851677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.853495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:15.854895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1785e54c-4286-4c5c-94ab-8562882254c5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.266577 Nov 02 14:07:15.879844 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3120/4308] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:15 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:16.062878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:16.063650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:16.084764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.085288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.085734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.086471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.086922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.093312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.200994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:16.212587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:16.214917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:16.216643 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9cd997c7-79e9-49a5-9077-298b575921c4 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1399 microversion: 2.54 time: 0.158984 Nov 02 14:07:16.232516 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1189/4309] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:16 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1399 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:16.262751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10423a6c-d828-4f94-b661-697ec7e41f0d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '.version_select at 0x7f6f80ee65e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:16.360821 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10423a6c-d828-4f94-b661-697ec7e41f0d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1534814807" status: 204 len: 0 microversion: 2.54 time: 0.100936 Nov 02 14:07:16.363655 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3121/4310] 10.222.0.18 () {60 vars in 1319 bytes} [Wed Nov 2 14:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1534814807 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:07:16.383511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:16.384216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:16.397194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.406346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.424382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:16.425453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:16.425554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.426309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.431778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.432976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.464466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.464984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.465421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.469404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.471830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.472522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.477307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:16.637407 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f0428c8d-4374-4348-b61f-26c2d9fc5b1b tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 204 len: 0 microversion: 2.54 time: 0.256549 Nov 02 14:07:16.640630 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1190/4311] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:07:16 2022] DELETE /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:07:16.653038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:16.654109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:16.673927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.674420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.675056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:16.675797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:16.676254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:16.676674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:17.095323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.105728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.107224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.108401 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c2c589aa-428b-44cb-8a92-55fc4bcb598f tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1405 microversion: 2.54 time: 0.462149 Nov 02 14:07:17.109827 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1191/4312] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:16 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:17.114096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:17.114703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:17.136807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:17.137349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:17.137744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:17.138663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:17.139039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:17.144635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:17.215529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.225323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-09270f8f-010c-4299-89e6-e0fc03537a00 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1505 microversion: 2.1 time: 0.806949 Nov 02 14:07:17.226554 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3122/4313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:16 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1505 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:17.458744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.467067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.471192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.473220 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6278a248-140f-46c9-8120-d77d4965c194 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.362679 Nov 02 14:07:17.476686 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1192/4314] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:17 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:18.134420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:18.135448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:18.146917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.148024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.150420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.151452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.152146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.152828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.250496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:18.251170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:18.266409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.266901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.267489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.268147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.268736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.269167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.302787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.321610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.328099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.334719 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb503c6f-b874-4d01-837e-f62ef387a121 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1405 microversion: 2.54 time: 0.204159 Nov 02 14:07:18.335603 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3123/4315] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:18 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:18.506115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:18.507821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:18.526905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.528088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.528725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.529859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.531451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.532059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.787572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.797821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.802194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.805111 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6aa2a87e-c326-47f5-8e40-a2a0821870ab tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.302887 Nov 02 14:07:18.813719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.830149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3124/4316] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:18 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:18.831530 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6157d75b-0eb9-40b9-b411-4e14eefd4f07 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1505 microversion: 2.1 time: 0.585527 Nov 02 14:07:18.834412 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1193/4317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:18 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:18.933752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-09b40035-36aa-455b-8622-41396f0a42af req-36d18192-6871-4198-9c27-ef89cb747185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2871afe-6f23-4e73-aa6a-9a6da7a76411", "name": "network-vif-unplugged", "status": "completed", "tag": "18a12a24-c374-4699-b315-2e07f286ac03"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:18.962949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-09b40035-36aa-455b-8622-41396f0a42af req-36d18192-6871-4198-9c27-ef89cb747185 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.966558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-09b40035-36aa-455b-8622-41396f0a42af req-36d18192-6871-4198-9c27-ef89cb747185 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.967157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-09b40035-36aa-455b-8622-41396f0a42af req-36d18192-6871-4198-9c27-ef89cb747185 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.003941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-09b40035-36aa-455b-8622-41396f0a42af req-36d18192-6871-4198-9c27-ef89cb747185 service nova] Creating event network-vif-unplugged:18a12a24-c374-4699-b315-2e07f286ac03 for instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 on n-h1-858238-3 Nov 02 14:07:19.014664 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-09b40035-36aa-455b-8622-41396f0a42af req-36d18192-6871-4198-9c27-ef89cb747185 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085133 Nov 02 14:07:19.018625 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3125/4318] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:19.363337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:19.365791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:19.377967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.378970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.379997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.381088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.382447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.383079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.751280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.752035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.752628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.753241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lazy-loading 'fault' on Instance uuid 06555df6-9e1c-42ad-8830-5b95864b8f37 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:19.799791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:19.812694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:19.814406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:19.815847 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a62eb584-95c4-400c-a1f6-81f0d4040cf8 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1410 microversion: 2.54 time: 0.457803 Nov 02 14:07:19.817370 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1194/4319] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:19 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1410 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:19.868088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:19.871026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:19.875857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:19.878986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:19.887128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.889186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.891968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.892906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.896202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.896828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.897516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.899539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.901759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.904549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.905492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.906697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.254496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:20.274179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c021a5e0-57eb-4a15-bf8d-fdf602d679a9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1505 microversion: 2.1 time: 0.420013 Nov 02 14:07:20.277548 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3126/4320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:19 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:20.282930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:20.295536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:20.297540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:20.316377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:20.318180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:20.320473 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8245d9d4-d6fc-4cf7-9517-95867566e094 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.463898 Nov 02 14:07:20.322239 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1195/4321] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:19 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:20.332711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:20.335460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:20.336080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.338897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:20.339579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:20.340171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.480082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lazy-loading 'services' on Instance uuid a40ffe3c-33e5-44a6-a7ff-23606f1275a7 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:20.586157 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1baba181-3e21-48f6-bd1f-44f52875e323 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-volume_attachments/91d5a1d9-c7c0-42ac-a674-433e06f19bd0" status: 202 len: 0 microversion: 2.1 time: 0.286256 Nov 02 14:07:20.587054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3127/4322] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:07:20 2022] DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-volume_attachments/91d5a1d9-c7c0-42ac-a674-433e06f19bd0 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:20.847145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:20.848649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:20.865087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:20.865981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:20.866618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.868646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:20.869355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:20.871034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.948687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:20.951586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:20.952123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.956001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lazy-loading 'fault' on Instance uuid 06555df6-9e1c-42ad-8830-5b95864b8f37 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:21.014708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.031259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.033062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317c830b25e64d25b558cb6b88a42558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45a553706284719bc495d91f7fd7c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.034316 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dffed8ce-7baf-47a3-845c-a63b3f120b7d tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 200 len: 1410 microversion: 2.54 time: 0.191606 Nov 02 14:07:21.034925 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1196/4323] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:20 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 1410 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:21.308079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:21.309005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:21.324900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:21.325681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:21.327491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:21.331688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:21.332163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:21.332594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:21.363885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:21.364937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:21.392237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:21.396487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:21.397253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:21.399909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:21.402982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:21.405210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:21.650163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.676797 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a584ea4-4376-40fb-9766-5724705067b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1505 microversion: 2.1 time: 0.360751 Nov 02 14:07:21.677467 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3128/4324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:21 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:21.788820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.821417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.823550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.825686 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4c35bb27-34b6-4222-9708-c8a6c113bbcd tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.480535 Nov 02 14:07:21.826775 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1197/4325] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:21 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:22.064392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:22.065501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] [instance: 06555df6-9e1c-42ad-8830-5b95864b8f37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:22.075236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.076595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.078461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.080594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.081272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.081927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.106213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:22.107754 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] HTTP exception thrown: Instance 06555df6-9e1c-42ad-8830-5b95864b8f37 could not be found. Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Request method failure captured: Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 HTTP/1.1 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnlrTULysizjoYYiIBdo1N2gIul3CaWxE0XWdIbNvDQx5OXUFWlUwXdm8gBfKsWOBfXmG0qfBrpgQcxgiKskh04SiX_mkZLLcy2V4XyGdDWQny2VZJWbLhvcDfKaNbaKMK_-TSqmrIVM6KryIKpFRVvdrpTi0Fb6rbxkRNxNAQXPIag Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d45a553706284719bc495d91f7fd7c3b Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerShowV254Test-2062189643 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d45a553706284719bc495d91f7fd7c3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d45a553706284719bc495d91f7fd7c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d45a553706284719bc495d91f7fd7c3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d45a553706284719bc495d91f7fd7c3b"}]}] Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerShowV254Test-2062189643 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d45a553706284719bc495d91f7fd7c3b Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerShowV254Test-2062189643 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerShowV254Test-2062189643-project Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 317c830b25e64d25b558cb6b88a42558 Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerShowV254Test-2062189643-project Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 06555df6-9e1c-42ad-8830-5b95864b8f37 could not be found. Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '06555df6-9e1c-42ad-8830-5b95864b8f37'} Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06555df6-9e1c-42ad-8830-5b95864b8f37 could not be found. Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06555df6-9e1c-42ad-8830-5b95864b8f37 could not be found. Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:22.110144 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06555df6-9e1c-42ad-8830-5b95864b8f37 could not be found. Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:22.115566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] Returning 404 to user: Instance 06555df6-9e1c-42ad-8830-5b95864b8f37 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:22.117239 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-717e8513-93a8-4b32-9aff-21fb7e1abbe0 tempest-ServerShowV254Test-2062189643 tempest-ServerShowV254Test-2062189643-project] 10.222.0.18 "GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37" status: 404 len: 111 microversion: 2.54 time: 0.057015 Nov 02 14:07:22.117740 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3129/4326] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:22 2022] GET /compute/v2.1/servers/06555df6-9e1c-42ad-8830-5b95864b8f37 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:07:22.710212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:22.713710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:22.735005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.736916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.742673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.745760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.746443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.747846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.878996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:22.883528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:22.900351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.901442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.902071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.910837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.911810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.912827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.996722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.006867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c08673fd-2bc4-428e-9ab5-1fc1572196bf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 200 len: 1448 microversion: 2.1 time: 0.302598 Nov 02 14:07:23.020640 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1198/4327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:22 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 1448 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:23.034987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:23.036281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:23.051473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.052046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.052512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.053275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.053742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.054262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.107364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:23.213314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.226425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.228229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.229950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e910117-8c86-408c-a441-835984c6ee58 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.361984 Nov 02 14:07:23.240866 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3130/4328] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:22 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:23.290063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.300170 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-81eaa6ca-9d2f-45d7-a105-032b93adbb81 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.268136 Nov 02 14:07:23.301347 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1199/4329] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:23 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:23.335857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:23.337138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:23.347653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.348440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.349682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.350705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.351396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.351987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.565758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.581264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08023011-9be6-49e1-bf5c-5f7f53345ca6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.248086 Nov 02 14:07:23.603852 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3131/4330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:23 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:23.606071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:23.606698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:23.615635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.616551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.617001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.617719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.618279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.618897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.894394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.911520 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ad61914f-7be0-4e49-9faa-e092e0e87e7b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.310299 Nov 02 14:07:23.912315 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1200/4331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:23 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:23.940734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:23.941338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:23.957115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.957889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.957974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.958632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.959141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.959529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.259160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:24.260136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:24.272625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.274876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.275871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.278330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.279132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.282894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.465491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:24.483032 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b79c24bb-17ce-407c-a266-767f82b82c35 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.546373 Nov 02 14:07:24.492627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3132/4332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:23 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:24.524723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc9debb6-9e2a-44c6-8585-7e6a7b48625c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:24.538108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9debb6-9e2a-44c6-8585-7e6a7b48625c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.538594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9debb6-9e2a-44c6-8585-7e6a7b48625c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.539031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9debb6-9e2a-44c6-8585-7e6a7b48625c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.604948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:24.609814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc9debb6-9e2a-44c6-8585-7e6a7b48625c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:07:24.623477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:24.626627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:24.632433 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4273419c-483a-4e98-951a-690db3b39c6b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.377392 Nov 02 14:07:24.637234 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1201/4333] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:24 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:24.737623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc9debb6-9e2a-44c6-8585-7e6a7b48625c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.216756 Nov 02 14:07:24.740731 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3133/4334] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:07:24 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:24.757406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:24.759287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:24.786383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.791708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.792792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.793778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.795360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.797340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:25.041522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:25.055832 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-01334b2f-dac7-418c-af3e-5694cb8bb8b7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.307745 Nov 02 14:07:25.058859 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1202/4335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:24 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:25.385710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-560664883", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": "none"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:25.493377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:07:25.493806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:07:25.494281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:07:25.494976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:07:25.495434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:07:25.511611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:25.514088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:25.514795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:25.516206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:25.516738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:25.517235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:25.541739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Getting quotas for project e47c26cc3d874bd2b0a5893c92e9b33d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:07:25.552602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Getting quotas for user a87493e0a1de450f95e7634536196153 and project e47c26cc3d874bd2b0a5893c92e9b33d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:07:25.569716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:07:25.573197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:07:25.633369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06323495-cda9-44e9-b223-66b424157148 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.474540 Nov 02 14:07:25.634395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3134/4336] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:07:25.647651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98576ad3-3848-4370-894f-16cafb0dfe05 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:25.648293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98576ad3-3848-4370-894f-16cafb0dfe05 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:25.683165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:25.684076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:25.709740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:25.713622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:25.714142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:25.714921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:25.717073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:25.721753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:25.862000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98576ad3-3848-4370-894f-16cafb0dfe05 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:25.877176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98576ad3-3848-4370-894f-16cafb0dfe05 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:25.879600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98576ad3-3848-4370-894f-16cafb0dfe05 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:25.882610 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98576ad3-3848-4370-894f-16cafb0dfe05 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1277 microversion: 2.57 time: 0.239915 Nov 02 14:07:25.886727 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1203/4337] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:25 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:26.086433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:26.088058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:26.095863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:26.108219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:26.112558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:26.113535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:26.116683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:26.119462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:26.159983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:26.185409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:26.197715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:26.199510 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-543063af-bd77-4d33-8646-d094c98b6d7c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.521072 Nov 02 14:07:26.200523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3135/4338] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:25 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:26.555372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:26.568079 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3e82df0b-8728-43ea-aa38-c61a0a656b4a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.485420 Nov 02 14:07:26.569465 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1204/4339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:26 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:26.915313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38986c3a-c734-4a8e-8b25-42c3fcc307c6 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:26.916430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38986c3a-c734-4a8e-8b25-42c3fcc307c6 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:27.118983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38986c3a-c734-4a8e-8b25-42c3fcc307c6 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.133871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38986c3a-c734-4a8e-8b25-42c3fcc307c6 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.136368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38986c3a-c734-4a8e-8b25-42c3fcc307c6 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.137848 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38986c3a-c734-4a8e-8b25-42c3fcc307c6 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1277 microversion: 2.57 time: 0.228893 Nov 02 14:07:27.138908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3136/4340] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:26 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:27.238056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:27.238805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:27.254901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:27.259478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:27.259973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:27.268455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:27.268993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:27.269429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:27.575635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.598902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:27.599569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:27.620302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.622444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:27.623423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:27.624046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:27.624695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.627708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:27.628600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:27.632326 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b6b6427c-7f93-4adc-b041-6f885272271a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.398371 Nov 02 14:07:27.634070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:27.635691 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1205/4341] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:27 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:27.907283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.919976 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec1f838c-ad86-4190-a03a-2878a2e2ad3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.325719 Nov 02 14:07:27.923845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3137/4342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:27 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:28.173151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:28.173766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:28.184433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:28.184993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:28.191960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:28.194964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:28.196034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:28.196714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:28.296597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:28.326047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:28.328373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:28.329583 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c622278c-ddd7-4da2-b54c-dfffb41a6868 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1337 microversion: 2.57 time: 0.163633 Nov 02 14:07:28.332845 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1206/4343] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:28 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1337 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:28.684867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:28.685861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:28.724431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:28.728928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:28.732781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:28.734974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:28.757998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:28.759705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:28.949332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:28.949948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:29.002951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:29.004677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:29.009004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:29.015830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:29.018666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:29.019390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:29.048589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.060330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.062520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.064320 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb3cd75d-f281-42a4-bdf8-b128b5816528 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.384276 Nov 02 14:07:29.065081 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3138/4344] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:28 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:29.224426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.240617 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-27b8641d-c8c9-4b3b-be88-7c3af969305d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.295113 Nov 02 14:07:29.258366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1207/4345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:28 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:29.366244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:29.367031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:29.373696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:29.374346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:29.374890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:29.375663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:29.376343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:29.376975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:29.454259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.466614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.469114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.476692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e2d33a2-2066-423a-8311-4b979bfdb1a2 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1335 microversion: 2.57 time: 0.114437 Nov 02 14:07:29.497045 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3139/4346] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:29 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:30.090200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:30.090943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:30.100289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.101078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.101676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.102580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.103218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.103813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.253815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.264418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.266174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.267590 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c78fdc98-a1f6-4c20-a05c-04e9104900b9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.181727 Nov 02 14:07:30.268414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:30.268936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:30.269430 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1208/4347] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:30 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:30.279812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.280336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.281339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.282301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.282759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.283221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.457645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.466555 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c74117fe-1b6f-4eba-8e73-441922d5091a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.204344 Nov 02 14:07:30.468616 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3140/4348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:30 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:30.510038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:30.510756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:30.517970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.518510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.519727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.520694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.521360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.521988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.603570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.615363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.617277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:30.619492 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5648dd05-ee2c-4760-aa3f-e8ef2993a970 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1335 microversion: 2.57 time: 0.113092 Nov 02 14:07:30.620812 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1209/4349] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:30 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:30.856762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3d881904-cae4-403c-acfc-a33cf9fd1897 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:30.862950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d881904-cae4-403c-acfc-a33cf9fd1897 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.863599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d881904-cae4-403c-acfc-a33cf9fd1897 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.864253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d881904-cae4-403c-acfc-a33cf9fd1897 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.893101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3d881904-cae4-403c-acfc-a33cf9fd1897 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:07:30.938703 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3d881904-cae4-403c-acfc-a33cf9fd1897 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action" status: 202 len: 0 microversion: 2.1 time: 0.085329 Nov 02 14:07:30.939334 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3141/4350] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:07:30 2022] POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:30.951298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:30.953245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:30.963636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.964740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.965183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.966187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.966644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.967067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.157136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.169795 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5efd27d-c004-459e-a7d6-9192b2cfa2b9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.224597 Nov 02 14:07:31.172347 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1210/4351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:30 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:31.301041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:31.301937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:31.309907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.310711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.311357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.312680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.313238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.313863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.462991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.472389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.473848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.475023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7c662bf6-96c6-4785-906a-367619957ebc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1743 microversion: 2.20 time: 0.179040 Nov 02 14:07:31.475623 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3142/4352] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:31 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:31.492116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:31.493068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:31.499660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.500161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.500602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.501416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.501887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.502319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.649601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:31.650301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:31.658448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.658848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.659371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.660157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.660671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.661156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.705865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.713721 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-729d9ed7-a78c-4da4-b9f9-48856dce9dd1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.225409 Nov 02 14:07:31.714323 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1211/4353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:31 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:31.750816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.759160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.760604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.761786 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfe2099a-7bae-49f8-985f-181a30947abd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1356 microversion: 2.57 time: 0.116226 Nov 02 14:07:31.762363 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3143/4354] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:31 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:31.787777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:31.791108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:31.797410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.798170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.798869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.799836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.800362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.800862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.884725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:07:31.885149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:07:31.885646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:07:31.886049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:07:31.886671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:07:31.951677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:31.958642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.959157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.959597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.960513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:31.960973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:31.961397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.992553 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bdafcc6c-7caf-4021-a9eb-1cc14e8d6a6c tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "POST /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4/action" status: 202 len: 1137 microversion: 2.57 time: 0.208654 Nov 02 14:07:31.993175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1212/4355] 10.222.0.18 () {62 vars in 1320 bytes} [Wed Nov 2 14:07:31 2022] POST /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4/action => generated 1137 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 14:07:32.017236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:32.017881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:32.025625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.026149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.026587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.027658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.028419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.028851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.098992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.108641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.110112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.111845 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5958315-59d6-4c61-a39e-90536b9f04c9 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.100624 Nov 02 14:07:32.112186 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3144/4356] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:32 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:32.198221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:32.200116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:32.207041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.207568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.208008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.209392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.209867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.210302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.370313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.380557 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f388d6d4-20de-406b-94e2-449eae7900e2 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.187104 Nov 02 14:07:32.381131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1213/4357] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:32 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:32.501879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:32.503259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:32.509887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.510373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.510809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.511854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.512588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.513984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.663483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.674634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.676354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.678051 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca468653-5fd5-4d93-a127-36a9b08f81b2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1743 microversion: 2.20 time: 0.180069 Nov 02 14:07:32.696716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3145/4358] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:32 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:32.738175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:32.738798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:32.747729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.748217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.751515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.752271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.752744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.753180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.909052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.917112 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e956e32-1806-4e7d-b883-bf7cd15b2dbd tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.183549 Nov 02 14:07:32.917728 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1214/4359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:32 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:33.143427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:33.144042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:33.147380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:33.151003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.151530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.151970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.152679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.153317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.153901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.160346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:33.245232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.260255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.262415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.263768 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5fcc5b3e-010e-47bf-ba41-c258dbbffd3e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.125919 Nov 02 14:07:33.264594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3146/4360] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:33 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:33.404777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:33.405566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:33.419307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.420159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.420852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.427460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.427947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.428409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.432934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:33.615947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.625555 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4841b06-e660-4da1-a533-7180c499728a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.224647 Nov 02 14:07:33.640803 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1215/4361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:33 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:33.707535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:33.708240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:33.718427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.719232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.719931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.720617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.721269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.721699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.884812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.894415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.896415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.897846 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a84de4c1-7afd-4133-86f0-ce0323503790 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.195251 Nov 02 14:07:33.899005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3147/4362] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:33 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:33.943308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:33.944408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:33.952680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.953546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.954232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.955703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.956484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.957218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.181066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:34.194946 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ac70d995-0d30-43af-ac01-5d7d4773eb2b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1681 microversion: 2.1 time: 0.256481 Nov 02 14:07:34.196377 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1216/4363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:33 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:34.293201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:34.293827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:34.301544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.302035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.303696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.304436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.304905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.305333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.387519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:34.426264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:34.428369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:34.430498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8d665bb-4287-4928-988c-2bbb654f49e0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.141218 Nov 02 14:07:34.456665 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3148/4364] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:34 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:34.654192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:34.655000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:34.668163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.668674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.669091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.675728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.677517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.679556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.928416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:34.929703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:34.954113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.954804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.957527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.965202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.966269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.967447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.992360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.004580 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-072ba2bc-c3ed-4bf3-8a29-7918f7a22466 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.356027 Nov 02 14:07:35.009642 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1217/4365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:34 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:35.223901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:35.224993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:35.241396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.241910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.242355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.243163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.252380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.252902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.407466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.419819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.421871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.423147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-807b5882-59b4-4e9a-9393-ebfd0a679514 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.499728 Nov 02 14:07:35.428669 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3149/4366] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:34 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:35.462743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:35.464436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:35.476333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.478911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.479697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.482380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.488369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.491126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.553825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:35.577183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.599842 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-39717ec6-95fd-4d22-88f2-1572ac197598 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1658 microversion: 2.1 time: 0.381720 Nov 02 14:07:35.600469 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1218/4367] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:35 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1658 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:35.633834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-802b2d0b-68c6-4c12-9c1c-9b4c2fc6104a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:35.650347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802b2d0b-68c6-4c12-9c1c-9b4c2fc6104a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.650852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802b2d0b-68c6-4c12-9c1c-9b4c2fc6104a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.651327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802b2d0b-68c6-4c12-9c1c-9b4c2fc6104a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.708683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.711842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-802b2d0b-68c6-4c12-9c1c-9b4c2fc6104a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Going to try to start instance {{(pid=137558) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:07:35.720173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.721647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.724654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a92c287a-4d8e-4367-98c3-7088fdd5dbc4 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.266145 Nov 02 14:07:35.727722 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3150/4368] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:35 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:35.767252 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-802b2d0b-68c6-4c12-9c1c-9b4c2fc6104a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.145235 Nov 02 14:07:35.776294 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1219/4369] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:07:35 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:35.785285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:35.786104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:35.802743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.804884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.805850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.806955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.807682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.808292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.001432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:36.016919 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-deddfad2-50d6-426a-b45a-b2eba6d60433 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1667 microversion: 2.1 time: 0.234434 Nov 02 14:07:36.018958 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3151/4370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:35 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1667 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:36.033286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:36.037850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:36.039231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:36.056135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:36.056902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:36.058673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.067919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:36.068690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:36.069143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.330023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:36.341178 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7229fc3e-f3e2-42c9-84e7-f0fdff52f52a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.308783 Nov 02 14:07:36.341845 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1220/4371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:36 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:36.453957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:36.454684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:36.465255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:36.465756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:36.466196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.466913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:36.467661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:36.467837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.715300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:36.725643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:36.730845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:36.736431 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3bba4d28-0f90-44c6-9acc-37b1a45e8ba5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.285683 Nov 02 14:07:36.752889 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3152/4372] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:36 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:36.758309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:36.759802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:36.770116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:36.770879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:36.771635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.772558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:36.773014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:36.773598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:36.995204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:37.005576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:37.007069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:37.008469 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-137e831b-3a52-4f10-8d04-b0ef17103bd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.253960 Nov 02 14:07:37.019798 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1221/4373] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:36 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:37.042585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:37.043386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:37.056621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.057415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.058042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.059590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.060696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.062625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.125736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:37.438978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:37.450750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d1d22c8-ec49-4e09-a94b-ec098b310cdc tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1667 microversion: 2.1 time: 0.410120 Nov 02 14:07:37.455255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3153/4374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:37 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1667 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:37.465796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:37.469812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:37.503151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.503569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.504014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.504766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.506744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.507863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.546968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-76a9fab3-43a1-4629-91ac-54804af6b3ae req-92b0c5cb-585d-496b-9c30-a78e7797fa9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "name": "network-vif-plugged", "status": "completed", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:37.574815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-76a9fab3-43a1-4629-91ac-54804af6b3ae req-92b0c5cb-585d-496b-9c30-a78e7797fa9b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.575657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-76a9fab3-43a1-4629-91ac-54804af6b3ae req-92b0c5cb-585d-496b-9c30-a78e7797fa9b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.580004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-76a9fab3-43a1-4629-91ac-54804af6b3ae req-92b0c5cb-585d-496b-9c30-a78e7797fa9b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.607159 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-76a9fab3-43a1-4629-91ac-54804af6b3ae req-92b0c5cb-585d-496b-9c30-a78e7797fa9b service nova] Creating event network-vif-plugged:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h1-858238-3 Nov 02 14:07:37.622093 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-76a9fab3-43a1-4629-91ac-54804af6b3ae req-92b0c5cb-585d-496b-9c30-a78e7797fa9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.412707 Nov 02 14:07:37.624318 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1222/4375] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:37.769815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:37.771257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:37.782631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.790000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.790752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.791762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.792450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.793155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.847618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:37.856855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad2c82bd-751c-4343-895b-37cfdd917019 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.400356 Nov 02 14:07:37.857477 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3154/4376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:37 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:38.043014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:38.044689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:38.073172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.076726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.078331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.082164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.083208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.100001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.101325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.110614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.112398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.114000 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe9ba55a-d5b2-4fa8-b67f-10b47a9d2338 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.351620 Nov 02 14:07:38.114572 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1223/4377] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:37 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:38.222036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.234205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.237193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.237942 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66e7c714-4db4-49c3-90a1-5b19cb544e58 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.199454 Nov 02 14:07:38.238619 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3155/4378] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:38 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:38.504109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:38.504735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:38.513125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.513632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.514075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.514796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.515493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.523559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.770688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.779929 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-61282c4e-c74b-4397-98a0-0ecb4460d754 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.280603 Nov 02 14:07:38.781028 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1224/4379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:38 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:38.807119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:38.809021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:38.816086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.816852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.817519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.818834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.820154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.820804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.885047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:38.885859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:38.894948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.896068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.896941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.898298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.899129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.899715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.086773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.102549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-298b4706-44be-4647-b961-1f07ea8369ea tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.299143 Nov 02 14:07:39.103748 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3156/4380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:38 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:39.133432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:39.134427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:39.147129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.148621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.159834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.159834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.171794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.172264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.241689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.250268 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-32216f34-1643-4ad8-a1a7-40930c0c8fb9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.369206 Nov 02 14:07:39.269684 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1225/4381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:38 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:39.289189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:39.289999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:39.300049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.301230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.302472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.303476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.304221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.305134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.480290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.491002 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc9d85b6-b320-490e-8851-ce53a45cb31b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.362277 Nov 02 14:07:39.492958 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3157/4382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:39 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:39.507363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:39.521187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:39.544835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.545324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.545764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.546523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.546983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.547442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.628512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.644876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.660766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.661389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.662431 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c39ea1f7-c9fe-4d30-b157-bb37e16afe59 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.391398 Nov 02 14:07:39.677286 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1226/4383] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:39 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:39.694927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.696907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.698333 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d74b8ff7-22a8-437b-8941-13054beb0ed8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.204422 Nov 02 14:07:39.699850 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3158/4384] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:39 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:39.708946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:39.711336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:39.723675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.724695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.725432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.726382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.726954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.728297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.936386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.946334 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1bbd380-8104-481c-a183-f4bd3d07c2d9 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.250275 Nov 02 14:07:39.947540 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1227/4385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:39 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:39.971210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:39.972108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:39.978536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.979285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.980128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.981017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.981639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.982257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.206863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:40.223204 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8fa2464-836a-4c27-a925-cedbb3bb8f38 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.256093 Nov 02 14:07:40.224524 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3159/4386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:39 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:40.251446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:40.251870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:40.262771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:40.266994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.267744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.268354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.272584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.273270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.275559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:40.275723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.276706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:40.293092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.295767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.297166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.300100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.302741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.303321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.329893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lazy-loading 'flavor' on Instance uuid 3b24d306-b049-4140-b93e-e92a824d8d35 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:40.522206 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-337be220-6f07-4973-9db7-151017337530 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.275038 Nov 02 14:07:40.527211 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1228/4387] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:07:40 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:40.540115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:40.541035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:40.548806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.549448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.549992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.550806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.551598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.552064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.592812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:40.613405 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6c398fe-2639-4ff7-a913-6e8eb1a19dfa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1676 microversion: 2.1 time: 0.340922 Nov 02 14:07:40.631313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3160/4388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:40 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1676 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:40.707760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:40.708433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:40.718716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.719467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.720388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.722063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.723276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.724815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.856259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:40.868966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:40.872917 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1596cc49-e1d5-4d4b-9420-f07b168a2ed7 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1679 microversion: 2.1 time: 0.343562 Nov 02 14:07:40.873872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1229/4389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:40 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1679 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:40.883833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:40.884824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:40.895471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.896563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.897718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.899744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.900867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.901569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.995498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.016452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.024025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.025675 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a25a42f7-3753-4e1d-99eb-087a8da2f113 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.149812 Nov 02 14:07:41.027032 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1230/4390] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:40 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:41.141783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.156116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.158108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.159955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ccfdbd4-bb6a-499a-bcd2-f0538371f64a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.462300 Nov 02 14:07:41.161245 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3161/4391] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:40 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:41.666148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:41.667049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:41.693048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:41.696315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:41.696853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:41.697697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:41.699857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:41.700635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:41.915955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:41.918659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:41.940098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:41.940952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:41.941396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:41.944276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:41.944897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:41.945563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:41.983143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.993776 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-df2e29c0-f3ab-478f-b473-b3fa0a19dbc9 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1653 microversion: 2.1 time: 0.331728 Nov 02 14:07:41.995021 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1231/4392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:41 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1653 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:42.021023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-22ab9bd2-70e5-4868-b230-644e01ae98d3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:42.030656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22ab9bd2-70e5-4868-b230-644e01ae98d3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.031296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22ab9bd2-70e5-4868-b230-644e01ae98d3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.031814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22ab9bd2-70e5-4868-b230-644e01ae98d3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.107641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-22ab9bd2-70e5-4868-b230-644e01ae98d3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Going to try to start instance {{(pid=137558) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:07:42.229045 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-22ab9bd2-70e5-4868-b230-644e01ae98d3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action" status: 202 len: 0 microversion: 2.1 time: 0.211256 Nov 02 14:07:42.232728 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1232/4393] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:07:42 2022] POST /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:42.297172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:42.301633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:42.308242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:42.325767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:42.337239 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e70a51f-eb08-4b9b-99f2-8da7dca12934 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1662 microversion: 2.1 time: 0.425428 Nov 02 14:07:42.343006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.345036 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3162/4394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:41 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1662 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:42.359301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.359301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.359301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.359301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.360400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.369100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:42.371442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:42.383522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.383658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.384005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.384712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.385161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.385580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.526185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:42.537459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:42.540307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:42.541852 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-924ee350-6d31-49ea-9ae6-7308a731fcd5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.292390 Nov 02 14:07:42.543158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1233/4395] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:42 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:42.548612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:42.549239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:42.556184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.556344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.556732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.557452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.558087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.558922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.165118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.184514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.186420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.188093 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39238bb1-dad9-445d-ac73-d796da59cc0a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.834278 Nov 02 14:07:43.189573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3163/4396] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:42 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:43.195494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:43.196385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:43.204136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:43.204950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:43.205608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.206535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:43.207376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:43.208040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.310108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3809c27b-5b4c-4f33-915c-bc7934218328 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action" status: 202 len: 0 microversion: 2.1 time: 0.117814 Nov 02 14:07:43.321088 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3164/4397] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:07:43 2022] POST /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:43.321296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.331193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-436293907", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:43.340564 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a700309c-3117-4f4c-937f-21029aca81a7 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1662 microversion: 2.1 time: 0.791056 Nov 02 14:07:43.341721 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1234/4398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:42 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1662 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:43.354717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:43.355729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:43.385958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:43.386559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:43.387069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.388062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:43.388862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:43.403378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.452122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:07:43.805167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.813468 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e011639-367d-4772-9973-d8e038f6d7c1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1668 microversion: 2.1 time: 0.469298 Nov 02 14:07:43.839131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1235/4399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:43 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1668 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:43.839131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:43.839131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:43.840685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:43.845931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:43.845931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.845931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:43.845931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:43.845931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.972517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.992394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.996261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.000197 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9c50b586-d738-4a08-b6b2-47914d008af5 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.169330 Nov 02 14:07:44.005241 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1236/4400] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:43 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:44.113673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:07:44.114093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:07:44.114778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:07:44.115373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:07:44.115948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:07:44.133961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.134728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.135467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.138647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.139437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.140113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.182859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Getting quotas for project 6537fd684cfa434b84674b58c83b4ad8. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:07:44.198249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Getting quotas for user 6728c27bfa614ba197a4995684c3fefb and project 6537fd684cfa434b84674b58c83b4ad8. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:07:44.213789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:07:44.216649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:07:44.223678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:44.224389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:44.233004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.234043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.234912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.236138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.236825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.237526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.302874 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4726d6d9-354e-4158-b1e4-ebfffc9010b5 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978088 Nov 02 14:07:44.311392 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3165/4401] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:07:44.317271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f483ad14-43b6-4f45-927c-5a587ab744f7 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:44.318133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f483ad14-43b6-4f45-927c-5a587ab744f7 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:44.393932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f483ad14-43b6-4f45-927c-5a587ab744f7 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.403313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f483ad14-43b6-4f45-927c-5a587ab744f7 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1213 microversion: 2.1 time: 0.090627 Nov 02 14:07:44.404313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3166/4402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:44 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:44.433722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:44.434758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:44.458599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.459122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.461595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.462994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.467729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.470083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.658691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.701030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.704432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.710175 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1dda023-59ff-4e2c-a37b-63d21a14e5dc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.492191 Nov 02 14:07:44.714649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1237/4403] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:44 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:44.763539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.785101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b090a0a0-edda-43be-95c3-65412165f199 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1662 microversion: 2.1 time: 0.378762 Nov 02 14:07:44.787620 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3167/4404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:44 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1662 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:44.878993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:44.880493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:44.925096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.925753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.928348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.929196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.929677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.930122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.041656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:45.042423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:45.053745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.059499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.062025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.063844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.069334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.076206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.276948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:45.298331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:45.302648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:45.307732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:45.309231 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed8a3e17-3fd9-4868-a70d-bab885771eb0 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.271456 Nov 02 14:07:45.311710 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ceee405e-34d1-4db9-9fda-1ab831a9ef12 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1668 microversion: 2.1 time: 0.458282 Nov 02 14:07:45.313195 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3168/4405] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:45 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:45.314179 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1238/4406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:44 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1668 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:45.439628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:45.452272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:45.475264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.475987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.488360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.489821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.490803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.491581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.632468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:45.641766 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7117fe5a-afd1-4fb6-969d-5d0291716378 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1217 microversion: 2.1 time: 0.209499 Nov 02 14:07:45.642714 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1239/4407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:45 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:45.750373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:45.750913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:45.762972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.763497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.763933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.764647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.765640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.766064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.813658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:45.814242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:45.823121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.823910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.824530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.826886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.828139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.828784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.041320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.062676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.069053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.070564 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8f3e2ca-7700-4b46-acf4-e158c6e87061 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.325361 Nov 02 14:07:46.071638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3169/4408] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:45 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:46.101451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.117808 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5e40c87-ac0a-49fd-b57f-37c3932ab103 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1666 microversion: 2.1 time: 0.308273 Nov 02 14:07:46.119872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1240/4409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:45 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1666 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:46.370588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.371331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.371956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.372410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.382129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.382635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.383078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.383951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.384408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.384624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.384831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.384986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.385709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.386712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.387321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.387768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.547758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.581752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.586454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.587724 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-03495c6e-af26-4590-ac19-0672c0e979c8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.220900 Nov 02 14:07:46.591588 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1241/4410] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:46 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:46.637369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.648513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82900926-1c54-4188-9029-e3b26c10d27d tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.284316 Nov 02 14:07:46.649681 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3170/4411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:46 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:46.671158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.673270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.675787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.677380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.682390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.685566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.686211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.687063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.687683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.688537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.691392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.692200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.693356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.693843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.694667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.695424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.824187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.866146 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a8ba23ec-61b3-4280-a86e-f56bb24ed592 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1273 microversion: 2.1 time: 0.204892 Nov 02 14:07:46.867641 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1242/4412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:46 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:46.972496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.982425 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66d74193-3ffe-4e03-beb7-e13bd25aedda tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1671 microversion: 2.1 time: 0.311963 Nov 02 14:07:46.983158 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3171/4413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:46 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1671 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:47.016728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:47.017526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:47.024103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.024589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.025211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.026087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.026703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.027636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.059331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:47.068234 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.compute.api [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Working on deleting snapshot 64bd28ef-9dac-45df-9865-d7ed3c40b1f8 from shelved instance... Nov 02 14:07:47.103415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:47.104086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:47.113242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.113732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.114277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.114853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.118454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.118962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.387662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.405033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.407591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.416540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7e2a0e6-0828-4308-a60f-0246a3f84a91 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.317813 Nov 02 14:07:47.419564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3172/4414] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:47 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:47.639987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:47.641068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:47.650811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.653627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.653627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.653627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.653627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.653627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.834098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.863426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.867282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.870360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e48a5284-654f-4944-ab23-63cef7c9e173 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.251968 Nov 02 14:07:47.873553 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3173/4415] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:47 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:47.901651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:47.904267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:47.919145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.920429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.922129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.934030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.938023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.939467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.244934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:48.277260 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e0ef631-3377-4b64-87c0-da11d86683e9 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.389669 Nov 02 14:07:48.279609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3174/4416] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:47 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:48.457065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Doing local delete in cell 9d7d2220-711a-49ba-b1ed-85ca0f1895b5(cell1) {{(pid=137558) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 14:07:48.458785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.459974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.465194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.465913 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.compute.api [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 14:07:48.467541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:48.468801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:48.471639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] deallocate_for_instance() {{(pid=137558) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 14:07:48.479335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.480774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.481479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.482429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.483089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.483831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.828597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:48.840375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:48.842442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:48.844108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c778373b-210c-4879-bd76-5454d5c8e48a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.387192 Nov 02 14:07:48.864358 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3175/4417] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:48 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:48.928512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:48.931657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:48.961762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.962658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.964785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.968531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.972323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.974307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.126322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:49.138330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:49.148232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:49.153448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5fd9c118-d480-467b-af8e-b1f16a8216ef tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.236051 Nov 02 14:07:49.154074 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3176/4418] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:48 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:49.177213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-208f7bd7-40c6-4b33-ae0f-8c4c19736d08 req-64667fac-580a-4e98-af76-8a093173c86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f366ab5-db8f-4218-a225-5cb499b0899e", "tag": "1660ba65-5617-46a1-b752-75017e127845"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:49.219513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-208f7bd7-40c6-4b33-ae0f-8c4c19736d08 req-64667fac-580a-4e98-af76-8a093173c86e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:49.220389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-208f7bd7-40c6-4b33-ae0f-8c4c19736d08 req-64667fac-580a-4e98-af76-8a093173c86e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:49.220996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-208f7bd7-40c6-4b33-ae0f-8c4c19736d08 req-64667fac-580a-4e98-af76-8a093173c86e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.253931 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-208f7bd7-40c6-4b33-ae0f-8c4c19736d08 req-64667fac-580a-4e98-af76-8a093173c86e service nova] Creating event network-changed:1660ba65-5617-46a1-b752-75017e127845 for instance 9f366ab5-db8f-4218-a225-5cb499b0899e on n-h2-858238-3 Nov 02 14:07:49.263139 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-208f7bd7-40c6-4b33-ae0f-8c4c19736d08 req-64667fac-580a-4e98-af76-8a093173c86e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107717 Nov 02 14:07:49.264126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3177/4419] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:49.303838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:49.304206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:49.320316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:49.320808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:49.325565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.326511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:49.326946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:49.327440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.792105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Updating instance_info_cache with network_info: [] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 14:07:49.795789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:49.831680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:49.848570 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9fdf1f0-3f3c-4c96-af2d-fd24708cf83a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.548968 Nov 02 14:07:49.851667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3178/4420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:49 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:50.117564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-43a19eb8-bed3-4270-92ed-11768d181a16 req-ba58538c-05f0-4966-bd2f-1bbedd3d8dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2871afe-6f23-4e73-aa6a-9a6da7a76411", "name": "network-vif-deleted", "tag": "18a12a24-c374-4699-b315-2e07f286ac03"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:50.146210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-43a19eb8-bed3-4270-92ed-11768d181a16 req-ba58538c-05f0-4966-bd2f-1bbedd3d8dc4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.146694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-43a19eb8-bed3-4270-92ed-11768d181a16 req-ba58538c-05f0-4966-bd2f-1bbedd3d8dc4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.150647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-43a19eb8-bed3-4270-92ed-11768d181a16 req-ba58538c-05f0-4966-bd2f-1bbedd3d8dc4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.178608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.compute.server_external_events [req-43a19eb8-bed3-4270-92ed-11768d181a16 req-ba58538c-05f0-4966-bd2f-1bbedd3d8dc4 service nova] Unable to find a host for instance a2871afe-6f23-4e73-aa6a-9a6da7a76411. Dropping event network-vif-deleted {{(pid=137559) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 14:07:50.180095 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-43a19eb8-bed3-4270-92ed-11768d181a16 req-ba58538c-05f0-4966-bd2f-1bbedd3d8dc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.327149 Nov 02 14:07:50.181928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3179/4421] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 330 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 14:07:50.200547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.202120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.210828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.212366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.212990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.213884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.214521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.216097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.384318 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb1f85e4-da4e-491b-9c3b-1894d69fe78f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 204 len: 0 microversion: 2.1 time: 3.371043 Nov 02 14:07:50.386904 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1243/4422] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:07:47 2022] DELETE /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 0 bytes in 3375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:07:50.393379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.394664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.401370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.409850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.411185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.414815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.415533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.419080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.420851 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8e3dd88-f165-4695-8f52-564f39b036f0 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.232050 Nov 02 14:07:50.422085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.423349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.423837 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3180/4423] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:50 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:50.424401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.446246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.447923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: a2871afe-6f23-4e73-aa6a-9a6da7a76411] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.463731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.464135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.464573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.465296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.465747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.466271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.497248 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] HTTP exception thrown: Instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 could not be found. Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Request method failure captured: Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 HTTP/1.1 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndhdGKUC7D589ajspQB1yE7varO5rOuJ8uCp6LFA88n-7a6CJnNp_xYVdgh1S5kg2U35y0K0ywE-fPsP84zjQg21NU95D5-ohgaVtpj-Z2IQHTbxA-ZL9LOqzPNk-Xfxq1Fzwd331iqtO8K69cnJj7NznkzF70t0qxEcq6A5nzyEsM Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/440bbc53bad84aeda15c454a82450493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_440bbc53bad84aeda15c454a82450493"}]}] Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 53bef65bfa79486a8f0180f2f86eddba Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 could not be found. Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a2871afe-6f23-4e73-aa6a-9a6da7a76411'} Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 could not be found. Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 could not be found. Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:50.499282 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 could not be found. Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Returning 404 to user: Instance a2871afe-6f23-4e73-aa6a-9a6da7a76411 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:50.505302 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b9cb84d-b5e8-4c69-bc5d-1ffede8410c8 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411" status: 404 len: 111 microversion: 2.1 time: 0.078938 Nov 02 14:07:50.509097 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3181/4424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:50 2022] GET /compute/v2.1/servers/a2871afe-6f23-4e73-aa6a-9a6da7a76411 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:07:50.513942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.514715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.521935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.522667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.523212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.523920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.524449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.524948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.528147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:50.541511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.557980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.558229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:50.560801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.562995 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7228d38d-64ca-4c74-8109-2b88379dd660 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.174472 Nov 02 14:07:50.565265 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1244/4425] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:50 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:50.651711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e64faf07-2792-4a3b-bc12-144c36eb0702 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 204 len: 0 microversion: 2.1 time: 0.141268 Nov 02 14:07:50.652349 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3182/4426] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:07:50 2022] DELETE /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:07:50.665361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.665993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.674646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.675165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.675617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.676353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.676778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.677205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.793516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.802822 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e1fc46c-3a45-4d56-8a35-b42b66330b67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1466 microversion: 2.1 time: 0.142527 Nov 02 14:07:50.819061 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1245/4427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:50 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:50.884510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.888320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.900518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.901246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.906330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.908341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.909425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.910571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.117900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.130519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da3ac3b8-4b67-4f43-aa9c-01e6f1bc5951 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.258486 Nov 02 14:07:51.131458 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3183/4428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:50 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:51.470821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:51.472175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:51.487432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.487924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.488646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.489607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.490230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.490906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.597805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:51.597805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:51.604510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.605351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.605896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.616089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.617130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.617758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.689457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.704080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.706802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.708721 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae1eeb0c-4525-4960-93f1-557d1468fc16 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1738 microversion: 2.20 time: 0.244469 Nov 02 14:07:51.709805 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1246/4429] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:51 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:51.710243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.726611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.728178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.736184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe24ba26-d10f-4089-ad7d-9c8c03c52de3 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.142795 Nov 02 14:07:51.737155 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3184/4430] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:51 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:51.828033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:51.828815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:51.835272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.835770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.836206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.836923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.837413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.837842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.942639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.954061 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e5e811b-3b53-4c94-a199-bba9f5fd2de6 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1466 microversion: 2.1 time: 0.129917 Nov 02 14:07:51.954648 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1247/4431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:51 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1466 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:52.158485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:52.159305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:52.161434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:52.166613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.167269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.167805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.168611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.169303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.169677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.328936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:52.337267 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-220b21e8-a1e3-4953-aec4-ff78e23051ad tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.184548 Nov 02 14:07:52.337856 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3185/4432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:52 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:52.738443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:52.739466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:52.748075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.748908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.749564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.750597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.751263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.751859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.770294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:52.771640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:52.790518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.791439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.791777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.792490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.793122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.793733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.959989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:52.975022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:52.980831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:52.986205 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79de91e4-e0d5-4acf-a61a-b99f4dd0bfbd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.222479 Nov 02 14:07:53.005515 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3186/4433] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:52 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:53.021897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:53.022622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:53.031014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.031676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.032345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.033155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.033683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.034191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.277590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:53.284375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:53.290178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b40e6ba0-8fe7-40af-b898-525914705f63 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1466 microversion: 2.1 time: 0.282114 Nov 02 14:07:53.291062 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3187/4434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:53 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:53.293035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:53.294507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:53.295739 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-95eb8a4c-edfe-4158-8802-63a9cea5baee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1720 microversion: 2.20 time: 0.562364 Nov 02 14:07:53.296854 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1248/4435] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:52 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1720 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:53.363050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:53.364784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:53.373689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.374359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.375555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.376975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.377498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.377990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.680804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:53.690235 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ebb44e6-91af-44b1-92e2-fd054a467454 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.332995 Nov 02 14:07:53.691288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3188/4436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:53 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:53.976212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4aa5534f-3f5f-40e3-8d03-6041a6cda372 req-eefddac8-a926-45a9-a03c-fb90b9d241c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993beae9-f515-42d1-aee4-da8abb40512d", "name": "network-vif-deleted", "tag": "9653e393-b388-4d57-aac3-af97e267c746"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:53.993728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4aa5534f-3f5f-40e3-8d03-6041a6cda372 req-eefddac8-a926-45a9-a03c-fb90b9d241c3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.994554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4aa5534f-3f5f-40e3-8d03-6041a6cda372 req-eefddac8-a926-45a9-a03c-fb90b9d241c3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.995216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4aa5534f-3f5f-40e3-8d03-6041a6cda372 req-eefddac8-a926-45a9-a03c-fb90b9d241c3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.023805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:54.025876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:54.030405 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4aa5534f-3f5f-40e3-8d03-6041a6cda372 req-eefddac8-a926-45a9-a03c-fb90b9d241c3 service nova] Creating event network-vif-deleted:9653e393-b388-4d57-aac3-af97e267c746 for instance 993beae9-f515-42d1-aee4-da8abb40512d on n-h2-858238-3 Nov 02 14:07:54.041236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.041776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.042219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.042972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.043461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.043887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.053353 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4aa5534f-3f5f-40e3-8d03-6041a6cda372 req-eefddac8-a926-45a9-a03c-fb90b9d241c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080773 Nov 02 14:07:54.054173 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1249/4437] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:54.149496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:54.163484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.176761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.178393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.179681 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aeb0a45b-b11f-4235-93d7-aeb4b0769765 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.160215 Nov 02 14:07:54.197946 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3189/4438] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:54 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:54.320678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:54.320678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:54.330317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:54.332859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:54.344126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.344126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.344126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.344126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.347196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.347196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.349220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.349717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.350145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.350846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.351328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.351745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.386225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.386841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.387327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.387783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lazy-loading 'fault' on Instance uuid 993beae9-f515-42d1-aee4-da8abb40512d {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:54.398996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:54.491730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.500897 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a5384de-1b2a-4dc9-a6c1-69f3ab4f1dbe tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 200 len: 1305 microversion: 2.1 time: 0.186291 Nov 02 14:07:54.501490 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1250/4439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:54 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 1305 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:54.558858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.570088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.572494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.574640 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52f16a00-614e-438a-aca0-5f09a2cda2c2 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1720 microversion: 2.20 time: 0.250469 Nov 02 14:07:54.576013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3190/4440] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:54 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:54.714658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:54.715320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:54.728006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.728600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.729075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.729836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.730296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.730727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.915598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.926626 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-459d18fe-3e0d-45bb-8789-d1a6a1336717 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.216577 Nov 02 14:07:54.927354 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1251/4441] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:54 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:54.961171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-85139f9e-f800-4937-b7c2-2d2041bcfcd7 req-7eb162f0-9e19-4de2-9fe1-26709b4d85b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "name": "network-vif-unplugged", "status": "completed", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:54.975431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-85139f9e-f800-4937-b7c2-2d2041bcfcd7 req-7eb162f0-9e19-4de2-9fe1-26709b4d85b0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.976036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-85139f9e-f800-4937-b7c2-2d2041bcfcd7 req-7eb162f0-9e19-4de2-9fe1-26709b4d85b0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.976505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-85139f9e-f800-4937-b7c2-2d2041bcfcd7 req-7eb162f0-9e19-4de2-9fe1-26709b4d85b0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.993939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-85139f9e-f800-4937-b7c2-2d2041bcfcd7 req-7eb162f0-9e19-4de2-9fe1-26709b4d85b0 service nova] Creating event network-vif-unplugged:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h1-858238-3 Nov 02 14:07:55.000945 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-85139f9e-f800-4937-b7c2-2d2041bcfcd7 req-7eb162f0-9e19-4de2-9fe1-26709b4d85b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044396 Nov 02 14:07:55.002435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3191/4442] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:55.210683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.211253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.219322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.219804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.220234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.220992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.221444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.221865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.298438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.309839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.311593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.312846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a25bff91-9920-43b5-bba8-9a7d7864cb24 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.106768 Nov 02 14:07:55.313402 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1252/4443] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:55 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:55.534020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.534696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 993beae9-f515-42d1-aee4-da8abb40512d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.541899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.542416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.542864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.543675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.544141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.544573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.559468 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] HTTP exception thrown: Instance 993beae9-f515-42d1-aee4-da8abb40512d could not be found. Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Request method failure captured: Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d HTTP/1.1 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYndhdGKUC7D589ajspQB1yE7varO5rOuJ8uCp6LFA88n-7a6CJnNp_xYVdgh1S5kg2U35y0K0ywE-fPsP84zjQg21NU95D5-ohgaVtpj-Z2IQHTbxA-ZL9LOqzPNk-Xfxq1Fzwd331iqtO8K69cnJj7NznkzF70t0qxEcq6A5nzyEsM Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/440bbc53bad84aeda15c454a82450493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_440bbc53bad84aeda15c454a82450493"}]}] Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 53bef65bfa79486a8f0180f2f86eddba Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 993beae9-f515-42d1-aee4-da8abb40512d could not be found. Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '993beae9-f515-42d1-aee4-da8abb40512d'} Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993beae9-f515-42d1-aee4-da8abb40512d could not be found. Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993beae9-f515-42d1-aee4-da8abb40512d could not be found. Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:55.561129 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993beae9-f515-42d1-aee4-da8abb40512d could not be found. Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Returning 404 to user: Instance 993beae9-f515-42d1-aee4-da8abb40512d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc5d8b59-09d5-4beb-9994-ddd200e00372 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d" status: 404 len: 111 microversion: 2.1 time: 0.034657 Nov 02 14:07:55.565892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3192/4444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:55 2022] GET /compute/v2.1/servers/993beae9-f515-42d1-aee4-da8abb40512d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:07:55.572156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.573381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.580336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.580829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.581269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.581977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.582432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.582859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.607057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.608070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.610319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:55.614309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.614801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.615318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.615982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.616439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.616866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.720877 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d198b09f-0bb8-4778-bf78-f73a355c429f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 204 len: 0 microversion: 2.1 time: 0.151304 Nov 02 14:07:55.721493 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1253/4445] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:07:55 2022] DELETE /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:07:55.731775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.732656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.740501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.741177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.741610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.742520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.743012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.743501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.777234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=15,nova_cell1:RELEASE=1,nova_cell1:SELECT=80,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:55.778212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.788782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.790253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.791497 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37f8551e-ac28-41e5-8e9b-38b5cf5adf3a tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1720 microversion: 2.20 time: 0.188361 Nov 02 14:07:55.792263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3193/4446] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:55 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:55.913111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.921707 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-08fe6c8f-a568-4d3d-9dbd-a39c4f96009b tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1508 microversion: 2.1 time: 0.195534 Nov 02 14:07:55.922297 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1254/4447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:55 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:55.950276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.950885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.957997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.958478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.959181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.960131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.960588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.961015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.120015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:56.130350 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05d258e0-97eb-495d-9bc2-3462589d4ec4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.183852 Nov 02 14:07:56.139546 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3194/4448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:55 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:56.341116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:56.341630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:56.348845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.349362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.349797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.350788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.351496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.353122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.433500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:56.449122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:56.452161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:56.454149 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc86ed34-7c84-4811-8f15-2cc74770615f tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.117662 Nov 02 14:07:56.455203 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1255/4449] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:56 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:07:56.823390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:56.824128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:56.834910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.835443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.835873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.836582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.837033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.837449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.006262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:57.018385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:57.020041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:57.022357 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f02dc2d6-9683-4d32-9635-aab3d76b5ae5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1723 microversion: 2.20 time: 0.204054 Nov 02 14:07:57.023375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3195/4450] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:56 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:57.034566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6aff82cb-f847-4a36-abc1-4fd34c4e6f6d req-a1388014-38b3-449a-bbce-0f6a892db839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f366ab5-db8f-4218-a225-5cb499b0899e", "name": "network-vif-plugged", "status": "completed", "tag": "1660ba65-5617-46a1-b752-75017e127845"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:57.047507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6aff82cb-f847-4a36-abc1-4fd34c4e6f6d req-a1388014-38b3-449a-bbce-0f6a892db839 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.048678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6aff82cb-f847-4a36-abc1-4fd34c4e6f6d req-a1388014-38b3-449a-bbce-0f6a892db839 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.049696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6aff82cb-f847-4a36-abc1-4fd34c4e6f6d req-a1388014-38b3-449a-bbce-0f6a892db839 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.066144 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6aff82cb-f847-4a36-abc1-4fd34c4e6f6d req-a1388014-38b3-449a-bbce-0f6a892db839 service nova] Creating event network-vif-plugged:1660ba65-5617-46a1-b752-75017e127845 for instance 9f366ab5-db8f-4218-a225-5cb499b0899e on n-h2-858238-3 Nov 02 14:07:57.072303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6aff82cb-f847-4a36-abc1-4fd34c4e6f6d req-a1388014-38b3-449a-bbce-0f6a892db839 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047029 Nov 02 14:07:57.072898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3196/4451] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:57.079478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e19d73b0-0201-4da9-9bd0-e7fc5ae6cd8a"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:57.082044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:57.089111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.089706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.090147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.090886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.091382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.091820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.209331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:57.209987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:57.232792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.233111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.235321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.236722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.237371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.237708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.404159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:57.552143 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0f728eef-2c63-416a-ad77-894f9ca6deb8 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.477018 Nov 02 14:07:57.555776 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3197/4452] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Nov 2 14:07:57 2022] POST /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-volume_attachments => generated 188 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:07:57.571593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:57.572434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:57.585172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.585723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.586169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.587375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.587912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.588344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.966006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:57.974827 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-db50b1fe-e20e-444f-b87d-392f787ffd67 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1508 microversion: 2.1 time: 1.033329 Nov 02 14:07:57.975441 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1256/4453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:56 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1508 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:57.982827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:57.984512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:57.994605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.995956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.996803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:57.997544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:57.998294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:57.998589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.005859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.017138 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-81bd7174-7b01-499b-868a-ae0dffbe698f tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.459585 Nov 02 14:07:58.023859 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3198/4454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:57 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:58.038768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:58.042075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:58.050402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.050402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.050402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.052704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.052704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.052704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.075472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.087350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.089282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.091321 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-11230f1a-101e-498c-980f-12a8e71e663e tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.114849 Nov 02 14:07:58.092647 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1257/4455] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:57 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:58.242407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8793ec5c-e2aa-4e52-ac1c-bbfdac8f6f06 req-3e31cc63-4295-4fed-ac5e-6459088b6dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107e7aa9-3ba3-4257-8fff-77a14fa2115c", "name": "network-vif-deleted", "tag": "9f7af45a-9fcd-4e19-a1e6-b8cd8db58b7b"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:58.257593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8793ec5c-e2aa-4e52-ac1c-bbfdac8f6f06 req-3e31cc63-4295-4fed-ac5e-6459088b6dc0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.258198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8793ec5c-e2aa-4e52-ac1c-bbfdac8f6f06 req-3e31cc63-4295-4fed-ac5e-6459088b6dc0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.258815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8793ec5c-e2aa-4e52-ac1c-bbfdac8f6f06 req-3e31cc63-4295-4fed-ac5e-6459088b6dc0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.284601 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8793ec5c-e2aa-4e52-ac1c-bbfdac8f6f06 req-3e31cc63-4295-4fed-ac5e-6459088b6dc0 service nova] Creating event network-vif-deleted:9f7af45a-9fcd-4e19-a1e6-b8cd8db58b7b for instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c on n-h2-858238-3 Nov 02 14:07:58.289294 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8793ec5c-e2aa-4e52-ac1c-bbfdac8f6f06 req-3e31cc63-4295-4fed-ac5e-6459088b6dc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060549 Nov 02 14:07:58.290834 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1258/4456] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:07:58.394995 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9921c93-f5a0-4ead-aa1a-1a895ecb431b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-volume_attachments/e19d73b0-0201-4da9-9bd0-e7fc5ae6cd8a" status: 202 len: 0 microversion: 2.20 time: 0.369586 Nov 02 14:07:58.396013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3199/4457] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Nov 2 14:07:58 2022] DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-volume_attachments/e19d73b0-0201-4da9-9bd0-e7fc5ae6cd8a => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:07:58.468341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:58.469061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:58.476465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.476950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.477383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.478104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.478555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.478979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.525928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137558) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:07:58.606349 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04ebc3c4-ea55-4e24-a036-ce65dd3ca9f3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "POST /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/action" status: 202 len: 0 microversion: 2.20 time: 0.141065 Nov 02 14:07:58.607902 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1259/4458] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 14:07:58 2022] POST /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:07:58.617963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:58.618935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:58.628293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.629428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.630252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.631543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:58.632417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:58.633428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:58.823182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.833011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.835281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:58.835893 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a853a6a0-5b0e-49ed-9739-768fc950b6c1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1671 microversion: 2.20 time: 0.222376 Nov 02 14:07:58.841745 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3200/4459] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:58 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:59.007777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:59.008702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:59.021802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.022392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.022898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.024421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.025588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.027804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.047875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:59.049885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:59.058406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.059295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.059950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.061832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.062729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.063512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.085297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.085805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.086361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.087177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lazy-loading 'fault' on Instance uuid 107e7aa9-3ba3-4257-8fff-77a14fa2115c {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:59.174773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:59.199510 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-28c9371d-ded9-400c-a10b-39f64ede2469 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 200 len: 1305 microversion: 2.1 time: 0.198991 Nov 02 14:07:59.212086 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1260/4460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:58 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 1305 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:59.224334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:59.224979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:59.242539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.243403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.244126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.245269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.245993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.246677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.362335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:59.367756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:59.374897 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c133814-28d9-4112-a11d-ad51f5bf51da tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1313 microversion: 2.1 time: 0.335504 Nov 02 14:07:59.376010 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3201/4461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:07:59 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:59.379885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:59.381834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:59.383441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-18426717-e5cf-4740-bb58-85a8d324e981 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.169902 Nov 02 14:07:59.385227 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1261/4462] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:59 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:07:59.872168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:59.873314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:59.882657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.883352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.884062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.887549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.888496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.889322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.060508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.072929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.074380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.075693 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea1c225f-4113-44c2-beb2-6ff396e7a69b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1673 microversion: 2.20 time: 0.212842 Nov 02 14:08:00.076262 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3202/4463] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:07:59 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:00.237991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:00.238716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 107e7aa9-3ba3-4257-8fff-77a14fa2115c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.245817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.246960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.247421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.248516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.248971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.249415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.263495 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] HTTP exception thrown: Instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c could not be found. Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Request method failure captured: Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c HTTP/1.1 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYndhdGKUC7D589ajspQB1yE7varO5rOuJ8uCp6LFA88n-7a6CJnNp_xYVdgh1S5kg2U35y0K0ywE-fPsP84zjQg21NU95D5-ohgaVtpj-Z2IQHTbxA-ZL9LOqzPNk-Xfxq1Fzwd331iqtO8K69cnJj7NznkzF70t0qxEcq6A5nzyEsM Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/440bbc53bad84aeda15c454a82450493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_440bbc53bad84aeda15c454a82450493"}]}] Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 53bef65bfa79486a8f0180f2f86eddba Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c could not be found. Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '107e7aa9-3ba3-4257-8fff-77a14fa2115c'} Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c could not be found. Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c could not be found. Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:00.265845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c could not be found. Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Returning 404 to user: Instance 107e7aa9-3ba3-4257-8fff-77a14fa2115c could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8986984a-106b-441e-86a6-e0b8c481c289 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c" status: 404 len: 111 microversion: 2.1 time: 0.033615 Nov 02 14:08:00.270898 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1262/4464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:00 2022] GET /compute/v2.1/servers/107e7aa9-3ba3-4257-8fff-77a14fa2115c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:08:00.279124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:00.279983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.290819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.291709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.292447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.293321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.293882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.294315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.321149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:08:00.424021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:00.424791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.430648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-29012876-5115-4ffb-9051-2ca12e737535 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 204 len: 0 microversion: 2.1 time: 0.157785 Nov 02 14:08:00.432226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.432410 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3203/4465] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:08:00 2022] DELETE /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:08:00.433240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.433917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.434916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.435668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.437580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.441914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:00.443788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.455441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.456249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.457038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.457761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.458221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.458646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.591946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.602930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.604517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.605796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8bd81023-8a4c-4b84-8307-8b9e1ba4d8a8 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.171932 Nov 02 14:08:00.606459 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3204/4466] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:00 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:00.611588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:00.613012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.626888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.628923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.629506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.630373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.630834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.631301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.688900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.711151 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31d4b5bd-b42d-4381-b571-28bfff387be4 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1462 microversion: 2.1 time: 0.313835 Nov 02 14:08:00.713737 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1263/4467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:00 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1462 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:00.755821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e805ef2-2b1b-432e-b0d7-4b4b74b07778", "device": "/dev/sdb"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:00.759692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.770740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.771491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.772088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.772966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.779689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.780319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.981739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:00.990148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f7dfcdd-b3e4-42ee-ac0c-bfd23fa53735 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1496 microversion: 2.1 time: 0.382381 Nov 02 14:08:00.990738 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3205/4468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:00 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1496 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:01.106265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:01.106877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:01.125225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:01.126593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:01.127762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:01.132409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:01.134685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:01.135686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:01.146262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e2e7fb6b-5c2b-4f01-b93b-be22e48a9877 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "POST /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404759 Nov 02 14:08:01.150076 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1264/4469] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:08:00 2022] POST /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:01.536798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.551923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.554614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.558471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71710596-37f8-4589-a134-f1f1dad07985 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.456288 Nov 02 14:08:01.559066 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3206/4470] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:01 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:01.657206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:01.662475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:01.682575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:01.683281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:01.683835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:01.684675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:01.685236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:01.686589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:01.864211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ef50cee0-0bb5-4262-8543-343c5f918a74 req-32e1ea4d-8de9-48f1-ad48-30a023320785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49c5eac-d05c-48be-b4bd-3254cd3ef74a", "name": "network-vif-deleted", "tag": "96564291-d990-4f57-ae51-6dd88e66f18f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:01.926302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ef50cee0-0bb5-4262-8543-343c5f918a74 req-32e1ea4d-8de9-48f1-ad48-30a023320785 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:01.929017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.930185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ef50cee0-0bb5-4262-8543-343c5f918a74 req-32e1ea4d-8de9-48f1-ad48-30a023320785 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:01.931214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ef50cee0-0bb5-4262-8543-343c5f918a74 req-32e1ea4d-8de9-48f1-ad48-30a023320785 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:01.948032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.949561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.950780 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-96acdc82-72b2-4d30-a20a-e93a0023a0ec tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.307143 Nov 02 14:08:01.960817 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1265/4471] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:01 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:01.979803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ef50cee0-0bb5-4262-8543-343c5f918a74 req-32e1ea4d-8de9-48f1-ad48-30a023320785 service nova] Creating event network-vif-deleted:96564291-d990-4f57-ae51-6dd88e66f18f for instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a on n-h1-858238-3 Nov 02 14:08:01.997014 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ef50cee0-0bb5-4262-8543-343c5f918a74 req-32e1ea4d-8de9-48f1-ad48-30a023320785 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169623 Nov 02 14:08:02.000329 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3207/4472] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:02.016848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:02.017921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:02.021354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:02.026350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.027263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.028274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.029219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.029742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.030173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.074110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.074768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.075068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.075568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lazy-loading 'fault' on Instance uuid c49c5eac-d05c-48be-b4bd-3254cd3ef74a {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:08:02.114920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-94be0a8c-3e41-4174-b5da-123b824f8c6a req-a6d8d03d-ee0a-4af6-b2d6-08dce1c5230a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:02.144727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94be0a8c-3e41-4174-b5da-123b824f8c6a req-a6d8d03d-ee0a-4af6-b2d6-08dce1c5230a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.145158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94be0a8c-3e41-4174-b5da-123b824f8c6a req-a6d8d03d-ee0a-4af6-b2d6-08dce1c5230a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.147797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94be0a8c-3e41-4174-b5da-123b824f8c6a req-a6d8d03d-ee0a-4af6-b2d6-08dce1c5230a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.166587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:02.177654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-94be0a8c-3e41-4174-b5da-123b824f8c6a req-a6d8d03d-ee0a-4af6-b2d6-08dce1c5230a service nova] Creating event network-changed:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h2-858238-3 Nov 02 14:08:02.177817 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f7f22d3d-e5eb-40a6-8439-1980de07abae tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 200 len: 1305 microversion: 2.1 time: 0.165624 Nov 02 14:08:02.180863 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1266/4473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:02 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:02.202083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-94be0a8c-3e41-4174-b5da-123b824f8c6a req-a6d8d03d-ee0a-4af6-b2d6-08dce1c5230a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091643 Nov 02 14:08:02.205429 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3208/4474] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:08:02.585568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:02.586255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:02.593702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.594196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.594642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.595765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.595911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.596321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.842342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:02.852242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:02.854626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:02.856040 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2248e211-a9bd-4c04-91a1-6387d8a9e8ca tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.274879 Nov 02 14:08:02.857245 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1267/4475] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:02 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:03.009209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:03.010426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:03.019427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.020589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.021373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.023240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.023882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.024852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.168442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:03.180552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:03.182004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:03.183459 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae7616c8-d824-41e4-81f1-21330bd09586 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1365 microversion: 2.57 time: 0.182760 Nov 02 14:08:03.191942 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3209/4476] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:02 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:03.220545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:03.221550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: c49c5eac-d05c-48be-b4bd-3254cd3ef74a] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:03.229152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.230031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.230761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.231818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.232845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.234827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.260716 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] HTTP exception thrown: Instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a could not be found. Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Request method failure captured: Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a HTTP/1.1 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYndhdGKUC7D589ajspQB1yE7varO5rOuJ8uCp6LFA88n-7a6CJnNp_xYVdgh1S5kg2U35y0K0ywE-fPsP84zjQg21NU95D5-ohgaVtpj-Z2IQHTbxA-ZL9LOqzPNk-Xfxq1Fzwd331iqtO8K69cnJj7NznkzF70t0qxEcq6A5nzyEsM Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/440bbc53bad84aeda15c454a82450493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_440bbc53bad84aeda15c454a82450493"}]}] Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 53bef65bfa79486a8f0180f2f86eddba Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a could not be found. Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'c49c5eac-d05c-48be-b4bd-3254cd3ef74a'} Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a could not be found. Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a could not be found. Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:03.262565 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a could not be found. Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Returning 404 to user: Instance c49c5eac-d05c-48be-b4bd-3254cd3ef74a could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:03.268696 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a79b0ed5-d9b5-4424-a46f-48d36c628c3f tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a" status: 404 len: 111 microversion: 2.1 time: 0.047279 Nov 02 14:08:03.273478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:03.282402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:03.290307 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1268/4477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:03 2022] GET /compute/v2.1/servers/c49c5eac-d05c-48be-b4bd-3254cd3ef74a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:03.299339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.300107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.300764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.302654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.303323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.304130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.355858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:03.372473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:08:03.648131 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b0dcbc0b-6c5f-49e2-8f58-b9f0605c5684 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 204 len: 0 microversion: 2.1 time: 0.377910 Nov 02 14:08:03.653823 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3210/4478] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:08:03 2022] DELETE /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:08:03.668694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:03.672261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:03.756906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.759207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.760269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.762346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.766462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.768995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.886197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:03.887433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:03.907849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.908652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.909573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.910617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.911961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.912831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:04.087509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.104463 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-be6bcf07-0af1-43c0-be90-21ba4772e672 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.448578 Nov 02 14:08:04.105424 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1269/4479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:03 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:04.181199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.192517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.195291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.196510 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8c10515b-23ff-4739-b7c3-41d73405406c tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.317660 Nov 02 14:08:04.197278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3211/4480] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:03 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:04.219084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:04.220540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:04.240537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:04.241288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:04.242055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:04.243343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:04.244181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:04.244948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:04.281109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:04.355002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.372503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.376345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.379089 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ba25114-f5d9-45be-95fc-8f10e50b7f90 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1383 microversion: 2.57 time: 0.171160 Nov 02 14:08:04.380277 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1270/4481] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:04 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1383 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:05.048149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:05.048998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:05.059644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.060392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.061083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.062810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.063630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.064347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.131434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:08:05.138554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:05.141164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:05.151888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.152688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.153341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.154258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.154929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.155599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.264799 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79ed94c7-161b-42c6-9928-ef9d208a87d4 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 204 len: 0 microversion: 2.32 time: 0.365743 Nov 02 14:08:05.271019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3212/4482] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:08:04 2022] DELETE /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 14:08:05.278713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:05.280310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:05.292992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.294328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.294328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.295036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.295634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.297803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.399915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:05.409124 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-290939a5-e1a0-47d5-ad8e-5890347945b1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.279337 Nov 02 14:08:05.409719 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1271/4483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:05 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:05.437493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:05.438127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:05.462381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.462890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.463354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.464075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.464526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.464948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.044546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.059661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.064108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.065772 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d947d49-f70f-43d9-bd61-cdd38574f9b5 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.796340 Nov 02 14:08:06.067002 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3213/4484] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:05 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:06.104549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.113581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:06.114210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:06.122469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.127922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.127922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.127922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.127922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.127922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.137054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.143832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.149292 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9162c2d8-73a3-40f4-aa95-e693737ebb64 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.732444 Nov 02 14:08:06.151269 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1272/4485] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:05 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:06.305150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.328040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.332959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.339063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0cee8796-eefa-4597-96ca-e80f4c2c9c04 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1371 microversion: 2.57 time: 0.252736 Nov 02 14:08:06.342482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3214/4486] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:06 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:06.438682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:06.439894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:06.448284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.448770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.449209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.449905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.450522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.451135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.636130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.645322 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5239eff4-31e5-48f0-9aaa-9af4dd573ab1 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.214679 Nov 02 14:08:06.645903 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1273/4487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:06 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:07.101647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:07.102594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:07.109729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.110370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.110903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.111782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.112398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.112916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.188398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:07.189322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:07.204010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.205001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.205811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.206817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.207314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.207902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.365226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.384573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.386028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.390607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-162217bc-f90a-4b64-86ca-4211d59c0a8b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.289907 Nov 02 14:08:07.406774 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3215/4488] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:07 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:07.419627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:07.420489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:07.437533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.438358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.439173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.440150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.440837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.441471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.547518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.562168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.564290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.564755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.566072 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a2786bef-2ab6-4afd-aeea-f6a55f23b19b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1356 microversion: 2.57 time: 0.157893 Nov 02 14:08:07.566818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3216/4489] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:07 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:07.575805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.578188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.580488 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2f93d1a1-2f20-431e-a32d-1cee1d7f54fa tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.397148 Nov 02 14:08:07.581753 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1274/4490] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:07 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:07.603753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:07.604220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:07.610821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.611364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.611800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.613234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.613346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.613718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.644872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:08:07.669815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:07.670698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:07.677290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.678032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.678685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.679996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.680618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.681838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.756640 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c72f188-be5d-469c-bf43-7d8173fb9d74 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 204 len: 0 microversion: 2.57 time: 0.156554 Nov 02 14:08:07.757803 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3217/4491] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:08:07 2022] DELETE /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:08:07.771616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:07.772885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:07.789568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.790423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.790991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.791839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:07.792407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:07.792937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:07.907296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.918355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.920178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:07.923062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a8fe15b-0f1c-4cf1-989f-84ecb5f7a780 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1362 microversion: 2.57 time: 0.156521 Nov 02 14:08:07.924493 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3218/4492] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:07 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:08.015265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:08.052522 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ecef1a4b-b571-431d-9906-172b641f0507 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.386479 Nov 02 14:08:08.061899 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1275/4493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:07 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:08.421558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:08.422364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:08.430212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.430700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.431161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.432051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.432534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.432961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.585901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:08.595069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:08.596584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:08.597777 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71542162-3ddf-4f4c-a270-b2bb8277e540 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.180659 Nov 02 14:08:08.598354 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3219/4494] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:08 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:08.614453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:08.616320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:08.624811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.625507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.625991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.629738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.630217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.630652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.953314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:08.954241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:08.964284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.964788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.969585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.970921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.971438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.975986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:09.080198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.095322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.104528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.107848 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2f5cd0a6-b800-4267-bdaf-79138c2f3c71 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.498306 Nov 02 14:08:09.111596 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1276/4495] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:08 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:09.127162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:09.142522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:09.150207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:09.150991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:09.151715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:09.152652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:09.153397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:09.154064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:09.168097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.176597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.178053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.179280 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c1cb60b-abd1-45f0-88ec-fb73d885b951 tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1362 microversion: 2.57 time: 0.230628 Nov 02 14:08:09.181246 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3220/4496] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:08 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:09.365571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.380022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-254d4e6a-eb38-4e11-9cec-deea0a49cb61 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.266528 Nov 02 14:08:09.380901 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1277/4497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:09 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:09.628513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:09.630357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:09.641495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:09.642726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:09.643764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:09.645276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:09.646341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:09.647374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:09.883296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.887035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:09.894284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.896060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:09.897529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa3a0dcc-1464-4df1-a7cc-218d8fbebdaf tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.276943 Nov 02 14:08:09.898321 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3221/4498] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:09 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:10.142061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.142848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.153663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.156105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.161740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.163063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.163778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.164440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.207017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.208461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.217324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.217981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.218545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.219414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.219993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.220519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.352812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:10.376795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.382454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.382912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.383436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lazy-loading 'fault' on Instance uuid b2149c0e-a08c-41e7-8e52-1566e71eeab4 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:08:10.579750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.589680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.595868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87493e0a1de450f95e7634536196153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c26cc3d874bd2b0a5893c92e9b33d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.598661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93b7b176-0730-4d5b-9349-a81b5d29358b tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 200 len: 1367 microversion: 2.57 time: 0.396555 Nov 02 14:08:10.601703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3222/4499] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:10 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:10.613171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.618971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.624345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.630319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.633267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.637441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-90777803-3161-49f9-8994-2c821caa4765 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.497813 Nov 02 14:08:10.638798 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1278/4500] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:10 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:10.640117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.640667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.641311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.642314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.642969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.643579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.902265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:10.911870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8127e671-1838-4447-8031-2a61f5cf67d4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.308360 Nov 02 14:08:10.912587 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3223/4501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:10 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:10.926534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.927367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.948510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.949401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.950071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.951070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.951746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.952349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:11.192183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:11.201894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:11.208839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:11.212749 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d204be4f-4ce0-43bd-8ece-026d9ac4cb93 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.290106 Nov 02 14:08:11.213909 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1279/4502] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:10 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:11.637905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:11.638979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] [instance: b2149c0e-a08c-41e7-8e52-1566e71eeab4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:11.648037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:11.649377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:11.649972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:11.650870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:11.651755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:11.652364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:11.676811 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] HTTP exception thrown: Instance b2149c0e-a08c-41e7-8e52-1566e71eeab4 could not be found. Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Request method failure captured: Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 HTTP/1.1 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnmcGW7mIkn85H662N6fLjKwD7BtzpHXVdthqnq2AyQjmvgaz-q5xby87Tz_VtzmiH_Af3O_tFdWbbKP4OeDWdr0FhgqktZic5VgjEiAh_dBUXKItL3NeGxjsWah1Dr2G63vZrd8dfIwlyiVd0xo-fUCfKp6wRAmiOeWCXMD0SAerq0 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e47c26cc3d874bd2b0a5893c92e9b33d Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerShowV257Test-1828949451 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e47c26cc3d874bd2b0a5893c92e9b33d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e47c26cc3d874bd2b0a5893c92e9b33d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e47c26cc3d874bd2b0a5893c92e9b33d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e47c26cc3d874bd2b0a5893c92e9b33d"}]}] Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerShowV257Test-1828949451 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e47c26cc3d874bd2b0a5893c92e9b33d Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerShowV257Test-1828949451 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerShowV257Test-1828949451-project Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a87493e0a1de450f95e7634536196153 Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerShowV257Test-1828949451-project Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance b2149c0e-a08c-41e7-8e52-1566e71eeab4 could not be found. Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'b2149c0e-a08c-41e7-8e52-1566e71eeab4'} Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2149c0e-a08c-41e7-8e52-1566e71eeab4 could not be found. Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2149c0e-a08c-41e7-8e52-1566e71eeab4 could not be found. Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:11.680492 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2149c0e-a08c-41e7-8e52-1566e71eeab4 could not be found. Nov 02 14:08:11.689388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:11.690411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:11.690771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:11.695249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] Returning 404 to user: Instance b2149c0e-a08c-41e7-8e52-1566e71eeab4 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:11.695249 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-071e5260-11d9-48cd-a11d-c79e00da19fd tempest-ServerShowV257Test-1828949451 tempest-ServerShowV257Test-1828949451-project] 10.222.0.18 "GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4" status: 404 len: 111 microversion: 2.57 time: 0.060585 Nov 02 14:08:11.699987 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3224/4503] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:11 2022] GET /compute/v2.1/servers/b2149c0e-a08c-41e7-8e52-1566e71eeab4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:08:11.724974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:11.725476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:11.725920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:11.726634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:11.727118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:11.727552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:11.939962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:11.940970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:11.957562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:11.958429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:11.959057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:11.960633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:11.961274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:11.961869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:12.275226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.287136 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84af6feb-879a-4823-83c6-139b1134a60a tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.352721 Nov 02 14:08:12.291030 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3225/4504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:11 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:12.299133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:12.299741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:12.305112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.318093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.321609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.323590 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-11b10d61-2934-4824-bffa-c5822999df47 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.637556 Nov 02 14:08:12.324170 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1280/4505] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:11 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:12.339055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:12.349145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:12.350069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:12.355682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:12.356832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:12.357297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:12.764450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.790079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.792551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:12.794182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac156e38-c6e3-4642-9d60-db29df5d61bc tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.501866 Nov 02 14:08:12.813609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3226/4506] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:12 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:13.323231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:13.324737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:13.333421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:13.334044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:13.334711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:13.335793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:13.336527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:13.337444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:13.362598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:13.363327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:13.379781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:13.383722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:13.385203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:13.389449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:13.391166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:13.398576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:13.898783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:13.909190 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1ecb69a7-022d-4faf-a5b4-db3eee4debf2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.590611 Nov 02 14:08:13.912378 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1281/4507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:13 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:13.918538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:13.919461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:13.927849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:13.928825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:13.929449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:13.930174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:13.930629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:13.931057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:14.250741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:14.274677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:14.282008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:14.287825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a39c93b8-c071-4983-84b4-e1e7a5dc7434 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.928725 Nov 02 14:08:14.294560 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3227/4508] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:13 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:14.431302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:14.440374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:14.441973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:14.443314 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eed70919-4f7e-4f37-b854-4c6186040cb6 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.529790 Nov 02 14:08:14.444466 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1282/4509] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:13 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:14.938036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:14.938516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:14.946073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:14.946572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:14.947011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:14.947765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:14.948221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:14.948650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:15.227902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:15.240049 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-81f514b6-da7c-482a-925d-343d97b5ba4c tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.306417 Nov 02 14:08:15.240977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3228/4510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:14 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:15.325384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:15.326001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:15.342248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:15.342771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:15.343249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:15.348008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:15.348485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:15.349269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:15.474924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:15.477056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:15.490332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:15.491600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:15.492654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:15.497401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:15.498094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:15.498718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:15.962194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:15.989942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:15.991503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:15.992980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:15.999737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:16.004030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:16.005253 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3fe8dff-46fa-4907-813b-743e1b5be217 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.673206 Nov 02 14:08:16.006778 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1283/4511] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:15 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:16.010535 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-111b5444-72b0-47f2-8392-b57152386804 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.542370 Nov 02 14:08:16.024046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3229/4512] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:15 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:16.273459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:16.274071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:16.283217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:16.285948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:16.286588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:16.287517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:16.296460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:16.297024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:16.680871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:16.708899 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8163c00d-9304-40f5-81bb-f5365ef442d2 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.438947 Nov 02 14:08:16.710746 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1284/4513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:16 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:17.041060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:17.043352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:17.050860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:17.053374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:17.064210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:17.065018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:17.065715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:17.066628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:17.067302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:17.067905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:17.084997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:17.091789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:17.093558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:17.094429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:17.095017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:17.095577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:17.568137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:17.580159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:17.581650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:17.583352 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c91e271b-b4e1-4549-ba43-8884a3ebdbd9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.538765 Nov 02 14:08:17.583958 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1285/4514] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:17 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:17.600644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:17.614051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:17.615542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:17.617390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3eb4ee5-2aa3-4e03-b9dd-b0c4518487d6 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.582449 Nov 02 14:08:17.628625 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3230/4515] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:17 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:17.737445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:17.738305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:17.746457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:17.747802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:17.748631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:17.749959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:17.750784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:17.751375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:18.037415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:18.041138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:18.059588 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47887349-1248-449d-b357-92f21b966306 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.315182 Nov 02 14:08:18.067284 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1286/4516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:17 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:18.616910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:18.617740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:18.638365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:18.638854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:18.639318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:18.640572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:18.641021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:18.641440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:18.650333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:18.650978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:18.661244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:18.661244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:18.661724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:18.662435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:18.662888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:18.663364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:19.118260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:19.130378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:19.134514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:19.136614 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7d9832ba-d450-480b-8300-dd25237b1723 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.490389 Nov 02 14:08:19.138116 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1287/4517] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:18 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:19.145869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:19.146513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:19.153843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:19.154642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:19.155300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:19.157731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:19.158448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:19.159531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:19.239353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:19.257613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:19.266829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:19.268471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8932cb91-926b-4df3-ba9e-225bcb809167 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.656171 Nov 02 14:08:19.269755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3231/4518] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:18 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:20.094909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:20.105753 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3a9435ce-2ea9-4a1e-85a8-7d036da42314 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1677 microversion: 2.1 time: 0.966252 Nov 02 14:08:20.107801 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1288/4519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:19 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1677 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:20.180802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:20.182286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:20.191540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:20.192424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:20.193096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:20.194657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:20.195532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:20.196206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:20.304266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:20.305735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:20.328493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:20.332337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:20.333387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:20.334337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:20.338656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:20.339501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:21.064685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.077130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.078673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.086518 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9763efb0-2772-42f7-8175-463ca4c754cb tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2952 microversion: 2.32 time: 0.917257 Nov 02 14:08:21.087151 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3232/4520] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:20 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2952 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:21.141131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:21.142105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:21.153256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:21.154009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:21.155763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:21.160036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:21.160830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:21.161462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:21.276015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.296086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.300453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.302866 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b101e271-3d90-4dd3-91c8-f1133b1ff592 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 1.005090 Nov 02 14:08:21.311432 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1289/4521] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:20 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:21.573173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:21.596905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-647995b7-2cf0-4bdf-b495-90c4c15fc6b4 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1610 microversion: 2.1 time: 0.460471 Nov 02 14:08:21.598359 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3233/4522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:21 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1610 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:21.730387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:21.732725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:21.757544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:21.758282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:21.758760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:21.761714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:21.766164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:21.768847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:21.940805 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae369f7b-0126-418d-9c3f-cc046d90fad3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.214797 Nov 02 14:08:21.946558 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1290/4523] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:08:21 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7/os-volume_attachments => generated 25 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:08:22.149977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:22.153076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:22.159748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:22.174681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:22.192873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.195229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.195704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:22.199050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.199551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.199985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:22.201789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.202288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.202756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:22.205114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.205590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.209017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:22.350478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:08:22.680233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5aed8537-2b9c-46fa-8218-c4d51a11b551 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 204 len: 0 microversion: 2.1 time: 0.573579 Nov 02 14:08:22.681544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3234/4524] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:08:22 2022] DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:08:22.705668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9d32de80-39ac-4500-85a8-9b895eb19c74 req-e4835d5e-fc0a-48ca-a398-53924bcb8d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-unplugged", "status": "completed", "tag": "804ef20f-d150-45fe-a7c1-5f7f3504a381"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:22.769575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9d32de80-39ac-4500-85a8-9b895eb19c74 req-e4835d5e-fc0a-48ca-a398-53924bcb8d1e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.770110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9d32de80-39ac-4500-85a8-9b895eb19c74 req-e4835d5e-fc0a-48ca-a398-53924bcb8d1e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.770557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9d32de80-39ac-4500-85a8-9b895eb19c74 req-e4835d5e-fc0a-48ca-a398-53924bcb8d1e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:22.816324 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9d32de80-39ac-4500-85a8-9b895eb19c74 req-e4835d5e-fc0a-48ca-a398-53924bcb8d1e service nova] Creating event network-vif-unplugged:804ef20f-d150-45fe-a7c1-5f7f3504a381 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:22.835190 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9d32de80-39ac-4500-85a8-9b895eb19c74 req-e4835d5e-fc0a-48ca-a398-53924bcb8d1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151201 Nov 02 14:08:22.841636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3235/4525] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:22.873385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:22.892335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:22.909976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.910847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.911522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:22.912899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:22.913812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:22.914529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.230967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.242621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.250228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.268446 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-da9b3530-0270-49a6-b811-a1a43bc26e83 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2931 microversion: 2.32 time: 1.153292 Nov 02 14:08:23.275864 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1291/4526] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:22 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2931 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:23.281855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-884123dd-dbbb-47b7-8716-18eeec64a1ba req-455cac33-5e8f-446a-a77b-70a4ae1d755a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b24d306-b049-4140-b93e-e92a824d8d35", "name": "network-vif-deleted", "tag": "1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:23.330702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-884123dd-dbbb-47b7-8716-18eeec64a1ba req-455cac33-5e8f-446a-a77b-70a4ae1d755a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:23.332803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-884123dd-dbbb-47b7-8716-18eeec64a1ba req-455cac33-5e8f-446a-a77b-70a4ae1d755a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:23.336753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-884123dd-dbbb-47b7-8716-18eeec64a1ba req-455cac33-5e8f-446a-a77b-70a4ae1d755a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.369697 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-884123dd-dbbb-47b7-8716-18eeec64a1ba req-455cac33-5e8f-446a-a77b-70a4ae1d755a service nova] Creating event network-vif-deleted:1d9b1fe7-d25c-4fba-93cc-ee63aff67bd3 for instance 3b24d306-b049-4140-b93e-e92a824d8d35 on n-h2-858238-3 Nov 02 14:08:23.384585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-884123dd-dbbb-47b7-8716-18eeec64a1ba req-455cac33-5e8f-446a-a77b-70a4ae1d755a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107016 Nov 02 14:08:23.385718 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1292/4527] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:23.398917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:23.415309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:23.450664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:23.452499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:23.453414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.454443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:23.455160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:23.457301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.612096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:23.626173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:23.629685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.630409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lazy-loading 'fault' on Instance uuid 3b24d306-b049-4140-b93e-e92a824d8d35 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:08:23.646743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.663245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.665130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.666551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee027222-0398-4276-a326-42e89315259e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 0.823379 Nov 02 14:08:23.667677 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3236/4528] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:22 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:23.675413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:23.676477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:23.684403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:23.686014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:23.686814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.687744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:23.688412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:23.689593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:23.804890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53bef65bfa79486a8f0180f2f86eddba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440bbc53bad84aeda15c454a82450493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:23.818699 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cccecd4a-e180-4e56-97ab-0975ae531066 tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 200 len: 1329 microversion: 2.1 time: 0.427917 Nov 02 14:08:23.826734 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1293/4529] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:23 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 1329 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:24.340425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:24.341129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:24.356266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:24.370029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:24.370741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:24.371810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:24.372462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:24.372615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:24.373232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:24.382762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:24.421865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b2882c4-5781-4f09-b6f1-c6f5dfd0a771 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1672 microversion: 2.1 time: 0.750755 Nov 02 14:08:24.444041 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3237/4530] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:23 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1672 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:24.703762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:24.705237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:24.748640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:24.756380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:24.758824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:24.760632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:24.761666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:24.762631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:25.464429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:25.484474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:25.487008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:25.488810 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a38efed-e489-4c9a-8bb9-441b44389426 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2910 microversion: 2.32 time: 1.152530 Nov 02 14:08:25.489609 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1294/4531] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:24 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2910 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:25.499679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:25.500903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] [instance: 3b24d306-b049-4140-b93e-e92a824d8d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:25.520296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:25.521223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:25.521898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:25.522855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:25.523559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:25.524209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:25.558742 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] HTTP exception thrown: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 could not be found. Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Request method failure captured: Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 HTTP/1.1 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYndhdGKUC7D589ajspQB1yE7varO5rOuJ8uCp6LFA88n-7a6CJnNp_xYVdgh1S5kg2U35y0K0ywE-fPsP84zjQg21NU95D5-ohgaVtpj-Z2IQHTbxA-ZL9LOqzPNk-Xfxq1Fzwd331iqtO8K69cnJj7NznkzF70t0qxEcq6A5nzyEsM Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/440bbc53bad84aeda15c454a82450493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/440bbc53bad84aeda15c454a82450493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_440bbc53bad84aeda15c454a82450493"}]}] Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 440bbc53bad84aeda15c454a82450493 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-2081198081 Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 53bef65bfa79486a8f0180f2f86eddba Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-2081198081-project Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 could not be found. Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3b24d306-b049-4140-b93e-e92a824d8d35'} Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 could not be found. Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 could not be found. Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:25.560675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 could not be found. Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:25.566592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Returning 404 to user: Instance 3b24d306-b049-4140-b93e-e92a824d8d35 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:25.568363 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9d33a298-5afc-4285-88af-ea5487967ccf tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35" status: 404 len: 111 microversion: 2.1 time: 0.077455 Nov 02 14:08:25.572084 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1295/4532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:25 2022] GET /compute/v2.1/servers/3b24d306-b049-4140-b93e-e92a824d8d35 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:25.580933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-unplugged", "status": "completed", "tag": "1c162986-e82f-4c13-98f1-243a8b0bbad7"}, {"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-unplugged", "status": "completed", "tag": "a5539551-be83-4803-9781-fb3190ae7b9d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:25.600109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:25.602628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:25.603460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:25.628078 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] Creating event network-vif-unplugged:1c162986-e82f-4c13-98f1-243a8b0bbad7 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:25.633270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] Creating event network-vif-unplugged:a5539551-be83-4803-9781-fb3190ae7b9d for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:25.641155 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-33aeb268-00e7-440a-ab33-44d98ba270ce req-5a57ff97-556d-465c-8cc7-5e98f1772efa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.067106 Nov 02 14:08:25.642200 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1296/4533] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:25.648386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:25.650142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:25.659440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:25.660519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:25.661217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:25.662216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:25.662919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:25.663569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:25.948424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:25.974194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:25.993230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:26.010873 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12a6cf39-5dd3-41e0-98ba-f8790994d7d3 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 1.311135 Nov 02 14:08:26.012305 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3238/4534] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:24 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:26.032133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-103879a8-8101-4870-997f-010035ebd9ed tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] Calling method '.version_select at 0x7f6f85f61dc0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:26.087671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-103879a8-8101-4870-997f-010035ebd9ed tempest-ServerActionsTestJSON-2081198081 tempest-ServerActionsTestJSON-2081198081-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586223354" status: 202 len: 0 microversion: 2.1 time: 0.073652 Nov 02 14:08:26.093010 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3239/4535] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:08:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586223354 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:08:26.462947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-13689aa5-66de-4250-943d-5189efb641af req-54199123-c8bf-4f09-bb56-b4abc0e6d0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-deleted", "tag": "299b6036-dca6-4c82-92ac-af0f73e5cc45"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:26.514015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-13689aa5-66de-4250-943d-5189efb641af req-54199123-c8bf-4f09-bb56-b4abc0e6d0ed service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:26.514789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-13689aa5-66de-4250-943d-5189efb641af req-54199123-c8bf-4f09-bb56-b4abc0e6d0ed service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:26.518287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-13689aa5-66de-4250-943d-5189efb641af req-54199123-c8bf-4f09-bb56-b4abc0e6d0ed service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:26.571833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-13689aa5-66de-4250-943d-5189efb641af req-54199123-c8bf-4f09-bb56-b4abc0e6d0ed service nova] Creating event network-vif-deleted:299b6036-dca6-4c82-92ac-af0f73e5cc45 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:26.588184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-13689aa5-66de-4250-943d-5189efb641af req-54199123-c8bf-4f09-bb56-b4abc0e6d0ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476882 Nov 02 14:08:26.589259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3240/4536] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:08:26.603951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:26.618662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:26.638935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:26.639620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:26.640203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:26.643602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:26.654904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:26.656101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:27.311679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:27.341820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:27.377153 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9db9bbd-87a2-491d-a392-0f025db66ba3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1672 microversion: 2.1 time: 1.732428 Nov 02 14:08:27.399959 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1297/4537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:25 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1672 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:27.405784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:27.409305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:27.421109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-989979c4-f843-4d7c-a9d0-10e4bbc62b67 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2750 microversion: 2.32 time: 0.830238 Nov 02 14:08:27.422403 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3241/4538] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:26 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2750 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:27.446314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:27.450525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:27.475924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:27.476740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:27.507187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:27.508505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:27.509272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:27.509968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:27.730277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2cb3ef-3e5b-43c6-a04a-cdb499783d05"}, {"server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "name": "network-vif-plugged", "status": "completed", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:27.767564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:27.775412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:27.776356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:27.867978 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] Creating event network-vif-unplugged:4c2cb3ef-3e5b-43c6-a04a-cdb499783d05 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:27.868888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] Creating event network-vif-plugged:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h2-858238-3 Nov 02 14:08:27.895829 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f16d2125-b02d-4380-b28a-a4aea8a392f9 req-1d19acd2-a04f-427c-acbb-ef4e1e114144 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.173556 Nov 02 14:08:27.903845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3242/4539] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:28.540282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:28.542325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:28.555030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:28.556401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:28.560438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:28.563185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:28.564236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:28.565278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:28.647614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:08:28.809934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:28.858579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:28.868953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:28.873138 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04397938-b322-4a07-87e9-097ae0dc088b tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 1.469743 Nov 02 14:08:28.876107 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1298/4540] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:27 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:28.932396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:28.935176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:28.973969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:28.985984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:28.989922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:28.993628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:28.995049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:28.999766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.034075 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a139f34-f12c-423c-9903-9e0274d2e516 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "DELETE /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 204 len: 0 microversion: 2.1 time: 0.801220 Nov 02 14:08:29.061154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3243/4541] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:08:28 2022] DELETE /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:08:29.079966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:29.082106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:29.113931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.120442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.134152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.137515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.147221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.149839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.327980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:29.358245 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-551fed9f-0090-4905-babf-ec7621427956 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1605 microversion: 2.1 time: 0.475879 Nov 02 14:08:29.360864 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1299/4542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:28 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1605 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:29.381502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-deleted", "tag": "a5539551-be83-4803-9781-fb3190ae7b9d"}, {"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-deleted", "tag": "4c2cb3ef-3e5b-43c6-a04a-cdb499783d05"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:29.399895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.406399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.407682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.448633 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] Creating event network-vif-deleted:a5539551-be83-4803-9781-fb3190ae7b9d for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:29.449173 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] Creating event network-vif-deleted:4c2cb3ef-3e5b-43c6-a04a-cdb499783d05 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:29.460340 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5fbbe30f-75a1-4491-b3df-6b5fb6438c40 req-6dea5ed5-0661-4457-97e1-7c60bf813e6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097237 Nov 02 14:08:29.461421 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1300/4543] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:29.479567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:29.481318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:29.503212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.504365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.505235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.506359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.512377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.513191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.161425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:30.187696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:30.204843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:30.206478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffb206a8-d89d-42e4-986b-32d626b8fdd5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2658 microversion: 2.32 time: 1.142204 Nov 02 14:08:30.207086 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3244/4544] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:29 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2658 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:30.226843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:30.235853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:30.262086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.262491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.262922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.263656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.264103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.264521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.444624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:30.491793 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2f51345-4eb3-4ca2-92cb-27603a114b91 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1733 microversion: 2.1 time: 1.028780 Nov 02 14:08:30.501794 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1301/4545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:29 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1733 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:30.545238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:30.556950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:30.617801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.618686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.636020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.637703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.638405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.641313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.447273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:31.500599 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-616c309c-84b8-4dad-a726-90fa168fc7a0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 200 len: 1605 microversion: 2.1 time: 0.985621 Nov 02 14:08:31.510430 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1302/4546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:30 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 1605 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:31.538088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8fbc8de6-484b-4615-8ba6-477ef028c3c8 req-0769f3c8-1634-48cc-b941-9665015aabf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40ffe3c-33e5-44a6-a7ff-23606f1275a7", "name": "network-vif-deleted", "tag": "f9bc5cf6-eede-4706-9096-a8e8dbabfae5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:31.586719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8fbc8de6-484b-4615-8ba6-477ef028c3c8 req-0769f3c8-1634-48cc-b941-9665015aabf6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.592087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8fbc8de6-484b-4615-8ba6-477ef028c3c8 req-0769f3c8-1634-48cc-b941-9665015aabf6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.594651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8fbc8de6-484b-4615-8ba6-477ef028c3c8 req-0769f3c8-1634-48cc-b941-9665015aabf6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.650445 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8fbc8de6-484b-4615-8ba6-477ef028c3c8 req-0769f3c8-1634-48cc-b941-9665015aabf6 service nova] Creating event network-vif-deleted:f9bc5cf6-eede-4706-9096-a8e8dbabfae5 for instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 on n-h1-858238-3 Nov 02 14:08:31.683624 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8fbc8de6-484b-4615-8ba6-477ef028c3c8 req-0769f3c8-1634-48cc-b941-9665015aabf6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170483 Nov 02 14:08:31.692245 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1303/4547] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:31.768320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:31.769222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:31.785962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:31.808183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:31.812477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:31.815827 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52873239-6f0d-4144-be22-37d324d8ecee tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1729 microversion: 2.20 time: 1.604362 Nov 02 14:08:31.817957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3245/4548] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:30 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1729 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:31.820734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.822288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.829815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.830233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:31.830728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.831414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.831991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.832707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:31.845601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.846846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.848031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.849698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.850745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.853137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:32.771319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:32.785883 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3c853ef-9fc7-43ed-b4c2-1813eba8b40f tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1733 microversion: 2.1 time: 0.966038 Nov 02 14:08:32.800377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3246/4549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:31 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1733 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:32.819788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-deleted", "tag": "804ef20f-d150-45fe-a7c1-5f7f3504a381"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:32.855696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:32.859982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:32.860711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:32.897505 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] Creating event network-vif-deleted:804ef20f-d150-45fe-a7c1-5f7f3504a381 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:32.928691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126172 Nov 02 14:08:32.932306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3247/4550] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:32.933936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:32.934996 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-97233c16-aa1e-4526-8e0b-d659e9208d36 req-2406d8cd-5dd6-4eb7-8e05-e43b8f387b25 service nova] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001684 Nov 02 14:08:32.935388 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3248/4551] 10.222.0.18 () {56 vars in 886 bytes} [Wed Nov 2 14:08:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 14:08:32.959575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:32.975228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:32.976325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:32.991689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:32.994576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:33.001039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.003744 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0ab67340-aad5-49bf-a4aa-e6cec0bd228c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 2385 microversion: 2.32 time: 1.308104 Nov 02 14:08:33.004273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.004928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:33.006629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.008732 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1304/4552] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:31 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 2385 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:33.010418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.011041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:33.031393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:33.035727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:33.052145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] HTTP exception thrown: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:08:33.053540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=81 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Request method failure captured: Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 HTTP/1.1 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjt4ETorHLEp11Vn1aGw_WKk2uI39g5H32kSJ7dpp6YusDXsVcR1OvoWRbuo3CNlTktqi2Pt7DNOXg0w8U1W9oQBIRV1IyzGVnhoz_X_FGRLWwixdRe5Na5syNoW-6bwtDgWD52hjxAAuy21v3KGeZ2NhcKbI6BcbpbqKIHh0T7WXM Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4109b13b99644609bedb98d8e28c8e59"}]}] Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a01f842614b24924bcc2196332cb5f35 Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a40ffe3c-33e5-44a6-a7ff-23606f1275a7'} Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:33.054497 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:08:33.059644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:33.070497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.071111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.071521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Returning 404 to user: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:33.071797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:33.072638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.072950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6088a0f2-980f-4a4b-86b1-a321553cbc6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 404 len: 111 microversion: 2.1 time: 0.117730 Nov 02 14:08:33.073318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.073989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:33.074404 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3249/4553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:32 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:33.085468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7db290bd-8fcc-4ee8-a8a5-5d3878f9a4e1 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '.version_select at 0x7f6f80c059d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:33.128630 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7db290bd-8fcc-4ee8-a8a5-5d3878f9a4e1 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91316864" status: 202 len: 0 microversion: 2.1 time: 0.049296 Nov 02 14:08:33.129487 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3250/4554] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Nov 2 14:08:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91316864 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:08:33.763051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:33.793880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:33.801015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:33.802417 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-66215c6b-7985-442b-aeaa-bcd2ea6280f9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1716 microversion: 2.20 time: 0.791357 Nov 02 14:08:33.809412 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1305/4555] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:33 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1716 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:33.818765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:33.819942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:33.852818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.853490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.854132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:33.865688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.869526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.871926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:34.041202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:34.043069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:34.069163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:34.069932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:34.070370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:34.081224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:34.087951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:34.089147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:34.112416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:34.121648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4351fbc9-5bec-46b8-adad-7585a359844d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1665 microversion: 2.1 time: 0.307813 Nov 02 14:08:34.138677 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3251/4556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:33 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1665 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:34.206201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:34.735730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:34.761135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:34.781333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:34.795309 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f49896c-a1cf-41c4-832a-ff3ab907d473 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.757513 Nov 02 14:08:34.815888 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1306/4557] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:34 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:35.050970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-95abaa5c-cad8-45b6-b8c7-8f5277f8bb35 req-9216e9b1-12a6-4257-a4aa-c88c9fef6fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6", "name": "network-vif-deleted", "tag": "1c162986-e82f-4c13-98f1-243a8b0bbad7"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:35.103244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95abaa5c-cad8-45b6-b8c7-8f5277f8bb35 req-9216e9b1-12a6-4257-a4aa-c88c9fef6fe9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.103971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95abaa5c-cad8-45b6-b8c7-8f5277f8bb35 req-9216e9b1-12a6-4257-a4aa-c88c9fef6fe9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.109866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-95abaa5c-cad8-45b6-b8c7-8f5277f8bb35 req-9216e9b1-12a6-4257-a4aa-c88c9fef6fe9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:35.158390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:35.159488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:35.185163 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-95abaa5c-cad8-45b6-b8c7-8f5277f8bb35 req-9216e9b1-12a6-4257-a4aa-c88c9fef6fe9 service nova] Creating event network-vif-deleted:1c162986-e82f-4c13-98f1-243a8b0bbad7 for instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 on n-h2-858238-3 Nov 02 14:08:35.192140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.200616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.201320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:35.206637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.213925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.216713 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-95abaa5c-cad8-45b6-b8c7-8f5277f8bb35 req-9216e9b1-12a6-4257-a4aa-c88c9fef6fe9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173364 Nov 02 14:08:35.217587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:35.228576 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3252/4558] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:35.856476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:35.859207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:35.879918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.880853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.884313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:35.886326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.890747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.891682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:36.454463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:36.466373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:36.475275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:36.476834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f2c9a12-f9ca-4eb9-846d-a39ab786e421 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.636568 Nov 02 14:08:36.479842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7453e356e6164465af839e2f7d600aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af544c47fd34763a0f4c9db29dc440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:36.502947 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3253/4559] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:35 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:36.513556 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c8406d9-b5d9-4520-96a1-4d4d5199f626 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 200 len: 1383 microversion: 2.1 time: 1.360013 Nov 02 14:08:36.565201 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1307/4560] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:35 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 1383 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:36.787041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb0e4c03-b2fd-401b-91c0-2aa34177574c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: .version_select at 0x7f6f80b97d30>, body: {"keypair": {"name": "tempest-keypair-2040081070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+MjD7a0H8EGerXsvGg6YRUorzsXCvHhFgTeS9cOtzlxBo9tLaAWtGtfkQ3Ugx/jnb+cxza5ArIQFso8HEGwWmmcUMfj6XRK36RsA6or7Jsg7f7WL1XP1sxuXGfrhC8mQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:36.804909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-cb0e4c03-b2fd-401b-91c0-2aa34177574c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for project 4109b13b99644609bedb98d8e28c8e59. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:08:36.812845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-cb0e4c03-b2fd-401b-91c0-2aa34177574c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for user a01f842614b24924bcc2196332cb5f35 and project 4109b13b99644609bedb98d8e28c8e59. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:08:36.864304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb0e4c03-b2fd-401b-91c0-2aa34177574c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081065 Nov 02 14:08:36.868119 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3254/4561] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:08:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:37.330794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-060352b0-fd4e-4fe5-a987-fcea33a5777c req-afb66d88-f60e-49f0-9aca-747519c6296b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cf0f49-acec-445d-b3c1-48dfd1ac2c60", "name": "network-vif-deleted", "tag": "0b3968f1-1ad5-49e9-a33a-fefdba7840c7"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:37.414692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-060352b0-fd4e-4fe5-a987-fcea33a5777c req-afb66d88-f60e-49f0-9aca-747519c6296b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.418775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-060352b0-fd4e-4fe5-a987-fcea33a5777c req-afb66d88-f60e-49f0-9aca-747519c6296b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.419683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-060352b0-fd4e-4fe5-a987-fcea33a5777c req-afb66d88-f60e-49f0-9aca-747519c6296b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.458692 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-060352b0-fd4e-4fe5-a987-fcea33a5777c req-afb66d88-f60e-49f0-9aca-747519c6296b service nova] Creating event network-vif-deleted:0b3968f1-1ad5-49e9-a33a-fefdba7840c7 for instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 on n-h1-858238-3 Nov 02 14:08:37.466209 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-060352b0-fd4e-4fe5-a987-fcea33a5777c req-afb66d88-f60e-49f0-9aca-747519c6296b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140083 Nov 02 14:08:37.469406 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1308/4562] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:08:37.511048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:37.511812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:37.534783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.535323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.535762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.536489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.536951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.537376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.596672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:37.597798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:37.614808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.628799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.629954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.634673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.635811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.639215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.729124 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] HTTP exception thrown: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Request method failure captured: Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 HTTP/1.1 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYniNh31qV81tMvNOXuytzjOzaoQDFS7OJ5g4gC6MxUDBNXLkoWn6W7s8GD0mxP9qgG6exfceezrrw0WismNrHHVHRqnd8IfSBLGAGuyzBWdJhLhSc1V_iE4gj_XNXx_kpL6JNHXF6xz9UqWAX35Re-1NphXzrskfRz_9ZMbht_CloUs Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2af544c47fd34763a0f4c9db29dc440d Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestServerBasicOps-538446582 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af544c47fd34763a0f4c9db29dc440d"}]}] Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestServerBasicOps-538446582 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2af544c47fd34763a0f4c9db29dc440d Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestServerBasicOps-538446582 Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestServerBasicOps-538446582-project Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 7453e356e6164465af839e2f7d600aca Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestServerBasicOps-538446582-project Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '83cf0f49-acec-445d-b3c1-48dfd1ac2c60'} Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:37.735575 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:37.740998 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:37.752177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Returning 404 to user: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:37.753314 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8af7054d-f18f-4a23-abfe-228d5f3a9207 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 404 len: 111 microversion: 2.1 time: 0.160966 Nov 02 14:08:37.758278 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1309/4563] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:37 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:37.942339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:37.957302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:37.962980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:37.967591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f465df4-3b00-43dd-9c87-6b5bb29cc1e5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.460613 Nov 02 14:08:37.990515 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3255/4564] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:37 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:38.998080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:39.000158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:39.018937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:39.020915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:39.030220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:39.031584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:39.034899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:39.035745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:39.267074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:39.312221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:39.316837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:39.325212 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98839ef2-2abe-46d4-a65f-1deadc4c78ab tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.330973 Nov 02 14:08:39.328555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1310/4565] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:38 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:40.354752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:40.355578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:40.448170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:40.460458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:40.463791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:40.466347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:40.467481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:40.468979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:40.470988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:40.712697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:40.763468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:40.765473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:40.766975 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c563f8c-3f56-4a1e-be48-b34905a7bea5 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.416721 Nov 02 14:08:40.795939 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3256/4566] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:40 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:40.963217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:40.963801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:40.983079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:40.983625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:40.984116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:40.985032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:40.985484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:40.985922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:41.024077 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] HTTP exception thrown: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Request method failure captured: Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 HTTP/1.1 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYniNh31qV81tMvNOXuytzjOzaoQDFS7OJ5g4gC6MxUDBNXLkoWn6W7s8GD0mxP9qgG6exfceezrrw0WismNrHHVHRqnd8IfSBLGAGuyzBWdJhLhSc1V_iE4gj_XNXx_kpL6JNHXF6xz9UqWAX35Re-1NphXzrskfRz_9ZMbht_CloUs Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2af544c47fd34763a0f4c9db29dc440d Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestServerBasicOps-538446582 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af544c47fd34763a0f4c9db29dc440d"}]}] Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestServerBasicOps-538446582 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2af544c47fd34763a0f4c9db29dc440d Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestServerBasicOps-538446582 Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestServerBasicOps-538446582-project Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 7453e356e6164465af839e2f7d600aca Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestServerBasicOps-538446582-project Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '83cf0f49-acec-445d-b3c1-48dfd1ac2c60'} Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:41.026203 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.030399 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.033313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Returning 404 to user: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:41.034430 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed6522b9-8084-4a0b-9aef-0f59b1eb2e6d tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "DELETE /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 404 len: 111 microversion: 2.1 time: 0.075258 Nov 02 14:08:41.035593 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1311/4567] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:08:40 2022] DELETE /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:41.047849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:41.049203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] [instance: 83cf0f49-acec-445d-b3c1-48dfd1ac2c60] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:41.071559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:41.072544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:41.073634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:41.074567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:41.075236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:41.078736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:41.130660 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] HTTP exception thrown: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Request method failure captured: Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 HTTP/1.1 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYniNh31qV81tMvNOXuytzjOzaoQDFS7OJ5g4gC6MxUDBNXLkoWn6W7s8GD0mxP9qgG6exfceezrrw0WismNrHHVHRqnd8IfSBLGAGuyzBWdJhLhSc1V_iE4gj_XNXx_kpL6JNHXF6xz9UqWAX35Re-1NphXzrskfRz_9ZMbht_CloUs Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2af544c47fd34763a0f4c9db29dc440d Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestServerBasicOps-538446582 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2af544c47fd34763a0f4c9db29dc440d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2af544c47fd34763a0f4c9db29dc440d"}]}] Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestServerBasicOps-538446582 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2af544c47fd34763a0f4c9db29dc440d Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestServerBasicOps-538446582 Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestServerBasicOps-538446582-project Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 7453e356e6164465af839e2f7d600aca Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestServerBasicOps-538446582-project Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '83cf0f49-acec-445d-b3c1-48dfd1ac2c60'} Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:41.136017 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. Nov 02 14:08:41.147638 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:08:41.150043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Returning 404 to user: Instance 83cf0f49-acec-445d-b3c1-48dfd1ac2c60 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:41.153150 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b9b7311-957b-49d1-8937-3becb4f77143 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60" status: 404 len: 111 microversion: 2.1 time: 0.112689 Nov 02 14:08:41.154907 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3257/4568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:41 2022] GET /compute/v2.1/servers/83cf0f49-acec-445d-b3c1-48dfd1ac2c60 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:41.826657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:41.827490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:41.847770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:41.848724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:41.849445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:41.850426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:41.855610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:41.858765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:42.163336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3af5ae82-f730-4375-9867-54e7039ae7f5 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] Calling method '.version_select at 0x7f6f80c2d4c0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:42.275385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3af5ae82-f730-4375-9867-54e7039ae7f5 tempest-TestServerBasicOps-538446582 tempest-TestServerBasicOps-538446582-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1816308707" status: 202 len: 0 microversion: 2.1 time: 0.118148 Nov 02 14:08:42.276536 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3258/4569] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Nov 2 14:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1816308707 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:08:42.956096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:42.972371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:42.978758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:42.980666 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-663a74fa-f9ca-4109-a281-74e3df2dc00c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 1.159029 Nov 02 14:08:42.995723 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1312/4570] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:41 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:44.010764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:44.012113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:44.031271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:44.032263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:44.032947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:44.036585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:44.037400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:44.039512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:44.133198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1313485679", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8953a4e0-ba10-40e7-a67b-cb505e4ca121"}], "security_groups": [{"name": "tempest-securitygroup--1756273541"}], "key_name": "tempest-keypair-2040081070", "user_data": "}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:44.706719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:44.727024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:44.756806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:44.758259 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9f493f6-fee1-4e41-b981-aa0eccb6509a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.751667 Nov 02 14:08:44.758848 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3259/4571] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:44 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:44.825166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] validate_networks() for [('8953a4e0-ba10-40e7-a67b-cb505e4ca121', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:08:45.790670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:45.794501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:45.825446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:45.826225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:45.833191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:45.835173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:45.838932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:45.839643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:46.623667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:08:46.624777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:08:46.625595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:08:46.626357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:08:46.627305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:08:46.661119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:46.662397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:46.670148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:46.671236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:46.674405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:46.676483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:46.677123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:46.709511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:46.722333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:46.727549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-446e5817-809d-482c-bb57-15d876ca1480 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.941587 Nov 02 14:08:46.729477 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3260/4572] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:45 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:46.737783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for project 4109b13b99644609bedb98d8e28c8e59. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:08:46.751283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Getting quotas for user a01f842614b24924bcc2196332cb5f35 and project 4109b13b99644609bedb98d8e28c8e59. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:08:46.797788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:08:46.800655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:08:46.955639 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-86c1d523-c7f9-4ffe-86d1-da1730d96d4c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.827026 Nov 02 14:08:46.968741 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1313/4573] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:08:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:08:46.974073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b404865-d736-47ed-8798-460c8e8863f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:46.976557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b404865-d736-47ed-8798-460c8e8863f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:46.979817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:47.560396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b404865-d736-47ed-8798-460c8e8863f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:47.575180 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b404865-d736-47ed-8798-460c8e8863f5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1238 microversion: 2.1 time: 0.603284 Nov 02 14:08:47.591930 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3261/4574] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:46 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1238 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:47.772377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:47.773818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:47.790189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:47.791089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:47.791797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:47.794008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:47.796263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:47.797470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:48.495862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:48.547950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:48.552856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:48.569841 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-da3c956b-9898-4e4d-b32f-17713950c248 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.790888 Nov 02 14:08:48.575253 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1314/4575] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:47 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:48.609591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:48.611113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:48.646555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:48.649872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:48.651471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:48.654730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:48.655530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:48.657469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:48.922661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:48.932914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:48.947347 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ed635ea-b957-4f34-8926-c52044b2930a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1290 microversion: 2.1 time: 0.343902 Nov 02 14:08:48.948507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3262/4576] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:48 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1290 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:49.610159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:49.612245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:49.634405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:49.635320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:49.637806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:49.642571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:49.643358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:49.643972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:49.843562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:49.865968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:49.867849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:49.869314 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1ea09ab-ef24-4372-b883-2c207217cd15 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.263772 Nov 02 14:08:49.887483 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1315/4577] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:49 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:49.977806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:49.978429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:49.994622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:50.000736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:50.001628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:50.003157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:50.003816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:50.004636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:50.493119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:50.515373 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8a1a002c-a1e3-4c90-bbe0-d9dec182b7ab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1296 microversion: 2.1 time: 0.541747 Nov 02 14:08:50.516477 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3263/4578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:49 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1296 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:50.899895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:50.900580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:50.914028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:50.914586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:50.915467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:50.916954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:50.928236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:50.929075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:51.100018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:51.136018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:51.138796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:51.140880 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a25a5d5c-4b84-4f61-b36f-dae2ee0b044a tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.244377 Nov 02 14:08:51.144264 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1316/4579] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:50 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:51.544192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:51.544802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:51.580335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:51.587559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:51.589523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:51.594197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:51.595535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:51.599317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:52.169385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:52.170515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:52.172338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:52.188127 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-771352f0-7c3a-4ae7-a98c-a4ae461bde6a tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.648434 Nov 02 14:08:52.188797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:52.189635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:52.190381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:52.191406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:52.192106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:52.192749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:52.205755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3264/4580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:51 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:52.317900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:52.332765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:52.335820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:52.343946 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e35ab21d-6a39-4821-8e23-6368de58f8d9 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.174140 Nov 02 14:08:52.350363 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1317/4581] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:52 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:53.225078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:53.226787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:53.238612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:53.241222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:53.242027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:53.243932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:53.244557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:53.245353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:53.380699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:53.382026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:53.391833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:53.392621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:53.394063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:53.395274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:53.395907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:53.396814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:53.504985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:53.517383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:53.520753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:53.522807 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dc2594c6-d4c8-452b-946e-b5f6d20605fc tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.146145 Nov 02 14:08:53.523877 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1318/4582] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:53 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:08:53.536581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:53.557638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da3fb397-a56b-47bc-b291-dbca439a2ea0 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.343110 Nov 02 14:08:53.562643 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3265/4583] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:53 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:54.125696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-180750ee-5501-4156-81f7-660d85c918aa req-a3690b19-a50f-4477-9f32-b6af70b4db44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adf7971-0422-490c-9b8c-8b3de45d3476", "tag": "7387b1d0-b33a-4d41-9675-e8ec12d435fc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:54.178408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-180750ee-5501-4156-81f7-660d85c918aa req-a3690b19-a50f-4477-9f32-b6af70b4db44 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:54.178953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-180750ee-5501-4156-81f7-660d85c918aa req-a3690b19-a50f-4477-9f32-b6af70b4db44 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:54.188975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-180750ee-5501-4156-81f7-660d85c918aa req-a3690b19-a50f-4477-9f32-b6af70b4db44 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:54.238360 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-180750ee-5501-4156-81f7-660d85c918aa req-a3690b19-a50f-4477-9f32-b6af70b4db44 service nova] Creating event network-changed:7387b1d0-b33a-4d41-9675-e8ec12d435fc for instance 7adf7971-0422-490c-9b8c-8b3de45d3476 on n-h1-858238-3 Nov 02 14:08:54.247048 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-180750ee-5501-4156-81f7-660d85c918aa req-a3690b19-a50f-4477-9f32-b6af70b4db44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158924 Nov 02 14:08:54.247693 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1319/4584] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:54.550234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:54.551006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:54.573317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:54.573835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:54.574279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:54.575005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:54.575493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:54.587605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:54.588652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:54.593963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:54.610158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:54.610876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:54.613826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:54.614973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:54.619828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:54.620279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:55.076399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:55.100795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:55.102234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:55.114272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-293cd896-9120-412a-ab7e-a38d849e4c43 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.566902 Nov 02 14:08:55.114923 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3266/4585] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:54 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:55.258196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:55.280408 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-288f3a2a-3265-49de-8532-04f065bfbd83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.696320 Nov 02 14:08:55.283034 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1320/4586] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:54 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:55.406854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a970b970-086a-460d-bf47-f12cf9c3269c tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Action: 'create', calling method: .version_select at 0x7f6f80c641f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-558147866", "metadata": {"Type": "work"}}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:56.032998 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a970b970-086a-460d-bf47-f12cf9c3269c tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.916806 Nov 02 14:08:56.047700 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3267/4587] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 14:08:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 932 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 14:08:56.048312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc0e75d8-72d9-42dd-bb04-6fad91deefc9 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f81ea6af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:56.147409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:56.148112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:56.162078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:56.164982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:56.165437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:56.167720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:56.168776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:56.169211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:56.200810 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc0e75d8-72d9-42dd-bb04-6fad91deefc9 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 352 microversion: 2.1 time: 0.157112 Nov 02 14:08:56.201406 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1321/4588] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:08:56 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:56.307418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:56.307974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:56.322341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:56.327406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:56.328216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:56.330737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:56.331427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:56.332048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:56.552233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:56.569287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:56.573467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:56.578594 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e725701-ffb9-4f2f-92c9-921a051e2199 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.436796 Nov 02 14:08:56.581204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3268/4589] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:56 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:56.704044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:56.767334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:56.785843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:56.802805 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-296e1889-57be-4c8a-af5b-e422a9f12eaa tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.498039 Nov 02 14:08:56.805970 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1322/4590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:56 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:57.217214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76222a4c-0532-4351-bb33-3d9f211cd3b6 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f85e2fc10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:57.314179 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76222a4c-0532-4351-bb33-3d9f211cd3b6 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 352 microversion: 2.1 time: 0.101600 Nov 02 14:08:57.322435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3269/4591] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:08:57 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:57.609089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:57.610734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:57.631757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:57.632932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:57.633484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:57.634362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:57.638263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:57.638795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:57.794346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:57.823465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:57.826422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:57.826607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:57.839691 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f752bab0-cf20-4cbb-b0df-fc7a20504d45 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.235244 Nov 02 14:08:57.840973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:57.841595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:57.860942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:57.861454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:57.861896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:57.862653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:57.863127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:57.863562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:57.868398 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1323/4592] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:57 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:58.280780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:58.298917 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e9afdd6-df86-49be-8e9e-dab7d7de423b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.473017 Nov 02 14:08:58.299565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3270/4593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:57 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:58.332741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2337b694-beaf-436f-8c66-f64da85c37b0 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f85e53700>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:58.409789 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2337b694-beaf-436f-8c66-f64da85c37b0 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 353 microversion: 2.1 time: 0.081341 Nov 02 14:08:58.428592 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1324/4594] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:08:58 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:58.437886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19b38a01-12be-44d2-9d98-9ede1329006c tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f80bb2820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:58.653671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19b38a01-12be-44d2-9d98-9ede1329006c tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 353 microversion: 2.1 time: 0.224752 Nov 02 14:08:58.659758 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3271/4595] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:08:58 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:58.676508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7925e340-965c-44c3-b341-c8d5cbb1cbb4 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f85e3b940>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:58.822796 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7925e340-965c-44c3-b341-c8d5cbb1cbb4 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 202 len: 0 microversion: 2.1 time: 0.151120 Nov 02 14:08:58.824077 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1325/4596] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:08:58 2022] DELETE /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:08:58.834135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c3f2aeeb-1c33-430c-8feb-4fb1208785a0 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f809f1af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:58.916479 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c3f2aeeb-1c33-430c-8feb-4fb1208785a0 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 352 microversion: 2.1 time: 0.088309 Nov 02 14:08:58.917797 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3272/4597] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:08:58 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:58.964388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:58.965739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:58.984560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:58.987160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:58.987862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:58.989887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:58.993190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:58.993508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:59.129213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:59.143201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:59.145035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:59.146708 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-26b939d0-7928-4fba-99aa-2ad904211447 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.188841 Nov 02 14:08:59.147936 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1326/4598] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:08:58 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:08:59.326541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:59.327192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:59.357562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:59.359544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:59.362114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:59.362868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:59.363571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:59.364178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:59.824018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:59.838275 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8b9a33b-ad80-45f6-8f30-11e234b911ba tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.515873 Nov 02 14:08:59.853982 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3273/4599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:08:59 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:59.932823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-66566888-be08-44f9-a4b5-8283ecdeaf5b tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f85e53e50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:00.024056 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-66566888-be08-44f9-a4b5-8283ecdeaf5b tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 352 microversion: 2.1 time: 0.095529 Nov 02 14:09:00.025493 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1327/4600] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:08:59 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:00.174127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:00.174735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:00.192244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:00.192913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:00.194237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:00.209929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:00.210675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:00.211303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:00.453675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:00.471920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:00.473356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:00.479068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-135ac64c-14b7-41d6-b885-098ba11b740d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.309425 Nov 02 14:09:00.487076 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3274/4601] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:00 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:00.876323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:00.876937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:00.903593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:00.904481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:00.905114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:00.907188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:00.907820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:00.908411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:01.038837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3232843b-a97f-4526-bb69-cf2531d16a86 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f81f8d9d0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:01.151972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3232843b-a97f-4526-bb69-cf2531d16a86 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 352 microversion: 2.1 time: 0.116818 Nov 02 14:09:01.153247 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3275/4602] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:09:01 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:09:01.379768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:01.396704 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3d922470-0653-4df2-abcb-69c9e080ab13 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.524318 Nov 02 14:09:01.397959 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1328/4603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:00 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:01.522205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:01.523647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:01.536931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:01.537906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:01.538585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:01.540171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:01.540897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:01.542001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:01.702398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:01.714881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:01.717086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:01.719275 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a76d8d04-5874-46a4-9e2d-3ca60ae2985d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.205471 Nov 02 14:09:01.732512 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3276/4604] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:01 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:02.167745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1fcac096-d0a7-418d-9e23-e0f23348c788 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f81c59940>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:02.288521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1fcac096-d0a7-418d-9e23-e0f23348c788 tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 200 len: 352 microversion: 2.1 time: 0.125381 Nov 02 14:09:02.291175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1329/4605] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:09:02 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:02.431115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:02.432807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:02.447274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:02.448088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:02.450228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:02.453161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:02.453712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:02.454202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:02.756059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:02.756639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:02.768694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:02.769559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:02.770303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:02.773315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:02.773971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:02.774886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:03.180716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:03.204483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:03.207237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:03.209603 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-133aefa9-111d-4a5f-90cd-82ed7561db86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.458818 Nov 02 14:09:03.224042 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1330/4606] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:02 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:09:03.305820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca4a064b-7943-431d-98e3-c69fdde7d50f tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Calling method '.version_select at 0x7f6f82040af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:03.362947 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ca4a064b-7943-431d-98e3-c69fdde7d50f tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] HTTP exception thrown: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca4a064b-7943-431d-98e3-c69fdde7d50f tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Request method failure captured: Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 HTTP/1.1 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnn2AvEqsX75ZjJ2ihGB46GnvLSVJJX-jFzMwmjVCRSJyKZQG85x37zxqlRFdc0rlwm-lnmdDYtgSm8JNTWjxCSRERqsdfgPe7TCL6di5w_j4Px7iRKOyXO-Utx7dNc12gBMYgMz-YtcYCHgRjHuhjj2xylhuHsbkxVZV2CvuYwXVDQ Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 70870edae63046d0a13c15bdc63c831e Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-VolumesGetTestJSON-1001672745 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70870edae63046d0a13c15bdc63c831e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/70870edae63046d0a13c15bdc63c831e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/70870edae63046d0a13c15bdc63c831e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_70870edae63046d0a13c15bdc63c831e"}]}] Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-VolumesGetTestJSON-1001672745 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 70870edae63046d0a13c15bdc63c831e Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-VolumesGetTestJSON-1001672745 Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-VolumesGetTestJSON-1001672745-project Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 9dfeac87220c435c8ce5a106226b55bf Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-VolumesGetTestJSON-1001672745-project Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: method: Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: exception: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'cbb36ee8-3538-4a4f-8d91-036eb30ac226'} Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. (HTTP 404) (Request-ID: req-a9569a5b-cecf-4380-96cd-84ccb7b7d7d6) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 14:09:03.367675 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. Nov 02 14:09:03.373212 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:03.378679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca4a064b-7943-431d-98e3-c69fdde7d50f tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] Returning 404 to user: Volume cbb36ee8-3538-4a4f-8d91-036eb30ac226 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:03.379807 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca4a064b-7943-431d-98e3-c69fdde7d50f tempest-VolumesGetTestJSON-1001672745 tempest-VolumesGetTestJSON-1001672745-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226" status: 404 len: 109 microversion: 2.1 time: 0.078926 Nov 02 14:09:03.380579 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1331/4607] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:09:03 2022] GET /compute/v2.1/os-volumes/cbb36ee8-3538-4a4f-8d91-036eb30ac226 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:09:03.443758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:03.465725 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-559768e9-a108-43e2-a34b-52e3af3385cf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 1.033662 Nov 02 14:09:03.466692 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3277/4608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:02 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:04.009753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-787704499", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "2c083d43-c155-4425-848d-3f96ac1e7987"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:04.078578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:04.139350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] validate_networks() for [('2c083d43-c155-4425-848d-3f96ac1e7987', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:09:04.242943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c4a2daa6-16a1-44e0-9021-d72687d8fb32 req-cdafe314-db9a-47cd-b9d9-6f443b7f61d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adf7971-0422-490c-9b8c-8b3de45d3476", "name": "network-vif-plugged", "status": "completed", "tag": "7387b1d0-b33a-4d41-9675-e8ec12d435fc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:04.267046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c4a2daa6-16a1-44e0-9021-d72687d8fb32 req-cdafe314-db9a-47cd-b9d9-6f443b7f61d3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:04.267556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c4a2daa6-16a1-44e0-9021-d72687d8fb32 req-cdafe314-db9a-47cd-b9d9-6f443b7f61d3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:04.269961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c4a2daa6-16a1-44e0-9021-d72687d8fb32 req-cdafe314-db9a-47cd-b9d9-6f443b7f61d3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:04.318954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c4a2daa6-16a1-44e0-9021-d72687d8fb32 req-cdafe314-db9a-47cd-b9d9-6f443b7f61d3 service nova] Creating event network-vif-plugged:7387b1d0-b33a-4d41-9675-e8ec12d435fc for instance 7adf7971-0422-490c-9b8c-8b3de45d3476 on n-h1-858238-3 Nov 02 14:09:04.344190 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c4a2daa6-16a1-44e0-9021-d72687d8fb32 req-cdafe314-db9a-47cd-b9d9-6f443b7f61d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104997 Nov 02 14:09:04.345017 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3278/4609] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:09:04.359705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:04.360393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:04.377236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:04.377913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:04.381671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:04.383688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:04.384326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:04.384910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:04.528222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:04.548380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:04.551994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:04.558871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f44dde8-6f6b-4014-984c-ca2257278b4d tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.211036 Nov 02 14:09:04.580547 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3279/4610] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:04 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:04.597175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:04.598647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:04.612758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:04.616239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:04.616919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:04.620372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:04.621149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:04.623055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:05.346226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:05.364656 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95c4ad98-e92d-4962-9d50-d0319e3d1242 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1364 microversion: 2.1 time: 0.782753 Nov 02 14:09:05.365245 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3280/4611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:04 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1364 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:05.596883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:05.598136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:05.608085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:05.609883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:05.611943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:05.614776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:05.615541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:05.617628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:05.816597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:09:05.817024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:09:05.817508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:09:05.818116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:09:05.818541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:09:05.821503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:05.834314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:05.835851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:05.841785 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3c9f38d-d3bc-4ee1-823e-37a0c654d9a3 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.249833 Nov 02 14:09:05.863133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3281/4612] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:05 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:09:05.885885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:05.886380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:05.886823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:05.887606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:05.888066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:05.889085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:05.922420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:05.987709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Getting quotas for project 465dea95e85e4608b43d6166e11a4db0. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:09:06.016139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Getting quotas for user 5f4f2f9c6c004829ac2744382836b936 and project 465dea95e85e4608b43d6166e11a4db0. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:09:06.064598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:09:06.072701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:09:06.220271 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ea6d4654-2854-44f8-9a57-67f8c56682eb tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.620644 Nov 02 14:09:06.221592 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1332/4613] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:09:06.232895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f56b251-815a-4761-bf81-aec4725b891d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:06.235869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f56b251-815a-4761-bf81-aec4725b891d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:06.399007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:06.400779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:06.446231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:06.446414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:06.496035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:06.499272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:06.499855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:06.500314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:06.643041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f56b251-815a-4761-bf81-aec4725b891d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:06.656400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f56b251-815a-4761-bf81-aec4725b891d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1224 microversion: 2.1 time: 0.423147 Nov 02 14:09:06.662014 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3282/4614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:06 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1224 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:06.899365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:06.904320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:06.961119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:06.975211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:06.977515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:06.980010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:06.982249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:06.985424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:07.255344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:07.309173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:07.317875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:07.323522 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb17ad83-a0ff-47f1-b4d5-c7deac0b77dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.428433 Nov 02 14:09:07.327761 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3283/4615] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:06 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:07.403773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:07.432286 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d4f204f5-16fa-4513-bb5c-1052d2e65a93 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1551 microversion: 2.1 time: 1.042617 Nov 02 14:09:07.432904 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1333/4616] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:06 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1551 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:07.465528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:07.471200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:07.488598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:07.489711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:07.492384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:07.498815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:07.499574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:07.502353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:07.684402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:07.685261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:07.703253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:07.708181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:07.709166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:07.710577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:07.716051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:07.716914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:07.906531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c30545b-a3d5-4a1a-8238-6773f9a3777b tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.446069 Nov 02 14:09:07.908846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3284/4617] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:09:07 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-interface => generated 285 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:08.214439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:08.228821 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4687c1f3-41e8-416a-a8ce-09eea128d681 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1220 microversion: 2.1 time: 0.549742 Nov 02 14:09:08.231873 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1334/4618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:07 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1220 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:08.350848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:08.351850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:08.362821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:08.373245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:08.373809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:08.375331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:08.378122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:08.380281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:08.746142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:08.756832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:08.764488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:08.768466 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f9aff10-8308-4265-a9d5-791ec5ce34b8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.421880 Nov 02 14:09:08.770224 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3285/4619] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:08 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:09.269443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:09.273568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:09.324873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:09.326635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:09.330317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:09.334000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:09.337052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:09.338982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:09.741815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:09.757037 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-790bafa5-d121-4ce0-b365-a6ed1a78386d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1284 microversion: 2.1 time: 0.505476 Nov 02 14:09:09.762127 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1335/4620] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:09 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1284 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:09.804381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:09.809372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:09.837238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:09.844555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:09.846060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:09.846953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:09.848646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:09.850251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:09.933767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:10.172733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:10.205303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:10.206975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:10.216918 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-074f9efc-8233-47e3-add0-e5b6e7291963 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.420569 Nov 02 14:09:10.218034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3286/4621] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:09 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:10.791660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:10.792511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:10.812462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:10.814808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:10.822108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:10.824198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:10.824774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:10.825486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:11.042539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:11.051555 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eab5a9c3-e976-462c-96da-65afe14d01fe tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1282 microversion: 2.1 time: 0.265337 Nov 02 14:09:11.062751 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1336/4622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:10 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:11.249754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:11.250491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:11.261073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:11.262643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:11.266679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:11.267259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:11.268089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:11.269628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:11.271181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:11.527785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:11.548631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:11.554544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:11.565829 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e544d284-947c-4b27-9951-f43a727b1c70 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.319906 Nov 02 14:09:11.568769 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3287/4623] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:11 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:12.087332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:12.088112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:12.101817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:12.102459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:12.103013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:12.103877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:12.106998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:12.107865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:12.599928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:12.600523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:12.612614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:12.628534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:12.629550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:12.631027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:12.632954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:12.633792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:13.687570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:13.700425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:13.702013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:13.703290 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7aa45e26-152e-4367-962f-face0081ad86 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 1.107539 Nov 02 14:09:13.707618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3288/4624] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:12 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:13.719136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:13.722898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:13.754322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:13.754806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:13.755268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:13.755970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:13.763038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:13.763510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:13.824507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:13.832575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6287b4ea-3db2-4d9b-8c15-fd5c6330228b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 1.749466 Nov 02 14:09:13.837126 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1337/4625] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:12 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:13.862667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eea032c2-af9c-4201-b50a-98f0fbbde150 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.153217 Nov 02 14:09:13.863652 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3289/4626] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 14:09:13 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:14.027742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:14.028519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:14.039782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.046044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.047282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:14.048200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.048837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.049515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:14.115556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:09:14.339785 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8ff08798-a5fc-4449-9f15-d8e2246d140f tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 204 len: 0 microversion: 2.20 time: 0.315381 Nov 02 14:09:14.340324 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1338/4627] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:09:14 2022] DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 14:09:14.350397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:14.351300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:14.366284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.366786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.367248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:14.371408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.375478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.376038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:14.653324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b583abe0-61d2-43b8-807a-37dfc9e5a863 req-3f7faf71-66c0-4e2a-addd-161b085ee6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adf7971-0422-490c-9b8c-8b3de45d3476", "tag": "7387b1d0-b33a-4d41-9675-e8ec12d435fc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:14.673707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b583abe0-61d2-43b8-807a-37dfc9e5a863 req-3f7faf71-66c0-4e2a-addd-161b085ee6ab service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.674683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b583abe0-61d2-43b8-807a-37dfc9e5a863 req-3f7faf71-66c0-4e2a-addd-161b085ee6ab service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.675602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b583abe0-61d2-43b8-807a-37dfc9e5a863 req-3f7faf71-66c0-4e2a-addd-161b085ee6ab service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:14.740356 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b583abe0-61d2-43b8-807a-37dfc9e5a863 req-3f7faf71-66c0-4e2a-addd-161b085ee6ab service nova] Creating event network-changed:7387b1d0-b33a-4d41-9675-e8ec12d435fc for instance 7adf7971-0422-490c-9b8c-8b3de45d3476 on n-h1-858238-3 Nov 02 14:09:14.760772 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b583abe0-61d2-43b8-807a-37dfc9e5a863 req-3f7faf71-66c0-4e2a-addd-161b085ee6ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115056 Nov 02 14:09:14.780393 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1339/4628] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:14.806322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:14.828754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:14.852403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.852905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.853349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:14.857453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:14.877440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:14.877440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:15.330913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.355443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.363958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.367277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31373ae2-05e5-4993-af65-f14b583a1935 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.581695 Nov 02 14:09:15.371325 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1340/4629] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:14 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:15.381471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:15.385542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:15.430281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:15.430914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:15.431404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:15.432168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:15.437332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.438932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:15.439527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:15.452304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.453908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:15.464517 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03ddd75a-50e5-4cf7-b4cc-1b8db9896bb1 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 1.119031 Nov 02 14:09:15.470519 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3290/4630] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:14 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:15.923473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:16.037940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:16.401817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:16.422749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:16.440070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:16.442940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:16.446097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:16.450751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:16.451591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:16.452272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:16.652150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:16.949074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:16.960094 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f59d5c7-983c-40b4-868c-2f747c77de3c tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 1.587036 Nov 02 14:09:16.961001 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1341/4631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:15 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:16.973113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:16.973968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:17.000941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:17.006496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:17.007307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:17.008933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.009799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:17.012772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:17.013455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:17.033678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.044498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.045596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95ffea0f-1229-41f2-b931-2a8861911997 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.649187 Nov 02 14:09:17.053943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3291/4632] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:16 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:17.541313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.550323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.554773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:17.560654 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9dd48369-847a-459d-aa63-6e6cb53a0879 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1722 microversion: 2.20 time: 0.598433 Nov 02 14:09:17.561619 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1342/4633] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:16 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1722 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:17.761508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-68255219-3ba3-4fd5-9301-a0e8a0ef3115 req-4d772093-125c-4fd1-9b88-bccbb55c0eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a581e3e-ce4e-4a5c-994a-718d43b595c0", "tag": "2b111531-3a65-4223-a1e0-b3bd78aa39a4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:17.784520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-68255219-3ba3-4fd5-9301-a0e8a0ef3115 req-4d772093-125c-4fd1-9b88-bccbb55c0eaa service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:17.785370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-68255219-3ba3-4fd5-9301-a0e8a0ef3115 req-4d772093-125c-4fd1-9b88-bccbb55c0eaa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:17.786598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-68255219-3ba3-4fd5-9301-a0e8a0ef3115 req-4d772093-125c-4fd1-9b88-bccbb55c0eaa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:17.803265 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-68255219-3ba3-4fd5-9301-a0e8a0ef3115 req-4d772093-125c-4fd1-9b88-bccbb55c0eaa service nova] Creating event network-changed:2b111531-3a65-4223-a1e0-b3bd78aa39a4 for instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 on n-h2-858238-3 Nov 02 14:09:17.810955 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-68255219-3ba3-4fd5-9301-a0e8a0ef3115 req-4d772093-125c-4fd1-9b88-bccbb55c0eaa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054660 Nov 02 14:09:17.812748 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3292/4634] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:17.987573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:17.990630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:18.009744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.010244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.010690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.011432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.012790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.013408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.080955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:18.081663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:18.104584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.105079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.105717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.106625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.107089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.107541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.258358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.273704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.283944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.285536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aafdf735-1ea0-46bc-a3a2-98261e71332c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.209157 Nov 02 14:09:18.286384 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3293/4635] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:18 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:09:18.461251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.472495 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dc1961b3-d954-40c5-9d4e-9a0e360b3e56 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 0.489243 Nov 02 14:09:18.485344 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1343/4636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:17 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:09:18.594551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:18.595749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:18.613456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.614256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.618561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.619659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:18.620352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:18.621022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:18.784174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.800963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.805875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:18.807325 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-455178b6-0bea-46bd-bed3-2f778efec31e tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1655 microversion: 2.20 time: 0.217861 Nov 02 14:09:18.835568 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3294/4637] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:18 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1655 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:09:19.328650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:19.330224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:19.345335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.346071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.346717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.353830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.355825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.358943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.535792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:19.541100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:19.556065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.575138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.578224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.579142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.581885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.583634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.602957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:19.637883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:19.649052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:19.664839 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d2e83a05-a2d0-4bcb-8611-d011d57de8d8 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.340687 Nov 02 14:09:19.669692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1344/4638] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:19 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:19.839527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:19.840128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:19.865473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.865987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.874633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:19.875815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:19.878524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:19.878975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:20.018786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.034898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62730e7f-9867-472a-ae94-371b5fb25a06 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 0.512769 Nov 02 14:09:20.036518 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3295/4639] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:19 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:09:20.040288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.044486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-296a2786-0ef6-4143-bb32-164ef5052cc0 req-c05cf485-8ddd-45a2-90db-ac52c7275a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77537b96-c4e1-4711-8be3-903a2b7824e8", "name": "network-vif-deleted", "tag": "73e68504-6e1b-49f5-b709-86aeb8d3512d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:20.059718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-296a2786-0ef6-4143-bb32-164ef5052cc0 req-c05cf485-8ddd-45a2-90db-ac52c7275a73 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:20.060915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-296a2786-0ef6-4143-bb32-164ef5052cc0 req-c05cf485-8ddd-45a2-90db-ac52c7275a73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:20.061586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-296a2786-0ef6-4143-bb32-164ef5052cc0 req-c05cf485-8ddd-45a2-90db-ac52c7275a73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:20.067421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.076002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.077520 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-39cfa7fd-c2e7-46a2-bbe1-802a44ac4eea tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1655 microversion: 2.20 time: 0.242027 Nov 02 14:09:20.083856 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1345/4640] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:19 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:09:20.094944 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-296a2786-0ef6-4143-bb32-164ef5052cc0 req-c05cf485-8ddd-45a2-90db-ac52c7275a73 service nova] Creating event network-vif-deleted:73e68504-6e1b-49f5-b709-86aeb8d3512d for instance 77537b96-c4e1-4711-8be3-903a2b7824e8 on n-h2-858238-3 Nov 02 14:09:20.107488 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-296a2786-0ef6-4143-bb32-164ef5052cc0 req-c05cf485-8ddd-45a2-90db-ac52c7275a73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066900 Nov 02 14:09:20.110260 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3296/4641] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:20.699545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:20.700868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:20.723286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:20.724063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:20.724712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:20.737434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:20.742934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:20.748624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:20.879010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.894495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.896938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:20.899486 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c6d8510-be83-4afe-9652-837936c57fc1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.203765 Nov 02 14:09:20.900407 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1346/4642] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:20 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:21.063069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:21.063870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:21.089126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.089622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.090133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.093959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.096677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.097134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.106257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:21.107041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:21.121733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.122232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.123131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.123422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.123887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.144467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.345026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.345433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.345876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.346334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lazy-loading 'fault' on Instance uuid 77537b96-c4e1-4711-8be3-903a2b7824e8 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:09:21.570868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:21.585294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:21.589576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54b21c1bdc9742a084ad3fb5e480bd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edee2f45a1d2435d83d8e9e19fa53ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:21.593951 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-be48ac4c-8f0a-4060-9832-48f5757768b4 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 200 len: 1371 microversion: 2.20 time: 0.491303 Nov 02 14:09:21.603333 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1347/4643] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:21 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:21.860153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:21.871584 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-561d9c1c-9580-42b5-88f7-c2002634b6ae tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 0.813320 Nov 02 14:09:21.875841 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3297/4644] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:21 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:21.931068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:21.931884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:21.974290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.978047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.980205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:21.982303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:21.986915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:21.987678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:22.095916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:22.247771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:22.272887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:22.280443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:22.284650 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d183d733-73e3-4e86-91a8-5c26feb2a968 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.357336 Nov 02 14:09:22.288057 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1348/4645] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:21 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:22.640795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:22.640795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:22.652736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:22.670466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:22.670466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:22.670466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:22.670466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:22.670466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:22.707417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] HTTP exception thrown: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Request method failure captured: Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 HTTP/1.1 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngad1o9rlay4YgDarPBJ2nKYn0a3xZorq-Z0kX1XuJYagc4jd-9Phwwb9Q6cawhIOFMKDIIRzgKgy40xW6zGnoMYoIwI8w8_zKaPrlq_XE-_QgrvcfN1oDhytO3GSOPvKs9bfRFSeXUiS9813nd3qVv9k65Yj-oHRhYQBLaf2nJaXY Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edee2f45a1d2435d83d8e9e19fa53ea8"}]}] Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54b21c1bdc9742a084ad3fb5e480bd45 Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '77537b96-c4e1-4711-8be3-903a2b7824e8'} Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:22.711614 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:22.717182 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:22.721885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Returning 404 to user: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:22.723015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b79e897e-c5aa-4973-b9c6-30ced6861123 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 404 len: 111 microversion: 2.20 time: 0.093152 Nov 02 14:09:22.729847 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3298/4646] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:22 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 14:09:22.739082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c7c735ef-a89a-4b17-a854-f6bfc306ca08 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '.version_select at 0x7f6f820400d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:22.785588 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c7c735ef-a89a-4b17-a854-f6bfc306ca08 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150853030" status: 204 len: 0 microversion: 2.20 time: 0.050313 Nov 02 14:09:22.786362 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1349/4647] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 14:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150853030 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 14:09:22.901655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:22.902478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:22.929841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:22.934743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:22.935325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:22.936084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:22.936585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:22.937073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:23.316917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:23.318850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:23.339865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:23.340855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:23.356427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:23.357741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:23.361975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:23.364178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:23.739762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:23.752464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:23.761522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:23.763270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e5cbf32-7e7a-4c47-9c88-b7ac53eb60dd tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1605 microversion: 2.32 time: 0.452520 Nov 02 14:09:23.775614 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1350/4648] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:23 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1605 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:09:24.131107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:24.147368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6f39ec5a-ca8f-495a-9fc0-5d1bbcb96f85 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 1.245748 Nov 02 14:09:24.166996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3299/4649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:22 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:24.794745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:24.795952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:24.809692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:24.816589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:24.818736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:24.835384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:24.836026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:24.836477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:25.001700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:25.014564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:25.015564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:25.016053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lazy-loading 'fault' on Instance uuid f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:09:25.176799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:25.179190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:25.191391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:25.192154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:25.192778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:25.193664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:25.194276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:25.194862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:25.226523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:25.250298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:25.251825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34fc7bf6ff247e8b9a77d3f505358a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195705b5a7b543ef8d284ddacae98a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:25.253081 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-246b8746-0a04-4ca6-a46f-6be8c678487c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 200 len: 1610 microversion: 2.32 time: 0.463250 Nov 02 14:09:25.253659 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1351/4650] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:24 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 1610 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:09:25.708092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:25.716335 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74189a3e-be21-44a6-b3f5-85a432192887 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 0.544095 Nov 02 14:09:25.721361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3300/4651] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:25 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:26.176255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-704cda0c-a97d-4a34-a45c-c30386ccd183 req-b52370a8-42e8-4dcb-a835-5631058992da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a581e3e-ce4e-4a5c-994a-718d43b595c0", "name": "network-vif-plugged", "status": "completed", "tag": "2b111531-3a65-4223-a1e0-b3bd78aa39a4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:26.206022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-704cda0c-a97d-4a34-a45c-c30386ccd183 req-b52370a8-42e8-4dcb-a835-5631058992da service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:26.206505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-704cda0c-a97d-4a34-a45c-c30386ccd183 req-b52370a8-42e8-4dcb-a835-5631058992da service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:26.206940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-704cda0c-a97d-4a34-a45c-c30386ccd183 req-b52370a8-42e8-4dcb-a835-5631058992da service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:26.262040 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-704cda0c-a97d-4a34-a45c-c30386ccd183 req-b52370a8-42e8-4dcb-a835-5631058992da service nova] Creating event network-vif-plugged:2b111531-3a65-4223-a1e0-b3bd78aa39a4 for instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 on n-h2-858238-3 Nov 02 14:09:26.285076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:26.286305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:26.293954 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-704cda0c-a97d-4a34-a45c-c30386ccd183 req-b52370a8-42e8-4dcb-a835-5631058992da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120222 Nov 02 14:09:26.294677 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1352/4652] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:26.301297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:26.301795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:26.304304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:26.304304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:26.304304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:26.304304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:26.354784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] HTTP exception thrown: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Request method failure captured: Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 HTTP/1.1 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngolBmOqP29AXmBBtFfBOWCjTP6B3BncEK-y9TkwL8qTFP6-lJUHwo-Y3xIPVl52dE3lUY2qIdskE_qDoyFtoxNY_QsEEg6nbMazsb8HwWj1b0vMUxL4RMUbHMaJgcloXVSnRuJJ74g-gp1RkamRL4Oz6NJZCDMJ4E-xdboOjG_KTw Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 195705b5a7b543ef8d284ddacae98a0c Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_195705b5a7b543ef8d284ddacae98a0c"}]}] Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 195705b5a7b543ef8d284ddacae98a0c Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TaggedBootDevicesTest-1255787201-project Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a34fc7bf6ff247e8b9a77d3f505358a4 Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TaggedBootDevicesTest-1255787201-project Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6'} Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:26.356385 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Returning 404 to user: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:26.361374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c467de2-e877-4e16-836a-22fee353aad1 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 404 len: 111 microversion: 2.32 time: 0.077204 Nov 02 14:09:26.368466 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3301/4653] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:26 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:26.369733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c654d21e-8624-422d-935b-c1313095193c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '.version_select at 0x7f6f85eb8310>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:26.418478 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c654d21e-8624-422d-935b-c1313095193c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078066795" status: 204 len: 0 microversion: 2.32 time: 0.054649 Nov 02 14:09:26.422596 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1353/4654] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 14:09:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078066795 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:09:26.750085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:26.750969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:26.761295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:26.766456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:26.767136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:26.772045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:26.772885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:26.773479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:28.250999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:28.259730 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d660d817-8bd0-4bd5-8f35-2e5d85e8de9f tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1324 microversion: 2.1 time: 1.514286 Nov 02 14:09:28.275526 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3302/4655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:26 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1324 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:29.284455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:29.286730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:29.303371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:29.303908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:29.304366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:29.305122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:29.305590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:29.306181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:29.905614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:29.926744 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed22ef7f-c87e-4eab-b9b9-6a865e985bbf tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1520 microversion: 2.1 time: 0.647636 Nov 02 14:09:29.927943 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1354/4656] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:29 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1520 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:29.953909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:29.954694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:29.963602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:29.963981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:29.964430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:29.965684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:29.967356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:29.967976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:30.000149 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] HTTP exception thrown: Instance is not a member of specified network Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Request method failure captured: Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0/ips/invalid HTTP/1.1 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnn_t8t0D1lmGxP9iRyxIe8UZ_Dit-ArHoBxNLiRbuOilROAFne7Akusyzr4BGYfM7he51OcmZV1g1E6EMXxfg0CiiJEjl1CMTUAPdDzG2tZ-ZcYGVkp6OHCGR3Z92IuT19Dt3MJBD4LkEtQWDg7um-9FECNuqUhvtHemkQuIMJvsfc Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 465dea95e85e4608b43d6166e11a4db0 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_465dea95e85e4608b43d6166e11a4db0"}]}] Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 465dea95e85e4608b43d6166e11a4db0 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerAddressesNegativeTestJSON-884513508-project Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 5f4f2f9c6c004829ac2744382836b936 Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-884513508-project Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance is not a member of specified network Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': '2a581e3e-ce4e-4a5c-994a-718d43b595c0', 'id': 'invalid'} Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 02 14:09:30.005840 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.011255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Returning 404 to user: Instance is not a member of specified network {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:30.012475 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f02c419-b003-448f-9ec1-a825c438aa4b tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.064128 Nov 02 14:09:30.013217 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3303/4657] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 14:09:29 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0/ips/invalid => generated 91 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:09:30.024236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8fb1c8b8-3a8c-4345-ae98-5abe6b55fea5 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:30.025009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8fb1c8b8-3a8c-4345-ae98-5abe6b55fea5 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Failed to fetch instance by id 999 {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 14:09:30.025724 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8fb1c8b8-3a8c-4345-ae98-5abe6b55fea5 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] HTTP exception thrown: Instance 999 could not be found. Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8fb1c8b8-3a8c-4345-ae98-5abe6b55fea5 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Request method failure captured: Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnn_t8t0D1lmGxP9iRyxIe8UZ_Dit-ArHoBxNLiRbuOilROAFne7Akusyzr4BGYfM7he51OcmZV1g1E6EMXxfg0CiiJEjl1CMTUAPdDzG2tZ-ZcYGVkp6OHCGR3Z92IuT19Dt3MJBD4LkEtQWDg7um-9FECNuqUhvtHemkQuIMJvsfc Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 465dea95e85e4608b43d6166e11a4db0 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_465dea95e85e4608b43d6166e11a4db0"}]}] Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 465dea95e85e4608b43d6166e11a4db0 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerAddressesNegativeTestJSON-884513508-project Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 5f4f2f9c6c004829ac2744382836b936 Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-884513508-project Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 999 could not be found. Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': '999'} Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 14:09:30.027960 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:30.035297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8fb1c8b8-3a8c-4345-ae98-5abe6b55fea5 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Returning 404 to user: Instance 999 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:30.039862 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8fb1c8b8-3a8c-4345-ae98-5abe6b55fea5 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020382 Nov 02 14:09:30.043876 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1355/4658] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 14:09:30 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:09:30.052839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:30.053654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:30.087200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:30.087982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:30.088621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:30.089528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:30.094309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:30.095049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:30.180271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:09:30.332773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:30.429614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca2598f8-4aff-45c3-a1a9-8d5667ca3ec2 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 204 len: 0 microversion: 2.1 time: 0.380429 Nov 02 14:09:30.439656 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3304/4659] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:09:30 2022] DELETE /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:09:30.452222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:30.456581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:30.506474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:30.507959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:30.509058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:30.510660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:30.528118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:30.528926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:31.141312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:31.184606 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-090ca65c-b3e5-480d-bd81-d302f7ce69fa tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1526 microversion: 2.1 time: 0.737451 Nov 02 14:09:31.188964 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1356/4660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:30 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1526 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:32.210373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:32.211068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:32.225643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:32.226477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:32.228518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:32.229643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:32.231470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:32.232114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:32.858305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:32.874277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9a06017-9779-43c6-98b6-431a27af4635 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1526 microversion: 2.1 time: 0.666344 Nov 02 14:09:32.878487 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3305/4661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:32 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1526 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:32.998074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:32.999369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:33.008377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.009269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.009937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.010923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.013576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.014377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.037072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] HTTP exception thrown: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Request method failure captured: Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 HTTP/1.1 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYngad1o9rlay4YgDarPBJ2nKYn0a3xZorq-Z0kX1XuJYagc4jd-9Phwwb9Q6cawhIOFMKDIIRzgKgy40xW6zGnoMYoIwI8w8_zKaPrlq_XE-_QgrvcfN1oDhytO3GSOPvKs9bfRFSeXUiS9813nd3qVv9k65Yj-oHRhYQBLaf2nJaXY Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edee2f45a1d2435d83d8e9e19fa53ea8"}]}] Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 54b21c1bdc9742a084ad3fb5e480bd45 Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '77537b96-c4e1-4711-8be3-903a2b7824e8'} Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:33.041808 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.047229 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.074226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Returning 404 to user: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:33.078622 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2508e5a4-651e-48d0-8c47-200b9f309a44 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 404 len: 111 microversion: 2.20 time: 0.082818 Nov 02 14:09:33.079859 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1357/4662] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:09:32 2022] DELETE /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:33.092340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:33.094473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: 77537b96-c4e1-4711-8be3-903a2b7824e8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:33.121138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.124580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.128181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.130310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.137306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.141232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.205047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] HTTP exception thrown: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Request method failure captured: Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 HTTP/1.1 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngad1o9rlay4YgDarPBJ2nKYn0a3xZorq-Z0kX1XuJYagc4jd-9Phwwb9Q6cawhIOFMKDIIRzgKgy40xW6zGnoMYoIwI8w8_zKaPrlq_XE-_QgrvcfN1oDhytO3GSOPvKs9bfRFSeXUiS9813nd3qVv9k65Yj-oHRhYQBLaf2nJaXY Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edee2f45a1d2435d83d8e9e19fa53ea8"}]}] Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54b21c1bdc9742a084ad3fb5e480bd45 Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '77537b96-c4e1-4711-8be3-903a2b7824e8'} Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.210924 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. Nov 02 14:09:33.218997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:33.227425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Returning 404 to user: Instance 77537b96-c4e1-4711-8be3-903a2b7824e8 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:33.228688 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-39199d77-2d06-4be9-99f7-feda91abde62 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8" status: 404 len: 111 microversion: 2.20 time: 0.145093 Nov 02 14:09:33.229933 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3306/4663] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:33 2022] GET /compute/v2.1/servers/77537b96-c4e1-4711-8be3-903a2b7824e8 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:33.618739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-cbc68735-9f88-4882-96b8-2edaf185d616 req-c93c3bf8-1f4a-4c5f-b954-20d7f5a2a765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a581e3e-ce4e-4a5c-994a-718d43b595c0", "name": "network-vif-deleted", "tag": "2b111531-3a65-4223-a1e0-b3bd78aa39a4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:33.647196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cbc68735-9f88-4882-96b8-2edaf185d616 req-c93c3bf8-1f4a-4c5f-b954-20d7f5a2a765 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.656510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cbc68735-9f88-4882-96b8-2edaf185d616 req-c93c3bf8-1f4a-4c5f-b954-20d7f5a2a765 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.657959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cbc68735-9f88-4882-96b8-2edaf185d616 req-c93c3bf8-1f4a-4c5f-b954-20d7f5a2a765 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.741301 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-cbc68735-9f88-4882-96b8-2edaf185d616 req-c93c3bf8-1f4a-4c5f-b954-20d7f5a2a765 service nova] Creating event network-vif-deleted:2b111531-3a65-4223-a1e0-b3bd78aa39a4 for instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 on n-h2-858238-3 Nov 02 14:09:33.779022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-cbc68735-9f88-4882-96b8-2edaf185d616 req-c93c3bf8-1f4a-4c5f-b954-20d7f5a2a765 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164397 Nov 02 14:09:33.786109 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1358/4664] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:33.905863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:33.906946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:33.930353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.932408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.936333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:33.939781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:33.942546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:33.945860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:34.056068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:34.057597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:34.061568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:34.062476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lazy-loading 'fault' on Instance uuid 2a581e3e-ce4e-4a5c-994a-718d43b595c0 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:09:34.198704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4f2f9c6c004829ac2744382836b936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '465dea95e85e4608b43d6166e11a4db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:34.214822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e15f0ee2-8a66-41d5-915e-7935a956cd86 tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 200 len: 1314 microversion: 2.1 time: 0.310487 Nov 02 14:09:34.219122 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3307/4665] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:33 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:35.243998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:35.244633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] [instance: 2a581e3e-ce4e-4a5c-994a-718d43b595c0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:35.271981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:35.292809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:35.294612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:35.296809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:35.300820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:35.307213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:35.307908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:35.368269 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] HTTP exception thrown: Instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 could not be found. Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Request method failure captured: Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 HTTP/1.1 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnn_t8t0D1lmGxP9iRyxIe8UZ_Dit-ArHoBxNLiRbuOilROAFne7Akusyzr4BGYfM7he51OcmZV1g1E6EMXxfg0CiiJEjl1CMTUAPdDzG2tZ-ZcYGVkp6OHCGR3Z92IuT19Dt3MJBD4LkEtQWDg7um-9FECNuqUhvtHemkQuIMJvsfc Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 465dea95e85e4608b43d6166e11a4db0 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/465dea95e85e4608b43d6166e11a4db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_465dea95e85e4608b43d6166e11a4db0"}]}] Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 465dea95e85e4608b43d6166e11a4db0 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-884513508 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerAddressesNegativeTestJSON-884513508-project Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 5f4f2f9c6c004829ac2744382836b936 Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-884513508-project Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 could not be found. Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2a581e3e-ce4e-4a5c-994a-718d43b595c0'} Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 could not be found. Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 could not be found. Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:35.370883 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 could not be found. Nov 02 14:09:35.376088 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:35.378455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] Returning 404 to user: Instance 2a581e3e-ce4e-4a5c-994a-718d43b595c0 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:35.379565 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8710df83-4480-4757-985d-4d99ab3a823d tempest-ServerAddressesNegativeTestJSON-884513508 tempest-ServerAddressesNegativeTestJSON-884513508-project] 10.222.0.18 "GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0" status: 404 len: 111 microversion: 2.1 time: 0.142327 Nov 02 14:09:35.380723 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1359/4666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:35 2022] GET /compute/v2.1/servers/2a581e3e-ce4e-4a5c-994a-718d43b595c0 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:09:37.234481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:37.235702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:37.256141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:37.257172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:37.258888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:37.262818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:37.263823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:37.264495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:37.310360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] HTTP exception thrown: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Request method failure captured: Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 HTTP/1.1 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngolBmOqP29AXmBBtFfBOWCjTP6B3BncEK-y9TkwL8qTFP6-lJUHwo-Y3xIPVl52dE3lUY2qIdskE_qDoyFtoxNY_QsEEg6nbMazsb8HwWj1b0vMUxL4RMUbHMaJgcloXVSnRuJJ74g-gp1RkamRL4Oz6NJZCDMJ4E-xdboOjG_KTw Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 195705b5a7b543ef8d284ddacae98a0c Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_195705b5a7b543ef8d284ddacae98a0c"}]}] Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 195705b5a7b543ef8d284ddacae98a0c Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TaggedBootDevicesTest-1255787201-project Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a34fc7bf6ff247e8b9a77d3f505358a4 Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TaggedBootDevicesTest-1255787201-project Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6'} Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:37.317012 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.322210 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.324768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Returning 404 to user: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:37.328906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a549677-27d0-462a-b0aa-9b50f2f83392 tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 404 len: 111 microversion: 2.32 time: 0.099018 Nov 02 14:09:37.331263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3308/4667] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:09:37 2022] DELETE /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:37.340738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:37.341336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] [instance: f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:37.363296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:37.363820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:37.364263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:37.364971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:37.373231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:37.373921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:37.445959 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] HTTP exception thrown: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Request method failure captured: Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 HTTP/1.1 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYngolBmOqP29AXmBBtFfBOWCjTP6B3BncEK-y9TkwL8qTFP6-lJUHwo-Y3xIPVl52dE3lUY2qIdskE_qDoyFtoxNY_QsEEg6nbMazsb8HwWj1b0vMUxL4RMUbHMaJgcloXVSnRuJJ74g-gp1RkamRL4Oz6NJZCDMJ4E-xdboOjG_KTw Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 195705b5a7b543ef8d284ddacae98a0c Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/195705b5a7b543ef8d284ddacae98a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_195705b5a7b543ef8d284ddacae98a0c"}]}] Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 195705b5a7b543ef8d284ddacae98a0c Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1255787201 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TaggedBootDevicesTest-1255787201-project Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: a34fc7bf6ff247e8b9a77d3f505358a4 Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TaggedBootDevicesTest-1255787201-project Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6'} Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.449033 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. Nov 02 14:09:37.455418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:09:37.458369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] Returning 404 to user: Instance f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:37.464890 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c0c12400-94c7-473b-9761-29e2ccaf4b4c tempest-TaggedBootDevicesTest-1255787201 tempest-TaggedBootDevicesTest-1255787201-project] 10.222.0.18 "GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6" status: 404 len: 111 microversion: 2.32 time: 0.125875 Nov 02 14:09:37.465977 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1360/4668] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:37 2022] GET /compute/v2.1/servers/f12bc7dc-6ce9-4287-bcc6-8892ed1c77c6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:41.257822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:41.258386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:41.279800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:41.283215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:41.289341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:41.295064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:41.297021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:41.298609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:41.398757 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5e09815-205c-4d2e-a1fd-75f753737301 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/ips" status: 200 len: 147 microversion: 2.1 time: 1.197720 Nov 02 14:09:41.425463 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3309/4669] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:09:40 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/ips => generated 147 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:09:42.708861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-878561781", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ecb986ea-ee30-46c8-bbd1-56c8d0ac5c9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:42.941840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:09:43.940567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:43.941180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:43.946151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:43.966553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:43.971781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:43.972387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:43.978972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:43.979818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:43.980498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:44.047403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] HTTP exception thrown: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Request method failure captured: Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 HTTP/1.1 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngad1o9rlay4YgDarPBJ2nKYn0a3xZorq-Z0kX1XuJYagc4jd-9Phwwb9Q6cawhIOFMKDIIRzgKgy40xW6zGnoMYoIwI8w8_zKaPrlq_XE-_QgrvcfN1oDhytO3GSOPvKs9bfRFSeXUiS9813nd3qVv9k65Yj-oHRhYQBLaf2nJaXY Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edee2f45a1d2435d83d8e9e19fa53ea8"}]}] Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54b21c1bdc9742a084ad3fb5e480bd45 Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'b4cea623-4709-4680-9646-d7263f443356'} Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:44.052967 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.058432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.072254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Returning 404 to user: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:44.077484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d3f4716-8883-448c-b755-7bfb2709c68d tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 404 len: 111 microversion: 2.20 time: 0.140714 Nov 02 14:09:44.081192 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3310/4670] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:09:43 2022] DELETE /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:44.086366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:44.095878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] [instance: b4cea623-4709-4680-9646-d7263f443356] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:44.102604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:44.103319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:44.103854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:44.108558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:44.115662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:44.116283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:44.153941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] HTTP exception thrown: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Request method failure captured: Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 HTTP/1.1 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYngad1o9rlay4YgDarPBJ2nKYn0a3xZorq-Z0kX1XuJYagc4jd-9Phwwb9Q6cawhIOFMKDIIRzgKgy40xW6zGnoMYoIwI8w8_zKaPrlq_XE-_QgrvcfN1oDhytO3GSOPvKs9bfRFSeXUiS9813nd3qVv9k65Yj-oHRhYQBLaf2nJaXY Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/edee2f45a1d2435d83d8e9e19fa53ea8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_edee2f45a1d2435d83d8e9e19fa53ea8"}]}] Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: edee2f45a1d2435d83d8e9e19fa53ea8 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2005209876 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 54b21c1bdc9742a084ad3fb5e480bd45 Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2005209876-project Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'b4cea623-4709-4680-9646-d7263f443356'} Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.156553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. Nov 02 14:09:44.161901 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:09:44.172093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] Returning 404 to user: Instance b4cea623-4709-4680-9646-d7263f443356 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:09:44.173397 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22252d46-ebae-499e-afb6-43f0b5b94ab9 tempest-AttachVolumeShelveTestJSON-2005209876 tempest-AttachVolumeShelveTestJSON-2005209876-project] 10.222.0.18 "GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356" status: 404 len: 111 microversion: 2.20 time: 0.090909 Nov 02 14:09:44.175956 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3311/4671] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:09:44 2022] GET /compute/v2.1/servers/b4cea623-4709-4680-9646-d7263f443356 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:09:45.115037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:09:45.115573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:09:45.115961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:09:45.116368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:09:45.116778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:09:45.137995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:45.141380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:45.142944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:45.145483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:45.150839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:45.151693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:45.214372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:09:45.229261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:09:45.399035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:09:45.403021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecb986ea-ee30-46c8-bbd1-56c8d0ac5c9a',volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:09:45.845323 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c3f74cf-bd2d-44c3-ae04-c4cbea09b092 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.139997 Nov 02 14:09:45.846828 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1361/4672] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:09:45.859675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f9cf8a6-5e7c-4216-be58-ff90060febbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:45.860443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f9cf8a6-5e7c-4216-be58-ff90060febbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:46.074664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a3655c2-2589-451d-a0d9-dce5c22fb14a"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:46.077379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:46.107971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:46.117013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:46.117683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:46.119337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f9cf8a6-5e7c-4216-be58-ff90060febbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:46.119935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:46.125741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:46.126360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:46.132033 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f9cf8a6-5e7c-4216-be58-ff90060febbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1056 microversion: 2.1 time: 0.277531 Nov 02 14:09:46.156842 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3312/4673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:45 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1056 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:46.766218 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5e567399-6f74-4cfd-8781-d54d4f3e4d83 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697629 Nov 02 14:09:46.774473 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1362/4674] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:09:46 2022] POST /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:09:47.162075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:47.162690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:47.241017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:47.241527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:47.241970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:47.242752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:47.259372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:47.259971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:47.565091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:47.600820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87460f18-91d4-4d0e-83ae-d741a2e62556 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1106 microversion: 2.1 time: 0.442623 Nov 02 14:09:47.601438 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3313/4675] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:47 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:48.643785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:48.645928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:48.696708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:48.698419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:48.703784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:48.706546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:48.716750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:48.717509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:49.038312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:49.047672 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ee628a10-d980-419f-9746-995b83764505 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1154 microversion: 2.1 time: 0.419826 Nov 02 14:09:49.057352 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1363/4676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:48 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1154 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:50.095792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:50.096771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:50.132036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:50.132445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:50.132884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:50.133604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:50.140061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:50.141154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:51.009270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:51.050228 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d490144-250d-4c28-8db6-3deae4df6961 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1172 microversion: 2.1 time: 0.959804 Nov 02 14:09:51.053652 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3314/4677] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:50 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1172 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:52.103033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:52.106738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:52.155646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:52.156846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:52.157305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:52.163577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:52.163995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:52.173611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:52.202598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:52.363574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:52.377437 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d876aa3a-591b-4cfe-88d3-81dd6f59d40c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1172 microversion: 2.1 time: 0.302936 Nov 02 14:09:52.379306 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1364/4678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:52 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1172 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:53.405521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:53.407782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:53.421557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:53.427241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:53.428023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:53.430318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:53.439460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:53.442230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:54.389342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:54.409731 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9aef7315-fd06-4592-86a2-711b6a893781 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 1.007895 Nov 02 14:09:54.418526 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3315/4679] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:53 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:55.442090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:55.443477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:55.447267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:55.450932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:55.465771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:55.466478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:55.466914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:55.467661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:55.468120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:55.468624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:55.845412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-37beb2cb-c3b2-4541-8f7d-98803f0c8a07 req-64e7c09b-4072-4973-b71a-e7fe3a17676c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae5040c-bc78-4f84-b637-192a1251b791", "tag": "ce96c718-0e93-4364-b06b-7f51955dfdbc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:09:55.865549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-37beb2cb-c3b2-4541-8f7d-98803f0c8a07 req-64e7c09b-4072-4973-b71a-e7fe3a17676c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:55.866048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-37beb2cb-c3b2-4541-8f7d-98803f0c8a07 req-64e7c09b-4072-4973-b71a-e7fe3a17676c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:55.866580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-37beb2cb-c3b2-4541-8f7d-98803f0c8a07 req-64e7c09b-4072-4973-b71a-e7fe3a17676c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:55.903836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-37beb2cb-c3b2-4541-8f7d-98803f0c8a07 req-64e7c09b-4072-4973-b71a-e7fe3a17676c service nova] Creating event network-changed:ce96c718-0e93-4364-b06b-7f51955dfdbc for instance aae5040c-bc78-4f84-b637-192a1251b791 on n-h1-858238-3 Nov 02 14:09:55.913046 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-37beb2cb-c3b2-4541-8f7d-98803f0c8a07 req-64e7c09b-4072-4973-b71a-e7fe3a17676c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072546 Nov 02 14:09:55.913986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3316/4680] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:09:56.461032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:56.471796 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-10fccd0c-13af-41de-88b6-41f0993766cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 1.033481 Nov 02 14:09:56.477113 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1365/4681] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:55 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:57.526620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:57.527575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:57.549967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:09:57.560250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:57.560881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:57.561334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:57.564244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:57.565098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:57.565549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:58.523834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:09:58.534989 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9ecb2c7-5918-41f7-b575-cebb2ce53b84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 1.026988 Nov 02 14:09:58.544058 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3317/4682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:57 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:09:59.570007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:09:59.570536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:09:59.603911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:59.606951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:59.610233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:09:59.610959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:09:59.611467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:09:59.611903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:00.073408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:00.089388 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f279175b-6af5-4eb6-9bd8-549f51747b0b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.521909 Nov 02 14:10:00.095331 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1366/4683] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:09:59 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:01.121180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:01.121752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:01.139949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:01.141028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:01.141475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:01.142906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:01.142906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:01.143204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:01.178044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:01.470613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:01.482741 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-339edaeb-9699-48b7-8244-2c3a86f147c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.365557 Nov 02 14:10:01.508084 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3318/4684] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:01 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:02.516794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:02.517374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:02.536493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:02.537299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:02.542213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:02.543270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:02.544037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:02.544634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:02.890069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:02.907158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-748ff8ee-8505-4102-b379-272be6ff75dd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.395700 Nov 02 14:10:02.908730 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1367/4685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:02 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:03.935872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:03.936501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:03.952145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:03.953268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:03.953801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:03.958534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:03.962443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:03.963119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:04.850020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:04.858240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ebcad186-0e4e-4ee5-91d4-45c7dc7efb6e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.926805 Nov 02 14:10:04.869329 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3319/4686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:03 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:05.888322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:05.892634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:05.907039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:05.908186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:05.910711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:05.911744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:05.912578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:05.913232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:06.099674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:06.108121 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-642949f2-baa2-4403-bb0c-3f872d56c52d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.228668 Nov 02 14:10:06.110882 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1368/4687] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:05 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:06.867769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2120112632", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e6be5110-068a-4169-b11b-0d1d4c28270e"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:06.966152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] validate_networks() for [('e6be5110-068a-4169-b11b-0d1d4c28270e', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:10:07.134601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:07.135248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:07.148127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:07.148614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:07.149049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:07.149772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:07.150252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:07.169116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:07.689474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:07.714083 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31e0eb9c-60c6-4fe6-8090-6b8aaaee37bb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.583482 Nov 02 14:10:07.728660 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1369/4688] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:07 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:10:08.214760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:10:08.215343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:10:08.215682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:10:08.216091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:10:08.216502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:10:08.243419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:08.243821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:08.245945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:08.250043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:08.250752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:08.253518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:08.294008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Getting quotas for project c9b62205e4b44561b43219709c8c5ecc. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:10:08.317480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Getting quotas for user c3721c29baed49418307528be871f2cd and project c9b62205e4b44561b43219709c8c5ecc. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:10:08.334736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:10:08.339160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:10:08.436056 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [ceba6743-ad8c-4bca-b702-20d91cfa053f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:10:08.740021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:08.741028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:08.751899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:08.753857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:08.754360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:08.755069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:08.755807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:08.756260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:08.756690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:09.042559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:09.063393 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-94536933-b882-4961-9397-4f438e29687e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.327020 Nov 02 14:10:09.063993 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1370/4689] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:08 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:10:09.446180 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [ceba6743-ad8c-4bca-b702-20d91cfa053f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 48430. Nov 02 14:10:09.451642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c50aa202-72ae-47c5-87d7-d50d615097e2 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.134603 Nov 02 14:10:09.461377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3320/4690] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:10:09.473711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98441615-678b-4cf1-8283-d677a4bd3821 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:09.474701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98441615-678b-4cf1-8283-d677a4bd3821 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:09.624867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98441615-678b-4cf1-8283-d677a4bd3821 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:09.634995 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98441615-678b-4cf1-8283-d677a4bd3821 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1216 microversion: 2.1 time: 0.165779 Nov 02 14:10:09.635873 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1371/4691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:09 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:09.795885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0666114c-68ea-4fea-aa43-ebaebc42225e tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f80361040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:09.877454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0666114c-68ea-4fea-aa43-ebaebc42225e tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/783e84d7-3f96-4b74-8250-c774eaecd211" status: 200 len: 351 microversion: 2.1 time: 0.085577 Nov 02 14:10:09.888106 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3321/4692] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:10:09 2022] GET /compute/v2.1/os-volumes/783e84d7-3f96-4b74-8250-c774eaecd211 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:10.088690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:10.089852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:10.103322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:10.106104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:10.106796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:10.107910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:10.111864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:10.113358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:10.365925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:10.389671 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c162d098-7fdf-463d-9af6-7c8089a7454f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.302780 Nov 02 14:10:10.393935 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1372/4693] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:10 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:10.659898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:10.663837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:10.681483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:10.682006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:10.682440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:10.687941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:10.688459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:10.688898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:10.904734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:10.920120 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c61555d5-6e56-4fb5-afd2-f1f3290c2508 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1268 microversion: 2.1 time: 0.264342 Nov 02 14:10:10.921183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3322/4694] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:10 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1268 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:11.435571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:11.436009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:11.455899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:11.457826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:11.459504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:11.462348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:11.464193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:11.467154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:11.960408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:11.962009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:11.987471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:11.989171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:11.990840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:11.993752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:11.994687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:11.997251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:12.197400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:12.214078 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f554ef7b-6104-4b75-a8ff-c8b84b33afae tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1214 microversion: 2.1 time: 0.795335 Nov 02 14:10:12.227445 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1373/4695] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:11 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1214 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:12.239912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:12.242531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:12.250616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:12.260236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:12.260991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:12.261979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:12.262660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:12.263350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:12.324990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:12.338022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7a18dad-8ea4-44f2-b47c-c9ef53b3cd4e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1274 microversion: 2.1 time: 0.395909 Nov 02 14:10:12.349688 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3323/4696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:11 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1274 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:12.364716 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cc5363e8-54b1-4995-b93f-83a6fad4d870 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135732 Nov 02 14:10:12.368549 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1374/4697] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:10:12 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:12.379389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:12.380016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:12.388326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:12.389119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:12.389738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:12.391540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:12.392168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:12.393182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:12.459827 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dfba9663-eed0-4b7e-a5cf-6489a2dddc35 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/3a3655c2-2589-451d-a0d9-dce5c22fb14a" status: 200 len: 194 microversion: 2.1 time: 0.084797 Nov 02 14:10:12.461097 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3324/4698] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Nov 2 14:10:12 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/3a3655c2-2589-451d-a0d9-dce5c22fb14a => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:12.846755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45a05afb-0d1e-4d2e-bf9f-47fa2c9c3142 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f81e5f820>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:13.011403 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45a05afb-0d1e-4d2e-bf9f-47fa2c9c3142 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/94e56b46-4047-42c9-8deb-940e67631325" status: 200 len: 350 microversion: 2.1 time: 0.169064 Nov 02 14:10:13.012335 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1375/4699] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:10:12 2022] GET /compute/v2.1/os-volumes/94e56b46-4047-42c9-8deb-940e67631325 => generated 350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:13.246192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:13.248413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:13.261688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:13.263191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:13.264128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:13.267003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:13.268536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:13.269141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:13.364991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:13.365912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:13.383278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:13.383885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:13.385813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:13.388326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:13.393957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:13.394431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:13.973519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:13.984665 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11a23be8-998b-4fa1-bee3-62b511bcffbf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.746545 Nov 02 14:10:13.988083 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3325/4700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:13 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:14.021825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:14.033347 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b3449576-af0f-4e3b-9e45-351f9292fce6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.672198 Nov 02 14:10:14.034478 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1376/4701] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:13 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:15.016663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:15.017987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:15.028605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:15.033575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:15.046376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:15.049454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:15.051512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:15.097242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:15.098090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:15.103260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:15.103798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:15.116749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:15.117251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:15.130560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:15.131558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:15.132053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:15.138733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:15.774685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:15.809812 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7043e36d-d643-49b1-8aeb-b15fda3e7ca9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.799568 Nov 02 14:10:15.823803 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3326/4702] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:15 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:15.873504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:15.890365 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4718cbea-40d6-46f6-a2a8-9f1504eaf0b6 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.824324 Nov 02 14:10:15.891277 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1377/4703] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:15 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:16.137911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-194ffc8d-4117-48bb-859f-ec15eae52a31 req-7f4ed0ad-4ad2-4bde-8386-8677f8532227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e958d6e0-1ca8-4260-a9ce-06614693118d", "tag": "4f7696e3-4048-42a1-8878-6d9c18fe5873"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:16.178031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-194ffc8d-4117-48bb-859f-ec15eae52a31 req-7f4ed0ad-4ad2-4bde-8386-8677f8532227 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:16.178541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-194ffc8d-4117-48bb-859f-ec15eae52a31 req-7f4ed0ad-4ad2-4bde-8386-8677f8532227 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:16.188812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-194ffc8d-4117-48bb-859f-ec15eae52a31 req-7f4ed0ad-4ad2-4bde-8386-8677f8532227 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:16.227200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-194ffc8d-4117-48bb-859f-ec15eae52a31 req-7f4ed0ad-4ad2-4bde-8386-8677f8532227 service nova] Creating event network-changed:4f7696e3-4048-42a1-8878-6d9c18fe5873 for instance e958d6e0-1ca8-4260-a9ce-06614693118d on n-h2-858238-3 Nov 02 14:10:16.237486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-194ffc8d-4117-48bb-859f-ec15eae52a31 req-7f4ed0ad-4ad2-4bde-8386-8677f8532227 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112573 Nov 02 14:10:16.243694 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3327/4704] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:16.270326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-48077fbe-749f-41e1-82a5-e8c37dae67eb tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f82210430>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:16.336023 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-48077fbe-749f-41e1-82a5-e8c37dae67eb tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5256c18-2978-44be-87c8-c6ff79bb0e01" status: 200 len: 351 microversion: 2.1 time: 0.071187 Nov 02 14:10:16.351004 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1378/4705] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 14:10:16 2022] GET /compute/v2.1/os-volumes/d5256c18-2978-44be-87c8-c6ff79bb0e01 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:16.351766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98bdbe63-6e68-47d8-9388-c59f4bdd1e5f tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f81d2ce50>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:16.553901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98bdbe63-6e68-47d8-9388-c59f4bdd1e5f tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.206187 Nov 02 14:10:16.565046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3328/4706] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Nov 2 14:10:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:16.565258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "619eb83d-7219-44ba-83a7-974cd76a2c97"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:16.567811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:16.573550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4647df9-001e-42a7-8733-dc8624dfdd06 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f80371820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:16.585266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:16.586038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:16.586666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:16.587418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:16.587878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:16.588370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:16.700286 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4647df9-001e-42a7-8733-dc8624dfdd06 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.131112 Nov 02 14:10:16.701072 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3329/4707] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 14:10:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:10:16.717960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4da8025c-f282-4870-9523-44e0b8ef55d9 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f80353ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:16.886596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4da8025c-f282-4870-9523-44e0b8ef55d9 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.173769 Nov 02 14:10:16.898449 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3330/4708] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Nov 2 14:10:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:16.906001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:16.908270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:16.926279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:16.928884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:16.929516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:16.932216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:16.933246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:16.935316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:17.036855 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-511ffdac-a59a-4a91-8527-82a8cd240126 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "POST /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474102 Nov 02 14:10:17.038584 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1379/4709] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:10:16 2022] POST /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:17.047327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b96fbcc5-32a4-401f-be6a-276669144bc5 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f81c73280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:17.204759 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b96fbcc5-32a4-401f-be6a-276669144bc5 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.163991 Nov 02 14:10:17.216924 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1380/4710] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 14:10:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:17.227517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:17.229526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:17.255935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:17.258991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:17.259998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:17.260965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:17.263672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:17.271720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:17.347768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:17.356553 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd03c4ae-367b-4caf-bc93-9195842de04f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.456673 Nov 02 14:10:17.357150 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3331/4711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:16 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:17.375263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9d4e888-a044-4d3f-bc05-67ca26244611 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f8096fd30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:17.563630 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9d4e888-a044-4d3f-bc05-67ca26244611 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194762 Nov 02 14:10:17.564288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3332/4712] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 14:10:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:17.578644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9cab80d3-5547-491e-bde4-616e8e4bdd92 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f80361820>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:17.722945 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9cab80d3-5547-491e-bde4-616e8e4bdd92 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.148300 Nov 02 14:10:17.724185 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3333/4713] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 14:10:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:10:17.739679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85ef7598-2536-4a30-997e-e15be8aa9fa1 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f80ad0c10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:17.865834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85ef7598-2536-4a30-997e-e15be8aa9fa1 tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.131627 Nov 02 14:10:17.875031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3334/4714] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Nov 2 14:10:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:17.879907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d7d3bdf-2b66-43f1-b125-eeb2f6364bee tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] Calling method '.version_select at 0x7f6f80351430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:17.907993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:17.916141 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eee1fa8b-b548-4b2e-aa1b-28b397d46b66 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.698039 Nov 02 14:10:17.916724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1381/4715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:17 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:18.047113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d7d3bdf-2b66-43f1-b125-eeb2f6364bee tempest-VolumesTestJSON-1010407042 tempest-VolumesTestJSON-1010407042-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.170790 Nov 02 14:10:18.047605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3335/4716] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 14:10:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:18.383621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:18.384241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:18.404420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:18.408557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:18.409264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:18.410196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:18.410853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:18.412562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:18.905602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:18.930512 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-faf24f61-417b-4cb1-851d-9f36c8037a62 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.551942 Nov 02 14:10:18.932921 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1382/4717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:18 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:18.949020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:18.949624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:18.964428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:18.965171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:18.973480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:18.979938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:18.980439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:18.987799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:18.988652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:18.988824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:19.625991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:19.634708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c859c24-a4d1-471f-b96b-2c6a22878492 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.689727 Nov 02 14:10:19.636430 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3336/4718] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:18 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:19.963448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:19.965783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:19.984944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:19.990643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:19.993487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:19.995805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:19.996869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:20.000984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:20.001744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:20.075059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:20.529820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:20.541679 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d4d08279-7eb1-43fb-97e0-4d31d9595f6b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.582166 Nov 02 14:10:20.548618 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1383/4719] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:19 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:20.659982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:20.660600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:20.678088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:20.680140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:20.682821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:20.688165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:20.701323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:20.701773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:21.262753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:21.279810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8cb5683-5835-40ce-8360-4a17563e2df8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.624259 Nov 02 14:10:21.284019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3337/4720] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:20 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:21.575966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:21.576580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:21.593912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:21.594467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:21.594908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:21.599755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:21.600266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:21.600720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:22.157577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:22.174131 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-94c82c77-b3f7-420f-a2f8-367c08057ed7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.602173 Nov 02 14:10:22.195178 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1384/4721] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:21 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:22.310876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:22.311762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:22.330334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:22.330828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:22.331295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:22.332010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:22.332462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:22.332880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:22.816619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:22.827515 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57508b6e-feb5-4ad4-8239-34e0ee45b24e tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.520316 Nov 02 14:10:22.831875 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3338/4722] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:22 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:23.198495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:23.199186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:23.213261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:23.214281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:23.215593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:23.216493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:23.221465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:23.222473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:23.662949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:23.685811 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4ead666c-2101-4185-936b-07bbb072ec82 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.491331 Nov 02 14:10:23.687457 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1385/4723] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:23 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:23.856928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:23.857606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:23.865354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:23.872113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:23.872771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:23.876458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:23.877123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:23.881038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:24.366277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:24.377506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb98b3fc-8360-4fdc-914d-03172aad775b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.524898 Nov 02 14:10:24.391138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3339/4724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:23 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:24.711705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:24.712263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:24.723763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:24.724205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:24.741357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:24.742281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:24.742597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:24.743035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:25.403693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:25.404309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:25.430185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:25.430678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:25.431176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:25.431833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:25.432296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:25.432693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:25.680708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:25.701036 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-149ba4a5-838d-4834-b0d9-cd5ec02755c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 0.992837 Nov 02 14:10:25.716114 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1386/4725] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:24 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:25.824651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8c497321-0ce3-4380-80df-02c84d6e9250 req-52469719-c0dc-4616-8d47-0d69206c864e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e958d6e0-1ca8-4260-a9ce-06614693118d", "name": "network-vif-plugged", "status": "completed", "tag": "4f7696e3-4048-42a1-8878-6d9c18fe5873"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:25.855970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8c497321-0ce3-4380-80df-02c84d6e9250 req-52469719-c0dc-4616-8d47-0d69206c864e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:25.860773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8c497321-0ce3-4380-80df-02c84d6e9250 req-52469719-c0dc-4616-8d47-0d69206c864e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:25.861751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8c497321-0ce3-4380-80df-02c84d6e9250 req-52469719-c0dc-4616-8d47-0d69206c864e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:25.919141 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8c497321-0ce3-4380-80df-02c84d6e9250 req-52469719-c0dc-4616-8d47-0d69206c864e service nova] Creating event network-vif-plugged:4f7696e3-4048-42a1-8878-6d9c18fe5873 for instance e958d6e0-1ca8-4260-a9ce-06614693118d on n-h2-858238-3 Nov 02 14:10:25.938995 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8c497321-0ce3-4380-80df-02c84d6e9250 req-52469719-c0dc-4616-8d47-0d69206c864e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116336 Nov 02 14:10:25.945657 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1387/4726] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:10:26.503952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:26.543825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9422a015-9997-4cc9-a0a0-1ce6a2da3695 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 1.143807 Nov 02 14:10:26.550448 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3340/4727] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:25 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:26.738706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:26.739866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:26.763846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:26.764310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:26.766867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:26.775656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:26.776316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:26.776776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:27.575997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:27.579248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:27.589702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:27.590734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:27.591439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:27.592511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:27.593227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:27.594421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:28.315358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:28.339151 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-24aa7861-fa6a-4ba8-b64d-4316710239f8 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1316 microversion: 2.1 time: 0.768810 Nov 02 14:10:28.343421 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3341/4728] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:27 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:28.361850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b6f30eb4-9d90-45a6-ab88-b9943d67c0c2 req-f486ff91-8bf2-46dd-b925-04fc9a8c4f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae5040c-bc78-4f84-b637-192a1251b791", "name": "network-vif-plugged", "status": "completed", "tag": "ce96c718-0e93-4364-b06b-7f51955dfdbc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:28.401779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6f30eb4-9d90-45a6-ab88-b9943d67c0c2 req-f486ff91-8bf2-46dd-b925-04fc9a8c4f65 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:28.402729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6f30eb4-9d90-45a6-ab88-b9943d67c0c2 req-f486ff91-8bf2-46dd-b925-04fc9a8c4f65 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:28.403556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6f30eb4-9d90-45a6-ab88-b9943d67c0c2 req-f486ff91-8bf2-46dd-b925-04fc9a8c4f65 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:28.454730 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b6f30eb4-9d90-45a6-ab88-b9943d67c0c2 req-f486ff91-8bf2-46dd-b925-04fc9a8c4f65 service nova] Creating event network-vif-plugged:ce96c718-0e93-4364-b06b-7f51955dfdbc for instance aae5040c-bc78-4f84-b637-192a1251b791 on n-h1-858238-3 Nov 02 14:10:28.504994 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b6f30eb4-9d90-45a6-ab88-b9943d67c0c2 req-f486ff91-8bf2-46dd-b925-04fc9a8c4f65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159964 Nov 02 14:10:28.511166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3342/4729] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:28.640652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:28.652203 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a1a07623-8b89-44cd-8c77-cb029d280dbd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 1.917954 Nov 02 14:10:28.652771 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1388/4730] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:26 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:29.371701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:29.372815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:29.391024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:29.392686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:29.408072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:29.408072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:29.408072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:29.408072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:29.683500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:29.684600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:29.706010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:29.706936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:29.710339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:29.716790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:29.726462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:29.729535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.394445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:30.435695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8834c446-e266-4f50-8380-4e478708ee97 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1503 microversion: 2.1 time: 1.073032 Nov 02 14:10:30.441890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3343/4731] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:29 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1503 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:30.473431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:30.473941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:30.490446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:30.494598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:30.497139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.498640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:30.500199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:30.501276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.608313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:30.777440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-648e8525-a5ad-43df-a23b-6ffa5536a2a4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.310314 Nov 02 14:10:30.781557 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3344/4732] 10.222.0.18 () {58 vars in 1296 bytes} [Wed Nov 2 14:10:30 2022] DELETE /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d/os-server-password => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:10:30.791849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:30.794788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:30.808300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:30.809052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:30.809679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.814539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:30.815578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:30.816210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.823773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:30.842936 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-19a6c006-85ca-4f5f-a7c4-375ca8f4745a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1202 microversion: 2.1 time: 1.161971 Nov 02 14:10:30.851839 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1389/4733] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:29 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1202 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:10:30.878971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-453dfb86-343f-4a4e-9e31-1ba322f1703b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.092544 Nov 02 14:10:30.884230 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3345/4734] 10.222.0.18 () {58 vars in 1293 bytes} [Wed Nov 2 14:10:30 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d/os-server-password => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 14:10:30.894869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:30.895689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:30.908906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:30.913676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:30.915493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.924718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:30.925547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:30.932337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:30.994196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:10:31.299129 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6093e076-cb92-4ff5-b27b-8e60bf7f8a58 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 204 len: 0 microversion: 2.1 time: 0.408440 Nov 02 14:10:31.305505 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1390/4735] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:10:30 2022] DELETE /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:10:31.315445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:31.316265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:31.337608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:31.338119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:31.338568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:31.344194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:31.344796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:31.345257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:31.880695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:31.881423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:31.904293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:31.912109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:31.912569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:31.913344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:31.913814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:31.914247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:31.950220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:31.962885 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82d9b19f-9c2d-479f-94ec-83ee59086cb5 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1509 microversion: 2.1 time: 0.651846 Nov 02 14:10:31.964488 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3346/4736] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:31 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1509 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:32.992022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:32.992936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:33.010532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:33.010721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:33.023625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:33.025060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:33.036605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:33.037346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:33.392393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:33.402886 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5fecab0-979c-473c-bc53-280c6da3e09b tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1509 microversion: 2.1 time: 0.414921 Nov 02 14:10:33.425709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3347/4737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:32 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:10:33.473788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:33.483934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a26e02b-08b0-496f-aae8-eb7b9a262d31 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1389 microversion: 2.1 time: 1.608935 Nov 02 14:10:33.508285 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1391/4738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:31 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1389 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:33.527415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:33.528030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:33.543540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:33.544097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:33.544503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:33.545570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:33.547480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:33.548092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:33.975801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:33.989508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5665e7c0-da77-47e0-bdb7-1fceb4645503 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1389 microversion: 2.1 time: 0.466753 Nov 02 14:10:34.012566 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3348/4739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:33 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1389 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:34.028531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:34.029238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:34.048957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.054182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.054643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.055436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.055909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.056337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.429597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:34.430220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:34.442452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.442964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.443457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.444173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.444635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.445063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.556957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:34.568122 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b7a11efd-8179-47ac-b448-f7ba9ddf27ff tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1389 microversion: 2.1 time: 0.544095 Nov 02 14:10:34.569901 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1392/4740] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:34 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1389 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:34.603456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:34.610502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:34.632759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.635764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.636249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.637003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.637467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.637893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.726316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:10:34.818286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3721c29baed49418307528be871f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b62205e4b44561b43219709c8c5ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:34.829403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55d9dd6b-22ac-4537-b862-9e1feec88db4 tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 200 len: 1467 microversion: 2.1 time: 0.403607 Nov 02 14:10:34.830348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3349/4741] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:34 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 1467 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:34.898847 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-21c0f1a3-888f-4cca-9973-da8d6a7a732d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 204 len: 0 microversion: 2.1 time: 0.301809 Nov 02 14:10:34.900333 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1393/4742] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:10:34 2022] DELETE /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:10:34.913403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:34.914034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:34.928767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.930156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.930616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.934291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:34.935665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:34.936367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:34.957954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ba39e3e9-b39c-4c4b-ad67-c769b3f89315 req-37663469-6437-42f2-9e3a-79453fccab04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e958d6e0-1ca8-4260-a9ce-06614693118d", "name": "network-vif-deleted", "tag": "4f7696e3-4048-42a1-8878-6d9c18fe5873"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:34.999259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ba39e3e9-b39c-4c4b-ad67-c769b3f89315 req-37663469-6437-42f2-9e3a-79453fccab04 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:35.001197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ba39e3e9-b39c-4c4b-ad67-c769b3f89315 req-37663469-6437-42f2-9e3a-79453fccab04 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:35.004104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ba39e3e9-b39c-4c4b-ad67-c769b3f89315 req-37663469-6437-42f2-9e3a-79453fccab04 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:35.037665 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ba39e3e9-b39c-4c4b-ad67-c769b3f89315 req-37663469-6437-42f2-9e3a-79453fccab04 service nova] Creating event network-vif-deleted:4f7696e3-4048-42a1-8878-6d9c18fe5873 for instance e958d6e0-1ca8-4260-a9ce-06614693118d on n-h2-858238-3 Nov 02 14:10:35.068090 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ba39e3e9-b39c-4c4b-ad67-c769b3f89315 req-37663469-6437-42f2-9e3a-79453fccab04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114512 Nov 02 14:10:35.068720 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1394/4743] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:35.838346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:35.857782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:35.858489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] [instance: e958d6e0-1ca8-4260-a9ce-06614693118d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:35.865155 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea7305a3-a9df-40ea-af80-a616b1a3d80d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1395 microversion: 2.1 time: 0.957040 Nov 02 14:10:35.868389 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3350/4744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:34 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1395 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:10:35.893400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:35.901628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:35.902295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:35.906766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:35.911087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:35.911809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:35.981906 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] HTTP exception thrown: Instance e958d6e0-1ca8-4260-a9ce-06614693118d could not be found. Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Request method failure captured: Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d HTTP/1.1 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYno9o67bn_-H6xZny4vwhea_cgnSsdIjMaZ-RXmVbFu0jH84muwtHQX0z6QmiTeA7PFfRdwNorqHQUrAKZo1o82O5g0marivVjv3S0fWIiu2EXftmzzh4eNsaVqexOFDQfnAX9wfUHGicvlp0QsQgk0505fIARBzWOurhIx99NEd1oo Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c9b62205e4b44561b43219709c8c5ecc Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerPasswordTestJSON-295530987 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c9b62205e4b44561b43219709c8c5ecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c9b62205e4b44561b43219709c8c5ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c9b62205e4b44561b43219709c8c5ecc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c9b62205e4b44561b43219709c8c5ecc"}]}] Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerPasswordTestJSON-295530987 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c9b62205e4b44561b43219709c8c5ecc Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerPasswordTestJSON-295530987 Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerPasswordTestJSON-295530987-project Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c3721c29baed49418307528be871f2cd Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerPasswordTestJSON-295530987-project Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance e958d6e0-1ca8-4260-a9ce-06614693118d could not be found. Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'e958d6e0-1ca8-4260-a9ce-06614693118d'} Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e958d6e0-1ca8-4260-a9ce-06614693118d could not be found. Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e958d6e0-1ca8-4260-a9ce-06614693118d could not be found. Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:10:35.983627 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e958d6e0-1ca8-4260-a9ce-06614693118d could not be found. Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] Returning 404 to user: Instance e958d6e0-1ca8-4260-a9ce-06614693118d could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-908b4787-43f3-4491-8e33-e458616b7dde tempest-ServerPasswordTestJSON-295530987 tempest-ServerPasswordTestJSON-295530987-project] 10.222.0.18 "GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d" status: 404 len: 111 microversion: 2.1 time: 0.131841 Nov 02 14:10:35.989090 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1395/4745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:35 2022] GET /compute/v2.1/servers/e958d6e0-1ca8-4260-a9ce-06614693118d => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:10:36.896133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:36.896734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:36.924420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:36.926749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:36.928082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:36.930413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:36.933639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:36.934299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:37.430338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:37.446384 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2483ef1-1ce1-4133-8ece-b616b51885b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1395 microversion: 2.1 time: 0.554306 Nov 02 14:10:37.446999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3351/4746] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:36 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1395 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:38.475890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:38.477092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:38.486368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:38.493151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:38.494316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:38.495256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:38.496039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:38.496715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:38.899015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:38.911028 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5ce25064-8204-430d-bb21-dd8465bd8de0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1395 microversion: 2.1 time: 0.439188 Nov 02 14:10:38.913070 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1396/4747] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:38 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1395 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:39.541582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b68dac1e-abdd-4e26-add5-8d7195bdeb17 req-2b98d04b-a3de-406f-9222-0f480676b429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae5040c-bc78-4f84-b637-192a1251b791", "name": "network-vif-deleted", "tag": "ce96c718-0e93-4364-b06b-7f51955dfdbc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:39.572851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b68dac1e-abdd-4e26-add5-8d7195bdeb17 req-2b98d04b-a3de-406f-9222-0f480676b429 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:39.573344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b68dac1e-abdd-4e26-add5-8d7195bdeb17 req-2b98d04b-a3de-406f-9222-0f480676b429 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:39.574037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b68dac1e-abdd-4e26-add5-8d7195bdeb17 req-2b98d04b-a3de-406f-9222-0f480676b429 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:39.627201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b68dac1e-abdd-4e26-add5-8d7195bdeb17 req-2b98d04b-a3de-406f-9222-0f480676b429 service nova] Creating event network-vif-deleted:ce96c718-0e93-4364-b06b-7f51955dfdbc for instance aae5040c-bc78-4f84-b637-192a1251b791 on n-h1-858238-3 Nov 02 14:10:39.644410 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b68dac1e-abdd-4e26-add5-8d7195bdeb17 req-2b98d04b-a3de-406f-9222-0f480676b429 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106594 Nov 02 14:10:39.645022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3352/4748] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:39.945382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:39.947199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:39.951166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:39.986614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:39.990567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:39.990848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:39.993938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:39.994431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:39.994878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:40.266863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:40.290412 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-890ff445-30c3-415a-8778-a3991d67b7c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.350641 Nov 02 14:10:40.291154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1397/4749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:39 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:41.322807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:41.324800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:41.376296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:41.378256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:41.381027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:41.412862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:41.414301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:41.414918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:41.803138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:41.824929 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6e01340-03fd-49b9-b889-5272f3768e09 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.507302 Nov 02 14:10:41.825687 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3353/4750] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:41 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:42.853871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:42.854486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:42.870284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:42.877196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:42.877700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:42.878460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:42.880795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:42.881306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:43.172410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:43.180271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:43.191619 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ea355bda-dd79-4ab4-a768-31981af0b47f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.337910 Nov 02 14:10:43.192589 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1398/4751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:42 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:44.220787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:44.221404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:44.232615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:44.235295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:44.236326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:44.239220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:44.240001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:44.242202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:44.378510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:44.391450 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a0a26bad-400f-436a-a900-f81d852d415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.173020 Nov 02 14:10:44.393224 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3354/4752] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:44 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:45.415134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:45.417521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:45.437583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:45.440613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:45.441063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:45.441795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:45.442252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:45.442716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:45.611701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:45.626436 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c838cd2-f659-448f-af75-187a8b794129 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.215781 Nov 02 14:10:45.635218 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1399/4753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:45 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:46.655684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:46.656436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:46.659747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=44 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:46.676471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:46.676955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:46.679403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:46.680320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:46.684102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:46.684604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:46.854646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:46.880035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0de7ecf9-c211-4df2-ab9f-f6c33770da1f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.225162 Nov 02 14:10:46.895578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3355/4754] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:46 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:47.903541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:47.904159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:47.923295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:47.924073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:47.924722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:47.925678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:47.926329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:47.926948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:48.047834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:48.059191 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38bd6794-c299-40f5-b590-9c14781b326e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.159533 Nov 02 14:10:48.061656 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1400/4755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:47 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:49.089158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:49.089641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:49.101277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:49.102359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:49.103050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:49.104181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:49.105128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:49.105716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:49.199494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:49.212272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a493f7d-714c-4951-aeba-471058dac06c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.128401 Nov 02 14:10:49.213325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3356/4756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:49 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:50.238898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:50.240306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:50.256737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:50.257234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:50.259576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:50.265049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:50.265613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:50.266068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:50.468066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:50.499971 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-89058ff4-e5bd-4ec3-88c4-56d4cf351822 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 200 len: 1187 microversion: 2.1 time: 0.266522 Nov 02 14:10:50.500704 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1401/4757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:50 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 1187 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:50.800628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:50.801219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:50.811449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:50.811948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:50.812410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:50.817589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:50.819288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:50.819960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:51.056639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lazy-loading 'services' on Instance uuid 9f366ab5-db8f-4218-a225-5cb499b0899e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:10:51.205134 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-682ee232-c180-4291-bedf-ab7452785ba0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e/os-volume_attachments/8e805ef2-2b1b-432e-b0d7-4b4b74b07778" status: 202 len: 0 microversion: 2.1 time: 0.407471 Nov 02 14:10:51.215179 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3357/4758] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:10:50 2022] DELETE /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e/os-volume_attachments/8e805ef2-2b1b-432e-b0d7-4b4b74b07778 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:10:51.545424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:51.551286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: aae5040c-bc78-4f84-b637-192a1251b791] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:51.576493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:51.577288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:51.578791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:51.579757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:51.580385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:51.582001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:51.625740 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance aae5040c-bc78-4f84-b637-192a1251b791 could not be found. Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 HTTP/1.1 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance aae5040c-bc78-4f84-b637-192a1251b791 could not be found. Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'aae5040c-bc78-4f84-b637-192a1251b791'} Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae5040c-bc78-4f84-b637-192a1251b791 could not be found. Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae5040c-bc78-4f84-b637-192a1251b791 could not be found. Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:10:51.628908 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae5040c-bc78-4f84-b637-192a1251b791 could not be found. Nov 02 14:10:51.634417 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:10:51.637542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance aae5040c-bc78-4f84-b637-192a1251b791 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:10:51.638694 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a1fb1618-b0f2-403d-a4b1-885c2e40adcb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791" status: 404 len: 111 microversion: 2.1 time: 0.114756 Nov 02 14:10:51.639848 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1402/4759] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:10:51 2022] GET /compute/v2.1/servers/aae5040c-bc78-4f84-b637-192a1251b791 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:11:02.348385 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:11:02.348935 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Nov 02 14:11:02.349894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=5 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:02.350668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=5 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:02.669413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1056162115", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:02.817588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] validate_networks() for [('8a7da38e-e895-4f80-8321-8e988c87645c', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:11:04.025618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:11:04.026555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:11:04.027171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:11:04.027903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:11:04.028570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:11:04.054827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:04.055762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:04.056585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:04.057888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:04.058619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:04.059587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:04.143888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Getting quotas for project 7aa447cf682848278bbc77e70d04013c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:11:04.161621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Getting quotas for user b80d7d9f70e5433f9d76d5fca703f49e and project 7aa447cf682848278bbc77e70d04013c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:11:04.213320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:11:04.227411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:11:04.409898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-670eec9b-3508-4441-ae54-1cce3a90925e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.060285 Nov 02 14:11:04.411423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3358/4760] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:11:04.422066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-144f2f47-80f2-4180-a37a-8aa1d520e3fe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:04.422690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-144f2f47-80f2-4180-a37a-8aa1d520e3fe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:04.439808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=11 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:04.445121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=21 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:04.966856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-144f2f47-80f2-4180-a37a-8aa1d520e3fe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:04.980960 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-144f2f47-80f2-4180-a37a-8aa1d520e3fe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1217 microversion: 2.1 time: 0.559514 Nov 02 14:11:04.981626 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1403/4761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:04 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1217 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:06.009018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:06.009623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:06.030208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:06.032772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:06.033238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:06.033992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:06.047742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:06.048158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:06.277874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:06.297003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b821cd57-6018-4ca4-bacd-4bf890903e61 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1213 microversion: 2.1 time: 0.295110 Nov 02 14:11:06.303226 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3359/4762] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:06 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:07.326831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:07.328937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:07.347717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:07.356183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:07.356612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:07.357385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:07.359670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:07.360275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:07.614475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:07.657885 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54a0c480-9aff-451f-9a75-55967847ebc2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1275 microversion: 2.1 time: 0.333959 Nov 02 14:11:07.674253 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1404/4763] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:07 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:08.716728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:08.718127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:08.732012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:08.733878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:08.734474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:08.740613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:08.741237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:08.743174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:08.760351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:08.761508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:08.801851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:08.802531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:08.802984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:08.806583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:08.809513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:08.809994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:08.928777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:11:09.144154 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2321db0-eee8-4208-aa5a-4abd660ba061 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 204 len: 0 microversion: 2.1 time: 0.392218 Nov 02 14:11:09.150351 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1405/4764] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:11:08 2022] DELETE /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:11:09.667388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:09.677630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1794474437", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:09.690633 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4dddd558-cbce-456a-9ec0-68f9114dc38c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1275 microversion: 2.1 time: 0.994312 Nov 02 14:11:09.691288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3360/4765] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:08 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1275 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:09.709533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:09.710167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:09.737219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:09.737943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:09.738175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:09.738849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:09.739333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:09.743571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:09.815289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] validate_networks() for [('5cc5c180-e739-48f3-83d7-bd0a42c248db', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:11:10.330864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:10.383180 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ee2d438-5939-4d9f-9779-0ec18a7ea21b tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1468 microversion: 2.1 time: 0.666861 Nov 02 14:11:10.403235 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3361/4766] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:09 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1468 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:10.725479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:10.727826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:10.747917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:10.751245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:10.751934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:10.753322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:10.754266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:10.754995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:10.941887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:10.955018 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0568557-fb71-4b37-8eee-3273d297a7bd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1275 microversion: 2.1 time: 0.234410 Nov 02 14:11:10.958491 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3362/4767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:10 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:11.426034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:11.429204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:11.453598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:11.454466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:11.455328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:11.458525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:11.460060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:11.461581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:11.522584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:11:11.523006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:11:11.524021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:11:11.524579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:11:11.525262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:11:11.540598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:11.545794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:11.552449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:11.553464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:11.554763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:11.558598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:11.655547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Getting quotas for project ab14644376154978b2acd420b095e7ee. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:11:11.678470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Getting quotas for user 5f2d940a1ce2438792865f66a37f09fd and project ab14644376154978b2acd420b095e7ee. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:11:11.730965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:11:11.741992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:11:11.918653 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b01aa417-b95e-4d1b-b6ee-a6ae55c8b5d4 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.766535 Nov 02 14:11:11.922151 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1406/4768] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:11:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:11:11.928573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:11.943536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47e48a65-9bcd-417a-9739-70802d71f9de tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:11.947154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47e48a65-9bcd-417a-9739-70802d71f9de tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:11.948434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d3bb2c3-4fed-49ab-b9c6-54faf9046fe0 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1468 microversion: 2.1 time: 0.541534 Nov 02 14:11:11.951928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3363/4769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:11 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1468 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:11.988477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:11.989532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:12.046324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:12.048141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:12.049929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:12.056189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:12.057501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:12.060301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:12.480096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47e48a65-9bcd-417a-9739-70802d71f9de tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:12.491906 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47e48a65-9bcd-417a-9739-70802d71f9de tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1223 microversion: 2.1 time: 0.557080 Nov 02 14:11:12.492786 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1407/4770] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:11 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1223 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:12.848023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:12.860020 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ec4e5b4-07b6-4b24-9689-edb0f199f9df tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 0.881493 Nov 02 14:11:12.862778 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3364/4771] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:11 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:12.979595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:12.980307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:13.021681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.026595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.030309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.032076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.034561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.036217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.517092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:13.517748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:13.530500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.535303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.535820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.541057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.541057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.541057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.861470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:13.874414 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cbc66012-2ad4-4c4f-aa00-0c77d3629d38 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1227 microversion: 2.1 time: 0.360255 Nov 02 14:11:13.880401 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3365/4772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:13 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1227 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:13.893342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:13.894201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:13.912322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.914073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.914730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.915706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.919293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.922843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.054981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:14.063918 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bba64530-00f7-490f-a1a8-63e68bb32f6a tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1468 microversion: 2.1 time: 1.089784 Nov 02 14:11:14.091127 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1408/4773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:12 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1468 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:14.104823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:14.137748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2235b220-18f4-4459-8532-f29b09ec9dcd req-377535b9-a1c8-49ed-bacc-1981161ea38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f366ab5-db8f-4218-a225-5cb499b0899e", "name": "network-vif-deleted", "tag": "1660ba65-5617-46a1-b752-75017e127845"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:14.177158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2235b220-18f4-4459-8532-f29b09ec9dcd req-377535b9-a1c8-49ed-bacc-1981161ea38b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:14.178298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2235b220-18f4-4459-8532-f29b09ec9dcd req-377535b9-a1c8-49ed-bacc-1981161ea38b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:14.180045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2235b220-18f4-4459-8532-f29b09ec9dcd req-377535b9-a1c8-49ed-bacc-1981161ea38b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.185456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:14.218785 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2235b220-18f4-4459-8532-f29b09ec9dcd req-377535b9-a1c8-49ed-bacc-1981161ea38b service nova] Creating event network-vif-deleted:1660ba65-5617-46a1-b752-75017e127845 for instance 9f366ab5-db8f-4218-a225-5cb499b0899e on n-h2-858238-3 Nov 02 14:11:14.232159 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2235b220-18f4-4459-8532-f29b09ec9dcd req-377535b9-a1c8-49ed-bacc-1981161ea38b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106106 Nov 02 14:11:14.235821 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1409/4774] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 14:11:14.558464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:14.574831 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f12edd73-1c62-4714-979d-0b790bd22103 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 0.692703 Nov 02 14:11:14.592220 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3366/4775] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:13 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:14.819942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-66341755", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "01f9638b-3c63-426e-bd46-baa7f514ceb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:14.903073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:14.903981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:14.919024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:14.920875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:14.923645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.925718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:14.927629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:14.928237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.934293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:11:15.178706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:15.200443 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e83e5977-1f20-436b-a786-0768797788d8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1275 microversion: 2.1 time: 0.294853 Nov 02 14:11:15.201125 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3367/4776] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:14 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:15.223301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:15.225512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:15.264570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.264813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.265108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:15.266214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.266817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.267417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:15.382506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.383168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.383643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:15.384101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lazy-loading 'fault' on Instance uuid 9f366ab5-db8f-4218-a225-5cb499b0899e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:11:15.846429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c27bfa614ba197a4995684c3fefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6537fd684cfa434b84674b58c83b4ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:15.858232 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae916a39-5adb-4a0f-8735-5f6d5e4bf133 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 200 len: 1303 microversion: 2.1 time: 0.652049 Nov 02 14:11:15.861882 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3368/4777] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:15 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 1303 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:15.873250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:15.874082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:15.885827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.886498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.902919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:15.909339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.911712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.912298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:17.294050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:17.299426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:11:17.299870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:11:17.300332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:11:17.300749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:11:17.301165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:11:17.305455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8b676f15-56a8-40b7-afb9-a8fef503cbec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 1.442029 Nov 02 14:11:17.306745 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3369/4778] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:15 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:17.311827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:17.313256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:17.320082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:17.320864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:17.321539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:17.322442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:17.323118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:17.323746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:17.330892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:17.334585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:17.338348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:17.342663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:17.343569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:17.344963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:17.392083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:11:17.406504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:11:17.558372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:11:17.564155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01f9638b-3c63-426e-bd46-baa7f514ceb3',volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:11:17.888398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f4c6ce44-79ed-4f78-9ec7-7b299ffc923d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.073848 Nov 02 14:11:17.891215 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1410/4779] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:11:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:11:17.904206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-12b07e6d-36c2-4d51-acdc-6a7372ef3580 req-6ce5310c-adf8-4fcb-a409-199e97646740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511d5964-e104-402a-969a-be2812c93bdf", "tag": "6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:17.964211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-12b07e6d-36c2-4d51-acdc-6a7372ef3580 req-6ce5310c-adf8-4fcb-a409-199e97646740 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:17.964714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-12b07e6d-36c2-4d51-acdc-6a7372ef3580 req-6ce5310c-adf8-4fcb-a409-199e97646740 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:17.970229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-12b07e6d-36c2-4d51-acdc-6a7372ef3580 req-6ce5310c-adf8-4fcb-a409-199e97646740 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:17.995859 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-12b07e6d-36c2-4d51-acdc-6a7372ef3580 req-6ce5310c-adf8-4fcb-a409-199e97646740 service nova] Creating event network-changed:6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e for instance 511d5964-e104-402a-969a-be2812c93bdf on n-h1-858238-3 Nov 02 14:11:18.004377 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-12b07e6d-36c2-4d51-acdc-6a7372ef3580 req-6ce5310c-adf8-4fcb-a409-199e97646740 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110463 Nov 02 14:11:18.005008 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1411/4780] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:18.027084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:18.027831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] [instance: 9f366ab5-db8f-4218-a225-5cb499b0899e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:18.038279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:18.038958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:18.039708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:18.040570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:18.041157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:18.041727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:18.063838 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] HTTP exception thrown: Instance 9f366ab5-db8f-4218-a225-5cb499b0899e could not be found. Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Request method failure captured: Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e HTTP/1.1 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnmrJY3YOCfaC7HAkaiiGATwMKd1vlOhF7S2bF1CWT1aCK7Ra9EUsPD6EkBmNmT0Q5u26BjbN6IdGnqx3Ewn_-lMkHYi8-BOI_p-tv2L_PU8kn7rbKUkinO3FRAEHFYh9ez6HGzzxFpf_qxCqS71sKvAtBnNeztYC9oFpYiaG2vlQow Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 6537fd684cfa434b84674b58c83b4ad8 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-VolumesBackupsTest-1572726362 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6537fd684cfa434b84674b58c83b4ad8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6537fd684cfa434b84674b58c83b4ad8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6537fd684cfa434b84674b58c83b4ad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6537fd684cfa434b84674b58c83b4ad8"}]}] Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-VolumesBackupsTest-1572726362 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 6537fd684cfa434b84674b58c83b4ad8 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-VolumesBackupsTest-1572726362 Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-VolumesBackupsTest-1572726362-project Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 6728c27bfa614ba197a4995684c3fefb Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-VolumesBackupsTest-1572726362-project Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 9f366ab5-db8f-4218-a225-5cb499b0899e could not be found. Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '9f366ab5-db8f-4218-a225-5cb499b0899e'} Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f366ab5-db8f-4218-a225-5cb499b0899e could not be found. Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f366ab5-db8f-4218-a225-5cb499b0899e could not be found. Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:11:18.066074 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f366ab5-db8f-4218-a225-5cb499b0899e could not be found. Nov 02 14:11:18.071211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:18.085492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] Returning 404 to user: Instance 9f366ab5-db8f-4218-a225-5cb499b0899e could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:11:18.086836 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4fba8150-c381-47cb-a067-9f1d69bdd861 tempest-VolumesBackupsTest-1572726362 tempest-VolumesBackupsTest-1572726362-project] 10.222.0.18 "GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e" status: 404 len: 111 microversion: 2.1 time: 0.080184 Nov 02 14:11:18.090790 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1412/4781] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:18 2022] GET /compute/v2.1/servers/9f366ab5-db8f-4218-a225-5cb499b0899e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:11:18.106607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cb3ad88e-98a3-4378-9d7d-67398ef87c67 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:18.110077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cb3ad88e-98a3-4378-9d7d-67398ef87c67 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:18.477184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb3ad88e-98a3-4378-9d7d-67398ef87c67 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:18.492827 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cb3ad88e-98a3-4378-9d7d-67398ef87c67 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1055 microversion: 2.1 time: 0.400725 Nov 02 14:11:18.495257 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1413/4782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:18 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1055 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:18.509212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:18.510769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:18.522771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:18.584386 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-581e4447-aa15-4d8c-a39c-fd66cadc9e73 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1323 microversion: 2.1 time: 1.276181 Nov 02 14:11:18.591728 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3370/4783] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:17 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1323 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:18.600149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:18.600923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:18.601593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:18.602598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:18.603623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:18.604298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:19.527258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:19.528823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:19.567580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:19.570424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:19.573296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:19.578771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:19.582909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:19.583749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.082454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:20.098686 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-29a054b7-466e-471c-a54f-68c7f7a479c4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1153 microversion: 2.1 time: 0.577201 Nov 02 14:11:20.111605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3371/4784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:19 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1153 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:20.111684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:20.118689 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1bb85892-6093-410b-8b38-799f3614b4e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 1.617322 Nov 02 14:11:20.132141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:20.132758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:20.142862 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1414/4785] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:18 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:20.145484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.145977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.146409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.147138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.158448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.158997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.160511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-04a54468-dadc-41b3-a42d-2d7582c63055 req-d651a1b1-4085-47f8-9338-1892cb662e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:20.199627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-04a54468-dadc-41b3-a42d-2d7582c63055 req-d651a1b1-4085-47f8-9338-1892cb662e07 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.200642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-04a54468-dadc-41b3-a42d-2d7582c63055 req-d651a1b1-4085-47f8-9338-1892cb662e07 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.201198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-04a54468-dadc-41b3-a42d-2d7582c63055 req-d651a1b1-4085-47f8-9338-1892cb662e07 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.268906 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-04a54468-dadc-41b3-a42d-2d7582c63055 req-d651a1b1-4085-47f8-9338-1892cb662e07 service nova] Creating event network-changed:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:11:20.279679 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-04a54468-dadc-41b3-a42d-2d7582c63055 req-d651a1b1-4085-47f8-9338-1892cb662e07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135150 Nov 02 14:11:20.280664 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1415/4786] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:20.612505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:20.614902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:20.654112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.660514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.661708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.662781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.664279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.679893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.787804 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d6a416d-2122-4cd6-991a-4de6d2b5b8bd tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.181095 Nov 02 14:11:20.790085 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1416/4787] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:11:20 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments => generated 371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:20.872061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:20.883639 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6dfa06c0-44f8-4703-a8d4-e9dd5c08b7f8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1323 microversion: 2.1 time: 0.780100 Nov 02 14:11:20.884276 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3372/4788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:20 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1323 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:20.934649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:20.935201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:20.956657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.957174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.957616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:20.958318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:20.959181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:20.959762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.057346 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-37838d04-da18-414a-98c3-630d15fdabab tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/3a3655c2-2589-451d-a0d9-dce5c22fb14a" status: 200 len: 194 microversion: 2.1 time: 0.126840 Nov 02 14:11:21.060671 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1417/4789] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Nov 2 14:11:20 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/3a3655c2-2589-451d-a0d9-dce5c22fb14a => generated 194 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:21.075661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:21.076377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:21.085841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.089181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.089893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.092115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.092743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.094293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.126739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:21.127382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:21.146029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.146431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.151850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.152682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.153150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.158456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.290077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lazy-loading 'services' on Instance uuid 7adf7971-0422-490c-9b8c-8b3de45d3476 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:11:21.429989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:21.446059 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-98f1c426-845d-45fa-b54d-1d745b91c0ee tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1171 microversion: 2.1 time: 0.319950 Nov 02 14:11:21.470180 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1418/4790] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:21 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1171 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:21.492146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:21.538462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:21.545964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a836f165-7525-4214-a721-ba377d672c5c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/3a3655c2-2589-451d-a0d9-dce5c22fb14a" status: 202 len: 0 microversion: 2.1 time: 0.474761 Nov 02 14:11:21.579929 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3373/4791] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:11:21 2022] DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/3a3655c2-2589-451d-a0d9-dce5c22fb14a => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:11:21.586273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.594844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.599356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.600621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.607347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.608852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.912680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:21.914170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:21.928956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.934720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.935474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.936430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:21.937136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:21.938556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:21.955742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:22.531184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:22.542228 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d1fad600-c789-411f-a75e-8cd88009df06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 1.070846 Nov 02 14:11:22.551495 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1419/4792] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:21 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:22.559845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:22.576167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:22.598911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:22.619085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:22.619488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:22.620420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:22.621045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:22.621630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:22.876356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:22.896043 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-625c30eb-312b-4d7c-8e21-a7277176633a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1323 microversion: 2.1 time: 0.987837 Nov 02 14:11:22.909651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3374/4793] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:21 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1323 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:22.916845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:22.926474 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a3b52bc-90b2-493c-a6cf-8f66d16aa388 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1171 microversion: 2.1 time: 0.373790 Nov 02 14:11:22.942513 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1420/4794] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:22 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1171 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:23.129537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-24058085-e328-4259-8fe0-ca6776321a7a req-d1eeba4d-12ea-4389-9b32-b167d89b4851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5964-e104-402a-969a-be2812c93bdf", "name": "network-vif-plugged", "status": "completed", "tag": "6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:23.153132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-24058085-e328-4259-8fe0-ca6776321a7a req-d1eeba4d-12ea-4389-9b32-b167d89b4851 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:23.156932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-24058085-e328-4259-8fe0-ca6776321a7a req-d1eeba4d-12ea-4389-9b32-b167d89b4851 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:23.157522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-24058085-e328-4259-8fe0-ca6776321a7a req-d1eeba4d-12ea-4389-9b32-b167d89b4851 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:23.179756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-24058085-e328-4259-8fe0-ca6776321a7a req-d1eeba4d-12ea-4389-9b32-b167d89b4851 service nova] Creating event network-vif-plugged:6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e for instance 511d5964-e104-402a-969a-be2812c93bdf on n-h1-858238-3 Nov 02 14:11:23.206178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-24058085-e328-4259-8fe0-ca6776321a7a req-d1eeba4d-12ea-4389-9b32-b167d89b4851 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077111 Nov 02 14:11:23.206854 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3375/4795] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:23.572819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:23.573445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:23.588125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:23.591661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:23.592401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:23.593304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:23.595669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:23.599674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:23.937132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:23.938419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:23.966022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:23.966528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:23.971250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:23.972985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:23.973476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:23.976901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:24.629899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:24.650818 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c4625175-3aba-4a91-b670-21bf2baddbe8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 1.082294 Nov 02 14:11:24.656039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:24.657407 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1421/4796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:23 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:24.669175 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64c00726-122a-4045-b13f-b10f0452f786 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1323 microversion: 2.1 time: 0.735068 Nov 02 14:11:24.671292 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3376/4797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:23 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1323 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:24.685947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:24.686585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:24.720598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:24.721009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:24.721515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:24.722161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:24.722621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:24.723055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:25.685982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:25.686609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:25.704537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:25.705242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:25.707021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:25.717122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:25.720141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:25.722962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:26.292150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:26.303870 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea85f094-04ba-4d0e-861b-ae1f8793a326 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1317 microversion: 2.1 time: 0.623166 Nov 02 14:11:26.306568 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3377/4798] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:25 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:26.333457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:26.334307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:26.350873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:26.353201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:26.356930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:26.357844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:26.362935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:26.363422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:26.471603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:26.484085 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7df1e89d-3054-4c61-8724-f45b43985136 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 1.805674 Nov 02 14:11:26.485340 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1422/4799] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:24 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:26.721056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-288f09b4-70d1-4d3e-be69-2d607657f750 req-4d49b236-cab4-4e1e-8ff2-ed604a0af8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "name": "network-vif-plugged", "status": "completed", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:26.764380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-288f09b4-70d1-4d3e-be69-2d607657f750 req-4d49b236-cab4-4e1e-8ff2-ed604a0af8f7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:26.779832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-288f09b4-70d1-4d3e-be69-2d607657f750 req-4d49b236-cab4-4e1e-8ff2-ed604a0af8f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:26.781673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-288f09b4-70d1-4d3e-be69-2d607657f750 req-4d49b236-cab4-4e1e-8ff2-ed604a0af8f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:26.826816 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-288f09b4-70d1-4d3e-be69-2d607657f750 req-4d49b236-cab4-4e1e-8ff2-ed604a0af8f7 service nova] Creating event network-vif-plugged:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:11:26.877118 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-288f09b4-70d1-4d3e-be69-2d607657f750 req-4d49b236-cab4-4e1e-8ff2-ed604a0af8f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160599 Nov 02 14:11:26.881200 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1423/4800] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:27.009397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5ceab122-a934-404a-a6fd-5f2fc45b9f60 req-6722f30b-236d-42f3-a25c-e3e02f9bcf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "809fc4c1-fb17-4ce7-a5dc-8d661d516e72", "tag": "9a644289-65f5-46e3-b89e-f42fc5f3a9c3"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:27.054886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5ceab122-a934-404a-a6fd-5f2fc45b9f60 req-6722f30b-236d-42f3-a25c-e3e02f9bcf69 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:27.063458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5ceab122-a934-404a-a6fd-5f2fc45b9f60 req-6722f30b-236d-42f3-a25c-e3e02f9bcf69 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:27.068411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5ceab122-a934-404a-a6fd-5f2fc45b9f60 req-6722f30b-236d-42f3-a25c-e3e02f9bcf69 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:27.105678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:27.109563 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5ceab122-a934-404a-a6fd-5f2fc45b9f60 req-6722f30b-236d-42f3-a25c-e3e02f9bcf69 service nova] Creating event network-changed:9a644289-65f5-46e3-b89e-f42fc5f3a9c3 for instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 on n-h2-858238-3 Nov 02 14:11:27.114287 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fea1bf1b-83d6-4ca2-bb02-6c53dc0841c3 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1323 microversion: 2.1 time: 0.802695 Nov 02 14:11:27.118960 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3378/4801] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:26 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1323 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:27.134198 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5ceab122-a934-404a-a6fd-5f2fc45b9f60 req-6722f30b-236d-42f3-a25c-e3e02f9bcf69 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139785 Nov 02 14:11:27.135897 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1424/4802] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:11:27.332261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:27.332883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:27.347905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:27.348484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:27.348827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:27.349627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:27.349988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:27.350414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:27.510225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:27.516291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:27.517288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:27.534881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:27.535641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:27.536217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:27.537098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:27.541175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:27.541828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:28.202565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:28.224194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:28.245954 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20041b30-7c54-4ec0-b32e-7aa6806c6835 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.737700 Nov 02 14:11:28.246899 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1425/4803] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:27 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:28.252171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:28.252806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:28.270465 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42d076dc-0925-450d-a353-9a23b9f09c65 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.942602 Nov 02 14:11:28.277082 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3379/4804] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:27 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:28.282514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:28.283305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:28.287549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:28.288508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:28.289138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:28.289761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:28.298915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:28.482137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=18 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:28.516915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-278708613", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:28.639283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] validate_networks() for [('8a7da38e-e895-4f80-8321-8e988c87645c', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:11:28.852490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:28.866134 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a34dda0-4518-49ad-920c-d22ce510e364 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1323 microversion: 2.1 time: 0.617770 Nov 02 14:11:28.875273 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1426/4805] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:28 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:29.272741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:29.273484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:29.281764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:29.284407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:29.286528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:29.288502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:29.291261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:29.292082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:29.997185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:30.010667 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-749f6fdc-9e38-4b57-a5fd-9cfc42332133 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.742027 Nov 02 14:11:30.019510 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1427/4806] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:29 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:30.035351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:30.036205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:30.043502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.049626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.050287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.051216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.053512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.055305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.102850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:11:30.103812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:11:30.104430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:11:30.105013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:11:30.105568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:11:30.124542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.125675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.126235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.127025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.127525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.127955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.197208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Getting quotas for project 7aa447cf682848278bbc77e70d04013c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:11:30.210593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Getting quotas for user b80d7d9f70e5433f9d76d5fca703f49e and project 7aa447cf682848278bbc77e70d04013c. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:11:30.249258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:11:30.252274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:11:30.429196 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3daf7c04-1a19-4e03-ad1b-a9b5dbefdbbb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917108 Nov 02 14:11:30.429864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3380/4807] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:11:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:11:30.444119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c84a0a5a-7d64-4405-845f-43f616edd334 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:30.444726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c84a0a5a-7d64-4405-845f-43f616edd334 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:30.571391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:30.580608 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ecde5f14-fe34-4025-a427-b22a5e319014 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1519 microversion: 2.1 time: 0.559834 Nov 02 14:11:30.584595 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1428/4808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:30 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:30.606499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:30.609802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:30.636623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.637138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.637588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.642683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.642991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.643481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.650942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c84a0a5a-7d64-4405-845f-43f616edd334 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:30.658939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c84a0a5a-7d64-4405-845f-43f616edd334 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1216 microversion: 2.1 time: 0.218585 Nov 02 14:11:30.659570 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3381/4809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:30 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:30.700859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lazy-loading 'flavor' on Instance uuid 5f4b7e59-253b-472b-b069-34ca385bd346 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:11:30.881993 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b7db997d-5c85-4221-8263-896b6f49b504 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action" status: 200 len: 32 microversion: 2.1 time: 0.279490 Nov 02 14:11:30.882739 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1429/4810] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:11:30 2022] POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:11:30.894383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:30.895275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:30.910652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.915330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.915935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:30.917631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:30.919360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:30.920743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:31.046442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:31.047756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:31.059989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:31.060488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:31.064384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:31.070861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:31.072630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:31.076657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:31.660116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:31.696068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d55196f-704f-4d73-9d3d-cf5c623df058 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.807431 Nov 02 14:11:31.698323 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3382/4811] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:30 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:31.719228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:31.721006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:31.734158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:31.747832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:31.748453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:31.749323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:31.750513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:31.751089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:31.874855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:31.888082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dcb24c30-01fc-4979-b701-281801d2ba4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.846076 Nov 02 14:11:31.888948 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1430/4812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:31 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:31.959665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:31.980869 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c20226e-0fd1-476d-89d1-41674a19236a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1212 microversion: 2.1 time: 0.281039 Nov 02 14:11:31.982163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3383/4813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:31 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1212 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:32.727051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:32.728765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:32.751588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:32.752219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:32.773668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:32.779827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:32.782879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:32.783409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:32.792094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:32.792865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:32.802434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:32.809967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:32.812033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:32.817466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:32.819428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:32.822846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:32.823610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:33.024315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-494d6aa0-f0c2-4937-a62c-8f173a342ecf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/619eb83d-7219-44ba-83a7-974cd76a2c97" status: 200 len: 194 microversion: 2.1 time: 0.249319 Nov 02 14:11:33.025396 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3384/4814] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Nov 2 14:11:32 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/619eb83d-7219-44ba-83a7-974cd76a2c97 => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:33.037882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:33.038825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:33.047063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:33.047740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:33.048340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:33.049287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:33.050194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:33.050761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:33.512247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:33.529650 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e7b8efe-0acc-4bf1-a7ec-c1d503836072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.496593 Nov 02 14:11:33.530455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3385/4815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:33 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:33.550304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:33.550957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:33.589938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:33.590832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:33.592723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:33.598300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:33.602685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:33.603562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:33.655043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:33.664215 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d8d78a8-04e7-440b-80c1-0e44ad6b2efa tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.942147 Nov 02 14:11:33.673560 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1431/4816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:32 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:33.685445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:33.685962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:33.713616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:33.719218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:33.719722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:33.722816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:33.723602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:33.729071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:33.732359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:34.179764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lazy-loading 'services' on Instance uuid 7adf7971-0422-490c-9b8c-8b3de45d3476 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:11:34.297176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:34.308288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77e72afd-065b-4461-80a5-ef69caa038db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1274 microversion: 2.1 time: 0.759961 Nov 02 14:11:34.308971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3386/4817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:33 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1274 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:34.371556 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f302ec6-6669-457a-9f7f-d03ebe45fe19 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/619eb83d-7219-44ba-83a7-974cd76a2c97" status: 202 len: 0 microversion: 2.1 time: 0.696615 Nov 02 14:11:34.375267 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1432/4818] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:11:33 2022] DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments/619eb83d-7219-44ba-83a7-974cd76a2c97 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:11:34.556569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:34.558856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:34.577435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:34.580298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:34.582276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:34.586041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:34.586769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:34.587367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:34.692906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:34.693847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:34.712381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:34.712875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:34.713311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:34.714014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:34.714466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:34.729833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:35.429541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:35.441911 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-628fc3b8-e47b-4038-bc2e-249d18f40327 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.756930 Nov 02 14:11:35.442503 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1433/4819] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:34 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:35.473407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:35.476525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:35.489021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:35.501432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:35.506445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:35.507046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:35.508043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:35.508637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:35.509508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:35.511707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c18867a-c700-48f5-8140-c11b6c71507c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.962544 Nov 02 14:11:35.514844 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3387/4820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:34 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:36.057624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:36.082195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fd56c533-ef5f-445c-9633-b7cd9bb0a5e7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.637155 Nov 02 14:11:36.087757 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1434/4821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:35 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:36.470115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:36.470807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:36.486662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:36.489087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:36.489667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:36.492586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:36.493075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:36.498866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:36.538559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:36.539386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:36.569429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:36.570935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:36.571812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:36.574226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:36.574698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:36.575155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:37.449953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:37.472429 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb9abb69-4987-4fff-a33f-2f44d3f86772 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.933577 Nov 02 14:11:37.475472 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1435/4822] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:36 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:37.476526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:37.488450 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34c5dcc4-00cb-408d-a4d3-aee3b2590471 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 1.023300 Nov 02 14:11:37.490982 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3388/4823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:36 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:37.510835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:37.511489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:37.528450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:37.528947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:37.535885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:37.536655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:37.537132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:37.537577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:37.970264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:37.983527 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a8f71e21-f7b6-4274-9bb9-75a24034daaf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.500559 Nov 02 14:11:37.984128 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1436/4824] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:37 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:38.077968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ad68f267-2cf7-4c4f-b2f4-1154ba791964 req-ff126671-406b-4ded-b954-05deb347463c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6", "tag": "11666c8d-60e1-4e46-a9ef-04a8f4a2952b"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:38.107157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ad68f267-2cf7-4c4f-b2f4-1154ba791964 req-ff126671-406b-4ded-b954-05deb347463c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.111937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ad68f267-2cf7-4c4f-b2f4-1154ba791964 req-ff126671-406b-4ded-b954-05deb347463c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.113702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ad68f267-2cf7-4c4f-b2f4-1154ba791964 req-ff126671-406b-4ded-b954-05deb347463c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:38.195329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ad68f267-2cf7-4c4f-b2f4-1154ba791964 req-ff126671-406b-4ded-b954-05deb347463c service nova] Creating event network-changed:11666c8d-60e1-4e46-a9ef-04a8f4a2952b for instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 on n-h1-858238-3 Nov 02 14:11:38.223392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ad68f267-2cf7-4c4f-b2f4-1154ba791964 req-ff126671-406b-4ded-b954-05deb347463c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150572 Nov 02 14:11:38.224573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3389/4825] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:38.502219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:38.503012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:38.517997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:38.518808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.519350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.519787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:38.520462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:38.533935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.534452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.537735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.542474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:38.542745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.543399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:38.548424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:38.549071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:38.549608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:39.591697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:39.607036 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-24193e46-ffb9-4bd9-a583-48daa40c15f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 1.105138 Nov 02 14:11:39.608871 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1437/4826] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:38 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:39.627977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:39.630755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:39.649435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:39.649963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:39.650409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:39.651160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:39.659673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:39.660613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:39.782363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:39.812941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79b64186-d7bb-40a3-ba44-0d68d3ab3439 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 1.298349 Nov 02 14:11:39.833364 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3390/4827] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:38 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:40.010859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:40.019998 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d867883-0dd6-4d30-b8e2-03209997e66c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.401077 Nov 02 14:11:40.035445 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1438/4828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:39 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:40.637071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:40.638199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:40.643031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:40.663690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:40.671571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:40.677664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:40.679627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:40.680846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:40.683878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:40.683878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:40.845888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:40.871059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:40.935067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:40.936082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:40.938364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:40.941287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:40.942914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:40.944056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:41.468128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:41.499664 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34879c98-e10a-42a1-8416-f1b372fdccb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.863164 Nov 02 14:11:41.500899 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3391/4829] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:40 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:41.519960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:41.523840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:41.546560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:41.550024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:41.550649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:41.553664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:41.554300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:41.558015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:42.050430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:42.070082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe940a0c-20a7-4900-a50b-64478dcf33ce tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 1.232946 Nov 02 14:11:42.085966 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1439/4830] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:40 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:42.458663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:42.472930 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13d7aedb-00fa-4b95-b75f-792301cd22b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.961950 Nov 02 14:11:42.474579 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3392/4831] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:41 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:42.538658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:42.539327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:42.566903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:42.568765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:42.572239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:42.576438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:42.578818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:42.580354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:42.690225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:43.095425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:43.095999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:43.110820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:43.111345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:43.111768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:43.112864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:43.113037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:43.113346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:43.834461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:43.847900 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b65cc01f-819d-43bd-9f2b-123665a142d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 1.315177 Nov 02 14:11:43.849238 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1440/4832] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:42 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:43.870711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:43.871630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:43.880683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:43.885266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:43.885958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:43.886859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:43.896131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:43.897042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:43.956845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:43.968308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:43.973554 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce0f58b9-250b-4519-9d6c-279c2f257717 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.882931 Nov 02 14:11:43.980214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3393/4833] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:43 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:44.460999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:44.471837 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-807757db-51e8-47a0-ae94-e2e35ec6b301 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.621394 Nov 02 14:11:44.480975 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1441/4834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:43 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:44.892012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:44.892677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:44.909746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:44.914977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:44.915687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:44.917284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:44.918102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:44.920874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:45.003030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:45.004272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:45.020660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:45.021760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:45.023317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:45.026145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:45.026823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:45.029158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:45.642995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:45.653276 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-63294020-e5a3-40ee-bc7e-ee96abc1f3b7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.654154 Nov 02 14:11:45.661003 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1442/4835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:44 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:45.666143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:45.666958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:45.683552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:45.688767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:45.689409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:45.691032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:45.692450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:45.692889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:45.867589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:45.879426 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d4e8120-981c-4766-b883-01e6bb2f82c9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 1.009895 Nov 02 14:11:45.880054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3394/4836] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:44 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:45.992490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:46.007828 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ecbdef32-d6f4-42b4-97ba-abb8f6087351 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.344272 Nov 02 14:11:46.011698 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1443/4837] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:45 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:46.686579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:46.687166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:46.698976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:46.702312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:46.703352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:46.704457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:46.707718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:46.708507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:46.907948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:46.909146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:46.924470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:46.927594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:46.928251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:46.929212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:46.931465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:46.932268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:47.419467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:47.441748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cf3cfc81-77c2-4c81-a085-3e16b501690f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.754336 Nov 02 14:11:47.444361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3395/4838] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:46 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:47.457077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:47.458013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:47.486125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:47.493360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:47.494765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:47.496403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:47.497744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:47.499055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:47.803872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:47.824770 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ad783c54-3ddc-44a9-90d4-e6ce56a4ea77 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.916862 Nov 02 14:11:47.835141 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1444/4839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:46 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:47.844155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f6e12d39-abf4-45cb-95ce-e4072c09a633 req-a463eaac-8f22-489d-8f61-2930f5f0568f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6", "name": "network-vif-plugged", "status": "completed", "tag": "11666c8d-60e1-4e46-a9ef-04a8f4a2952b"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:47.919581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:47.939149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f6e12d39-abf4-45cb-95ce-e4072c09a633 req-a463eaac-8f22-489d-8f61-2930f5f0568f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:47.942160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f6e12d39-abf4-45cb-95ce-e4072c09a633 req-a463eaac-8f22-489d-8f61-2930f5f0568f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:47.942160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f6e12d39-abf4-45cb-95ce-e4072c09a633 req-a463eaac-8f22-489d-8f61-2930f5f0568f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:47.942485 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-859ded2d-acd3-470e-b0c3-9fc1f3ecde47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.487499 Nov 02 14:11:47.942485 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3396/4840] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:47 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:48.020164 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f6e12d39-abf4-45cb-95ce-e4072c09a633 req-a463eaac-8f22-489d-8f61-2930f5f0568f service nova] Creating event network-vif-plugged:11666c8d-60e1-4e46-a9ef-04a8f4a2952b for instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 on n-h1-858238-3 Nov 02 14:11:48.041268 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f6e12d39-abf4-45cb-95ce-e4072c09a633 req-a463eaac-8f22-489d-8f61-2930f5f0568f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207826 Nov 02 14:11:48.042130 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1445/4841] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:48.471395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:48.472237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:48.481096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:48.481755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:48.482350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:48.483354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:48.484089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:48.484705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:48.694238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:48.713161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:48.733050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:48.734695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:48.735301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:48.743532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:48.744914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:48.745591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:48.878557 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-607daf57-e684-4bdf-afec-1b1fda96b653 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.189486 Nov 02 14:11:48.884261 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1446/4842] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:11:48 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments => generated 25 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:11:48.923469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:48.924526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:48.963276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:48.968336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:48.969897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:48.974984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:48.977062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:48.980785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:49.601095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:49.619867 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3809ef3c-7f24-4793-9603-61aabff89fc7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 1.151314 Nov 02 14:11:49.638367 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3397/4843] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:48 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:49.648466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:49.650018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:49.659955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:49.660671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:49.661276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:49.662206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:49.663374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:49.663992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:49.939430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:49.965689 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d0078e4-dc34-43b6-8f4c-a1c28b6487f8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 1.067450 Nov 02 14:11:49.990454 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1447/4844] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:48 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:49.997356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:50.008561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:50.035036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.036231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.038423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.041764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.047750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.048561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.120170 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d04d0af5-ebb0-46de-bf84-81a0ecd5fadf tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127397 Nov 02 14:11:50.124977 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1448/4845] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:11:49 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:11:50.269719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:50.270228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:50.283452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.283949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.284389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.285106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.285555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.300236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.323890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:50.339724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7c4777f-0904-44b0-82f9-7e232cbec804 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1316 microversion: 2.1 time: 0.700109 Nov 02 14:11:50.343506 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3398/4846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:49 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:50.447537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:11:50.645867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:50.647518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:50.666710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.671003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.673867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.675864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.677771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.679652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.707000 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f309a620-c348-4a64-bae1-3b6a1fe9c99e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 204 len: 0 microversion: 2.1 time: 0.441543 Nov 02 14:11:50.708673 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1449/4847] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:11:50 2022] DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:11:50.728141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:50.732075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:50.758051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.763430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.764227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:50.765434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:50.770722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:50.771564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:51.250635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:51.268505 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-abbaf214-4e08-4616-8aae-9cd5f4fe9e73 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1676 microversion: 2.1 time: 0.546847 Nov 02 14:11:51.269123 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1450/4848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:50 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1676 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:51.289985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:51.290620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:51.314937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:51.322591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:51.325128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:51.329370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:51.331570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:51.333089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:51.337510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:51.337897 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ab8b455-9986-424e-baae-a7c7a64adf4e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.696064 Nov 02 14:11:51.338533 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3399/4849] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:50 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:51.366907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:51.367433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:51.389198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:51.395166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:51.395727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:51.399713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:51.400468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:51.401131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:51.826983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:51.841532 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-511cd657-1a87-4009-b346-c4cdeeb245c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.564712 Nov 02 14:11:51.842700 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1451/4850] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:51 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:51.893478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:51.902761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5027d8f-8689-4d23-82c3-349eae7e9a2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1505 microversion: 2.1 time: 0.540007 Nov 02 14:11:51.914637 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3400/4851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:51 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:51.941219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:51.941662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:51.950354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:51.951129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:51.951573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:51.952288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:51.952745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:51.953745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:52.033002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:11:52.222749 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-323ba6ad-5c08-496a-adca-cd6b03f11b79 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 204 len: 0 microversion: 2.1 time: 0.284054 Nov 02 14:11:52.231068 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1452/4852] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:11:51 2022] DELETE /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:11:52.233508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:52.234127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:52.251582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:52.252074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:52.252509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:52.253217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:52.253687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:52.254088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:52.298224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:52.298950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:52.310509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:52.311053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:52.311532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:52.312283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:52.312810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:52.313749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:52.939504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:52.954599 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6dc56e97-1757-4156-b7a1-f4d09576dc6c tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1676 microversion: 2.1 time: 0.661870 Nov 02 14:11:52.957747 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1453/4853] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:52 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1676 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:52.965638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:52.967262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:52.981033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:52.990813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2091e56-bec8-4529-a8f7-cc6a95277682 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1511 microversion: 2.1 time: 0.761082 Nov 02 14:11:52.999482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3401/4854] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:52 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1511 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:53.011441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:53.014418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:53.016333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:53.017106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:53.020877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:53.022518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:53.031884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:53.041239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:53.055482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:53.055898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:53.056341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:53.057079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:53.057539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:53.057953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:53.097260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:53.523877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:53.538866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffd4cb47-eef5-4e77-ad3a-d7ca4126e38d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1213 microversion: 2.1 time: 0.516623 Nov 02 14:11:53.545122 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3402/4855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:53 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1213 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:53.599590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:53.613602 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-89f2bd77-d693-4ed1-b8d6-90c3e2f8c24b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.653793 Nov 02 14:11:53.630481 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1454/4856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:52 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:53.985075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:53.986456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:54.000766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:54.001524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:54.003659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:54.004601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:54.005359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:54.005938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:54.026718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:54.027665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:54.045083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:54.047408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:54.047408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:54.073875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:54.074496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:54.087638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:55.221583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:55.241745 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-925d1dac-25b0-4dc5-a91e-6766ac6abb11 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1676 microversion: 2.1 time: 1.259525 Nov 02 14:11:55.243017 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3403/4857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:53 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1676 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:55.294413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:55.296964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:55.318378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:55.320540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:55.321835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:55.322839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:55.327760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:55.331736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:55.341898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:55.360805 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-49cf3c10-4585-46a3-a3bb-54532f0205d7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1511 microversion: 2.1 time: 1.338726 Nov 02 14:11:55.361419 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1455/4858] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:54 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1511 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:55.400641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:55.407395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:55.437244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:55.439364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:55.439972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:55.442297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:55.444066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:55.445924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.340198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:56.348874 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-89a32c9d-322f-4157-9407-ed4632c5aa2f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.983838 Nov 02 14:11:56.356514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:56.361821 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1456/4859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:55 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:56.370652 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-570b7b37-a3b8-4fe5-9528-2606b4d0c77b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 1.114525 Nov 02 14:11:56.372495 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3404/4860] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:55 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:56.380256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:56.381830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9afba725-5d99-4d61-a64b-3dc5658acb0e req-a1504bbd-c26a-4128-844a-ee6e9ee350b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6", "name": "network-vif-deleted", "tag": "11666c8d-60e1-4e46-a9ef-04a8f4a2952b"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:56.391964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:56.414206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9afba725-5d99-4d61-a64b-3dc5658acb0e req-a1504bbd-c26a-4128-844a-ee6e9ee350b6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:56.416272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:56.416988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:56.417617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.427457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:56.428301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9afba725-5d99-4d61-a64b-3dc5658acb0e req-a1504bbd-c26a-4128-844a-ee6e9ee350b6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:56.428905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9afba725-5d99-4d61-a64b-3dc5658acb0e req-a1504bbd-c26a-4128-844a-ee6e9ee350b6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.429573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:56.434543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.470793 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9afba725-5d99-4d61-a64b-3dc5658acb0e req-a1504bbd-c26a-4128-844a-ee6e9ee350b6 service nova] Creating event network-vif-deleted:11666c8d-60e1-4e46-a9ef-04a8f4a2952b for instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 on n-h1-858238-3 Nov 02 14:11:56.497425 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9afba725-5d99-4d61-a64b-3dc5658acb0e req-a1504bbd-c26a-4128-844a-ee6e9ee350b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118130 Nov 02 14:11:56.499857 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1457/4861] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:56.513504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:56.517763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:56.539374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:56.541102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:56.542486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.545404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:56.548042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:56.551200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.634818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:56.639957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:56.643088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:56.644463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lazy-loading 'fault' on Instance uuid fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:11:56.836994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:56.845638 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0a232c90-daea-44dc-ba1c-409b5963b7f4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 200 len: 1306 microversion: 2.1 time: 0.344342 Nov 02 14:11:56.849451 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1458/4862] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:56 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 1306 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:57.131438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:57.160659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-928fe695-768c-4f5c-b2f8-f2d69f0fdde5 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1676 microversion: 2.1 time: 0.782872 Nov 02 14:11:57.165473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3405/4863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:56 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1676 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:57.389058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:57.390488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:57.398667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:57.399159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.399338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:57.399491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.400204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.417262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.418527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.419935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.440453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.441283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.442266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:57.444544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:57.445720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:57.447118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.228547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:58.235912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:58.240776 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f2eea84-e48a-4ea0-9ec9-891560fecac8 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.857526 Nov 02 14:11:58.244142 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7d3ab6d-7af3-458e-a216-10c04c0a4c20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 0.850115 Nov 02 14:11:58.244793 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1459/4864] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:57 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:58.258535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:58.259401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:58.269975 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3406/4865] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:57 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:58.285276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.286082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.287892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.288522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.297897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.299606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:58.300297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:58.304346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.333113 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:11:58.337933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.339632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.340565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.341330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 HTTP/1.1 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6'} Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:11:58.342080 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:11:58.348526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:11:58.349345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.349345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.351518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:11:58.352797 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0bea31c2-c4d2-462f-bcea-624f4408c879 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 404 len: 111 microversion: 2.1 time: 0.106426 Nov 02 14:11:58.356715 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1460/4866] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:58 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:11:58.364126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:58.366645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:58.380853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.382130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.383602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.384717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.386644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.388199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.517692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01f842614b24924bcc2196332cb5f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4109b13b99644609bedb98d8e28c8e59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:58.529544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84a9167f-8ca1-4c3f-930f-71b775ac42a3 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 200 len: 1608 microversion: 2.1 time: 0.258375 Nov 02 14:11:58.530143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3407/4867] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:58 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 1608 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:58.569282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-478e1506-c05f-40da-87dd-a747a829da1c req-455c0669-119e-4f00-87ee-6162f6452d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adf7971-0422-490c-9b8c-8b3de45d3476", "name": "network-vif-deleted", "tag": "7387b1d0-b33a-4d41-9675-e8ec12d435fc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:58.605419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-478e1506-c05f-40da-87dd-a747a829da1c req-455c0669-119e-4f00-87ee-6162f6452d2f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:58.607444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-478e1506-c05f-40da-87dd-a747a829da1c req-455c0669-119e-4f00-87ee-6162f6452d2f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:58.608046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-478e1506-c05f-40da-87dd-a747a829da1c req-455c0669-119e-4f00-87ee-6162f6452d2f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:58.642166 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-478e1506-c05f-40da-87dd-a747a829da1c req-455c0669-119e-4f00-87ee-6162f6452d2f service nova] Creating event network-vif-deleted:7387b1d0-b33a-4d41-9675-e8ec12d435fc for instance 7adf7971-0422-490c-9b8c-8b3de45d3476 on n-h1-858238-3 Nov 02 14:11:58.654675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-478e1506-c05f-40da-87dd-a747a829da1c req-455c0669-119e-4f00-87ee-6162f6452d2f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120639 Nov 02 14:11:58.657087 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3408/4868] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:11:59.051076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:59.069608 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-397eb589-d750-4134-857c-f60417cfdb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.705236 Nov 02 14:11:59.083616 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1461/4869] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:58 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:59.296347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:59.298067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:59.298976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:59.300207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:59.317120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.317620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.325295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:59.326331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.326817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.327285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:59.330550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.333607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.336114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:59.338283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:59.339671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:59.341346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.123056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:00.134709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3f81361-3f60-4a55-be90-38883f7964e3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 0.844591 Nov 02 14:12:00.137226 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3409/4870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:59 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:00.149960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3129ec64-14eb-41f1-b91e-f7a837e22cdc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3129ec64-14eb-41f1-b91e-f7a837e22cdc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 163 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": 12345, "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 12345 Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:00.162768 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 14:12:00.167565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.169830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3129ec64-14eb-41f1-b91e-f7a837e22cdc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:00.172419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3129ec64-14eb-41f1-b91e-f7a837e22cdc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.032542 Nov 02 14:12:00.177374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3410/4871] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:00 2022] POST /compute/v2.1/servers => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:00.202534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:00.204942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:00.225521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.227518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.228200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.230147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.230867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.232272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.279888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] HTTP exception thrown: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Request method failure captured: Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 HTTP/1.1 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjt4ETorHLEp11Vn1aGw_WKk2uI39g5H32kSJ7dpp6YusDXsVcR1OvoWRbuo3CNlTktqi2Pt7DNOXg0w8U1W9oQBIRV1IyzGVnhoz_X_FGRLWwixdRe5Na5syNoW-6bwtDgWD52hjxAAuy21v3KGeZ2NhcKbI6BcbpbqKIHh0T7WXM Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4109b13b99644609bedb98d8e28c8e59"}]}] Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a01f842614b24924bcc2196332cb5f35 Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7adf7971-0422-490c-9b8c-8b3de45d3476'} Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:00.287872 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:00.291340 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:00.294581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Returning 404 to user: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:00.295005 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-63d8e6b3-0df8-423b-82e8-d0108478be1e tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 404 len: 111 microversion: 2.1 time: 0.118284 Nov 02 14:12:00.305115 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3411/4872] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:00 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:00.321175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:00.321846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:00.346801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:00.361270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4de812d2-faaf-4ea4-9342-9c713ec2f1e7 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 1.069060 Nov 02 14:12:00.364475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.372358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.373940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.374932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.375953 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1462/4873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:11:59 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:00.379677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.380280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.385862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-93a6ba6d-3f75-48c7-bb8c-fe7d29cab3ca tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '.version_select at 0x7f6f81a279d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:00.401102 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93a6ba6d-3f75-48c7-bb8c-fe7d29cab3ca tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [85e59eba-f43c-438c-8a7c-155b0cbe1aa4] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:12:00.679981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:00.691186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:00.700675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-663caf0a-9066-4ee5-a1be-dd351ea9e833 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.393939 Nov 02 14:12:00.717048 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3412/4874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:00 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:00.737894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:00.740252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:00.755265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.757907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.759460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:00.762074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:00.763168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:00.764348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:01.183688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:01.200395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cb68bb5-3326-47ed-8c6f-5a377a93ddad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.467840 Nov 02 14:12:01.203838 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3413/4875] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:00 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:01.246827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:01.248489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:01.262376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:01.262871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:01.263330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:01.264041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:01.264492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:01.264912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:01.414762 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [None req-93a6ba6d-3f75-48c7-bb8c-fe7d29cab3ca tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [85e59eba-f43c-438c-8a7c-155b0cbe1aa4] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52124. Nov 02 14:12:01.464098 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-93a6ba6d-3f75-48c7-bb8c-fe7d29cab3ca tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040081070" status: 202 len: 0 microversion: 2.1 time: 1.086520 Nov 02 14:12:01.464970 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1463/4876] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040081070 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:12:01.485297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:01.487339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:01.506563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:01.508358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:01.509135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:01.510231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:01.510908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:01.511622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:02.007648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:02.021466 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8c4f67da-b1ec-4a62-82a8-ba57011bc58b tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1525 microversion: 2.1 time: 0.555002 Nov 02 14:12:02.026974 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1464/4877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:01 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1525 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:02.092879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:02.104891 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0dface50-661c-43f9-bec9-9528be78fb21 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 0.880290 Nov 02 14:12:02.106798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3414/4878] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:01 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:03.051276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:03.052540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:03.073888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:03.077930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:03.084056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:03.085073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:03.086643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:03.087517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:03.139512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:03.141019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:03.161808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=60 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:03.168235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:03.168734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:03.169172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:03.171598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:03.171598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:03.171598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:03.744128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:03.753344 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75d0a4b9-6de5-40d4-a06c-8e2162d74f47 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1505 microversion: 2.1 time: 0.707187 Nov 02 14:12:03.757948 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1465/4879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:03 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:03.818048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-566713ee-aecc-40ac-bee6-e98520fd76f2 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'create', calling method: .version_select at 0x7f6f823870d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1073483099", "description": "tempest-description-665191378"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:03.860407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:03.874130 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e8546f9-174b-4d03-8f4c-132aa3a0fc6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 0.740852 Nov 02 14:12:03.876685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3415/4880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:03 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:04.200861 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-566713ee-aecc-40ac-bee6-e98520fd76f2 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.394835 Nov 02 14:12:04.202663 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1466/4881] 10.222.0.18 () {60 vars in 1180 bytes} [Wed Nov 2 14:12:03 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:04.217426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1073483099"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:04.217961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:04.240352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:04.243229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:04.243986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:04.246513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:04.247032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:04.253882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:04.602822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Adding security group 1de5bbc0-24db-4bf6-a38b-28d2f9531bc6 to port 1447a14c-565b-4802-87a0-140c7ea55348 Nov 02 14:12:04.814540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7938d3b6-1a1d-4f25-a15e-6cd6b0554258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-229490686", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:04.830234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:04.965196 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-7938d3b6-1a1d-4f25-a15e-6cd6b0554258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Block Device fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d is not bootable. Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7938d3b6-1a1d-4f25-a15e-6cd6b0554258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 357 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-229490686", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: exception: Block Device fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d is not bootable. Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-229490686', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d'}], 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d is not bootable. Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:04.977068 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d is not bootable. Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d is not bootable. Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7938d3b6-1a1d-4f25-a15e-6cd6b0554258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Block Device fb77e9a8-1e26-49d3-a6ca-d76caeeaca4d is not bootable. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:04.981185 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7938d3b6-1a1d-4f25-a15e-6cd6b0554258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.169068 Nov 02 14:12:04.983222 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1467/4882] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:04.987784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:04.988400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:05.001908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.002714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.003392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.004311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.004909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.005538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.606889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:05.650118 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c2fc084-73e7-46d9-bc37-728a89cf7529 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 0.666241 Nov 02 14:12:05.652856 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1468/4883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:04 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:05.662012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:05.664158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:05.685937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.686733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.688150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.689122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.692382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.693692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.728466 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66c0c5ff-efe7-49c3-81ef-c5460ec38b1d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action" status: 202 len: 0 microversion: 2.1 time: 1.515949 Nov 02 14:12:05.735174 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3416/4884] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:04 2022] POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action => generated 0 bytes in 1523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:12:05.751580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d663a6f0-bdc8-41b7-86ab-081ed9924ff7 req-e8f3b740-c360-4061-8c6b-3bd34cdc82e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809fc4c1-fb17-4ce7-a5dc-8d661d516e72", "name": "network-vif-plugged", "status": "completed", "tag": "9a644289-65f5-46e3-b89e-f42fc5f3a9c3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:05.766758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d663a6f0-bdc8-41b7-86ab-081ed9924ff7 req-e8f3b740-c360-4061-8c6b-3bd34cdc82e8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.767620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d663a6f0-bdc8-41b7-86ab-081ed9924ff7 req-e8f3b740-c360-4061-8c6b-3bd34cdc82e8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.768258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d663a6f0-bdc8-41b7-86ab-081ed9924ff7 req-e8f3b740-c360-4061-8c6b-3bd34cdc82e8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.785960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d663a6f0-bdc8-41b7-86ab-081ed9924ff7 req-e8f3b740-c360-4061-8c6b-3bd34cdc82e8 service nova] Creating event network-vif-plugged:9a644289-65f5-46e3-b89e-f42fc5f3a9c3 for instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 on n-h2-858238-3 Nov 02 14:12:05.797467 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d663a6f0-bdc8-41b7-86ab-081ed9924ff7 req-e8f3b740-c360-4061-8c6b-3bd34cdc82e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059447 Nov 02 14:12:05.798411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3417/4885] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:05.805022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1073483099"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:05.806348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:05.835577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.837561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.838541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:05.839927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:05.840748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:05.841676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:06.218080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:06.230186 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2de8c8a5-4182-44d5-ace6-de2786dcc884 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.575848 Nov 02 14:12:06.235958 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1469/4886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:05 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:06.249237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4a2b8cbb-19fc-45e7-876b-5c4927860ef6 req-d6120a2b-791a-4720-a788-4f2a9c2de5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:06.273648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4a2b8cbb-19fc-45e7-876b-5c4927860ef6 req-d6120a2b-791a-4720-a788-4f2a9c2de5d8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:06.276189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4a2b8cbb-19fc-45e7-876b-5c4927860ef6 req-d6120a2b-791a-4720-a788-4f2a9c2de5d8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:06.277246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4a2b8cbb-19fc-45e7-876b-5c4927860ef6 req-d6120a2b-791a-4720-a788-4f2a9c2de5d8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:06.293388 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4a2b8cbb-19fc-45e7-876b-5c4927860ef6 req-d6120a2b-791a-4720-a788-4f2a9c2de5d8 service nova] Creating event network-changed:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:12:06.314737 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4a2b8cbb-19fc-45e7-876b-5c4927860ef6 req-d6120a2b-791a-4720-a788-4f2a9c2de5d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076739 Nov 02 14:12:06.319390 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1470/4887] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:06.333717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:06.334779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:06.351804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:06.353671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:06.354326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:06.356661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:06.357348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:06.361128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:06.397003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Removing security group 1de5bbc0-24db-4bf6-a38b-28d2f9531bc6 from port 1447a14c-565b-4802-87a0-140c7ea55348 Nov 02 14:12:07.122438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:07.143284 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-133b0947-7709-4fbe-b803-ceef0df592a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.811262 Nov 02 14:12:07.144688 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1471/4888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:06 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:07.150374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:07.160879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:07.189914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:07.193734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:07.194414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:07.195636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:07.199858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:07.200590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:08.211290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:08.224856 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b56d2b98-6af7-4c91-a1fc-e8b50b76a8bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1201 microversion: 2.1 time: 1.078187 Nov 02 14:12:08.225477 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1472/4889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:07 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1201 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:08.533743 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ee56405-2aa5-4c75-8cf8-8afa5430ab2d tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action" status: 202 len: 0 microversion: 2.1 time: 2.733504 Nov 02 14:12:08.539190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3418/4890] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:05 2022] POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action => generated 0 bytes in 2735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:12:08.555359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f00fa4a-28fb-46da-bbdf-de480ad25d6f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'create', calling method: .version_select at 0x7f6f817fe1f0>, body: {"pool": null} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:08.602267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-554e762a-545d-4ef1-bce8-abaa9e86d7a7 req-41538365-c1eb-43f2-bac4-ad8cb8dc1a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:08.639693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-554e762a-545d-4ef1-bce8-abaa9e86d7a7 req-41538365-c1eb-43f2-bac4-ad8cb8dc1a68 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:08.639693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-554e762a-545d-4ef1-bce8-abaa9e86d7a7 req-41538365-c1eb-43f2-bac4-ad8cb8dc1a68 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:08.639693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-554e762a-545d-4ef1-bce8-abaa9e86d7a7 req-41538365-c1eb-43f2-bac4-ad8cb8dc1a68 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:08.685876 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-554e762a-545d-4ef1-bce8-abaa9e86d7a7 req-41538365-c1eb-43f2-bac4-ad8cb8dc1a68 service nova] Creating event network-changed:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:12:08.706279 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-554e762a-545d-4ef1-bce8-abaa9e86d7a7 req-41538365-c1eb-43f2-bac4-ad8cb8dc1a68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107228 Nov 02 14:12:08.714599 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3419/4891] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:12:09.258882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:09.259922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:09.276148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:09.277491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:09.278071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:09.279646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:09.280270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:09.280840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:09.944228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:09.956425 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb156e32-3798-421f-adf2-292dc9967b40 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1388 microversion: 2.1 time: 0.703675 Nov 02 14:12:09.957043 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3420/4892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:09 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1388 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:10.008597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:10.010751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:10.027989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:10.028488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:10.028910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:10.030528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:10.032087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:10.033500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:11.077628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:11.098840 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-608e9e73-67c3-4604-b855-6e3b9f18054f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1388 microversion: 2.1 time: 1.112969 Nov 02 14:12:11.103820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3421/4893] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:09 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1388 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:11.128898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:11.132373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:11.145756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:11.146318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:11.146747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:11.147497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:11.147938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:11.148357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:11.509570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:11.519037 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01f26d71-68fb-419e-ba88-c1d86c452506 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1388 microversion: 2.1 time: 0.395369 Nov 02 14:12:11.522611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3422/4894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:11 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1388 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:11.549007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:11.549870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:11.557010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:11.557703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:11.558281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:11.559151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:11.564829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:11.565553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:11.660375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:12:11.913778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7c1e5b8-4bf7-4758-b32f-ac2b83bf830e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 204 len: 0 microversion: 2.1 time: 0.371979 Nov 02 14:12:11.917946 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3423/4895] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:12:11 2022] DELETE /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:11.926448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bdc9bed-299a-4d9b-98f6-24be0056bea3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721310372", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "destination_type": "local"}, {"source_type": "volume", "uuid": "dce6e664-4a6f-4a28-b3ea-065729a79386", "destination_type": "invalid"}], "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bdc9bed-299a-4d9b-98f6-24be0056bea3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 495 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721310372", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "destination_type": "local"}, {"source_type": "volume", "uuid": "dce6e664-4a6f-4a28-b3ea-065729a79386", "destination_type": "invalid"}], "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1721310372', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'dce6e664-4a6f-4a28-b3ea-065729a79386', 'destination_type': 'invalid'}], 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:11.931423 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bdc9bed-299a-4d9b-98f6-24be0056bea3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0bdc9bed-299a-4d9b-98f6-24be0056bea3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013418 Nov 02 14:12:11.946168 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3424/4896] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:11 2022] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:11.961644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:11.963022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:11.981634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:11.982441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:11.983184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:11.988927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:11.989620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:11.992078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:13.369713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:13.382475 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d61afcc6-4fec-471f-a513-884fb08752dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1394 microversion: 2.1 time: 1.448094 Nov 02 14:12:13.389777 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3425/4897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:11 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1394 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:13.439672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:13.440595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:13.449266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:13.450275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:13.451394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:13.453103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:13.454779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:13.455560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:14.095599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:14.103691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af3aef1b-e551-44e3-978b-9776d5273d4e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.711848 Nov 02 14:12:14.114504 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3426/4898] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:13 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:14.156877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:14.157716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:14.178856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:14.179379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:14.179815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:14.180516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:14.180966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:14.181374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:14.592957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:14.615436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c88091c1-6929-4090-a7cd-7500af0ce80f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.460283 Nov 02 14:12:14.617580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3427/4899] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:14 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:14.631481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:14.634733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:14.660161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:14.670676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:14.671340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:14.672554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:14.674677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:14.675776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:15.525532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:15.537068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aab52664-6548-4b2c-84f9-c6c72f0eea5b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1394 microversion: 2.1 time: 0.917946 Nov 02 14:12:15.540108 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3428/4900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:14 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1394 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:15.560868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46c79f03-8d96-4fa2-a2c5-aae83613c031 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-694136655", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46c79f03-8d96-4fa2-a2c5-aae83613c031 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 491 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-694136655", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-694136655', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.566172 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 14:12:15.569015 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:15.586390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46c79f03-8d96-4fa2-a2c5-aae83613c031 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:15.588069 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46c79f03-8d96-4fa2-a2c5-aae83613c031 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.046863 Nov 02 14:12:15.594548 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3429/4901] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:15 2022] POST /compute/v2.1/servers => generated 624 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:15.603704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:15.614022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:15.638688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:15.639472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:15.640087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:15.640993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:15.641591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:15.642158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:16.502169 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f00fa4a-28fb-46da-bbdf-de480ad25d6f tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.961460 Nov 02 14:12:16.521160 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1473/4902] 10.222.0.18 () {60 vars in 1170 bytes} [Wed Nov 2 14:12:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:16.521160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1427cec6-46f7-43cb-928b-258ce6a391c0 req-2426912a-918c-430a-a661-7a0b26297800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809fc4c1-fb17-4ce7-a5dc-8d661d516e72", "name": "network-vif-deleted", "tag": "9a644289-65f5-46e3-b89e-f42fc5f3a9c3"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:16.556581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1427cec6-46f7-43cb-928b-258ce6a391c0 req-2426912a-918c-430a-a661-7a0b26297800 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:16.557109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1427cec6-46f7-43cb-928b-258ce6a391c0 req-2426912a-918c-430a-a661-7a0b26297800 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:16.559938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1427cec6-46f7-43cb-928b-258ce6a391c0 req-2426912a-918c-430a-a661-7a0b26297800 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:16.628939 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1427cec6-46f7-43cb-928b-258ce6a391c0 req-2426912a-918c-430a-a661-7a0b26297800 service nova] Creating event network-vif-deleted:9a644289-65f5-46e3-b89e-f42fc5f3a9c3 for instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 on n-h2-858238-3 Nov 02 14:12:16.633630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:16.648346 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56f2b4ee-b145-4cd2-936d-824bc1136aad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.044466 Nov 02 14:12:16.654781 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1427cec6-46f7-43cb-928b-258ce6a391c0 req-2426912a-918c-430a-a661-7a0b26297800 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141211 Nov 02 14:12:16.659039 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1474/4903] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:16.676845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3430/4904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:15 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:16.682636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:16.687991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:16.688718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.71"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:16.695773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:16.697243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:16.699316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:16.700237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:16.704029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:16.704707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:16.705290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:16.714144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:16.717704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:16.722741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:16.723689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:16.724283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:16.725171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:16.794013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "refresh_cache-5f4b7e59-253b-472b-b069-34ca385bd346" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 14:12:16.795816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquired lock "refresh_cache-5f4b7e59-253b-472b-b069-34ca385bd346" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 14:12:17.023117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:17.027200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:17.036358 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e6f39b05-7729-4be3-8228-8f07dda0a31b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.358315 Nov 02 14:12:17.043473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3431/4905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:16 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:17.056080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:17.056938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:17.072777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:17.073463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:17.080352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:17.083601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:17.088089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:17.088767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:17.957139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:17.972767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04c61f07-fb53-443f-88cb-351c0f0539b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.925106 Nov 02 14:12:17.974964 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3432/4906] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:17 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:18.065972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:18.066657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:18.079852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:18.080473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:18.083654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:18.084700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:18.085590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:18.086536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:18.399761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:18.413931 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7956835-6047-4c75-a8fd-fc30637dbfdf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.351824 Nov 02 14:12:18.427773 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3433/4907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:18 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:18.438766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4fed582-f955-49d8-82da-f5525113b4f3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4fed582-f955-49d8-82da-f5525113b4f3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 416 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.442971 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:12:18.445828 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:18.450701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4fed582-f955-49d8-82da-f5525113b4f3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:18.452066 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a4fed582-f955-49d8-82da-f5525113b4f3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.020093 Nov 02 14:12:18.453712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3434/4908] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:18 2022] POST /compute/v2.1/servers => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:18.471887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:18.472749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:18.484908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:18.488300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:18.496545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:18.497606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:18.498283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:18.498919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:19.813582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:19.827556 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c9e53f4-939d-4568-926f-ced1273e0601 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.362260 Nov 02 14:12:19.839289 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3435/4909] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:18 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:19.853538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:19.857821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:19.867202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:19.870628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:19.871448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:19.874822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:19.875601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:19.876182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:20.212745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:20.222916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74c20177-7699-4b1d-9790-9ab2a2799aa1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.384949 Nov 02 14:12:20.244160 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3436/4910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:19 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:20.257035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:20.257588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:20.286254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:20.286775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:20.287248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:20.291255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:20.294620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:20.295084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:21.642364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:21.653578 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-783e13ce-4333-456e-bc2f-d196cc13babd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.407933 Nov 02 14:12:21.670448 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3437/4911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:20 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:21.691646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:21.694022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:21.708495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:21.711696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:21.712283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:21.713147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:21.716082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:21.716967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:21.951190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:21.975017 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7d62aab-d900-4f18-8bbb-8cee98fb2efd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.300727 Nov 02 14:12:21.975692 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3438/4912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:21 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:22.006354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-815e7c05-375c-4965-a6a6-e331e8137eb0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1561273831", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": -1, "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:22.054399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-815e7c05-375c-4965-a6a6-e331e8137eb0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Flavor -1 could not be found. Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-815e7c05-375c-4965-a6a6-e331e8137eb0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 206 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1561273831", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": -1, "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: exception: Flavor -1 could not be found. Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1561273831', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': -1, 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:22.063607 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:22.067740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-815e7c05-375c-4965-a6a6-e331e8137eb0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:22.074355 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-815e7c05-375c-4965-a6a6-e331e8137eb0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.093903 Nov 02 14:12:22.078130 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3439/4913] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:21 2022] POST /compute/v2.1/servers => generated 73 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 14:12:22.089059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:22.109932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:22.148145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:22.161873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:22.165776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:22.171483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:22.172949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:22.175721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:23.362923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:23.373183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e9f0457-d714-4dc8-833b-71c14a0114f7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.288107 Nov 02 14:12:23.383703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3440/4914] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:22 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:23.400456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:23.400954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:23.415880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:23.416385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:23.416822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:23.417538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:23.417989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:23.418418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:23.445401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] HTTP exception thrown: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Request method failure captured: Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 HTTP/1.1 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjt4ETorHLEp11Vn1aGw_WKk2uI39g5H32kSJ7dpp6YusDXsVcR1OvoWRbuo3CNlTktqi2Pt7DNOXg0w8U1W9oQBIRV1IyzGVnhoz_X_FGRLWwixdRe5Na5syNoW-6bwtDgWD52hjxAAuy21v3KGeZ2NhcKbI6BcbpbqKIHh0T7WXM Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4109b13b99644609bedb98d8e28c8e59"}]}] Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a01f842614b24924bcc2196332cb5f35 Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7adf7971-0422-490c-9b8c-8b3de45d3476'} Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:23.447066 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Returning 404 to user: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:23.450476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98a03686-8d8d-47a2-bb2f-79d98a5ad6d6 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 404 len: 111 microversion: 2.1 time: 0.063723 Nov 02 14:12:23.455122 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3441/4915] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:12:23 2022] DELETE /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:23.458873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:23.459447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:23.466164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:23.466656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:23.467118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:23.467821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:23.468269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:23.468714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:23.594634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:23.606351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55aa4349-15ce-4e73-bb82-6f28c08a89c5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.151772 Nov 02 14:12:23.612648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3442/4916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:23 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:23.620407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:23.621289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:23.629211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:23.629975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:23.630630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:23.631592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:23.632965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:23.633741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:24.468180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:24.484514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c28a5eb-3707-4184-8c3d-f89d5d7e4a1e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.869843 Nov 02 14:12:24.486135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3443/4917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:23 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:24.492474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:24.494458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: 7adf7971-0422-490c-9b8c-8b3de45d3476] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:24.505180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:24.506715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:24.507132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:24.575547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:24.579529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.071s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:24.580197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:24.658885 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] HTTP exception thrown: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Request method failure captured: Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 HTTP/1.1 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjt4ETorHLEp11Vn1aGw_WKk2uI39g5H32kSJ7dpp6YusDXsVcR1OvoWRbuo3CNlTktqi2Pt7DNOXg0w8U1W9oQBIRV1IyzGVnhoz_X_FGRLWwixdRe5Na5syNoW-6bwtDgWD52hjxAAuy21v3KGeZ2NhcKbI6BcbpbqKIHh0T7WXM Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4109b13b99644609bedb98d8e28c8e59"}]}] Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a01f842614b24924bcc2196332cb5f35 Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '7adf7971-0422-490c-9b8c-8b3de45d3476'} Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:24.662309 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. Nov 02 14:12:24.665918 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.675834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Returning 404 to user: Instance 7adf7971-0422-490c-9b8c-8b3de45d3476 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:24.677646 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ff57212-36e2-4cc1-9ec6-49c7990e2698 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476" status: 404 len: 111 microversion: 2.1 time: 0.190191 Nov 02 14:12:24.684949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3444/4918] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:24 2022] GET /compute/v2.1/servers/7adf7971-0422-490c-9b8c-8b3de45d3476 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:24.699259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:24.700287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:24.708937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:24.709672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:24.710323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:24.711404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:24.713422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:24.714088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:24.914382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:24.935651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c7d8c6e9-102f-4894-8664-2b957ab8f581 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.245249 Nov 02 14:12:24.942514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3445/4919] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:24 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:24.963036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43bc44d3-bb33-4026-a92f-e09abe21b30e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430918081", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43bc44d3-bb33-4026-a92f-e09abe21b30e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 172 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430918081", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-430918081', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi -1 Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:24.990761 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:24.994419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43bc44d3-bb33-4026-a92f-e09abe21b30e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:24.997707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43bc44d3-bb33-4026-a92f-e09abe21b30e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.052049 Nov 02 14:12:25.017812 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3446/4920] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:24 2022] POST /compute/v2.1/servers => generated 145 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:25.031748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:25.034516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:25.048938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:25.049657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:25.050309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:25.051267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:25.052003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:25.052694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:25.112282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Building network info cache for instance {{(pid=137558) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 14:12:25.115225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=91 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:25.651607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:25.662834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3969330d-cd3d-463c-aa03-876f3b709bdd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.654531 Nov 02 14:12:25.671348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3447/4921] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:25 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:25.678722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6124c9e5-89ba-4308-8e22-79e6b80db0e8 req-a94b0549-4a72-45e8-8115-d02b2e8f556b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:25.712583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6124c9e5-89ba-4308-8e22-79e6b80db0e8 req-a94b0549-4a72-45e8-8115-d02b2e8f556b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:25.713454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6124c9e5-89ba-4308-8e22-79e6b80db0e8 req-a94b0549-4a72-45e8-8115-d02b2e8f556b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:25.714133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6124c9e5-89ba-4308-8e22-79e6b80db0e8 req-a94b0549-4a72-45e8-8115-d02b2e8f556b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:25.745453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6124c9e5-89ba-4308-8e22-79e6b80db0e8 req-a94b0549-4a72-45e8-8115-d02b2e8f556b service nova] Creating event network-changed:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:12:25.777124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6124c9e5-89ba-4308-8e22-79e6b80db0e8 req-a94b0549-4a72-45e8-8115-d02b2e8f556b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103409 Nov 02 14:12:25.782740 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3448/4922] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:25.793767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:25.796308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:25.820970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:25.829199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:25.831978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:25.832963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:25.835602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:25.836161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:26.372591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Updating instance_info_cache with network_info: [{"id": "1447a14c-565b-4802-87a0-140c7ea55348", "address": "fa:16:3e:c7:7a:31", "network": {"id": "5cc5c180-e739-48f3-83d7-bd0a42c248db", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2035628759-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ab14644376154978b2acd420b095e7ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1447a14c-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 14:12:26.375620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:26.385018 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d80620f3-4098-4a67-adcd-b9441eb21d23 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.600537 Nov 02 14:12:26.385593 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3449/4923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:25 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:26.395309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:26.395309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:26.405853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:26.405853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:26.405853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:26.405853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:26.405853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:26.412009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:26.446899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Releasing lock "refresh_cache-5f4b7e59-253b-472b-b069-34ca385bd346" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 14:12:26.455133 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-59519aff-91b4-4d35-9810-3c4eb090b0af tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action" status: 202 len: 0 microversion: 2.1 time: 9.793694 Nov 02 14:12:26.460551 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1475/4924] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:16 2022] POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action => generated 0 bytes in 9801 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 14:12:26.484182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Action: 'action', calling method: .version_select at 0x7f6f83b63310>, body: {"removeFloatingIp": {"address": "172.25.9.71"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:26.512180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:26.525584 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9c59b52-9a20-432a-962f-bf7560f8fdb3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.136820 Nov 02 14:12:26.528162 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3450/4925] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:26 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:26.537667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-082bbc06-5f4a-4957-ac65-fd9e2091a9ff tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-154106812", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:26.543551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-082bbc06-5f4a-4957-ac65-fd9e2091a9ff tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-082bbc06-5f4a-4957-ac65-fd9e2091a9ff tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 215 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-154106812", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-154106812', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:26.545911 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 14:12:26.549907 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:26.552247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-082bbc06-5f4a-4957-ac65-fd9e2091a9ff tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:26.553203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-082bbc06-5f4a-4957-ac65-fd9e2091a9ff tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023566 Nov 02 14:12:26.553966 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3451/4926] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:26 2022] POST /compute/v2.1/servers => generated 123 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:26.571598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:26.572835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:26.587036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:26.587723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:26.588643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:26.589765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:26.590937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:26.592259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:26.713272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=15 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:27.057968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:27.066390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:27.066877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:27.067586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:27.068454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:27.069222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:27.069825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:27.071219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:27.083284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c654cd64-a751-4af4-a2c9-35c66ad3977f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.521981 Nov 02 14:12:27.095177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3452/4927] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:26 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:27.114987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:27.115792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:27.137750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:27.138360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:27.139074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:27.142289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:27.142786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:27.144058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:27.566596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:27.575823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-627fd1ab-13da-43c9-9b5b-81dd91e5aa45 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.464875 Nov 02 14:12:27.589360 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3453/4928] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:27 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:27.589360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:27.589360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:27.604895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:27.604895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:27.604895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:27.604895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:27.604895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:27.604895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:27.632664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:27.821449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:27.835888 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21114408-b0c8-4bbf-8430-b9e6215591b1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.257702 Nov 02 14:12:27.851139 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3454/4929] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:27 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:27.851139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-125d09a7-6f29-4ff9-a8f9-7a89d1e707dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-855252530", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-key-1361910261", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:27.873855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "refresh_cache-5f4b7e59-253b-472b-b069-34ca385bd346" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 14:12:27.874361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquired lock "refresh_cache-5f4b7e59-253b-472b-b069-34ca385bd346" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 14:12:27.947895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-125d09a7-6f29-4ff9-a8f9-7a89d1e707dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] validate_networks() for [('8a7da38e-e895-4f80-8321-8e988c87645c', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:12:28.801486 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-125d09a7-6f29-4ff9-a8f9-7a89d1e707dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Invalid key_name provided. Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-125d09a7-6f29-4ff9-a8f9-7a89d1e707dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 246 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-855252530", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-key-1361910261", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid key_name provided. Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-855252530', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'key_name': 'tempest-key-1361910261', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1361910261 not found for user b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:28.805388 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 02 14:12:28.808887 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:28.815155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-125d09a7-6f29-4ff9-a8f9-7a89d1e707dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid key_name provided. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:28.816383 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-125d09a7-6f29-4ff9-a8f9-7a89d1e707dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.978517 Nov 02 14:12:28.817562 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3455/4930] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:27 2022] POST /compute/v2.1/servers => generated 70 bytes in 980 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 14:12:28.833075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:28.834568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:28.850898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:28.851827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:28.852535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:28.853488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:28.854223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:28.855517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:29.259000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:29.269832 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bdcdc865-7bbe-413a-8a0f-9af226efaa2f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.447769 Nov 02 14:12:29.283649 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3456/4931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:28 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:29.300494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:29.301432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:29.307887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:29.309104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:29.309744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:29.310652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:29.311447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:29.312252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:29.434510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:29.458937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-497c4fe5-d679-4636-9f37-d1c2c35bd504 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.154161 Nov 02 14:12:29.474187 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3457/4932] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:29 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:29.498933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:29.505374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:29.535618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:29.536618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:29.538269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:29.539828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:29.543835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:29.545550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:29.934263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:29.947371 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76ccc554-6079-4ae5-9e69-d9d07f17b7b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.467002 Nov 02 14:12:29.948180 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3458/4933] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:29 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:30.077479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3350b364-6e7c-4503-a588-b91f71f05437 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298012317", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:30.144187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Building network info cache for instance {{(pid=137558) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 14:12:30.328978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.security_group_api [None req-3350b364-6e7c-4503-a588-b91f71f05437 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Neutron security group does_not_exist not found {{(pid=137559) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 02 14:12:30.329855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3350b364-6e7c-4503-a588-b91f71f05437 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3350b364-6e7c-4503-a588-b91f71f05437 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 257 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298012317", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-298012317', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 14:12:30.361050 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 02 14:12:30.365342 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:30.369877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3350b364-6e7c-4503-a588-b91f71f05437 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:30.370697 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3350b364-6e7c-4503-a588-b91f71f05437 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.297404 Nov 02 14:12:30.371503 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3459/4934] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:30 2022] POST /compute/v2.1/servers => generated 106 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 14:12:30.383040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d77c57d6-f927-46bf-8c1e-8d43f1741187 req-02650044-172d-47ff-89ec-f3f13db10d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:30.421183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d77c57d6-f927-46bf-8c1e-8d43f1741187 req-02650044-172d-47ff-89ec-f3f13db10d63 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:30.421709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d77c57d6-f927-46bf-8c1e-8d43f1741187 req-02650044-172d-47ff-89ec-f3f13db10d63 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:30.422680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d77c57d6-f927-46bf-8c1e-8d43f1741187 req-02650044-172d-47ff-89ec-f3f13db10d63 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:30.470296 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d77c57d6-f927-46bf-8c1e-8d43f1741187 req-02650044-172d-47ff-89ec-f3f13db10d63 service nova] Creating event network-changed:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:12:30.486035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d77c57d6-f927-46bf-8c1e-8d43f1741187 req-02650044-172d-47ff-89ec-f3f13db10d63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112485 Nov 02 14:12:30.494666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3460/4935] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:30.505194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:30.506039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:30.526153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:30.526644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:30.527537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:30.527815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:30.528275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:30.528703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:31.020195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:31.032755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e3e555a2-33b6-4257-b177-3fb13ed79a0b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.535363 Nov 02 14:12:31.037636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3461/4936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:30 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:31.042633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:31.043304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:31.061499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:31.062135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:31.062572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:31.063498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:31.063959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:31.064389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:31.272420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:31.284800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-170f7e6d-b6ed-4e43-ad88-158b15152deb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.246024 Nov 02 14:12:31.287793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3462/4937] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:31 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:31.295518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:31.296459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:31.316511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:31.318545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:31.319380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:31.322210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:31.325776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:31.326882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:31.622111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Updating instance_info_cache with network_info: [{"id": "1447a14c-565b-4802-87a0-140c7ea55348", "address": "fa:16:3e:c7:7a:31", "network": {"id": "5cc5c180-e739-48f3-83d7-bd0a42c248db", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2035628759-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ab14644376154978b2acd420b095e7ee", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1447a14c-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137558) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 14:12:31.648259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Releasing lock "refresh_cache-5f4b7e59-253b-472b-b069-34ca385bd346" {{(pid=137558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 14:12:31.650681 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8ca32b93-d3c6-42e5-9b79-34da124eb0a5 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action" status: 202 len: 0 microversion: 2.1 time: 5.182379 Nov 02 14:12:31.652610 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1476/4938] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:26 2022] POST /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346/action => generated 0 bytes in 5188 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 14:12:31.669340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b39740bc-9202-403e-adbf-86ecc309d46a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '.version_select at 0x7f6f81078af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:32.265988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:32.295934 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03ad49fa-ed97-4bb6-9234-7d1163b9ba41 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.004509 Nov 02 14:12:32.298861 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3463/4939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:31 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:32.316423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:32.321268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:32.340902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:32.345409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:32.346269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:32.347268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:32.349476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:32.352385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:32.524109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:32.545634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a507f5e2-f357-4de5-8cd6-513ccacb9859 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 200 len: 1186 microversion: 2.1 time: 0.234774 Nov 02 14:12:32.547785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3464/4940] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:32 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 1186 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:32.557201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea852422-dd06-436d-8a09-cba32d382784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:32.559373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea852422-dd06-436d-8a09-cba32d382784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: a368b328-566d-4435-a253-6382a9c7bb37] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:32.573782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ea852422-dd06-436d-8a09-cba32d382784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance a368b328-566d-4435-a253-6382a9c7bb37 could not be found. Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea852422-dd06-436d-8a09-cba32d382784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/a368b328-566d-4435-a253-6382a9c7bb37 HTTP/1.1 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a368b328-566d-4435-a253-6382a9c7bb37 could not be found. Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a368b328-566d-4435-a253-6382a9c7bb37'} Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a368b328-566d-4435-a253-6382a9c7bb37 could not be found. Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a368b328-566d-4435-a253-6382a9c7bb37 could not be found. Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:32.583603 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a368b328-566d-4435-a253-6382a9c7bb37 could not be found. Nov 02 14:12:32.587787 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:32.589537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea852422-dd06-436d-8a09-cba32d382784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance a368b328-566d-4435-a253-6382a9c7bb37 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:32.590813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea852422-dd06-436d-8a09-cba32d382784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a368b328-566d-4435-a253-6382a9c7bb37" status: 404 len: 111 microversion: 2.1 time: 0.041877 Nov 02 14:12:32.591573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3465/4941] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:12:32 2022] DELETE /compute/v2.1/servers/a368b328-566d-4435-a253-6382a9c7bb37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:32.601272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:32.602280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:32.614888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:32.618527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:32.619374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:32.620111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:32.628898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:32.630484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:32.631302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:33.105731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:33.116218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-feb7259f-7315-4a33-b2aa-a9409dff27b4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.519268 Nov 02 14:12:33.126630 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3466/4942] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:32 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:33.147656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:33.148312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:33.165485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:33.166210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:33.170138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:33.171218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:33.171882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:33.178104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:33.974619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:33.991081 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3696e2da-c793-42a5-bc54-2a363d17c7ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.847278 Nov 02 14:12:33.996318 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3467/4943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:33 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:34.011507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:34.013695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 809fc4c1-fb17-4ce7-a5dc-8d661d516e72] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:34.030683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.031421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.032134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.033027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.033612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.034185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.052212 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 could not be found. Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 HTTP/1.1 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 could not be found. Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '809fc4c1-fb17-4ce7-a5dc-8d661d516e72'} Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 could not be found. Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 could not be found. Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:34.053859 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 could not be found. Nov 02 14:12:34.057435 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.059341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 809fc4c1-fb17-4ce7-a5dc-8d661d516e72 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:34.060389 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c1a2fa0-b65c-44cb-bc76-8bdce087b554 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72" status: 404 len: 111 microversion: 2.1 time: 0.061286 Nov 02 14:12:34.061354 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3468/4944] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:33 2022] GET /compute/v2.1/servers/809fc4c1-fb17-4ce7-a5dc-8d661d516e72 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:34.074060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e98288c6-b9a5-41c9-a292-80f3c224aabd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:34.074997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e98288c6-b9a5-41c9-a292-80f3c224aabd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Failed to fetch instance by id 9223372036854775808 {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 14:12:34.077966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e98288c6-b9a5-41c9-a292-80f3c224aabd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e98288c6-b9a5-41c9-a292-80f3c224aabd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9223372036854775808 could not be found. Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9223372036854775808'} Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:34.082196 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:34.086024 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:34.086024 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:34.086024 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:34.086024 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 02 14:12:34.086024 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:34.088113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e98288c6-b9a5-41c9-a292-80f3c224aabd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:34.089628 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e98288c6-b9a5-41c9-a292-80f3c224aabd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.026929 Nov 02 14:12:34.090384 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3469/4945] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Nov 2 14:12:34 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:12:34.103500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:34.104443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:34.124793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.125513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.127408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.131829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.132618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.133329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.257264 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b39740bc-9202-403e-adbf-86ecc309d46a tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/dd133208-a311-4d06-976a-4e8f62c2574f" status: 202 len: 0 microversion: 2.1 time: 2.600008 Nov 02 14:12:34.258723 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1477/4946] 10.222.0.18 () {58 vars in 1263 bytes} [Wed Nov 2 14:12:31 2022] DELETE /compute/v2.1/os-floating-ips/dd133208-a311-4d06-976a-4e8f62c2574f => generated 0 bytes in 2602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:12:34.271818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f5bb424d-da0c-4cdc-aba9-dc530b4a829c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '.version_select at 0x7f6f81078280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:34.573998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:34.594550 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f0f07c96-5a5c-4bcc-9556-fbbe97376287 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.496623 Nov 02 14:12:34.621089 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3470/4947] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:34 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:34.649348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:34.649971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:34.661690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.662189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.662958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.665031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.668093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.668549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.789353 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f5bb424d-da0c-4cdc-aba9-dc530b4a829c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/1de5bbc0-24db-4bf6-a38b-28d2f9531bc6" status: 202 len: 0 microversion: 2.1 time: 0.522174 Nov 02 14:12:34.790260 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1478/4948] 10.222.0.18 () {58 vars in 1272 bytes} [Wed Nov 2 14:12:34 2022] DELETE /compute/v2.1/os-security-groups/1de5bbc0-24db-4bf6-a38b-28d2f9531bc6 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:12:34.798376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:34.798882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:34.812730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.813228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.813659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.814370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:34.814818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:34.815270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:34.870382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:12:34.991348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:35.010028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98dbd726-3098-4b72-82c8-3cf06a10e50f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.386959 Nov 02 14:12:35.010963 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3471/4949] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:34 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:35.039368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a55774c5-4d2a-402a-9e72-cbc0869d8619 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:35.040251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a55774c5-4d2a-402a-9e72-cbc0869d8619 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Failed to fetch instance by id -1 {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 14:12:35.040859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a55774c5-4d2a-402a-9e72-cbc0869d8619 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance -1 could not be found. Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a55774c5-4d2a-402a-9e72-cbc0869d8619 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance -1 could not be found. Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '-1'} Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:35.042488 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:35.046983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:35.046983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:35.046983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 02 14:12:35.046983 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:35.049355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a55774c5-4d2a-402a-9e72-cbc0869d8619 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance -1 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:35.050784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a55774c5-4d2a-402a-9e72-cbc0869d8619 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.016181 Nov 02 14:12:35.057131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3472/4950] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 14:12:35 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 14:12:35.072261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:35.074633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:35.086976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:35.095889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:35.097231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:35.098781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:35.099495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:35.100437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:35.108334 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56749e0a-e614-4000-b720-a5b9cc4eff9c tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 204 len: 0 microversion: 2.1 time: 0.311915 Nov 02 14:12:35.112451 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1479/4951] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:12:34 2022] DELETE /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:12:35.141154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:35.142263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:35.179182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:35.179771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:35.180198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:35.185280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:35.185789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:35.186234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:35.556242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:35.569619 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff47ac6e-0544-45f3-8a38-5675ec83eb0f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.501227 Nov 02 14:12:35.584045 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3473/4952] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:35 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:35.618834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:35.619498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:35.632062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:35.633820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:35.634303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:35.637155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:35.638575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:35.640714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:35.717952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:35.733710 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a34fd7ab-ed13-475c-9d8a-05f1da319760 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1511 microversion: 2.1 time: 0.618837 Nov 02 14:12:35.739016 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1480/4953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:35 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:36.074505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:36.087698 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf49a5d8-f76c-4f4b-9b74-95f02d3368ad tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.473030 Nov 02 14:12:36.091376 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3474/4954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:35 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:36.126011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c935a66f-0cdd-467b-b1f5-c71da731f983 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:36.126581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c935a66f-0cdd-467b-b1f5-c71da731f983 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:36.133724 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-c935a66f-0cdd-467b-b1f5-c71da731f983 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2 could not be found. Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c935a66f-0cdd-467b-b1f5-c71da731f983 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2/action HTTP/1.1 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 19 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: {"forceDelete": {}} Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2 could not be found. Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2', 'body': {'forceDelete': {}}} Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2 could not be found. Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2 could not be found. Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:36.143851 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:36.147649 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:36.147649 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:36.147649 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2 could not be found. Nov 02 14:12:36.147649 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:36.151245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c935a66f-0cdd-467b-b1f5-c71da731f983 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:36.152480 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c935a66f-0cdd-467b-b1f5-c71da731f983 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2/action" status: 404 len: 111 microversion: 2.1 time: 0.030888 Nov 02 14:12:36.164701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:36.165708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:36.169201 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1481/4955] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:36 2022] POST /compute/v2.1/servers/e3d480c5-9b2a-43c6-a5f6-af82e6bbc0c2/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:36.185273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:36.188079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:36.189562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:36.190430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:36.192318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:36.193722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:36.766720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:36.768736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:36.794792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:36.795601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:36.797726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:36.802565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:36.803572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:36.804349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:37.360886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:37.399025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-837c1b29-3689-4ef7-bf60-38fcfff22b32 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.240097 Nov 02 14:12:37.404427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3475/4956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:36 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:37.432731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:37.433582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:37.446520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:37.454917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:37.455615 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aedab35b-051c-4f10-aa89-6f57da1ed75e tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1511 microversion: 2.1 time: 0.694957 Nov 02 14:12:37.456315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:37.459028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:37.460213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:37.462612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:37.463348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:37.483337 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1482/4957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:36 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1511 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:37.771134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:37.783441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c622166f-82f7-418f-a25b-ac9e88d042ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.355458 Nov 02 14:12:37.799120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3476/4958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:37 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:37.808698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53b6e597-3a71-4119-89f6-6aacb4f55b08 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:37.811947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-53b6e597-3a71-4119-89f6-6aacb4f55b08 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 3ba93e88-77f6-442f-bb1b-6f8727ce06f9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:37.818671 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-53b6e597-3a71-4119-89f6-6aacb4f55b08 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 3ba93e88-77f6-442f-bb1b-6f8727ce06f9 could not be found. Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53b6e597-3a71-4119-89f6-6aacb4f55b08 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/3ba93e88-77f6-442f-bb1b-6f8727ce06f9/action HTTP/1.1 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 39 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: {"os-getConsoleOutput": {"length": 10}} Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3ba93e88-77f6-442f-bb1b-6f8727ce06f9 could not be found. Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3ba93e88-77f6-442f-bb1b-6f8727ce06f9', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba93e88-77f6-442f-bb1b-6f8727ce06f9 could not be found. Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba93e88-77f6-442f-bb1b-6f8727ce06f9 could not be found. Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:37.829082 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba93e88-77f6-442f-bb1b-6f8727ce06f9 could not be found. Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53b6e597-3a71-4119-89f6-6aacb4f55b08 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 3ba93e88-77f6-442f-bb1b-6f8727ce06f9 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53b6e597-3a71-4119-89f6-6aacb4f55b08 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/3ba93e88-77f6-442f-bb1b-6f8727ce06f9/action" status: 404 len: 111 microversion: 2.1 time: 0.026696 Nov 02 14:12:37.837982 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1483/4959] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:37 2022] POST /compute/v2.1/servers/3ba93e88-77f6-442f-bb1b-6f8727ce06f9/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:37.842703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:37.843482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:37.859634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:37.860847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:37.862014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:37.863404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:37.864432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:37.865596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:37.911426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:38.486622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:38.487538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:38.505885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:38.508809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:38.509499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:38.516288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:38.518406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:38.522690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:38.733449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2d940a1ce2438792865f66a37f09fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab14644376154978b2acd420b095e7ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:38.749345 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca5c3d9b-0a6f-4b01-bbb2-a7aba193b183 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 200 len: 1469 microversion: 2.1 time: 0.268164 Nov 02 14:12:38.753557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1484/4960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:38 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:12:38.754743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:38.771905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ae99493d-a27d-44e4-a8ce-42d20142f83c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.925648 Nov 02 14:12:38.776527 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3477/4961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:37 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:38.800215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:38.800829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:38.826501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:38.827160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:38.827935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:38.828485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:38.828867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:38.829301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:38.870387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ac909920-c4a4-432b-86ba-bade1ee68d49 req-d02c7784-e9f9-4bb4-9e9a-5fed1e40ba6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4b7e59-253b-472b-b069-34ca385bd346", "name": "network-vif-deleted", "tag": "1447a14c-565b-4802-87a0-140c7ea55348"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:38.911466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ac909920-c4a4-432b-86ba-bade1ee68d49 req-d02c7784-e9f9-4bb4-9e9a-5fed1e40ba6b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:38.912075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ac909920-c4a4-432b-86ba-bade1ee68d49 req-d02c7784-e9f9-4bb4-9e9a-5fed1e40ba6b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:38.912633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ac909920-c4a4-432b-86ba-bade1ee68d49 req-d02c7784-e9f9-4bb4-9e9a-5fed1e40ba6b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:38.945156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ac909920-c4a4-432b-86ba-bade1ee68d49 req-d02c7784-e9f9-4bb4-9e9a-5fed1e40ba6b service nova] Creating event network-vif-deleted:1447a14c-565b-4802-87a0-140c7ea55348 for instance 5f4b7e59-253b-472b-b069-34ca385bd346 on n-h2-858238-3 Nov 02 14:12:38.964278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ac909920-c4a4-432b-86ba-bade1ee68d49 req-d02c7784-e9f9-4bb4-9e9a-5fed1e40ba6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097681 Nov 02 14:12:38.967249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3478/4962] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:12:39.764007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:39.787898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:39.791003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] [instance: 5f4b7e59-253b-472b-b069-34ca385bd346] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:39.805232 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd951c04-83ec-4d47-9d64-aa0c03f6e01f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.987789 Nov 02 14:12:39.808115 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1485/4963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:38 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:39.812180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:39.814177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:39.814871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:39.818467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:39.819221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:39.819967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:39.839060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-157f4a4d-1882-4903-88b3-63dbb0fea48c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:39.840460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-157f4a4d-1882-4903-88b3-63dbb0fea48c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:39.857050 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-157f4a4d-1882-4903-88b3-63dbb0fea48c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc could not be found. Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-157f4a4d-1882-4903-88b3-63dbb0fea48c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc HTTP/1.1 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc could not be found. Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc'} Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc could not be found. Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc could not be found. Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:39.862897 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:39.866431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:39.866431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:39.866431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:39.866431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc could not be found. Nov 02 14:12:39.866431 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.870176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-157f4a4d-1882-4903-88b3-63dbb0fea48c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:39.871310 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-157f4a4d-1882-4903-88b3-63dbb0fea48c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc" status: 404 len: 111 microversion: 2.1 time: 0.039024 Nov 02 14:12:39.872247 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1486/4964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:39 2022] GET /compute/v2.1/servers/8fcc9c65-7f4d-491d-b9cc-a7f85f34b4dc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:12:39.885111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:39.886939 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] HTTP exception thrown: Instance 5f4b7e59-253b-472b-b069-34ca385bd346 could not be found. Nov 02 14:12:39.887975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Request method failure captured: Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 HTTP/1.1 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp8zWer1uweBNKLQ4ciS8rnKHBMJxhloKjdgZZR85Y9m3S_manxPgS1jNgU3wSPWzD-8KTp3Wtb4p-V_R8W2T8NgHQxPH6myWpycYjGP-ZARNzaBeg-VookVsPLtSanuZ07p8I1seE3MyfofnmiyAUawv569nNQJxGilu1U5nEzJ4Q Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ab14644376154978b2acd420b095e7ee Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-848240611 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab14644376154978b2acd420b095e7ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ab14644376154978b2acd420b095e7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ab14644376154978b2acd420b095e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ab14644376154978b2acd420b095e7ee"}]}] Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-848240611 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ab14644376154978b2acd420b095e7ee Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-848240611 Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerRescueTestJSONUnderV235-848240611-project Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 5f2d940a1ce2438792865f66a37f09fd Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-848240611-project Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5f4b7e59-253b-472b-b069-34ca385bd346 could not be found. Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5f4b7e59-253b-472b-b069-34ca385bd346'} Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f4b7e59-253b-472b-b069-34ca385bd346 could not be found. Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4b7e59-253b-472b-b069-34ca385bd346 could not be found. Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.888656 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4b7e59-253b-472b-b069-34ca385bd346 could not be found. Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] Returning 404 to user: Instance 5f4b7e59-253b-472b-b069-34ca385bd346 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:39.892705 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af6599cf-1554-4f17-a2b4-7c59ce71f728 tempest-ServerRescueTestJSONUnderV235-848240611 tempest-ServerRescueTestJSONUnderV235-848240611-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346" status: 404 len: 111 microversion: 2.1 time: 0.111930 Nov 02 14:12:39.903150 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3479/4965] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:39 2022] GET /compute/v2.1/servers/5f4b7e59-253b-472b-b069-34ca385bd346 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:39.913391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:39.914237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:39.915045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:39.916160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:39.916970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:39.917614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:40.367810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:40.378900 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56443f6b-defc-413f-9fad-d05537cf110c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.499807 Nov 02 14:12:40.381873 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1487/4966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:39 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:40.407261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:40.407839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:40.417407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:40.417911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:40.418313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:40.419064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:40.421483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:40.423630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:41.117288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:41.162811 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-321b688f-b7f5-49e3-be16-6273b35abfc6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.759585 Nov 02 14:12:41.181421 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3480/4967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:40 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:41.506809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83c98998-e5a7-4234-af67-a99a66a0c47b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-810247977", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83c98998-e5a7-4234-af67-a99a66a0c47b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 237 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-810247977", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-810247977', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.544733 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 14:12:41.549523 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:41.553074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83c98998-e5a7-4234-af67-a99a66a0c47b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:41.554205 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-83c98998-e5a7-4234-af67-a99a66a0c47b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.051356 Nov 02 14:12:41.555342 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1488/4968] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:41.564823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:41.565610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:41.579319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:41.580252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:41.583544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:41.586228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:41.588719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:41.590659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:42.260495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:42.300177 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83938ee3-27e4-4ca5-915f-afa240a0fda2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.740826 Nov 02 14:12:42.301398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3481/4969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:41 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:42.332656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:42.336712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:42.365998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:42.367790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:42.369344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:42.372367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:42.373392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:42.374634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:42.865349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:42.880672 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fa8db8ef-a820-4878-b887-c9b055dc6a11 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.559991 Nov 02 14:12:42.881587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1489/4970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:42 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:43.050887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46d3c4b3-1912-4894-99f9-de660d8a5d8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-211660089", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46d3c4b3-1912-4894-99f9-de660d8a5d8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 234 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-211660089", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-211660089', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.070206 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46d3c4b3-1912-4894-99f9-de660d8a5d8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:43.074021 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46d3c4b3-1912-4894-99f9-de660d8a5d8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.030474 Nov 02 14:12:43.085589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:43.086236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:43.089987 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3482/4971] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:12:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:12:43.096841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:43.097480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:43.097933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:43.098656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:43.101847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:43.104787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:43.749094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:43.770220 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-175e04b7-dcd1-4a5f-9601-9424d4aea5e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.688540 Nov 02 14:12:43.773424 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1490/4972] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:43 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:43.806329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:43.807947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:43.835983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:43.836401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:43.836835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:43.837542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:43.839446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:43.845076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:44.747077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:44.814227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52ee383e-17e1-44ca-a3c4-73a8ae6d8706 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.008523 Nov 02 14:12:44.832113 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3483/4973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:43 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:44.844996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8e02341d-eabc-44c1-b6af-6b82d078b0e4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:44.845601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8e02341d-eabc-44c1-b6af-6b82d078b0e4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 206dc040-921a-4cf9-8ea0-b5f45a0ee11c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:44.864529 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8e02341d-eabc-44c1-b6af-6b82d078b0e4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 206dc040-921a-4cf9-8ea0-b5f45a0ee11c could not be found. Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8e02341d-eabc-44c1-b6af-6b82d078b0e4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/206dc040-921a-4cf9-8ea0-b5f45a0ee11c/action HTTP/1.1 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 13 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: {"pause": {}} Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 206dc040-921a-4cf9-8ea0-b5f45a0ee11c could not be found. Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '206dc040-921a-4cf9-8ea0-b5f45a0ee11c', 'body': {'pause': {}}} Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206dc040-921a-4cf9-8ea0-b5f45a0ee11c could not be found. Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206dc040-921a-4cf9-8ea0-b5f45a0ee11c could not be found. Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:44.877216 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:44.880983 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:44.880983 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:44.880983 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206dc040-921a-4cf9-8ea0-b5f45a0ee11c could not be found. Nov 02 14:12:44.880983 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:44.880983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8e02341d-eabc-44c1-b6af-6b82d078b0e4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 206dc040-921a-4cf9-8ea0-b5f45a0ee11c could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:44.880983 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8e02341d-eabc-44c1-b6af-6b82d078b0e4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/206dc040-921a-4cf9-8ea0-b5f45a0ee11c/action" status: 404 len: 111 microversion: 2.1 time: 0.039846 Nov 02 14:12:44.892059 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1491/4974] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:44 2022] POST /compute/v2.1/servers/206dc040-921a-4cf9-8ea0-b5f45a0ee11c/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:44.900125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:44.900738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:44.914120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:44.918332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:44.918961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:44.921304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:44.925431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:44.926068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:45.867457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:45.883637 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56670149-68c8-4321-a85a-35d1200d7854 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.985940 Nov 02 14:12:45.884257 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3484/4975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:44 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:45.910892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:45.912369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:45.927589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:45.932162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:45.932743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:45.933592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:45.934165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:45.934695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.248339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:46.257909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6759cea6-56a7-4a7c-a92a-c144f936bba2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.350933 Nov 02 14:12:46.263447 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1492/4976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:45 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:46.284184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:46.285100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:46.296306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.304417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.305190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.306145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.306830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.307506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.473057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60272824-ef7a-45fd-bd25-559aa2e74483 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.192986 Nov 02 14:12:46.473614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3485/4977] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:46 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:12:46.482191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:46.482966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:46.497030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.497862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.498520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.499506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.500742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.501380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.584412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:46.585009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:46.598671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.599559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.600368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.601237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.601849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.602420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.632802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] HTTP exception thrown: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Request method failure captured: Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 HTTP/1.1 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjt4ETorHLEp11Vn1aGw_WKk2uI39g5H32kSJ7dpp6YusDXsVcR1OvoWRbuo3CNlTktqi2Pt7DNOXg0w8U1W9oQBIRV1IyzGVnhoz_X_FGRLWwixdRe5Na5syNoW-6bwtDgWD52hjxAAuy21v3KGeZ2NhcKbI6BcbpbqKIHh0T7WXM Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4109b13b99644609bedb98d8e28c8e59"}]}] Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a01f842614b24924bcc2196332cb5f35 Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a40ffe3c-33e5-44a6-a7ff-23606f1275a7'} Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:46.644378 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.647977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.650021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Returning 404 to user: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:46.657291 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6450a87-e8b3-4cad-a6c4-de7d4a565402 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 404 len: 111 microversion: 2.1 time: 0.070938 Nov 02 14:12:46.658173 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3486/4978] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:12:46 2022] DELETE /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:12:46.666336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:46.678212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] [instance: a40ffe3c-33e5-44a6-a7ff-23606f1275a7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:46.700264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.702433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.703987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.704954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:46.705624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:46.706985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:46.754403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] HTTP exception thrown: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Request method failure captured: Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 HTTP/1.1 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnjt4ETorHLEp11Vn1aGw_WKk2uI39g5H32kSJ7dpp6YusDXsVcR1OvoWRbuo3CNlTktqi2Pt7DNOXg0w8U1W9oQBIRV1IyzGVnhoz_X_FGRLWwixdRe5Na5syNoW-6bwtDgWD52hjxAAuy21v3KGeZ2NhcKbI6BcbpbqKIHh0T7WXM Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4109b13b99644609bedb98d8e28c8e59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4109b13b99644609bedb98d8e28c8e59"}]}] Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 4109b13b99644609bedb98d8e28c8e59 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1162945557 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a01f842614b24924bcc2196332cb5f35 Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeTestJSON-1162945557-project Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a40ffe3c-33e5-44a6-a7ff-23606f1275a7'} Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:46.757044 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. Nov 02 14:12:46.760590 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:46.765102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] Returning 404 to user: Instance a40ffe3c-33e5-44a6-a7ff-23606f1275a7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:46.766591 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a313e0d5-404d-4163-a4e5-8e796a65dd60 tempest-AttachVolumeTestJSON-1162945557 tempest-AttachVolumeTestJSON-1162945557-project] 10.222.0.18 "GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7" status: 404 len: 111 microversion: 2.1 time: 0.104051 Nov 02 14:12:46.768717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3487/4979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:46 2022] GET /compute/v2.1/servers/a40ffe3c-33e5-44a6-a7ff-23606f1275a7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:12:47.171223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:47.190586 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca3e8062-e5f9-40e8-ac40-05e834577190 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1511 microversion: 2.1 time: 0.708747 Nov 02 14:12:47.191244 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1493/4980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:46 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:48.218367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:48.220850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:48.239682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:48.242374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:48.242996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:48.245116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:48.248622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:48.249821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:48.489823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:48.504274 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1e1fd34-a521-40f7-8b44-0c3f5d53106a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1491 microversion: 2.1 time: 0.290313 Nov 02 14:12:48.508217 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3488/4981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:48 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1491 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:48.555761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:48.557203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:48.581897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:48.589740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:48.593852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:48.598126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:48.598625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:48.599070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:48.720698 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'pause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state paused Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 13 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: {"pause": {}} Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'pause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state paused Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'pause': {}}} Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state paused. Cannot pause while the instance is in this state. Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state paused Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:48.739672 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:48.744476 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:48.744476 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:48.744476 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:48.744476 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state paused Nov 02 14:12:48.744476 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:48.746112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'pause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state paused {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:48.749958 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d98f2cea-10fc-4264-84f4-7d8b568bbf59 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 143 microversion: 2.1 time: 0.196503 Nov 02 14:12:48.752181 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1494/4982] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:48 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 143 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:12:48.760210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:48.760748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:48.775798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:48.776297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:48.776724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:48.777543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:48.777860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:48.788450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:49.186714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-652e8471-1808-49e2-b842-3ebe32919bf3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.428267 Nov 02 14:12:49.195031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3489/4983] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:48 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:12:49.201735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:49.203578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:49.241624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:49.247975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:49.249698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:49.254018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:49.255481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:49.258498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:49.823411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:49.849934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6dd17fda-29d8-431a-baac-08c410c3b081 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1498 microversion: 2.1 time: 0.656181 Nov 02 14:12:49.872009 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1495/4984] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:49 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1498 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:50.900408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:50.901506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:50.920996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:50.921773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:50.922424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:50.924299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:50.925583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:50.927848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:51.748392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:51.759162 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6db43f22-2ff9-49b2-8a99-96ce10c32ac1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.864633 Nov 02 14:12:51.765299 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3490/4985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:50 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:51.801081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:51.802547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:51.817294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:51.818061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:51.820254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:51.821401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:51.824994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:51.825928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:51.866444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:52.304933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:52.315743 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ed26e56-fedb-4517-90fe-75beeada67b3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.521328 Nov 02 14:12:52.321007 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1496/4986] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:51 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:52.350968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:52.354296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:52.378797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:52.379319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:52.379759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:52.380466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:52.382153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:52.382720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:52.431950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6/action HTTP/1.1 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 28 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: {"reboot": {"type": "SOFT"}} Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:52.435468 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:52.440628 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:52.442773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:52.444001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa298b4d-495d-4924-8e77-fc20a60d328d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6/action" status: 404 len: 111 microversion: 2.1 time: 0.103506 Nov 02 14:12:52.445128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3491/4987] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:52 2022] POST /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:52.455780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:52.461077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:52.472894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:52.473977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:52.474626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:52.476034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:52.476681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:52.477287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:53.334977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:53.353848 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aead8ccd-da6c-4eae-84d7-4476f17d6258 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.904539 Nov 02 14:12:53.358093 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1497/4988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:52 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:53.385461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:53.386183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:53.397243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:53.398379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:53.399964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:53.401186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:53.425152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:53.429890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:54.003868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:54.019753 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b754838-4cb9-4910-a7a9-f908a47b6e25 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.632941 Nov 02 14:12:54.020411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3492/4989] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:53 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:54.042773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a488bfe-92f8-4275-a84d-1195e12b4d47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:54.045369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8a488bfe-92f8-4275-a84d-1195e12b4d47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: cc1e3698-becd-4186-a848-efa8da5638e9] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:54.058172 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8a488bfe-92f8-4275-a84d-1195e12b4d47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance cc1e3698-becd-4186-a848-efa8da5638e9 could not be found. Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a488bfe-92f8-4275-a84d-1195e12b4d47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/cc1e3698-becd-4186-a848-efa8da5638e9/action HTTP/1.1 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 28 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: {"reboot": {"type": "SOFT"}} Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance cc1e3698-becd-4186-a848-efa8da5638e9 could not be found. Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'cc1e3698-becd-4186-a848-efa8da5638e9', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1e3698-becd-4186-a848-efa8da5638e9 could not be found. Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1e3698-becd-4186-a848-efa8da5638e9 could not be found. Nov 02 14:12:54.059951 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1e3698-becd-4186-a848-efa8da5638e9 could not be found. Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a488bfe-92f8-4275-a84d-1195e12b4d47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance cc1e3698-becd-4186-a848-efa8da5638e9 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:54.064071 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8a488bfe-92f8-4275-a84d-1195e12b4d47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/cc1e3698-becd-4186-a848-efa8da5638e9/action" status: 404 len: 111 microversion: 2.1 time: 0.024899 Nov 02 14:12:54.067785 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1498/4990] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:54 2022] POST /compute/v2.1/servers/cc1e3698-becd-4186-a848-efa8da5638e9/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:54.072272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:54.072887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:54.081100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:54.081214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:54.081590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:54.082302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:54.087775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:54.088234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:54.556138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:54.567229 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b16c455-2a4d-48d1-8f6c-98067dc1b640 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.498635 Nov 02 14:12:54.568566 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3493/4991] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:54 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:54.594895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:54.596471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:54.611346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:54.612025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:54.612403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:54.613171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:54.616777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:54.617430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:54.937428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:54.948523 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-de713fd4-562e-48b4-a67a-3ee030f3fcaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.356533 Nov 02 14:12:54.955655 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1499/4992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:54 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:54.973797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:54.977142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:54.987781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:54.988429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:54.989018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:54.989877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:54.990459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:54.991011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:55.019755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6/action HTTP/1.1 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 65 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6', 'body': {'rebuild': {'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5'}}} Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 14:12:55.027881 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:12:55.032357 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:12:55.038153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:55.039227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b93e26b1-cdb2-4207-8b84-dbfe95e928d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6/action" status: 404 len: 111 microversion: 2.1 time: 0.070278 Nov 02 14:12:55.039845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3494/4993] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:54 2022] POST /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:55.049188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:55.050245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:55.065204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:55.068737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:55.069325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:55.070178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:55.071122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:55.072597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:55.500626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:55.510295 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d1ab0570-e0e4-4b71-b61f-a5598cededa7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.465855 Nov 02 14:12:55.511689 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1500/4994] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:55 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:55.542460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:55.543461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:55.571135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:55.571823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:55.578459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:55.579638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:55.580245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:55.583349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:58.522928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:58.539297 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c2ab706-511f-4233-a77f-806aee55f76e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 3.001012 Nov 02 14:12:58.564281 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3495/4995] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:55 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 3026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:58.568299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0cae4486-3f65-4ce5-a263-cb0e0d9ac5e9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:12:58.572019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0cae4486-3f65-4ce5-a263-cb0e0d9ac5e9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: d2470f82-cc67-4585-991f-d5dbab832990] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:58.605381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:12:58.614327 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-0cae4486-3f65-4ce5-a263-cb0e0d9ac5e9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance d2470f82-cc67-4585-991f-d5dbab832990 could not be found. Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0cae4486-3f65-4ce5-a263-cb0e0d9ac5e9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/d2470f82-cc67-4585-991f-d5dbab832990/action HTTP/1.1 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 65 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance d2470f82-cc67-4585-991f-d5dbab832990 could not be found. Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'd2470f82-cc67-4585-991f-d5dbab832990', 'body': {'rebuild': {'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5'}}} Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2470f82-cc67-4585-991f-d5dbab832990 could not be found. Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 14:12:58.619031 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2470f82-cc67-4585-991f-d5dbab832990 could not be found. Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2470f82-cc67-4585-991f-d5dbab832990 could not be found. Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:12:58.626087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0cae4486-3f65-4ce5-a263-cb0e0d9ac5e9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance d2470f82-cc67-4585-991f-d5dbab832990 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:12:58.627994 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0cae4486-3f65-4ce5-a263-cb0e0d9ac5e9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/d2470f82-cc67-4585-991f-d5dbab832990/action" status: 404 len: 111 microversion: 2.1 time: 0.063698 Nov 02 14:12:58.631575 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1501/4996] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:12:58 2022] POST /compute/v2.1/servers/d2470f82-cc67-4585-991f-d5dbab832990/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:12:58.640282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:58.642182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:58.660812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:58.663512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:58.665538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:58.666523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:58.666998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:58.670552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:59.664575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:12:59.682087 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2a111dfe-8ad6-498a-a0b5-0e1fcfc36bfb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.045194 Nov 02 14:12:59.683742 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3496/4997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:58 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:12:59.711980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:12:59.712646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:12:59.735541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:59.736319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:59.737538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:12:59.747313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:12:59.748204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:12:59.749836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:00.452990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:00.465584 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4debc610-d12d-4304-81de-abd5564dc429 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.758383 Nov 02 14:13:00.471384 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1502/4998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:12:59 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:00.493931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b43585fb-033a-4037-a8cd-07917b1ef571 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:00.494467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b43585fb-033a-4037-a8cd-07917b1ef571 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 97089e59-aa3f-4bef-bcd3-16f59701eab7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:00.508401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b43585fb-033a-4037-a8cd-07917b1ef571 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 97089e59-aa3f-4bef-bcd3-16f59701eab7 could not be found. Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b43585fb-033a-4037-a8cd-07917b1ef571 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/97089e59-aa3f-4bef-bcd3-16f59701eab7/action HTTP/1.1 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 15 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: {"restore": {}} Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 97089e59-aa3f-4bef-bcd3-16f59701eab7 could not be found. Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '97089e59-aa3f-4bef-bcd3-16f59701eab7', 'body': {'restore': {}}} Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97089e59-aa3f-4bef-bcd3-16f59701eab7 could not be found. Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97089e59-aa3f-4bef-bcd3-16f59701eab7 could not be found. Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:00.516679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:00.521456 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:13:00.521456 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:13:00.521456 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97089e59-aa3f-4bef-bcd3-16f59701eab7 could not be found. Nov 02 14:13:00.521456 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:00.525879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b43585fb-033a-4037-a8cd-07917b1ef571 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 97089e59-aa3f-4bef-bcd3-16f59701eab7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:13:00.526933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b43585fb-033a-4037-a8cd-07917b1ef571 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/97089e59-aa3f-4bef-bcd3-16f59701eab7/action" status: 404 len: 111 microversion: 2.1 time: 0.038494 Nov 02 14:13:00.529169 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3497/4999] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:13:00 2022] POST /compute/v2.1/servers/97089e59-aa3f-4bef-bcd3-16f59701eab7/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:13:00.537950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:00.538553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:00.549950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:00.551680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:00.552450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:00.563873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:00.564600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:00.565297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:01.561001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:01.581368 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9bdbfac7-0ce9-43b6-8f8f-437485c7964d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.047518 Nov 02 14:13:01.584188 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1503/5000] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:00 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:01.618831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:01.622024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:01.672416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:01.676051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:01.676700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:01.680132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:01.680763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:01.681417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:01.692040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.603516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:02.621773 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c785252-db2f-475c-badf-b36de9ca3eaa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.012649 Nov 02 14:13:02.624326 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3498/5001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:01 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:02.649230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:02.649773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:02.683689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:02.684719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:02.691813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:02.692906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:02.693855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:02.694817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:02.772374 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'restore' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 15 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: {"restore": {}} Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'restore' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'restore': {}}} Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state active. Cannot restore while the instance is in this state. Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:02.785539 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:02.790616 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:02.790616 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:13:02.790616 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:13:02.790616 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:02.790616 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:02.792078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'restore' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:13:02.793367 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76d7876e-3fcb-435f-8901-a9df31cc0733 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 145 microversion: 2.1 time: 0.148328 Nov 02 14:13:02.794455 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1504/5002] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:13:02 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 145 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:13:02.804395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:02.805387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:02.812024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=60 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:02.824892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:02.825381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:02.825820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:02.826520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:02.839773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:02.840345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:03.961678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:03.980092 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fcdfca9-45b1-48fe-897c-1875b17eb273 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.181399 Nov 02 14:13:03.991623 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3499/5003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:02 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:04.009648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:04.010183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:04.028684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:04.029190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:04.035163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:04.039972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:04.040526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:04.040974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:04.555868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:04.569374 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-243274f6-1d67-4805-a211-a2c4dc49fff9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.566552 Nov 02 14:13:04.570321 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1505/5004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:04 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:04.592638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-996b3be2-115a-4f1a-be4b-a8b5d3486f8a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:04.593593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-996b3be2-115a-4f1a-be4b-a8b5d3486f8a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: ea1be4a4-56c6-45fa-8849-caeabb8c4560] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:04.601424 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-996b3be2-115a-4f1a-be4b-a8b5d3486f8a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance ea1be4a4-56c6-45fa-8849-caeabb8c4560 could not be found. Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-996b3be2-115a-4f1a-be4b-a8b5d3486f8a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/ea1be4a4-56c6-45fa-8849-caeabb8c4560/action HTTP/1.1 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 14 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: {"resume": {}} Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance ea1be4a4-56c6-45fa-8849-caeabb8c4560 could not be found. Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'ea1be4a4-56c6-45fa-8849-caeabb8c4560', 'body': {'resume': {}}} Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1be4a4-56c6-45fa-8849-caeabb8c4560 could not be found. Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1be4a4-56c6-45fa-8849-caeabb8c4560 could not be found. Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:04.621002 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1be4a4-56c6-45fa-8849-caeabb8c4560 could not be found. Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-996b3be2-115a-4f1a-be4b-a8b5d3486f8a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance ea1be4a4-56c6-45fa-8849-caeabb8c4560 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-996b3be2-115a-4f1a-be4b-a8b5d3486f8a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/ea1be4a4-56c6-45fa-8849-caeabb8c4560/action" status: 404 len: 111 microversion: 2.1 time: 0.034289 Nov 02 14:13:04.629036 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3500/5005] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:13:04 2022] POST /compute/v2.1/servers/ea1be4a4-56c6-45fa-8849-caeabb8c4560/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:13:04.634712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:04.635529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:04.655127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:04.655775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:04.656326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:04.657175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:04.657846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:04.658692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:05.764361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:05.779082 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56944bc5-f110-4ae9-b28a-94271696641d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.147783 Nov 02 14:13:05.784302 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1506/5006] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:04 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:05.808604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:05.809235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:05.823366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:05.823862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:05.824298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:05.831004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:05.840914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:05.860793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:06.772667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:06.780945 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e78f5ce3-0558-42cf-a0bf-13c6ab36a9dc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.976082 Nov 02 14:13:06.798821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3501/5007] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:05 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:06.807132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:06.807756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:06.821419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:06.824831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:06.825301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:06.826297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:06.826755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:06.827204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:06.883693 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'resume' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 14 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: {"resume": {}} Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'resume' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'resume': {}}} Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state active. Cannot resume while the instance is in this state. Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:06.895385 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:13:06.899238 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:06.901458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'resume' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:13:06.902782 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ba6c6f60-eefc-4f41-877a-c66d05f810c0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 144 microversion: 2.1 time: 0.101604 Nov 02 14:13:06.903990 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1507/5008] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:13:06 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 144 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:13:06.914385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:06.915945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:06.931959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:06.934804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:06.935484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:06.936401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:06.939304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:06.940450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:07.989937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:08.016049 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5275d741-9265-436d-bbf2-44d0cbfbb784 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.106205 Nov 02 14:13:08.016576 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3502/5009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:06 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:08.044506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:08.045148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:08.073136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:08.073636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:08.074313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:08.075233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:08.075893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:08.081022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:08.957271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:08.968987 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1393be82-f042-4dbc-ba5e-8c7fcd54389b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.928836 Nov 02 14:13:08.984743 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1508/5010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:08 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:09.252929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24706577-20bc-4eaa-80e5-e69333e20515 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24706577-20bc-4eaa-80e5-e69333e20515 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 160 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "8a7da38e-e895-4f80-8321-8e988c87645c"}]}} Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'body': {'server': {'name': '', 'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5', 'flavorRef': '452', 'networks': [{'uuid': '8a7da38e-e895-4f80-8321-8e988c87645c'}]}}} Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:13:09.257430 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-24706577-20bc-4eaa-80e5-e69333e20515 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:13:09.262448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-24706577-20bc-4eaa-80e5-e69333e20515 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.011007 Nov 02 14:13:09.263752 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3503/5011] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:13:09 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:13:09.281664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:09.282473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:09.294996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:09.300371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:09.301540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:09.302509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:09.303181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:09.304827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:11.160532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:11.174701 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4f4fe85f-584d-4fef-b9b1-97e8aea2e3da tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.899578 Nov 02 14:13:11.175600 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1509/5012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:09 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:11.208988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:11.209684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:11.239713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:11.246391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:11.246857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:11.247663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:11.248126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:11.248555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:12.416700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:12.435753 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c35d41e-705a-40e5-b0f3-fd47c4e13155 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 1.235004 Nov 02 14:13:12.442696 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3504/5013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:11 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:12.466678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e98948e-0010-480d-853b-786957a490c4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:12.468474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e98948e-0010-480d-853b-786957a490c4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:12.487373 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-6e98948e-0010-480d-853b-786957a490c4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e could not be found. Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e98948e-0010-480d-853b-786957a490c4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e/action HTTP/1.1 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 14 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: {"shelve": {}} Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e could not be found. Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e', 'body': {'shelve': {}}} Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e could not be found. Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e could not be found. Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:13:12.497283 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:13:12.501571 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:13:12.501571 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:13:12.501571 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e could not be found. Nov 02 14:13:12.501571 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:13:12.506825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e98948e-0010-480d-853b-786957a490c4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:13:12.510071 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e98948e-0010-480d-853b-786957a490c4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e/action" status: 404 len: 111 microversion: 2.1 time: 0.049626 Nov 02 14:13:12.515277 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1510/5014] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:13:12 2022] POST /compute/v2.1/servers/bf3f46e3-ff66-4a5f-bea3-e86dd76d0a1e/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:13:12.525508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:12.526125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:12.534269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:12.534749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:12.535196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:12.549082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:12.549808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:12.550399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:13.077012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:13.092833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41e83a1b-a377-4a91-9649-b193c639bf3b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.571515 Nov 02 14:13:13.098264 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3505/5015] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:12 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:13.129576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:13.131881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:13.145803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:13.147029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:13.148564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:13.149808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:13.152153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:13.153865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:13.863755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:13.879341 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-91eea346-8466-443b-8ab3-dca86525ddfc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.757102 Nov 02 14:13:13.880262 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1511/5016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:13 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:13.905375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:13.905907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:13.916209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:13.916708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:13.917150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:13.917860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:13.918339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:13.918739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:14.003268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lazy-loading 'flavor' on Instance uuid 511d5964-e104-402a-969a-be2812c93bdf {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:13:14.404448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2309eb67-0e49-47aa-a665-ce446dab0d3c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.502771 Nov 02 14:13:14.405321 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3506/5017] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:13:13 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:13:14.421348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:14.421959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:14.442601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:14.445887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:14.459223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:14.460962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:14.461672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:14.462358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:14.859798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:14.871982 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b27bed15-c4ee-44c8-a605-52079ff41f03 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.461540 Nov 02 14:13:14.879916 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1512/5018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:14 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:15.907030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:15.907756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:15.938245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:15.938806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:15.948066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:15.949034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:15.950227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:15.950857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:16.271972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:16.285758 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34f2659c-efdc-4bc7-8ac7-55bf3207d0c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.382894 Nov 02 14:13:16.288768 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3507/5019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:15 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:17.324519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:17.326058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:17.349928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:17.350372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:17.351298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:17.352598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:17.353242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:17.353838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:18.118093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:18.138852 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-111d810d-1ced-40f3-9a18-7973a5db1b09 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.827658 Nov 02 14:13:18.153317 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1513/5020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:17 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:19.162391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:19.165079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:19.187611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:19.190993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:19.192808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:19.197188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:19.200070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:19.200836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:19.774182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:19.787123 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e1df230-1be8-4223-b866-b578dd8f3ff3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.628523 Nov 02 14:13:19.789251 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3508/5021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:19 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:20.809683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:20.811310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:20.823941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:20.824692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:20.825278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:20.835026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:20.835755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:20.836346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:21.320858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:21.332437 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-97153e0f-24cf-4726-9097-5d9304abeb6c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.526553 Nov 02 14:13:21.333577 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1514/5022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:20 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:22.358376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:22.358993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:22.376101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:22.379044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:22.379616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:22.380989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:22.386101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:22.386660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:22.934708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:22.952923 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffd952d9-28a3-4eb8-8b6e-19515117cacb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.591593 Nov 02 14:13:22.976673 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3509/5023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:22 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:23.992067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:23.992726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:23.994888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-950927446", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:24.009086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:24.013934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:24.014190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:24.014943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:24.023816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:24.024366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:24.111445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] validate_networks() for [('be96af4e-8690-437e-81b3-93b36670d1eb', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:13:25.001001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:25.038288 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-209be680-2fa7-4a6e-a3c9-eb3c55d15a5c tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 1.049150 Nov 02 14:13:25.044278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3510/5024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:23 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:26.065495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:26.066138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:26.094375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:26.094862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:26.100116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:26.101114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:26.103303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:26.107192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:26.903691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:26.916101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7c2edd2-2385-4a4b-83a9-7a7013ff7b24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1533 microversion: 2.1 time: 0.855229 Nov 02 14:13:26.940081 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3511/5025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:26 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1533 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:27.152338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:13:27.153398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:13:27.154047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:13:27.154719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:13:27.155321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:13:27.166871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:27.167638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:27.168223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:27.169330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:27.169948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:27.170544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:27.177539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=90 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:27.208690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for project eed37e20191b4a5e817442412da9dca3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:13:27.225363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for user 3d487891f8d84282ae11f28a2db2b230 and project eed37e20191b4a5e817442412da9dca3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:13:27.259737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:13:27.263534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:13:27.291575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2006716971", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ae05636d-1b2f-452e-bbeb-2550b7c26e0e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:27.462424 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-695b40fd-8780-4181-9a9a-3847ef1456ce tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.796235 Nov 02 14:13:27.476970 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1515/5026] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:13:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:13:27.487688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c1077f66-706e-4973-b650-8f3239ac83fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:27.488775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c1077f66-706e-4973-b650-8f3239ac83fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:27.630480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:13:27.665061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c1077f66-706e-4973-b650-8f3239ac83fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:27.684179 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c1077f66-706e-4973-b650-8f3239ac83fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1221 microversion: 2.1 time: 0.204017 Nov 02 14:13:27.708406 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1516/5027] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:27 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:27.945569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:27.947742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:27.969719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:27.971737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:27.972442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:27.974950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:27.978305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:27.978980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:28.617857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:28.626988 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5e27d50d-02f1-476b-af0c-ed1cfd0a75c2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.685361 Nov 02 14:13:28.631714 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1517/5028] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:27 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:28.657255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-832685518", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:28.845606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] validate_networks() for [('be96af4e-8690-437e-81b3-93b36670d1eb', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:13:29.192662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:13:29.193152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:13:29.193549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:13:29.193964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:13:29.194382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:13:29.221396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:29.226845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:29.227580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:29.228580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:29.230298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:29.231065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:29.312183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:13:29.327031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:13:29.434071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:13:29.439474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ae05636d-1b2f-452e-bbeb-2550b7c26e0e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:13:29.653654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1625e5a7-bfe9-44dd-8a4a-74c12d2d8aa3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.363095 Nov 02 14:13:29.657120 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3512/5029] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:13:29.672927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:29.675812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:29.692621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:29.696481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:29.697241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:29.698361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:29.700910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:29.702208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:30.537589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:30.553188 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2090078-2821-46b1-962d-3b8edd710a6b tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.891769 Nov 02 14:13:30.558499 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3513/5030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:29 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:30.576185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f34bceaa-a1f0-45c4-8e60-bc81d936c212 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:30.578995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f34bceaa-a1f0-45c4-8e60-bc81d936c212 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:30.885195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:13:30.885781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:13:30.886076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:13:30.886486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:13:30.886895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:13:30.889471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:30.931139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:30.932325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:30.932800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:30.935814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:30.937178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:30.940223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:30.974661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f34bceaa-a1f0-45c4-8e60-bc81d936c212 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:30.984105 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f34bceaa-a1f0-45c4-8e60-bc81d936c212 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1057 microversion: 2.1 time: 0.423547 Nov 02 14:13:30.988238 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3514/5031] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:30 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1057 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:31.000566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for project eed37e20191b4a5e817442412da9dca3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:13:31.013452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for user 3d487891f8d84282ae11f28a2db2b230 and project eed37e20191b4a5e817442412da9dca3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:13:31.048239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:13:31.058976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:13:31.198581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3de0c3ec-ee62-46a5-934e-0fc44edd6940 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.561676 Nov 02 14:13:31.200065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1518/5032] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:13:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:13:31.212693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e03282f-2343-4592-9dfa-50bf724f4153 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:31.213494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e03282f-2343-4592-9dfa-50bf724f4153 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:31.465059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e03282f-2343-4592-9dfa-50bf724f4153 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:31.476563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e03282f-2343-4592-9dfa-50bf724f4153 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1221 microversion: 2.1 time: 0.265094 Nov 02 14:13:31.480618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3515/5033] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:31 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:31.603663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:31.605263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:31.622318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:31.623660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:31.626004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:31.628879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:31.634404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:31.634404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:32.024023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:32.030454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:32.039370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:32.040431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:32.041110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:32.042110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:32.042815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:32.043511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:32.046997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:32.153785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:32.166103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cc5095f-ab37-4664-8e82-48636bc44c2f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1109 microversion: 2.1 time: 0.151240 Nov 02 14:13:32.172781 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3516/5034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:32 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1109 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:32.252150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:32.264714 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c8a0da0-e017-48c6-b324-757998f5bb8f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.684250 Nov 02 14:13:32.283868 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1519/5035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:31 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:32.506003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-774c7643-789b-4e87-95c8-ea0a43404678 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:32.506898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-774c7643-789b-4e87-95c8-ea0a43404678 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:32.635928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-774c7643-789b-4e87-95c8-ea0a43404678 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:32.650500 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-774c7643-789b-4e87-95c8-ea0a43404678 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1221 microversion: 2.1 time: 0.145649 Nov 02 14:13:32.652470 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1520/5036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:32 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:33.028981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0023392d-79e7-4aaa-9efb-0864f115b4bc req-a2abf064-488c-4e90-85b5-70e2e182b690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5964-e104-402a-969a-be2812c93bdf", "name": "network-vif-plugged", "status": "completed", "tag": "6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:33.043810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:33.050701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0023392d-79e7-4aaa-9efb-0864f115b4bc req-a2abf064-488c-4e90-85b5-70e2e182b690 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.051528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0023392d-79e7-4aaa-9efb-0864f115b4bc req-a2abf064-488c-4e90-85b5-70e2e182b690 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.052475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0023392d-79e7-4aaa-9efb-0864f115b4bc req-a2abf064-488c-4e90-85b5-70e2e182b690 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.082608 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0023392d-79e7-4aaa-9efb-0864f115b4bc req-a2abf064-488c-4e90-85b5-70e2e182b690 service nova] Creating event network-vif-plugged:6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e for instance 511d5964-e104-402a-969a-be2812c93bdf on n-h1-858238-3 Nov 02 14:13:33.096490 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0023392d-79e7-4aaa-9efb-0864f115b4bc req-a2abf064-488c-4e90-85b5-70e2e182b690 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.666394 Nov 02 14:13:33.097335 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3517/5037] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:33.195021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:33.197310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:33.227525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.228405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.229109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.230142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.231852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.232974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.296220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:33.297155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:33.316416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.320687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.322867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.324731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.325208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.325648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.387512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:33.399477 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ed1e42b-9389-4a9c-8aae-98133ec1d0c8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1127 microversion: 2.1 time: 0.208139 Nov 02 14:13:33.401231 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1521/5038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:33 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1127 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:33.681292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:33.682151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:33.695672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.696722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.698084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.699445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.700284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.700995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.873404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:33.911221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02f1ab29-2278-4c5d-bbb6-4811c35eab5d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.601647 Nov 02 14:13:33.914572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3518/5039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:33 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:34.039792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:34.083287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-02669edd-22df-4443-ba17-ae416a726a4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1273 microversion: 2.1 time: 0.388430 Nov 02 14:13:34.087494 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1522/5040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:33 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1273 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:34.424301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:34.425031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:34.440817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:34.441323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:34.441769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:34.442491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:34.442960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:34.445848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:34.665469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:34.677314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-840c1a92-2ed9-4169-8bad-fe774b38f173 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1127 microversion: 2.1 time: 0.256834 Nov 02 14:13:34.679114 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3519/5041] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:34 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1127 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:34.948525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:34.952342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:34.973527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:34.974315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:34.974918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:34.976144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:34.978868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:34.979552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:35.112043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:35.113656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:35.138421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:35.139175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:35.139847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:35.140888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:35.141803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:35.142977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:35.294962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:35.312943 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f86736f4-c2fa-464f-8fcc-fe17b65acf53 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1279 microversion: 2.1 time: 0.205036 Nov 02 14:13:35.314373 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3520/5042] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:35 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:35.705379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:35.706996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:35.734674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:35.735229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:35.740638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:35.741446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:35.750860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:35.751392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:35.782367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:35.806101 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f44e748e-85e7-4eb4-a94f-cbb99a0382d3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.871009 Nov 02 14:13:35.811381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1523/5043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:34 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:36.024254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:36.038670 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9db4272-5795-4378-ae4c-536a2bb43409 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1127 microversion: 2.1 time: 0.334137 Nov 02 14:13:36.040064 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3521/5044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:35 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1127 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:36.340767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:36.341572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:36.357485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:36.365057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:36.366022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:36.369817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:36.373595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:36.376406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:36.723351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:36.739722 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6da01312-ac04-4665-9c54-ba49cfa75f5f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1279 microversion: 2.1 time: 0.402943 Nov 02 14:13:36.744015 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1524/5045] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:36 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1279 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:36.849313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:36.851513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:36.873221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:36.875792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:36.877099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:36.879432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:36.881434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:36.882029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:37.068954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:37.069629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:37.101365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:37.102124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:37.102713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:37.103700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:37.104308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:37.104892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:37.636643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:37.661538 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c78b4e86-998d-4fe2-9c9a-8c840cf2b8ba tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1127 microversion: 2.1 time: 0.597482 Nov 02 14:13:37.668518 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1525/5046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:37 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1127 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:37.767716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:37.768855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:37.787524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:37.789263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:37.789716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:37.790449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:37.801651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:37.802174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:37.961764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:37.971234 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-048aa281-5129-4f59-a919-0cb07cdd6aac tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 1.135933 Nov 02 14:13:37.971833 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3522/5047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:36 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:38.397233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:38.415605 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1a78567e-c71d-457d-b08b-4d95e50f3c91 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1279 microversion: 2.1 time: 0.649222 Nov 02 14:13:38.435669 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1526/5048] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:37 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1279 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:38.696452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:38.697101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:38.710246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:38.714434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:38.714897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:38.715790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:38.716374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:38.716808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:39.002213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:39.003622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:39.034072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:39.036959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:39.039568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:39.041927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:39.043958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:39.047056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:39.270558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:40.958721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:40.970008 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e77cf09-ec48-4103-954c-8117dbe1545d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 1.971984 Nov 02 14:13:40.972625 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1527/5049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:38 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:40.981905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:40.988377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:41.002895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:41.010270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:41.014179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:41.015001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:41.016285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:41.016911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:41.017504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:41.029494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:41.048715 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83acd5e3-9713-45bb-b653-2ef4d9b68b5e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 2.351313 Nov 02 14:13:41.052195 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3523/5050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:38 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 2365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:41.998408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:41.999015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:42.018841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.022911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:42.023415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:42.023855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:42.024563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:42.025014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:42.025441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:42.458263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:42.466957 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5216cfea-0c9e-434c-9c96-df18a996c16b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 1.493014 Nov 02 14:13:42.467585 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1528/5051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:40 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:42.486214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:42.487118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:42.495571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:42.503655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:42.504605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:42.505517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:42.511344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:42.513265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:42.661162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=16 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:42.676701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:42.693445 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ef9226d-dbe9-4b75-a1ea-dfbb7951ae06 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.699280 Nov 02 14:13:42.694049 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3524/5052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:41 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:43.493823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:43.495107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:43.512706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:43.515753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:43.520041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:43.521040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:43.525285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:43.526084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:43.701216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:43.713530 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-842e33c4-bacf-4511-8ac5-12f5b1633a8b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 1.244879 Nov 02 14:13:43.721932 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1529/5053] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:42 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:43.729885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:43.740190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:43.763731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:43.764485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:43.765204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:43.766145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:43.767011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:43.772443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:44.358751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:44.400003 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-27dc441c-981e-49ab-b258-44f55cba4052 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.674722 Nov 02 14:13:44.400612 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1530/5054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:43 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:45.215232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:45.238050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3d7b331-9147-4c31-98ea-b5ebb84e4df2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 1.747828 Nov 02 14:13:45.245376 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3525/5055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:43 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:45.268387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:45.272467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:45.308892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:45.309400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:45.310033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:45.310955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:45.311651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:45.312261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:45.457526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1d8c0dbd-409f-4150-9862-eb52b1bc52bd req-df18d4e9-0135-4b44-a3ba-72df766c1ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1a31dc-9106-4288-ae94-5a4a8eab8d4d", "tag": "99d7c39d-d198-4bcc-83bb-a6cc4e1b0c16"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:45.492096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1d8c0dbd-409f-4150-9862-eb52b1bc52bd req-df18d4e9-0135-4b44-a3ba-72df766c1ab6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:45.495592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1d8c0dbd-409f-4150-9862-eb52b1bc52bd req-df18d4e9-0135-4b44-a3ba-72df766c1ab6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:45.502203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1d8c0dbd-409f-4150-9862-eb52b1bc52bd req-df18d4e9-0135-4b44-a3ba-72df766c1ab6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:45.548735 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1d8c0dbd-409f-4150-9862-eb52b1bc52bd req-df18d4e9-0135-4b44-a3ba-72df766c1ab6 service nova] Creating event network-changed:99d7c39d-d198-4bcc-83bb-a6cc4e1b0c16 for instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d on n-h2-858238-3 Nov 02 14:13:45.574205 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1d8c0dbd-409f-4150-9862-eb52b1bc52bd req-df18d4e9-0135-4b44-a3ba-72df766c1ab6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.166762 Nov 02 14:13:45.579975 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1531/5056] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:46.094601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-09ae2f22-5602-4f35-9339-2e63073a4026 req-1a9b011b-6b9b-43c5-885a-f6e692677024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900f3f98-e247-421a-a02b-ec33d49dc48b", "tag": "c49418a5-9b23-42b7-92ff-e37034c0b032"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:46.148296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:46.157058 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-933d8e5c-c75e-4f54-93db-713de4513f3e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.910357 Nov 02 14:13:46.166778 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3526/5057] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:45 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:46.176104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:46.177462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-09ae2f22-5602-4f35-9339-2e63073a4026 req-1a9b011b-6b9b-43c5-885a-f6e692677024 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:46.183968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:46.199676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-09ae2f22-5602-4f35-9339-2e63073a4026 req-1a9b011b-6b9b-43c5-885a-f6e692677024 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:46.200738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-09ae2f22-5602-4f35-9339-2e63073a4026 req-1a9b011b-6b9b-43c5-885a-f6e692677024 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:46.238492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:46.254366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:46.255200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:46.256517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:46.259588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:46.261629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:46.310731 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-09ae2f22-5602-4f35-9339-2e63073a4026 req-1a9b011b-6b9b-43c5-885a-f6e692677024 service nova] Creating event network-changed:c49418a5-9b23-42b7-92ff-e37034c0b032 for instance 900f3f98-e247-421a-a02b-ec33d49dc48b on n-h1-858238-3 Nov 02 14:13:46.363788 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-09ae2f22-5602-4f35-9339-2e63073a4026 req-1a9b011b-6b9b-43c5-885a-f6e692677024 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.773463 Nov 02 14:13:46.365184 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1532/5058] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:46.423083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:46.425810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:46.455960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:46.462896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:46.467848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:46.472522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:46.474528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:46.479311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:47.852262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:47.867471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2088f0c5-01d3-4aa3-a552-11bff2f14771 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 1.689796 Nov 02 14:13:47.870131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3527/5059] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:46 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:47.907638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:47.914141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:47.959443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:47.962483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:47.969861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:47.973594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:47.979589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:47.981434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:48.304098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:48.312332 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c9e24774-d9bf-4ab1-b54f-a6237e1f0d01 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 1.939460 Nov 02 14:13:48.319937 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1533/5060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:46 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:48.358725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e231e05f-7e32-4335-b0d6-bc74eaa7aaa3 req-168bd207-3882-4d20-8b56-cf6f4262c986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b5115b-c190-464a-977e-d9d6a4e47326", "tag": "de3bdd9b-420b-4215-8f42-88b66921746a"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:48.452018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e231e05f-7e32-4335-b0d6-bc74eaa7aaa3 req-168bd207-3882-4d20-8b56-cf6f4262c986 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:48.453640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e231e05f-7e32-4335-b0d6-bc74eaa7aaa3 req-168bd207-3882-4d20-8b56-cf6f4262c986 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:48.454349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e231e05f-7e32-4335-b0d6-bc74eaa7aaa3 req-168bd207-3882-4d20-8b56-cf6f4262c986 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:48.554243 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e231e05f-7e32-4335-b0d6-bc74eaa7aaa3 req-168bd207-3882-4d20-8b56-cf6f4262c986 service nova] Creating event network-changed:de3bdd9b-420b-4215-8f42-88b66921746a for instance 03b5115b-c190-464a-977e-d9d6a4e47326 on n-h2-858238-3 Nov 02 14:13:48.592098 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e231e05f-7e32-4335-b0d6-bc74eaa7aaa3 req-168bd207-3882-4d20-8b56-cf6f4262c986 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266410 Nov 02 14:13:48.599585 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1534/5061] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:48.905857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:48.907176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:48.984891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:48.987227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:48.988053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:48.992882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:48.993682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:48.998641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:49.510100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:49.522305 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ab12e4e-a1c5-43b2-a534-8219c03bf8e7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 1.646795 Nov 02 14:13:49.534382 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3528/5062] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:47 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:49.565892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:49.566532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:49.599587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:49.600091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:49.600531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:49.601287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:49.601686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:49.618154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:51.563751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:51.595425 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fdcf0a48-bc5c-47a1-afb2-94fd456da6a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 2.699791 Nov 02 14:13:51.596844 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1535/5063] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:48 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 2705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:51.606376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:51.607203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:51.615524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:51.616251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:51.617064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:51.618140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:51.618754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:51.619359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:53.290399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:53.312108 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e400849-3b1f-4378-912c-ab6acde6b73f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 3.776358 Nov 02 14:13:53.315506 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3529/5064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:49 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 3780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:53.358320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:53.363492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:53.400398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:53.400899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:53.407816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:53.412733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:53.416862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:53.417538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:53.705652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:53.714305 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38ce430e-0bcf-4587-9d17-3fe53f905368 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 2.113116 Nov 02 14:13:53.718587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1536/5065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:51 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:54.342594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:54.343266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:54.358578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:54.359380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:54.360039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:54.362164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:54.363303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:54.364606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:54.429816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:55.431728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:55.449527 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34c40172-36e3-4acd-9972-e2fb34780afc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 2.131762 Nov 02 14:13:55.450673 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3530/5066] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:53 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:55.456966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:55.457891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:55.467201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:55.467945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:55.468616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:55.470596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:55.472579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:55.473496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:55.996954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:56.004876 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f6b871e7-e65e-4bb8-8e26-319167b97a49 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 1.669051 Nov 02 14:13:56.031514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1537/5067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:54 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:56.283313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:56.293404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93e174b9-9625-4ef7-8601-ddde149b70c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.841014 Nov 02 14:13:56.303753 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3531/5068] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:55 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:56.485121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:56.487798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:56.511843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:56.513536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:56.513536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:56.513890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:56.514044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:56.514480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:57.033919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:57.035356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:57.049922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:57.053821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:57.055641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:57.056651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:57.059418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:57.062809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:57.503129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:57.514766 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d330d201-c19c-4ed8-a2bb-709e331567e2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 1.038089 Nov 02 14:13:57.518266 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1538/5069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:56 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:57.523184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:57.527578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:57.540165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:57.540659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:57.541094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:57.541839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:57.542251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:57.542676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:58.168265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:58.188985 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08bed927-ede0-419b-9b02-5e4c9b0ad074 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 1.158389 Nov 02 14:13:58.191170 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3532/5070] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:57 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:58.213184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-fc98292f-3197-466e-abe0-5b92024c6b21 req-dd30be97-cb1f-4048-9e14-89b4cadd6dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1a31dc-9106-4288-ae94-5a4a8eab8d4d", "name": "network-vif-plugged", "status": "completed", "tag": "99d7c39d-d198-4bcc-83bb-a6cc4e1b0c16"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:58.240082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc98292f-3197-466e-abe0-5b92024c6b21 req-dd30be97-cb1f-4048-9e14-89b4cadd6dbd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:58.246148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc98292f-3197-466e-abe0-5b92024c6b21 req-dd30be97-cb1f-4048-9e14-89b4cadd6dbd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:58.251788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc98292f-3197-466e-abe0-5b92024c6b21 req-dd30be97-cb1f-4048-9e14-89b4cadd6dbd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:58.300015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fc98292f-3197-466e-abe0-5b92024c6b21 req-dd30be97-cb1f-4048-9e14-89b4cadd6dbd service nova] Creating event network-vif-plugged:99d7c39d-d198-4bcc-83bb-a6cc4e1b0c16 for instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d on n-h2-858238-3 Nov 02 14:13:58.315759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-fc98292f-3197-466e-abe0-5b92024c6b21 req-dd30be97-cb1f-4048-9e14-89b4cadd6dbd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120669 Nov 02 14:13:58.339188 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3533/5071] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:58.496058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:58.508081 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3912ea54-57ac-4641-8347-710d96beae3f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.988694 Nov 02 14:13:58.516931 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1539/5072] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:57 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:58.544681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:58.545280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:58.560881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:58.563879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:58.568954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:58.570293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:58.579898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:58.581092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:58.622846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:59.074160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:59.084021 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fe62d2f-d1da-4f51-88b5-da11477839a1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.543772 Nov 02 14:13:59.088225 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3534/5073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:58 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:59.227559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:59.228927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:59.273142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:59.275295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:59.279454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:59.282411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:59.284001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:59.284621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:59.544055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:59.550658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:59.567792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:59.568847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:59.574242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:59.576882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:59.577673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:59.578362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:00.284377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:00.299454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0257154-7d97-4c8f-ade7-03c7580257a7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.759328 Nov 02 14:14:00.306983 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3535/5074] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:59 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:00.357072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:00.358090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:00.378331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:00.379135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:00.383749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:00.384775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:00.385416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:00.386007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:00.877554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:00.887612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3724c78b-4312-4be2-a0da-3a7d92d32083 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 1.669022 Nov 02 14:14:00.908545 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1540/5075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:13:59 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:00.935185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:00.941141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-39e648ce-5218-48c7-9f1c-96821d8e59bd req-a6e29ea6-e0be-48a1-9dbb-e8be851e1d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900f3f98-e247-421a-a02b-ec33d49dc48b", "name": "network-vif-plugged", "status": "completed", "tag": "c49418a5-9b23-42b7-92ff-e37034c0b032"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:00.949078 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44d61088-6dee-47b6-8152-8fa6a55a5d24 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.640261 Nov 02 14:14:00.955712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3536/5076] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:00 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:00.980363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:01.012364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-39e648ce-5218-48c7-9f1c-96821d8e59bd req-a6e29ea6-e0be-48a1-9dbb-e8be851e1d7d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:01.012898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-39e648ce-5218-48c7-9f1c-96821d8e59bd req-a6e29ea6-e0be-48a1-9dbb-e8be851e1d7d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:01.013511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-39e648ce-5218-48c7-9f1c-96821d8e59bd req-a6e29ea6-e0be-48a1-9dbb-e8be851e1d7d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:01.049973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-39e648ce-5218-48c7-9f1c-96821d8e59bd req-a6e29ea6-e0be-48a1-9dbb-e8be851e1d7d service nova] Creating event network-vif-plugged:c49418a5-9b23-42b7-92ff-e37034c0b032 for instance 900f3f98-e247-421a-a02b-ec33d49dc48b on n-h1-858238-3 Nov 02 14:14:01.059972 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-39e648ce-5218-48c7-9f1c-96821d8e59bd req-a6e29ea6-e0be-48a1-9dbb-e8be851e1d7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150048 Nov 02 14:14:01.068345 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1541/5077] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:14:01.329589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:01.330661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:01.346481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:01.357451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:01.357907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:01.359241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:01.359712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:01.383654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:01.912767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:01.913485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:01.935431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:01.938898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:01.941078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:01.945179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:01.946357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:01.947677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:02.457012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:02.469915 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3aeceaac-75ee-436e-8375-28eb645354d6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 1.143453 Nov 02 14:14:02.478661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3537/5078] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:01 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:02.484631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:02.485831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:02.532671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:02.548477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:02.548934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:02.549684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:02.559983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:02.560546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:02.721120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:02.736385 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6150bd59-a15d-4f20-ae55-bd550d85c04d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1321 microversion: 2.1 time: 0.828010 Nov 02 14:14:02.739813 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1542/5079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:01 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:03.072499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:03.084568 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f2fb570-0c5b-4523-b46a-5c94613ee0e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.603659 Nov 02 14:14:03.085182 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3538/5080] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:02 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:03.504175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:03.505463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:03.518755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:03.519550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:03.521223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:03.522723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:03.524602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:03.525205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:03.767443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:03.768608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:03.779086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=44 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:03.787354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:03.788098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:03.788755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:03.791545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:03.792177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:03.793207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:04.223150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:04.242097 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-87a6a3db-d436-437d-8067-da83cf8dc513 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.743537 Nov 02 14:14:04.242825 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1543/5081] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:03 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:04.263373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:04.269068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:04.289306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:04.290389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:04.291142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:04.293680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:04.298561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:04.299288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:04.935520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:04.946452 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb875aff-c693-4c99-9bc2-79f9a10e68d7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1514 microversion: 2.1 time: 1.184448 Nov 02 14:14:04.950324 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3539/5082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:03 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1514 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:04.975429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:04.978619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:04.994252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:04.995611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:04.996607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:04.997973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:04.999790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:05.002704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:05.076290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:05.078400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lazy-loading 'flavor' on Instance uuid 900f3f98-e247-421a-a02b-ec33d49dc48b {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:14:05.148120 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a7b942b4-6f50-4a69-8602-fed084b283aa tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 0.887426 Nov 02 14:14:05.154728 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1544/5083] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:04 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:05.270760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:05.272146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:05.280034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e13c98b4-7b89-4b49-907a-57202e2439c5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action" status: 200 len: 32 microversion: 2.1 time: 0.309027 Nov 02 14:14:05.283641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3540/5084] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:04 2022] POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 14:14:05.295716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:05.298512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:05.312062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:05.317537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:05.318427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:05.319887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:05.324610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:05.325306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:05.330046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:05.349801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:05.350266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:05.355005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:05.358204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:05.364757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:06.733845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:06.746487 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-874baa3c-a7f9-4a5d-936d-ad2c15f9e7fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 1.483836 Nov 02 14:14:06.751774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1545/5085] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:05 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:06.769874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:06.770490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:06.798283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:06.804159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:06.804970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:06.805910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:06.812060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:06.818306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:07.028450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:07.052453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ae44b4f-dca6-4335-bd76-594ece6d09d3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 1.762377 Nov 02 14:14:07.058860 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3541/5086] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:05 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:07.773127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:07.774795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:07.791426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:07.796017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:07.798127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:07.801692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:07.804030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:07.805963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:07.931625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:07.944219 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0343bc63-e31c-4569-a61b-2d97b5d66a9e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1528 microversion: 2.1 time: 1.191242 Nov 02 14:14:07.945655 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1546/5087] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:06 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1528 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:08.083881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:08.084877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:08.099238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:08.100941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:08.101702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:08.103489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:08.109217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:08.109988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:08.187481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:08.198652 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba2622d6-7df0-4541-b3a6-ddc0b05a9f91 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.429608 Nov 02 14:14:08.199305 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3542/5088] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:07 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:08.493426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:08.505777 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-65e9e101-71a0-4e6b-a798-9d6c750e5745 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.428260 Nov 02 14:14:08.521220 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1547/5089] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:08 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:08.974085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:08.974838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:08.993788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:08.994406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:08.994928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:08.995865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:08.997328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:08.997850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:09.232285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:09.233431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:09.249763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:09.260129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:09.260658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:09.261426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:09.270763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:09.271366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:09.466133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:09.474525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee9bdb7c-6527-403c-ba8f-e92195935323 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1510 microversion: 2.1 time: 0.508516 Nov 02 14:14:09.486731 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3543/5090] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:08 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:09.556060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:09.564949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:09.584760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:09.593121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:09.597846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:09.597846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:09.597846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:09.597846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:09.880390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:09.893287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3940f3bf-3eba-4078-9acd-a2cffbb73d85 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1169 microversion: 2.1 time: 0.671731 Nov 02 14:14:09.918263 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1548/5091] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:09 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1169 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:10.133971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:10.156428 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1caa55cb-1467-44f1-8c06-05a53718f8bd tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.618890 Nov 02 14:14:10.171662 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3544/5092] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:09 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:10.510896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:10.511641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:10.523233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:10.531732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:10.532269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:10.535358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:10.535912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:10.536414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:10.780947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:10.790192 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b064e55-6afb-4123-9f8d-9294f721eba0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1510 microversion: 2.1 time: 0.284102 Nov 02 14:14:10.792822 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1549/5093] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:10 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:10.927881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:10.929261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:10.945529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:10.946387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:10.947059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:10.948054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:10.948766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:10.949523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:11.184868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:11.185855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:11.199649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:11.201314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:11.202530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:11.208530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:11.213296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:11.214002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:11.389759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:11.422174 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3d90ba52-c437-4e1b-9780-58feb6be3a4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1215 microversion: 2.1 time: 0.490260 Nov 02 14:14:11.423932 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3545/5094] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:10 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1215 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:11.626833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:11.638973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4f965c1-e1b3-4713-9468-ad98bf4953fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.457478 Nov 02 14:14:11.641858 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1550/5095] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:11 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:11.664710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f3d63377-5eeb-4d7c-b68c-220668b85449 req-b7e4e3c8-e834-408b-8942-69d3287d2ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5964-e104-402a-969a-be2812c93bdf", "name": "network-vif-unplugged", "status": "completed", "tag": "6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:11.690981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d63377-5eeb-4d7c-b68c-220668b85449 req-b7e4e3c8-e834-408b-8942-69d3287d2ca0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:11.694225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d63377-5eeb-4d7c-b68c-220668b85449 req-b7e4e3c8-e834-408b-8942-69d3287d2ca0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:11.694676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f3d63377-5eeb-4d7c-b68c-220668b85449 req-b7e4e3c8-e834-408b-8942-69d3287d2ca0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:11.730635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f3d63377-5eeb-4d7c-b68c-220668b85449 req-b7e4e3c8-e834-408b-8942-69d3287d2ca0 service nova] Creating event network-vif-unplugged:6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e for instance 511d5964-e104-402a-969a-be2812c93bdf on n-h1-858238-3 Nov 02 14:14:11.740278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f3d63377-5eeb-4d7c-b68c-220668b85449 req-b7e4e3c8-e834-408b-8942-69d3287d2ca0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079131 Nov 02 14:14:11.741890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3546/5096] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:14:11.817486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:11.818560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:11.837717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:11.838571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:11.842402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:11.849393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:11.850228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:11.850891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:12.261360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:12.278158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8bcd2da1-346a-47dc-9e66-9b94095fe4c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1510 microversion: 2.1 time: 0.465203 Nov 02 14:14:12.304554 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1551/5097] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:11 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:12.447507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:12.448233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:12.464096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:12.464945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:12.465724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:12.466680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:12.470649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:12.471355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:12.670986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:12.672085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:12.718167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:12.723348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:12.725344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:12.733076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:12.734370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:12.737484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:12.938743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:12.961622 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55c650c3-c276-49ab-8dc1-646d956d91f5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.519084 Nov 02 14:14:12.974658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3547/5098] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:12 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:13.290397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:13.303474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:13.305086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:13.320970 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-efde63e7-0656-4fe3-a387-20f6bf6e08d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.655005 Nov 02 14:14:13.324041 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1552/5099] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:12 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:13.325848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:13.326467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:13.327148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:13.328157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:13.328837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:13.329272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:13.550711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:13.566783 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2af64351-6089-4e37-9269-b18c5f946ecb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1510 microversion: 2.1 time: 0.268253 Nov 02 14:14:13.568129 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3548/5100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:13 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:13.996365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:13.997098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:14.006586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:14.006586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:14.006586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:14.006586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:14.013455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:14.013886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:14.215479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:14.225439 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0b7e8c81-24a7-4e4f-85fe-e3ad31c4e695 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.233086 Nov 02 14:14:14.226843 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1553/5101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:13 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:14.349176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:14.350115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:14.357571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:14.358352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:14.358764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:14.360383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:14.361254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:14.361987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:14.387506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:14.591926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:14.593529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:14.607302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:14.607993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:14.608653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:14.609544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:14.610441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:14.611032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:14.647846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:14.672196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:14.681366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a65692b2-6628-4757-9490-b0df19ecc1cf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.336963 Nov 02 14:14:14.681972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3549/5102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:14 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:14.884059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:14.914971 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e47d7a3c-e4e6-4395-b64f-200d1262e0a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1510 microversion: 2.1 time: 0.327591 Nov 02 14:14:14.917603 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1554/5103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:14 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:15.250353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:15.251520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:15.264434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:15.265113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:15.265707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:15.266700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:15.276161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:15.276945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:15.537847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:15.550221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-32535527-e3b7-4959-abbb-a57ff14a4fbb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.304170 Nov 02 14:14:15.551667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3550/5104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:15 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:15.709278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:15.710176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:15.720095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:15.720593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:15.721035 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:15.721959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:15.722761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:15.723372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:15.940102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:15.940722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:15.952564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:15.953406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:15.959364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:15.959895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:15.960954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:15.961628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:15.962251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:15.969889 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cba7aff7-32ed-4029-9b3e-4dcb473b0a5a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.266474 Nov 02 14:14:15.970694 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1555/5105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:15 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:16.457239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:16.478099 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91e8d98c-4be3-4cf0-8b47-57fe98974d05 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1453 microversion: 2.1 time: 0.542445 Nov 02 14:14:16.504192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:16.510693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:16.515706 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3551/5106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:15 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1453 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:16.521500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:16.524337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:16.524975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:16.528664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:16.529615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:16.535945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:16.573819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:16.574427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:16.585264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:16.586659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:16.589376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:16.590303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:16.590973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:16.592355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.035130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:17.045004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:17.046508 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-37ee392a-c2ea-40a0-9dd3-52e22be248a6 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1453 microversion: 2.1 time: 0.546279 Nov 02 14:14:17.047057 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1556/5107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:16 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1453 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:17.064015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:17.065078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:17.076344 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa7e1fc2-2814-49db-884f-d5622c046f86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.506358 Nov 02 14:14:17.078195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.079314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.079759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.080478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.081196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.081627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.084543 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3552/5108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:16 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:17.168894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:17.169549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:17.184767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.185403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.190127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.190990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.198014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.200580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.245118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lazy-loading 'flavor' on Instance uuid 511d5964-e104-402a-969a-be2812c93bdf {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:14:17.264549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'shelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state shelved_offloaded Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 14 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: {"shelve": {}} Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'shelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state shelved_offloaded Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'shelve': {}}} Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:14:17.267777 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state shelved_offloaded Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state shelved_offloaded Nov 02 14:14:17.274982 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:17.278629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'shelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state shelved_offloaded {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:14:17.279793 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ff77d58-0117-41f1-9a88-b6ad51d1d974 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 155 microversion: 2.1 time: 0.118360 Nov 02 14:14:17.289920 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3553/5109] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:17 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 155 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 14:14:17.295762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:17.296563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:17.305150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.305900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.306763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.307723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.313927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.314700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.428013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137559) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 14:14:17.450220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:17.474730 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8dbcad3f-50cf-433a-b9ed-88d7787de84c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.423806 Nov 02 14:14:17.487251 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1557/5110] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:17 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:17.682411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5de2146c-4b12-4de3-bd98-ba9d3b6f65c3 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.391010 Nov 02 14:14:17.691413 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3554/5111] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:17 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:14:17.705165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:17.706731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:17.734254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.737144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.739512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:17.741423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:17.745379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:17.747398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:18.111663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:18.113207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:18.131234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:18.132106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:18.132757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:18.135006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:18.135700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:18.136304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:18.437863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:18.452419 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a4a67167-0e52-4328-b18b-d04705cdcea5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1461 microversion: 2.1 time: 0.753131 Nov 02 14:14:18.454486 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1558/5112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:17 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1461 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:18.513656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:18.514929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:18.534997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:18.536570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:18.538327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:18.538946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:18.539544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:18.541757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:19.013841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:19.039713 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ecb86205-9c0e-4097-a3c7-8f43678707e8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.932327 Nov 02 14:14:19.043180 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3555/5113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:18 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:19.238722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:19.272303 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-07c3f638-d724-4e19-acbe-db8c89fe4432 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.762546 Nov 02 14:14:19.282496 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1559/5114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:18 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:19.478495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:19.496943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:19.557787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:19.558278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:19.558711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:19.577215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:19.577670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:19.578429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:20.081171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:20.082335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:20.090941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:20.091163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:20.091495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:20.092289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:20.092999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:20.095928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:20.096471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:20.100678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a4e16436-68a5-4237-997e-24633fb846b1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1461 microversion: 2.1 time: 0.627625 Nov 02 14:14:20.101277 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3556/5115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:19 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1461 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:20.321790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:20.322530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:20.335959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:20.336273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:20.336718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:20.337435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:20.337893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:20.338320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:20.760195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:20.774256 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-edf8ea59-a754-4a39-891a-c1b29937ed79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.703924 Nov 02 14:14:20.776878 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1560/5116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:20 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:21.129730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:21.130595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:21.144063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:21.148384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:21.148979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:21.149873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:21.151306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:21.155429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:21.397273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:21.423399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a1510873-edcb-4024-acba-8528bca42c45 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 1.106614 Nov 02 14:14:21.440398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3557/5117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:20 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:21.803209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:21.804131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:21.818429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:21.819354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:21.819964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:21.836015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:21.836770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:21.837482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:22.839335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:22.848401 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef0c0a0b-889c-46fe-bbf3-74fc2c389015 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1463 microversion: 2.1 time: 1.722701 Nov 02 14:14:22.849011 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1561/5118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:21 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1463 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:22.871471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:22.872125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:22.885254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:22.885755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:22.886198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:22.886920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:22.887411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:22.887839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:23.457025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:23.471421 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7bf35ac0-f13c-4222-94ae-76257a9aa2a2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.610032 Nov 02 14:14:23.474285 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1562/5119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:22 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:23.584685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:23.593198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-943cb11d-2c96-44f2-b909-22ea391dc694 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 1.793917 Nov 02 14:14:23.605034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3558/5120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:21 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:23.873768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:23.874486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:23.891398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:23.892356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:23.895308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:23.902166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:23.902762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:23.906537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:24.119263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-59d0a7e8-2bac-4f85-9463-6f3c18cf3f12 req-fcd0a3c4-0c4c-4f41-a273-ad117363b289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b5115b-c190-464a-977e-d9d6a4e47326", "name": "network-vif-plugged", "status": "completed", "tag": "de3bdd9b-420b-4215-8f42-88b66921746a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:24.126858 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:14:24.127134 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Nov 02 14:14:24.158314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-59d0a7e8-2bac-4f85-9463-6f3c18cf3f12 req-fcd0a3c4-0c4c-4f41-a273-ad117363b289 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:24.158804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-59d0a7e8-2bac-4f85-9463-6f3c18cf3f12 req-fcd0a3c4-0c4c-4f41-a273-ad117363b289 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:24.159274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-59d0a7e8-2bac-4f85-9463-6f3c18cf3f12 req-fcd0a3c4-0c4c-4f41-a273-ad117363b289 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:24.199614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-59d0a7e8-2bac-4f85-9463-6f3c18cf3f12 req-fcd0a3c4-0c4c-4f41-a273-ad117363b289 service nova] Creating event network-vif-plugged:de3bdd9b-420b-4215-8f42-88b66921746a for instance 03b5115b-c190-464a-977e-d9d6a4e47326 on n-h2-858238-3 Nov 02 14:14:24.205768 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-59d0a7e8-2bac-4f85-9463-6f3c18cf3f12 req-fcd0a3c4-0c4c-4f41-a273-ad117363b289 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090393 Nov 02 14:14:24.210609 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3559/5121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:14:24.499360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:24.500019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:24.515036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:24.515713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:24.516026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:24.517313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:24.517793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:24.518211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:25.234539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:25.252482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a0ee567-48e6-4153-be70-c562742897e2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1520 microversion: 2.1 time: 0.758014 Nov 02 14:14:25.257405 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3560/5122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:24 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1520 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:25.283945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:25.296303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:25.328158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:25.328715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:25.332440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:25.336302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:25.341547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:25.344013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:25.404154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:25.425037 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a870e8e-92b6-4725-8c7c-07ca98eb64ae tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.555324 Nov 02 14:14:25.447796 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1563/5123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:23 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:26.110776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:26.146499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b10c5b9a-bacb-44dd-bfc3-5f06721582c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1203 microversion: 2.1 time: 0.875937 Nov 02 14:14:26.147274 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3561/5124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:25 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1203 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:26.285233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:26.286090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:26.302281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:26.302833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:26.307771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:26.308904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:26.309480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:26.315898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:26.459251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:26.460611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:26.473548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:26.474719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:26.476465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:26.482666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:26.486353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:26.486845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:27.244037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:27.267480 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fb30de60-cfa9-41bd-b7e6-07cd0b1f4a98 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1500 microversion: 2.1 time: 0.984865 Nov 02 14:14:27.269362 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1564/5125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:26 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1500 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:27.282281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:27.283875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:27.300614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:27.304842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:27.306310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:27.307467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:27.315154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:27.316176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:27.642305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:27.654684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-18a9d9b6-6b25-4062-8e76-326dbaf42a56 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.201418 Nov 02 14:14:27.671382 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3562/5126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:26 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:27.682509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:27.683371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:27.699872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:27.704487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:27.705778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:27.707757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:27.712433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:27.713537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:28.746323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:28.755836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c03e3c21-9f82-4981-9217-b6553f28c28d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1514 microversion: 2.1 time: 1.082966 Nov 02 14:14:28.765152 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3563/5127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:27 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1514 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:28.770892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:28.774091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:28.792444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:28.793244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:28.794866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:28.796054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:28.805878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:28.806616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:28.852559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:28.861611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a53117e8-d1e6-4645-a238-a864dc017682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1391 microversion: 2.1 time: 1.590947 Nov 02 14:14:28.870766 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1565/5128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:27 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1391 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:28.890669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3001661e-21cd-4b45-8112-baf4840301d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:28.896639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3001661e-21cd-4b45-8112-baf4840301d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: f1d34613-7a1c-4262-a7db-8a2b53201e69] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:28.930788 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-3001661e-21cd-4b45-8112-baf4840301d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Instance f1d34613-7a1c-4262-a7db-8a2b53201e69 could not be found. Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3001661e-21cd-4b45-8112-baf4840301d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/f1d34613-7a1c-4262-a7db-8a2b53201e69/action HTTP/1.1 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 14 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: {"rescue": {}} Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance f1d34613-7a1c-4262-a7db-8a2b53201e69 could not be found. Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'f1d34613-7a1c-4262-a7db-8a2b53201e69', 'body': {'rescue': {}}} Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d34613-7a1c-4262-a7db-8a2b53201e69 could not be found. Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d34613-7a1c-4262-a7db-8a2b53201e69 could not be found. Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:28.938665 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d34613-7a1c-4262-a7db-8a2b53201e69 could not be found. Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3001661e-21cd-4b45-8112-baf4840301d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 404 to user: Instance f1d34613-7a1c-4262-a7db-8a2b53201e69 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:14:28.944495 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3001661e-21cd-4b45-8112-baf4840301d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/f1d34613-7a1c-4262-a7db-8a2b53201e69/action" status: 404 len: 111 microversion: 2.1 time: 0.068231 Nov 02 14:14:28.954694 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1566/5129] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:28 2022] POST /compute/v2.1/servers/f1d34613-7a1c-4262-a7db-8a2b53201e69/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:14:28.964544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:28.965164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:29.000334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:29.000876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:29.001367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:29.002135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:29.002591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:29.015280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:30.578896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:30.591323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1131ddef-3cbd-4c9d-8c14-badb53f54ebb tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.824607 Nov 02 14:14:30.595362 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3564/5130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:28 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:30.608078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:30.613861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:30.646989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:30.648109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:30.648939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:30.649991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:30.650960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:30.651718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:30.756306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:30.867843 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac4c9d75-5b76-49b6-9c14-01a3300bd8f4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action" status: 202 len: 0 microversion: 2.1 time: 0.270460 Nov 02 14:14:30.880068 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3565/5131] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:30 2022] POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:14:30.890691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:30.904501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:30.918361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:30.918905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:30.921503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:30.925925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:30.926666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:30.927316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:31.062559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:31.095281 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cbe5ff17-449e-4147-b910-098c9feb3cb9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1391 microversion: 2.1 time: 2.133155 Nov 02 14:14:31.116676 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1567/5132] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:28 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1391 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:31.123667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:31.124629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:31.133503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:31.134742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:31.135581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:31.136542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:31.138084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:31.138790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:32.205281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:32.221845 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd105175-cfb1-43d9-995a-b0141581e9af tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1519 microversion: 2.1 time: 1.340291 Nov 02 14:14:32.238344 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3566/5133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:30 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1519 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:32.251762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:32.268661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:32.317989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:32.322123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:32.323047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:32.324007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:32.326808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:32.327483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:32.723630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:32.734969 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f7360bbe-64a6-43a3-800e-df61647af3f4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1391 microversion: 2.1 time: 1.615880 Nov 02 14:14:32.739653 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1568/5134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:31 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1391 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:32.983316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:32.986985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:33.006278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=56 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:33.012165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.012897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.013536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.016205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.018195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.018819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.115808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:14:33.160680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:33.183651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e804ce5-8d69-40cb-964b-06cf1e90422a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.942002 Nov 02 14:14:33.188615 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3567/5135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:32 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:33.269907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:33.270755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:33.288915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.298005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.298899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.299931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.302568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.303320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.621461 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a23a6114-f6a2-453d-9d7c-cfe7fe3b0cb1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 204 len: 0 microversion: 2.1 time: 0.658801 Nov 02 14:14:33.627050 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1569/5136] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:14:32 2022] DELETE /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:14:33.656465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:33.657352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:33.724659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.725850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.734011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.734784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.739945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.743244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.756414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:33.772304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fcb3bee-421c-4688-bfb2-bb36e58a15c1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1499 microversion: 2.1 time: 0.510221 Nov 02 14:14:33.773189 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3568/5137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:33 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1499 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:33.814729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:33.823982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:33.827459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:33.835412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:33.884569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.885075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.885515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:33.886384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:33.886961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:33.887656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:34.011332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lazy-loading 'flavor' on Instance uuid fc1a31dc-9106-4288-ae94-5a4a8eab8d4d {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:14:34.049803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Cannot 'rescue' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state paused Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action HTTP/1.1 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 14 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: {"rescue": {}} Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'rescue' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state paused Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fc1a31dc-9106-4288-ae94-5a4a8eab8d4d', 'body': {'rescue': {}}} Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d in vm_state paused. Cannot rescue while the instance is in this state. Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state paused Nov 02 14:14:34.052167 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state paused Nov 02 14:14:34.056735 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:14:34.065243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 409 to user: Cannot 'rescue' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state paused {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:14:34.066391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-28b298e8-c4b0-4f74-9d50-d933890557e4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action" status: 409 len: 144 microversion: 2.1 time: 0.265577 Nov 02 14:14:34.067165 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3569/5138] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:33 2022] POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action => generated 144 bytes in 269 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:14:34.077751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:34.078451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:34.096783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:34.097839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:34.098459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:34.103579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:34.103579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:34.103579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:34.287264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d53add5-9a61-457c-b06c-b593e7c0ec4b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action" status: 202 len: 0 microversion: 2.1 time: 0.209725 Nov 02 14:14:34.289415 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3570/5139] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:34 2022] POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:14:34.311066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:34.314647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:34.337289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:34.338495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:34.340482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:34.342395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:34.344180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:34.351915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:34.566949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:34.620256 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d697f9c4-04be-4c55-bd8c-061b5b445cb7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1397 microversion: 2.1 time: 0.980594 Nov 02 14:14:34.641274 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1570/5140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:33 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1397 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:34.650154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:34.659693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:34.669203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:34.670394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:34.671509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:34.673681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:34.675467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:34.676375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:35.795708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:35.838877 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4aee2a4-18cf-4017-b047-44a457a88cf0 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.546578 Nov 02 14:14:35.875404 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3571/5141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:34 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:35.895279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:35.899730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:35.925151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:35.925790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:35.928036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:35.930476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:35.935053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:35.935799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:36.011856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:36.029325 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41cfd777-7da1-48af-8ac7-2e9e2c901a3e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1506 microversion: 2.1 time: 1.385223 Nov 02 14:14:36.031064 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1571/5142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:34 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1506 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:36.734180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:36.745052 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-827c70f6-ccf1-4625-92e9-654a02ea73ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1397 microversion: 2.1 time: 0.865851 Nov 02 14:14:36.759424 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3572/5143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:35 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1397 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:36.906728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:36.907599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:36.930022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:36.933359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:36.934092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:36.936747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:36.943867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:36.946527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:37.056352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:37.057711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:37.073988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:37.074489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:37.074931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:37.075691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:37.076155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:37.076568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:38.560973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:38.570832 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e67d87f-c34f-4250-a64f-e6042ac5bbd5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1514 microversion: 2.1 time: 1.518523 Nov 02 14:14:38.576470 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3573/5144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:37 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1514 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:38.674673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:38.683886 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-717d97e5-58be-4cb6-be79-ec862fa1eaf9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.781591 Nov 02 14:14:38.689679 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1572/5145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:36 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:39.114311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:39.115276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:39.145029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:39.151658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:39.153755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:39.155575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:39.156310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:39.157332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:39.540243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7e230108-c2d4-43d3-8aa3-c58c6fe51e3c req-96a9cfbc-093b-4da7-a0c3-853b0bb5daa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b5115b-c190-464a-977e-d9d6a4e47326", "name": "network-vif-unplugged", "status": "completed", "tag": "de3bdd9b-420b-4215-8f42-88b66921746a"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:39.567178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7e230108-c2d4-43d3-8aa3-c58c6fe51e3c req-96a9cfbc-093b-4da7-a0c3-853b0bb5daa1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:39.568825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7e230108-c2d4-43d3-8aa3-c58c6fe51e3c req-96a9cfbc-093b-4da7-a0c3-853b0bb5daa1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:39.569690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7e230108-c2d4-43d3-8aa3-c58c6fe51e3c req-96a9cfbc-093b-4da7-a0c3-853b0bb5daa1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:39.611116 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7e230108-c2d4-43d3-8aa3-c58c6fe51e3c req-96a9cfbc-093b-4da7-a0c3-853b0bb5daa1 service nova] Creating event network-vif-unplugged:de3bdd9b-420b-4215-8f42-88b66921746a for instance 03b5115b-c190-464a-977e-d9d6a4e47326 on n-h2-858238-3 Nov 02 14:14:39.643923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7e230108-c2d4-43d3-8aa3-c58c6fe51e3c req-96a9cfbc-093b-4da7-a0c3-853b0bb5daa1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101554 Nov 02 14:14:39.647135 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1573/5146] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:14:39.715804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:39.716495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:39.729214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:39.732299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:39.732949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:39.738642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:39.740680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:39.741417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:39.767640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:39.788302 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-452c5e1f-fd10-44e9-8aef-e11bd71169fb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1397 microversion: 2.1 time: 1.210089 Nov 02 14:14:39.789879 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3574/5147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:38 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1397 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:40.823399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:40.824470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:40.842978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:40.843577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:40.844464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:40.845279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:40.845787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:40.850497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:41.254218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:41.265478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-514f2599-2a4d-4a21-98f8-da38e5f90c32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1355 microversion: 2.1 time: 0.447421 Nov 02 14:14:41.289855 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3575/5148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:40 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1355 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:41.297059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1c6e12cf-29b3-48a5-8b5f-296dfa3e64bf req-1155b075-ae78-4031-b678-4a92e4cdb202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b5115b-c190-464a-977e-d9d6a4e47326", "name": "network-vif-deleted", "tag": "de3bdd9b-420b-4215-8f42-88b66921746a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:41.310130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1c6e12cf-29b3-48a5-8b5f-296dfa3e64bf req-1155b075-ae78-4031-b678-4a92e4cdb202 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:41.310842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1c6e12cf-29b3-48a5-8b5f-296dfa3e64bf req-1155b075-ae78-4031-b678-4a92e4cdb202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:41.311582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1c6e12cf-29b3-48a5-8b5f-296dfa3e64bf req-1155b075-ae78-4031-b678-4a92e4cdb202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:41.319556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:41.345107 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0801e531-80f7-4d82-9081-c8945708a7db tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.634263 Nov 02 14:14:41.345738 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1574/5149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:39 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:41.424452 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1c6e12cf-29b3-48a5-8b5f-296dfa3e64bf req-1155b075-ae78-4031-b678-4a92e4cdb202 service nova] Creating event network-vif-deleted:de3bdd9b-420b-4215-8f42-88b66921746a for instance 03b5115b-c190-464a-977e-d9d6a4e47326 on n-h2-858238-3 Nov 02 14:14:41.442278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1c6e12cf-29b3-48a5-8b5f-296dfa3e64bf req-1155b075-ae78-4031-b678-4a92e4cdb202 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148076 Nov 02 14:14:41.443818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3576/5150] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:14:42.303730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:42.304406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:42.335809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:42.336484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:42.336840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:42.340439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:42.349279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:42.353162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:42.375251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:42.377254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:42.392453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:42.393735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:42.395018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:42.396126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:42.396947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:42.397591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:42.854689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:42.867303 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a83d2653-eb54-438c-86d7-a040cba19283 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.564564 Nov 02 14:14:42.870824 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1575/5151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:42 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:42.900325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:42.934577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:42.954069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:42.954614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:42.955056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:42.955895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:42.956355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:42.957098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:43.032422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lazy-loading 'flavor' on Instance uuid fc1a31dc-9106-4288-ae94-5a4a8eab8d4d {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:14:43.088658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:43.102651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10377e2f-660c-425e-9716-ac253560de0d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.733165 Nov 02 14:14:43.116169 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3577/5152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:42 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:43.199844 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b74eec5d-d174-4519-94c1-9546d37310b9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action" status: 200 len: 32 microversion: 2.1 time: 0.325105 Nov 02 14:14:43.201229 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1576/5153] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:14:42 2022] POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action => generated 32 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:14:43.223920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:43.230224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:43.279547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:43.283678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:43.284325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:43.285216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:43.288132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:43.289752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:43.897563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:43.898110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:43.916017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:43.916532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:43.924174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:43.927524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:43.928314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:43.931535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:44.300455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:44.304244 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bd9aea5b-1415-42aa-b823-dc15e27a1c4d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.412534 Nov 02 14:14:44.305089 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1577/5154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:43 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:44.310193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:44.353293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e7ac086-1c77-4a00-ba7a-d63c362593f1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 1.140094 Nov 02 14:14:44.354638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3578/5155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:43 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:44.377279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:44.380036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:44.399901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:44.402044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:44.407460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:44.408606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:44.410350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:44.411791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:45.318668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:45.341456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:45.342838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:45.351626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:45.352392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:45.353078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:45.354022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:45.354714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:45.355496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:45.356823 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-35e2457d-fbde-4524-a6c8-6368104fc200 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.008345 Nov 02 14:14:45.357515 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1578/5156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:44 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:45.384847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:45.391908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:45.421534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:45.422262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:45.423281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:45.424009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:45.424460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:45.424880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:45.560199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:45.596341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dc876972-e059-44aa-a144-ddd4d7826869 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.255681 Nov 02 14:14:45.597942 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3579/5157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:45 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:46.034241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:46.068318 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-34f4f66c-8563-4345-92a1-754820de7670 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.687353 Nov 02 14:14:46.077389 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1579/5158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:45 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:46.382920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:46.384317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:46.402213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:46.403670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:46.412107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:46.417312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:46.421944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:46.423680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:46.631615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:46.632418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:46.663896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:46.664868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:46.665565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:46.666629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:46.668139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:46.668787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:46.880034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:46.889260 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf778f4d-1480-465a-8546-3abbc2ec6beb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.264979 Nov 02 14:14:46.902570 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1580/5159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:46 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:47.072752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:47.101303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:47.102023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:47.120125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba7986d8-fd19-4629-853f-3299ee614f63 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.741297 Nov 02 14:14:47.121806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:47.122591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:47.123299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:47.123873 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3580/5160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:46 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:47.124331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:47.124954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:47.125383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:47.903856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:47.914543 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd5a204f-551b-4462-8dc3-78060549ad64 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.817555 Nov 02 14:14:47.915937 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1581/5161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:47 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:47.935080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:47.936156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:47.947852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:47.949412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:47.950038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:47.951385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:47.953802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:47.954941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:48.208367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:48.216646 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50845e0d-e776-4c0a-a7a5-6f01b3ed7072 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.294926 Nov 02 14:14:48.225672 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1582/5162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:47 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:48.230675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:48.246361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:48.259561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:48.260060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:48.260501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:48.261221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:48.261679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:48.262110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:48.271976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:48.273694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:48.274180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:48.274616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:48.278031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:48.278544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:48.278989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:48.297691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:48.373865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a423e10d-e0a1-4508-8d36-523562367395 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.471249 Nov 02 14:14:48.374654 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3581/5163] 10.222.0.18 () {58 vars in 1185 bytes} [Wed Nov 2 14:14:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:14:48.618838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-142605199", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "availability_zone": "nova:n-h1-858238-3", "networks": [{"uuid": "85b482bb-1219-450a-8622-a880429b3523"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:48.803649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] validate_networks() for [('85b482bb-1219-450a-8622-a880429b3523', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:14:48.831766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:48.841834 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57736046-75f9-4b20-8c43-9fd70d0d25d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.614968 Nov 02 14:14:48.842955 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1583/5164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:48 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:48.938488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:48.940517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:48.948564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:48.949176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:48.949709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:48.950648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:48.951374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:48.952016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:49.936420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:49.945846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b96cd44f-8538-4fd7-82ea-33c1eae9d25d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 1.011830 Nov 02 14:14:49.958095 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1584/5165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:48 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:49.965121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:49.965947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:49.972776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:49.975960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:49.980189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:49.981217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:49.981859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:49.982458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:50.293612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:50.301571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:14:50.321841 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e45eb847-0ef6-4083-9358-2cd3a1f550ec tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.362282 Nov 02 14:14:50.325153 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1585/5166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:49 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:50.352274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:50.352906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:50.389121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:50.389628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:50.390068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:50.390782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:50.419336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:50.422027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:51.128175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:51.137091 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f436afa4-a7dc-428d-bf8d-d7412ad01880 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.810572 Nov 02 14:14:51.147494 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1586/5167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:50 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:51.159484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:51.160109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:51.185149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:51.185650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:51.186093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:51.186808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:51.187295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:51.187723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:51.978640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:51.997677 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0de2e932-7c86-45c0-ba7a-03dbcd0f28b1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.848488 Nov 02 14:14:52.005603 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1587/5168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:51 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:52.020320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:52.026178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:52.046167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.046774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.047311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.048194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.048699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.050963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.310960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:14:52.311672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:14:52.312159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:14:52.312673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:14:52.314067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:14:52.355071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.366215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.373225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.374320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.375693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.379484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.439293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:52.468396 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b0ff4f8-971c-4b44-9236-b7aced8e415f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 200 len: 1188 microversion: 2.1 time: 0.452390 Nov 02 14:14:52.471585 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1588/5169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:52 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 1188 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:52.483485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:52.491217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:52.512936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.513582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.514713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.517380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.519124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.521043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.530600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Getting quotas for project 1bbed77b022643c5883a42894fe5c07d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:14:52.561624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Getting quotas for user e96819f9b14f46e8b1100c3ca1bcde3e and project 1bbed77b022643c5883a42894fe5c07d. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:14:52.623830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:14:52.627242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:14:52.808911 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-125f83c2-76a7-48a9-a592-2080592837f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.194039 Nov 02 14:14:52.809640 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3582/5170] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:14:52.834481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-787cc24f-296e-4bbb-b793-d78a47048652 req-11557fe8-82f4-43c5-8fd2-2d8a8bd01474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5964-e104-402a-969a-be2812c93bdf", "name": "network-vif-plugged", "status": "completed", "tag": "6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:14:52.872640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-787cc24f-296e-4bbb-b793-d78a47048652 req-11557fe8-82f4-43c5-8fd2-2d8a8bd01474 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:52.873874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-787cc24f-296e-4bbb-b793-d78a47048652 req-11557fe8-82f4-43c5-8fd2-2d8a8bd01474 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:52.874332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-787cc24f-296e-4bbb-b793-d78a47048652 req-11557fe8-82f4-43c5-8fd2-2d8a8bd01474 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:52.916795 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-787cc24f-296e-4bbb-b793-d78a47048652 req-11557fe8-82f4-43c5-8fd2-2d8a8bd01474 service nova] Creating event network-vif-plugged:6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e for instance 511d5964-e104-402a-969a-be2812c93bdf on n-h1-858238-3 Nov 02 14:14:52.970059 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-787cc24f-296e-4bbb-b793-d78a47048652 req-11557fe8-82f4-43c5-8fd2-2d8a8bd01474 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145615 Nov 02 14:14:52.976660 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3583/5171] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:14:53.005706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce69f410-3c2d-4f8a-b67b-52f7a01258ff tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:53.018905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce69f410-3c2d-4f8a-b67b-52f7a01258ff tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:53.375804 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce69f410-3c2d-4f8a-b67b-52f7a01258ff tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1328 microversion: 2.1 time: 0.393903 Nov 02 14:14:53.377947 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3584/5172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:52 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1328 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:53.394551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:53.395496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:53.415838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:53.420577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:53.421237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:53.423545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:53.424445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:53.425038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:53.501211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:53.519503 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d4c38577-b9fe-4a68-80b5-d803634e3d7d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 1.045033 Nov 02 14:14:53.522062 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1589/5173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:52 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:53.530852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:53.537091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:53.566850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:53.570505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:53.574267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:53.576699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:53.577209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:53.580408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:53.630125 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 HTTP/1.1 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '03b5115b-c190-464a-977e-d9d6a4e47326'} Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:53.631469 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0164034a-cfd7-45c9-b2d0-ea8b2d3301c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 404 len: 111 microversion: 2.1 time: 0.108879 Nov 02 14:14:53.637242 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1590/5174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:53 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:14:53.979694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:53.993989 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb3a4ac1-0007-49be-8254-7ea92a484cf8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.613491 Nov 02 14:14:53.994882 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3585/5175] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:53 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:54.404015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:54.404903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:54.417625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:54.422808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:54.423656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:54.425712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:54.426341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:54.427646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:54.552184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:54.553895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:54.580815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:54.583300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:54.583978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:54.586275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:54.587770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:54.591140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:54.600019 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d76fc8a-d5cd-4d4d-af20-58f5ec871376 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1337 microversion: 2.1 time: 0.200541 Nov 02 14:14:54.600614 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1591/5176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:54 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1337 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:55.022721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:55.023649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:55.038936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:55.048070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:55.049353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:55.053800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:55.054307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:55.058515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:55.259713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:55.269174 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c86ac440-e856-489e-932e-e1b8c2fb4def tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.724595 Nov 02 14:14:55.275900 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3586/5177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:54 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:55.503571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:55.512911 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae39b908-4770-4c91-a21b-7a7d9365d73b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.496711 Nov 02 14:14:55.514350 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1592/5178] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:55 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:55.626045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:55.627363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:55.637718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:55.639253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:55.649694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:55.656047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:55.657725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:55.658426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:56.273351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ae386e3-a6aa-4ac1-b030-66ebe05b6a54 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1415 microversion: 2.1 time: 0.641111 Nov 02 14:14:56.290325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3587/5179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:55 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1415 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:56.301427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:56.302050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:56.310630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:56.311143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:56.311587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:56.312294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:56.316506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:56.317224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:56.541002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:56.541727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:56.552669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:56.553274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:56.558541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:56.559425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:56.561413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:56.561981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:57.013501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:57.041919 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31effc06-3987-4f77-a9f4-fa97a7fa08a9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1519 microversion: 2.1 time: 0.745358 Nov 02 14:14:57.049441 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1593/5180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:56 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1519 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:57.311960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:57.316396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:57.338108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:57.341488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:57.343520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:57.345254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:57.347694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:57.348833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:57.370619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:57.401971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8c8eef4-4258-4a58-af41-49c26f272fc1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.862950 Nov 02 14:14:57.406313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3588/5181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:56 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:57.708761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b7c7f63-dafc-4f82-b16e-c500315442d1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1421 microversion: 2.1 time: 0.406063 Nov 02 14:14:57.729219 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1594/5182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:57 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1421 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:14:58.087508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:58.100302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:58.120645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:58.125237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:58.162056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.167532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.168247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.169139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.173169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.174087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.174530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.181105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.184191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.184440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.185631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.187530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.286253 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 HTTP/1.1 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '03b5115b-c190-464a-977e-d9d6a4e47326'} Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:14:58.294003 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.308511 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.322983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:14:58.322983 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f5589006-7d62-455c-b9b7-77903726af48 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 404 len: 111 microversion: 2.1 time: 0.208652 Nov 02 14:14:58.328699 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1595/5183] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:14:58 2022] DELETE /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:14:58.359885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:58.360945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 03b5115b-c190-464a-977e-d9d6a4e47326] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:58.403585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.405653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.408221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.412573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.414245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.418125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.496844 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 HTTP/1.1 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '03b5115b-c190-464a-977e-d9d6a4e47326'} Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:14:58.503526 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. Nov 02 14:14:58.517520 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:14:58.520559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 03b5115b-c190-464a-977e-d9d6a4e47326 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:14:58.523882 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-81f81e2c-5272-47fe-a646-918e711fee35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326" status: 404 len: 111 microversion: 2.1 time: 0.187081 Nov 02 14:14:58.526018 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1596/5184] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:58 2022] GET /compute/v2.1/servers/03b5115b-c190-464a-977e-d9d6a4e47326 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:14:58.535691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:58.537128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:58.552051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.553285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.554246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.555975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.557114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.559160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.851794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:14:58.870950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ebc66b1c-5180-49dc-8750-23bd4def8e27 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.796178 Nov 02 14:14:58.876703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3589/5185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:58 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:14:58.889917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:14:58.896459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:14:58.926975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.927621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.928060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:14:58.928781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:14:58.929242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:14:58.929672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:00.213184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:00.224972 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dc024ff2-109c-4c19-b88d-3f5c830aa444 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 1.697056 Nov 02 14:15:00.234433 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1597/5186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:58 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:00.251481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:00.252438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:00.273337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:00.274061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:00.274709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:00.275720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:00.276389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:00.277024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:00.320916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66971473-306c-41b3-8e49-66275e52f2d7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 1.441279 Nov 02 14:15:00.321578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3590/5187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:14:58 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:00.639397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:00.662170 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce16aaa4-147a-4047-8280-9d5a7304eae8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.421762 Nov 02 14:15:00.666498 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1598/5188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:00 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:00.711454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:00.713941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:00.728150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:00.728924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:00.729656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:00.730623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:00.731554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:00.732135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.185572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:01.198129 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9511cf1f-a9e5-4400-8757-f7acc6fcb2a7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.496614 Nov 02 14:15:01.198129 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3591/5189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:00 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:01.223810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-486b013a-630f-41b9-8003-9af5bda4d6f1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:01.230297 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-486b013a-630f-41b9-8003-9af5bda4d6f1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 7a829451-2af9-49f9-9f6c-8f80f0fca063 has no mapping to a cell. Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-486b013a-630f-41b9-8003-9af5bda4d6f1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/7a829451-2af9-49f9-9f6c-8f80f0fca063/action HTTP/1.1 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 15 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: {"os-stop": {}} Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 7a829451-2af9-49f9-9f6c-8f80f0fca063 has no mapping to a cell. Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '7a829451-2af9-49f9-9f6c-8f80f0fca063', 'body': {'os-stop': {}}} Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7a829451-2af9-49f9-9f6c-8f80f0fca063 has no mapping to a cell. Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:01.244626 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a829451-2af9-49f9-9f6c-8f80f0fca063 has no mapping to a cell. Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a829451-2af9-49f9-9f6c-8f80f0fca063 has no mapping to a cell. Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-486b013a-630f-41b9-8003-9af5bda4d6f1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 7a829451-2af9-49f9-9f6c-8f80f0fca063 has no mapping to a cell. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-486b013a-630f-41b9-8003-9af5bda4d6f1 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/7a829451-2af9-49f9-9f6c-8f80f0fca063/action" status: 404 len: 117 microversion: 2.1 time: 0.026217 Nov 02 14:15:01.249710 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1599/5190] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:01 2022] POST /compute/v2.1/servers/7a829451-2af9-49f9-9f6c-8f80f0fca063/action => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:01.257760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:01.258385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:01.265153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:01.266921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:01.272256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.272758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.273197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.273915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.274370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.274797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.279241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.279939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.280662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.281667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.286030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.286871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.758458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:01.772215 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d629ff27-c1dd-4d0c-9146-810c5e65a88f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.514469 Nov 02 14:15:01.783291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:01.787021 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1600/5191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:01 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:01.805498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:01.806221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:01.811375 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26966733-5163-433e-a3f7-292355a24b2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.558559 Nov 02 14:15:01.812433 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3592/5192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:01 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:01.833490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.834002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.834451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.835209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.835661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.844807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.845986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:01.846899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:01.859397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.861376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.862086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:01.863338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:01.864033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:01.864985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.357296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a2ed3279-f727-416f-9f43-5d7f39434db7 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.560832 Nov 02 14:15:02.358856 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1601/5193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:01 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:02.369289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:02.381950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93bbeacd-a7e4-42c2-a89a-c3c828e7a749 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.541695 Nov 02 14:15:02.382646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3593/5194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:01 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:02.416380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9a2483a-f36f-42d4-9345-ba94213395d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:02.417292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9a2483a-f36f-42d4-9345-ba94213395d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 860c9f7b-88ec-4414-91b5-23906da672cc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:02.428705 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f9a2483a-f36f-42d4-9345-ba94213395d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 860c9f7b-88ec-4414-91b5-23906da672cc could not be found. Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9a2483a-f36f-42d4-9345-ba94213395d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/860c9f7b-88ec-4414-91b5-23906da672cc/action HTTP/1.1 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 15 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: {"suspend": {}} Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 860c9f7b-88ec-4414-91b5-23906da672cc could not be found. Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '860c9f7b-88ec-4414-91b5-23906da672cc', 'body': {'suspend': {}}} Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860c9f7b-88ec-4414-91b5-23906da672cc could not be found. Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860c9f7b-88ec-4414-91b5-23906da672cc could not be found. Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:02.431050 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:02.435877 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:02.435877 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:02.435877 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860c9f7b-88ec-4414-91b5-23906da672cc could not be found. Nov 02 14:15:02.435877 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:02.435877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9a2483a-f36f-42d4-9345-ba94213395d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 860c9f7b-88ec-4414-91b5-23906da672cc could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:02.448064 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9a2483a-f36f-42d4-9345-ba94213395d2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/860c9f7b-88ec-4414-91b5-23906da672cc/action" status: 404 len: 111 microversion: 2.1 time: 0.035565 Nov 02 14:15:02.448839 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1602/5195] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:02 2022] POST /compute/v2.1/servers/860c9f7b-88ec-4414-91b5-23906da672cc/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:02.457775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:02.458529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:02.460849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:02.474617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.478110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.478701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.479575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.480291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.480819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.579645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b9e8e509-9585-496e-90ae-d1e50fbf7ba3 req-266eb20f-37b2-4d61-9f9e-4752fac67648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fe6801-6f1d-4c99-9024-f4a69f4455cf", "tag": "89c241ad-8736-4d58-aa98-236075c532dc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:02.601269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b9e8e509-9585-496e-90ae-d1e50fbf7ba3 req-266eb20f-37b2-4d61-9f9e-4752fac67648 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.601937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b9e8e509-9585-496e-90ae-d1e50fbf7ba3 req-266eb20f-37b2-4d61-9f9e-4752fac67648 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.602455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b9e8e509-9585-496e-90ae-d1e50fbf7ba3 req-266eb20f-37b2-4d61-9f9e-4752fac67648 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.617481 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b9e8e509-9585-496e-90ae-d1e50fbf7ba3 req-266eb20f-37b2-4d61-9f9e-4752fac67648 service nova] Creating event network-changed:89c241ad-8736-4d58-aa98-236075c532dc for instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf on n-h1-858238-3 Nov 02 14:15:02.637923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b9e8e509-9585-496e-90ae-d1e50fbf7ba3 req-266eb20f-37b2-4d61-9f9e-4752fac67648 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065344 Nov 02 14:15:02.644369 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1603/5196] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:02.796213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:02.807503 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-71adc0b8-53d5-42d7-b441-5a8bd969e7a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.354023 Nov 02 14:15:02.819641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:02.819641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:02.821108 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3594/5197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:02 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:02.823867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.825188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.825882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.826823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.827531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.828260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.836346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:02.836970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:02.846846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.847379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.848129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:02.850834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:02.852065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:02.852881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.335060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:03.350729 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d7dfe38e-afe8-4a56-8afd-6a9dc5d7f65d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.543063 Nov 02 14:15:03.353261 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1604/5198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:02 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:03.361945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:03.374337 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13c2f37b-85c1-44cf-9aff-2bee36e70a77 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.542220 Nov 02 14:15:03.375330 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3595/5199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:02 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:03.391013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:03.392805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:03.401073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:03.432566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:03.439696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:03.441055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:03.441677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:03.442340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:03.443957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.445054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:03.446010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:03.446896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.456588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:03.457090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:03.457799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.458513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:03.458978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:03.459556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.504103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lazy-loading 'flavor' on Instance uuid 511d5964-e104-402a-969a-be2812c93bdf {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:15:03.675289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5815bedf-12be-458f-8565-8185208ba540 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.279615 Nov 02 14:15:03.676666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3596/5200] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:03 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:15:03.705927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:03.708566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:03.740480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:03.753362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:03.757187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.766482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:03.767581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:03.772340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:03.838378 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60a82bea-706b-4187-8094-d53d3bf36f15 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.456738 Nov 02 14:15:03.841886 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1605/5201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:03 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:04.008634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:04.018519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-375befd5-6439-489c-9503-3cbba9ef46ce tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1514 microversion: 2.1 time: 0.321136 Nov 02 14:15:04.019592 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3597/5202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:03 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:04.381656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:04.382541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:04.398379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:04.398965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:04.399515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:04.400336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:04.400883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:04.401529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:04.727209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:04.744870 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-32ed02af-056d-4b8c-96ac-4a04296d2b8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.365972 Nov 02 14:15:04.746385 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1606/5203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:04 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:04.865991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:04.867046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:04.870098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:04.880654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:04.882606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:04.884041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:04.885818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:04.886528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:04.887192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.048771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:05.050230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:05.064652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.066366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.069477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.070573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.071598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.075144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.079802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:05.328146 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5261a85f-13a3-4f02-8ed3-3e858a3b6a20 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.466871 Nov 02 14:15:05.342451 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3598/5204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:04 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:05.529772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:05.547317 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d6d94dc-abdd-42be-a8c3-e0ca630c4cb8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1497 microversion: 2.1 time: 0.501334 Nov 02 14:15:05.549547 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1607/5205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:05 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1497 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:05.570968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:05.571791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:05.579731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.580451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.581062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.581942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.582819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.583528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.587738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:05.617178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lazy-loading 'flavor' on Instance uuid 511d5964-e104-402a-969a-be2812c93bdf {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:15:05.636694 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'suspend' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state suspended Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 15 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: {"suspend": {}} Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'suspend' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state suspended Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'suspend': {}}} Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state suspended. Cannot suspend while the instance is in this state. Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 02 14:15:05.648689 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state suspended Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state suspended Nov 02 14:15:05.653992 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:05.659066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'suspend' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state suspended {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:05.663024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cb27e8d-629e-4c9f-86e7-0fb123bc49b9 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 148 microversion: 2.1 time: 0.096344 Nov 02 14:15:05.664911 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3599/5206] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:05 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 148 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 14:15:05.675921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:05.676474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:05.689515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.690015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.695894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.698508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.698873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.702149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.770285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:05.771009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:05.781820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.782892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.784299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.785036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.785498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.785926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.925571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-159f6a69-c5e3-4cc4-ac31-7db0685443e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.253971 Nov 02 14:15:05.929391 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1608/5207] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:05 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:15:05.940128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:05.941707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:05.966678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.967314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.967771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:05.971723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:05.973728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:05.974180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:06.111283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:06.128207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-583b2f56-f106-48ac-93fe-ffe104e6b408 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.356095 Nov 02 14:15:06.129431 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3600/5208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:05 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:06.353369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:06.354006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:06.380327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:06.380831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:06.381269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:06.381989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:06.389042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:06.389572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:06.713029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:06.722848 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a20751ea-e6e0-49e1-9e1f-9111367b82dd tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1503 microversion: 2.1 time: 0.791454 Nov 02 14:15:06.739146 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1609/5209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:05 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1503 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:06.885523 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5e6ef82-244f-46d2-a86f-5fb7ae3a1439 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.536095 Nov 02 14:15:06.888608 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3601/5210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:06 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:07.155347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:07.156381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:07.165457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:07.168908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:07.169509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:07.175295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:07.175880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:07.176389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:07.762479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:07.766908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:07.800137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:07.801669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:07.805004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:07.810898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:07.813388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:07.816420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:08.445409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:08.457498 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-554ecbfd-9356-433a-9e74-b46cbac3f4e7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 1.306647 Nov 02 14:15:08.460083 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1610/5211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:07 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:08.470282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:08.472812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:08.488450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:08.488980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:08.489434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:08.490178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:08.490640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:08.492237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:08.790474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:08.822647 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-54bf13d8-32df-4dfb-91c6-bd290846b46a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1503 microversion: 2.1 time: 1.072245 Nov 02 14:15:08.827216 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3602/5212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:07 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1503 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:08.925275 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7051e11f-b810-40eb-809c-70e0f0439c47 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.460576 Nov 02 14:15:08.937642 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1611/5213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:08 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:09.488872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:09.489500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:09.512040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:09.512677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:09.512979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:09.513786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:09.514160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:09.514591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:09.855848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:09.857237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:09.857971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:09.868498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-690c175e-41b3-490e-b6fb-1c1cab7d589e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.385220 Nov 02 14:15:09.869101 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3603/5214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:09 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:09.870103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:09.878408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:09.879712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:09.880624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:09.881274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:09.881881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:09.960630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:09.963195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:09.988373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:09.989914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:09.991913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:09.992846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:09.995561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:09.997633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.211428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:10.224706 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-687e7d00-48f1-4d73-89df-78b3d3974e5f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.372142 Nov 02 14:15:10.239891 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1612/5215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:09 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:10.250412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-bb3442d9-0f0b-48d1-98cc-73ebdf6e832c req-3802b77b-b349-49be-afa4-6c59534ca87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe6801-6f1d-4c99-9024-f4a69f4455cf", "name": "network-vif-plugged", "status": "completed", "tag": "89c241ad-8736-4d58-aa98-236075c532dc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:10.263191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bb3442d9-0f0b-48d1-98cc-73ebdf6e832c req-3802b77b-b349-49be-afa4-6c59534ca87d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.263939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bb3442d9-0f0b-48d1-98cc-73ebdf6e832c req-3802b77b-b349-49be-afa4-6c59534ca87d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.264528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bb3442d9-0f0b-48d1-98cc-73ebdf6e832c req-3802b77b-b349-49be-afa4-6c59534ca87d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.268654 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6259a4ec-4a2d-4413-aa9f-18741ed7c867 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.320613 Nov 02 14:15:10.269568 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3604/5216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:09 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:10.282361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:10.283780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:10.286141 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-bb3442d9-0f0b-48d1-98cc-73ebdf6e832c req-3802b77b-b349-49be-afa4-6c59534ca87d service nova] Creating event network-vif-plugged:89c241ad-8736-4d58-aa98-236075c532dc for instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf on n-h1-858238-3 Nov 02 14:15:10.294719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.295685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.296628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.298066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.298712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.299546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.304482 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-bb3442d9-0f0b-48d1-98cc-73ebdf6e832c req-3802b77b-b349-49be-afa4-6c59534ca87d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062607 Nov 02 14:15:10.307697 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1613/5217] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:10.549218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:10.558374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d16a9199-faaa-4634-8724-da433245a77f tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.281570 Nov 02 14:15:10.559785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3605/5218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:10 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:10.585183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-62a3f45f-7061-4bec-9318-3629e6330f83 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:10.586489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-62a3f45f-7061-4bec-9318-3629e6330f83 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: bd650133-69e7-4c48-81de-9df1e7f6ae08] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:10.601463 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-62a3f45f-7061-4bec-9318-3629e6330f83 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance bd650133-69e7-4c48-81de-9df1e7f6ae08 could not be found. Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-62a3f45f-7061-4bec-9318-3629e6330f83 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/bd650133-69e7-4c48-81de-9df1e7f6ae08/action HTTP/1.1 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 15 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: {"unpause": {}} Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance bd650133-69e7-4c48-81de-9df1e7f6ae08 could not be found. Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'bd650133-69e7-4c48-81de-9df1e7f6ae08', 'body': {'unpause': {}}} Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd650133-69e7-4c48-81de-9df1e7f6ae08 could not be found. Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd650133-69e7-4c48-81de-9df1e7f6ae08 could not be found. Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:10.607758 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd650133-69e7-4c48-81de-9df1e7f6ae08 could not be found. Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-62a3f45f-7061-4bec-9318-3629e6330f83 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance bd650133-69e7-4c48-81de-9df1e7f6ae08 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-62a3f45f-7061-4bec-9318-3629e6330f83 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/bd650133-69e7-4c48-81de-9df1e7f6ae08/action" status: 404 len: 111 microversion: 2.1 time: 0.036163 Nov 02 14:15:10.615750 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1614/5219] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:10 2022] POST /compute/v2.1/servers/bd650133-69e7-4c48-81de-9df1e7f6ae08/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:10.623329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:10.624455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:10.633270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.633967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.650458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.659174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.659779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.661609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.896038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:10.897249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:10.919907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.922305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.924456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:10.925213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:10.927825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:10.928273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.125921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:11.136908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-610ade54-67a1-4ea4-9afd-0dbbfa4278cf tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.517882 Nov 02 14:15:11.140690 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3606/5220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:10 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:11.171948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:11.173110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:11.188217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.189790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.190389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.191432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.192112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.192752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.290637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:11.309283 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54e774cb-17e4-4732-b5d2-12f32ba778be tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1500 microversion: 2.1 time: 0.419082 Nov 02 14:15:11.310196 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1615/5221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:10 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1500 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:11.318686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:11.320517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:11.338386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.340095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.343028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.353761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.354553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.356195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.752891 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0cd1d943-464f-4fcc-a288-1c0007487c64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1463 microversion: 2.1 time: 0.437199 Nov 02 14:15:11.768553 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1616/5222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:11 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1463 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:11.779563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:11.798670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40ff705a-d790-47b0-b116-8a6de01b1dc9"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:11.805379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:11.806230 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4712cd90-7516-4881-9518-094dac55bf04 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.645524 Nov 02 14:15:11.811963 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3607/5223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:11 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:11.816378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.816864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.817669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.818822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.819318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.820305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.838004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:11.838581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:11.855713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.860675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.861138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.866497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.867054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.867564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.876155 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Cannot 'attach_volume' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state rescued Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/os-volume_attachments HTTP/1.1 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 74 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: {"volumeAttachment": {"volumeId": "40ff705a-d790-47b0-b116-8a6de01b1dc9"}} Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'attach_volume' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state rescued Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': 'fc1a31dc-9106-4288-ae94-5a4a8eab8d4d', 'body': {'volumeAttachment': {'volumeId': '40ff705a-d790-47b0-b116-8a6de01b1dc9'}}} Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 14:15:11.877779 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state rescued Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state rescued Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.881685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 409 to user: Cannot 'attach_volume' instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d while it is in vm_state rescued {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:11.898045 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5955d7d7-6df3-4b41-a70a-cc8d5f1277d1 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.127062 Nov 02 14:15:11.902451 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1617/5224] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:15:11 2022] POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/os-volume_attachments => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:15:11.928045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:11.931500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:11.944590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'unpause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 15 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: {"unpause": {}} Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'unpause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'unpause': {}}} Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state active. Cannot unpause while the instance is in this state. Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:11.946515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:11.952957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:11.952957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:11.952957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:11.952957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:11.952957 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:11.956487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.963084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'unpause' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:11.967321 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1577f79e-c9a3-405d-900b-e3b412d40ebe tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 145 microversion: 2.1 time: 0.133570 Nov 02 14:15:11.970154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3608/5225] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:11 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 145 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:15:11.977315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.977774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.978510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:11.978958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:11.979398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:11.987829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:11.994198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:12.009057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.010209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.011045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.013225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.014139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.015887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.165194 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-36dcb157-22b0-497f-9720-6b6f24c4655f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action" status: 202 len: 0 microversion: 2.1 time: 0.256378 Nov 02 14:15:12.166384 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1618/5226] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:11 2022] POST /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:15:12.181209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:12.188893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:12.205331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.208162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.208823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.210901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.212918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.213565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.277780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:12.294300 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04879517-9b68-47ba-b5c9-79e2e53fb79d tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.318143 Nov 02 14:15:12.294903 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3609/5227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:11 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:12.328394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:12.329577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:12.345957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.346438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.350085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.351259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.359251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.359947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.698871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:12.715309 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0155ade3-9f06-48da-99c3-c45bde621515 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1508 microversion: 2.1 time: 0.538950 Nov 02 14:15:12.716368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1619/5228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:12 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:12.742980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:12.755464 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88053212-be10-490a-84b7-a68689119898 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.435167 Nov 02 14:15:12.771632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3610/5229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:12 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:12.783199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:12.784442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:12.798781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.802853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5d5e118-d5f6-475f-9b5c-78151c4f1e50 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:12.805530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.806000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f5d5e118-d5f6-475f-9b5c-78151c4f1e50 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 277a0325-3384-4805-8de2-209a6fffce85] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:12.809719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.812635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.813383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.814576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.821074 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f5d5e118-d5f6-475f-9b5c-78151c4f1e50 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 277a0325-3384-4805-8de2-209a6fffce85 could not be found. Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5d5e118-d5f6-475f-9b5c-78151c4f1e50 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/277a0325-3384-4805-8de2-209a6fffce85/action HTTP/1.1 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 18 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: {"unshelve": null} Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 277a0325-3384-4805-8de2-209a6fffce85 could not be found. Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '277a0325-3384-4805-8de2-209a6fffce85', 'body': {'unshelve': None}} Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277a0325-3384-4805-8de2-209a6fffce85 could not be found. Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277a0325-3384-4805-8de2-209a6fffce85 could not be found. Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:12.830679 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277a0325-3384-4805-8de2-209a6fffce85 could not be found. Nov 02 14:15:12.834956 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:12.841986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5d5e118-d5f6-475f-9b5c-78151c4f1e50 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 277a0325-3384-4805-8de2-209a6fffce85 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:12.845406 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f5d5e118-d5f6-475f-9b5c-78151c4f1e50 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/277a0325-3384-4805-8de2-209a6fffce85/action" status: 404 len: 111 microversion: 2.1 time: 0.056067 Nov 02 14:15:12.847870 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3611/5230] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:12 2022] POST /compute/v2.1/servers/277a0325-3384-4805-8de2-209a6fffce85/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:12.862052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:12.865556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:12.882391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.884689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.885545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:12.893483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:12.895990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:12.896679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.630736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:13.648261 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd67a52e-f86d-4d95-995d-d3e38185f160 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.795040 Nov 02 14:15:13.649890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3612/5231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:12 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:13.672130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:13.672806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:13.684447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.685296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.685959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.686903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.687716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.688919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.765377 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50c50e75-78c2-4f08-9be6-447883dbb64b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1648 microversion: 2.1 time: 0.990161 Nov 02 14:15:13.765953 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1620/5232] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:12 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1648 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:13.783226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:13.786020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:13.798706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.799240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.799671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.802765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.804958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.805636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.206552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:14.230622 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-143318d5-797a-4543-82ea-efb19d87e6a2 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.559781 Nov 02 14:15:14.231928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3613/5233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:13 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:14.240370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:14.249326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:14.262319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.264079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.265806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.267851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.269529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.270325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.626633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:14.644051 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a394b20a-8e19-47d3-a4bf-71939df2c998 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1508 microversion: 2.1 time: 0.875209 Nov 02 14:15:14.660000 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1621/5234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:13 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1508 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:14.666654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:14.667665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:14.676385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.677147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.677803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.679157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.680009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.680914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.721660 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Cannot 'unshelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action HTTP/1.1 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 18 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: {"unshelve": null} Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'unshelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'unshelve': None}} Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 511d5964-e104-402a-969a-be2812c93bdf in vm_state active. Cannot unshelve while the instance is in this state. Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:15:14.729214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active Nov 02 14:15:14.733979 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:14.736176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 409 to user: Cannot 'unshelve' instance 511d5964-e104-402a-969a-be2812c93bdf while it is in vm_state active {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:14.737283 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fbd3dbcc-e5e9-45df-b725-00ee5c9ba612 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action" status: 409 len: 146 microversion: 2.1 time: 0.075846 Nov 02 14:15:14.741363 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1622/5235] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:15:14 2022] POST /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf/action => generated 146 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:15:14.757431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:14.758066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:14.772171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2439e57f-059c-4bc8-b8bb-72f86c8d65c9 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1648 microversion: 2.1 time: 0.530522 Nov 02 14:15:14.790427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3614/5236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:14 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1648 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:14.795080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.797220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.798741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.799310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:14.800099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.800627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:14.801424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.801920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.813058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.814174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.814626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.815554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.816147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.816614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.199338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:15.201088 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e80a9575-2a54-47ef-a176-42147e2b8e64 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1648 microversion: 2.1 time: 0.409054 Nov 02 14:15:15.201691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3615/5237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:14 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1648 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:15.212762 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3acefc3f-e2f6-466a-9f6c-df18218db04a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.468251 Nov 02 14:15:15.213436 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1623/5238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:14 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:15.242115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:15.242924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:15.260449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.267480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.270587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.276460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.277684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.278467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.477453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-755339258", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "availability_zone": "nova:n-h2-858238-3", "networks": [{"uuid": "85b482bb-1219-450a-8622-a880429b3523"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:15.605903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] validate_networks() for [('85b482bb-1219-450a-8622-a880429b3523', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:15:15.770535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:15.785157 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-36ea020e-f28f-4e97-95c5-ea8deca88892 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.547842 Nov 02 14:15:15.786073 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3616/5239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:15 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:15.791534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:15.793003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:15.800052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.800874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.801645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.802915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.803420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.804008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.808098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:16.240710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:16.270724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b5cb477-2613-4b34-a4dd-eb9178f48320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1514 microversion: 2.1 time: 0.483552 Nov 02 14:15:16.275536 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3617/5240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:15 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:16.289358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cbc439d-2baf-4856-b6ae-d1b768f7eb47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2024169318_updated"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:16.292131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cbc439d-2baf-4856-b6ae-d1b768f7eb47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: a14c4837-0e49-4951-833c-c9438adccf7c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:16.304871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-8cbc439d-2baf-4856-b6ae-d1b768f7eb47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance a14c4837-0e49-4951-833c-c9438adccf7c could not be found. Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cbc439d-2baf-4856-b6ae-d1b768f7eb47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/servers/a14c4837-0e49-4951-833c-c9438adccf7c HTTP/1.1 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 81 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2024169318_updated"}} Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance a14c4837-0e49-4951-833c-c9438adccf7c could not be found. Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'a14c4837-0e49-4951-833c-c9438adccf7c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2024169318_updated'}}} Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14c4837-0e49-4951-833c-c9438adccf7c could not be found. Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 14:15:16.307194 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14c4837-0e49-4951-833c-c9438adccf7c could not be found. Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14c4837-0e49-4951-833c-c9438adccf7c could not be found. Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cbc439d-2baf-4856-b6ae-d1b768f7eb47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance a14c4837-0e49-4951-833c-c9438adccf7c could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:16.311068 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cbc439d-2baf-4856-b6ae-d1b768f7eb47 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "PUT /compute/v2.1/servers/a14c4837-0e49-4951-833c-c9438adccf7c" status: 404 len: 111 microversion: 2.1 time: 0.031484 Nov 02 14:15:16.323507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3618/5241] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 14:15:16 2022] PUT /compute/v2.1/servers/a14c4837-0e49-4951-833c-c9438adccf7c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:16.328429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:16.329093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:16.343475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.344190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.344824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.345701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.346316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.346885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.449124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:15:16.449574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:15:16.450005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:15:16.450485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:15:16.450898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:15:16.468092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.470122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.473130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.474935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.475813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.476293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.511297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:16.528486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Getting quotas for project 1bbed77b022643c5883a42894fe5c07d. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:15:16.545282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Getting quotas for user e96819f9b14f46e8b1100c3ca1bcde3e and project 1bbed77b022643c5883a42894fe5c07d. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:15:16.585851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:15:16.591724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:15:16.629277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:16.644154 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b3e7c85a-16e3-4f82-8362-9114bc1044ec tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.317390 Nov 02 14:15:16.648121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3619/5242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:16 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:16.673597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:16.674599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:16.685972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.687388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.689215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.691656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.692455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.693996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.720864 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4f0fdd28-6252-4824-96ca-94f304e08b41 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.246753 Nov 02 14:15:16.730994 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1624/5243] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:15:16.740180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f4828281-94cd-4b01-b664-d2e5b012e392 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:16.742164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f4828281-94cd-4b01-b664-d2e5b012e392 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:18.104542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f4828281-94cd-4b01-b664-d2e5b012e392 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1328 microversion: 2.1 time: 1.372292 Nov 02 14:15:18.131912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1625/5244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:16 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1328 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:18.868201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:18.887270 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db29dd97-378d-4788-b62a-793658d62dc4 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 2.218610 Nov 02 14:15:18.892099 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3620/5245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:16 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:18.915940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c1355b1-dc2b-4088-bb00-05a6dccc9030 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c1355b1-dc2b-4088-bb00-05a6dccc9030 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: request: PUT /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf HTTP/1.1 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 280 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.931420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 14:15:18.937651 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:18.942274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c1355b1-dc2b-4088-bb00-05a6dccc9030 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:18.943887 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0c1355b1-dc2b-4088-bb00-05a6dccc9030 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "PUT /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 400 len: 619 microversion: 2.1 time: 0.032455 Nov 02 14:15:18.945553 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1626/5246] 10.222.0.18 () {60 vars in 1257 bytes} [Wed Nov 2 14:15:18 2022] PUT /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:15:18.959560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:18.960747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:18.975571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:18.976556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:18.977441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:18.978344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:18.978962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:18.979572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:19.135154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:19.135787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:19.144112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:19.144898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:19.145396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:19.146418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:19.146963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:19.152539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:19.452951 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60d5ff0c-37c7-4433-baa8-d7fd6e95d71b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1433 microversion: 2.1 time: 0.322834 Nov 02 14:15:19.480717 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1627/5247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:19 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1433 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:19.487194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac177fb3-e1f5-4f72-9241-f5ff2602e331 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'create', calling method: .version_select at 0x7f6f80f15700>, body: {"keypair": {"name": "tempest-keypair-1175977821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6hU6k40r0k2uQJ8heS0L9TUPnjfUyYrAaGJRzbxaxLt8ZoTz7tb1/ZnZc1FW1mrT/BSvnsCe9bP9ICYkS6HB/dNd+c6e6nSIiKspARGSjN/01aovRVl1x1T+upvdkzWQ=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:19.547400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-ac177fb3-e1f5-4f72-9241-f5ff2602e331 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for project eed37e20191b4a5e817442412da9dca3. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:15:19.572473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-ac177fb3-e1f5-4f72-9241-f5ff2602e331 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for user 3d487891f8d84282ae11f28a2db2b230 and project eed37e20191b4a5e817442412da9dca3. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:15:19.664513 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ac177fb3-e1f5-4f72-9241-f5ff2602e331 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182537 Nov 02 14:15:19.665155 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1628/5248] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:15:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:19.702627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:19.712272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-15efb186-6293-48ce-bcb0-567df2af3ef7 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.762442 Nov 02 14:15:19.713550 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3621/5249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:18 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:19.743257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:19.744207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:19.752951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:19.753854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:19.754589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:19.755766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:19.756413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:19.757379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.268017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:20.296362 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50986f0f-179e-4f9b-8c59-c9bd13d70d3e tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.559396 Nov 02 14:15:20.315514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1629/5250] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:19 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:20.327612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e35f306-028d-4517-9765-24a0d7a42147 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e35f306-028d-4517-9765-24a0d7a42147 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf HTTP/1.1 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 24 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": ""}} Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf', 'body': {'server': {'name': ''}}} Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:15:20.332792 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 14:15:20.339231 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:20.365660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e35f306-028d-4517-9765-24a0d7a42147 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:20.368798 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e35f306-028d-4517-9765-24a0d7a42147 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "PUT /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 400 len: 108 microversion: 2.1 time: 0.049292 Nov 02 14:15:20.387753 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3622/5251] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 14:15:20 2022] PUT /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 108 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:15:20.393281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:20.395040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:20.409405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.416162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.417054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.418579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.419332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.426933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.480769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:20.481425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:20.521351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.522011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.526888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.528008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.531710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.532389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.925581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30ef1bab-cee4-433f-aa57-b116ac3ae60c tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1421 microversion: 2.1 time: 0.450405 Nov 02 14:15:20.926180 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3623/5252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:20 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1421 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:21.349275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:21.362210 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce86a712-4e45-4317-a176-f7b851442c28 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1506 microversion: 2.1 time: 0.984254 Nov 02 14:15:21.374717 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1630/5253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:20 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:21.955176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:21.956407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:21.997681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:21.998181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:22.003860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:22.006237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:22.009507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:22.014500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:23.261576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6996ef77-6908-4474-8d2b-a6afd78609bc tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 1.310244 Nov 02 14:15:23.262264 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3624/5254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:21 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:24.285355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:24.286884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:24.302662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:24.303441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:24.304476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:24.305565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:24.307139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:24.312527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:24.795040 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-42f89d7b-515e-40f7-9839-ec79d6407757 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 0.513343 Nov 02 14:15:24.798306 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1631/5255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:24 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:25.826788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:25.828295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:25.856154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:25.858134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:25.859741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:25.864165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:25.865231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:25.866470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:26.435880 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57759b6a-a3f7-43b9-8cab-0e9ce3e06704 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 0.614681 Nov 02 14:15:26.436569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3625/5256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:25 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:27.319436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:27.352271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-545485594", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be96af4e-8690-437e-81b3-93b36670d1eb"}], "security_groups": [{"name": "tempest-securitygroup--1881670139"}], "key_name": "tempest-keypair-1175977821", "user_data": "}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:27.461086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:27.462455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:27.482234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.485685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.490955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.492733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.494072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.495451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.740963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] validate_networks() for [('be96af4e-8690-437e-81b3-93b36670d1eb', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:15:28.490612 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d6d73cd-416d-4d6b-bcc6-5f5984443132 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 1.033475 Nov 02 14:15:28.497742 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3626/5257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:27 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:28.517538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-892229f9-ee64-41b2-8e0d-8dc3802a1c0c req-4198121e-7617-4938-83bf-36fdf1754cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849ad44a-7a1b-44be-aac7-2af875a2e530", "tag": "5adcf24a-583c-4f57-beaa-841bf1c12d27"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:28.535132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-892229f9-ee64-41b2-8e0d-8dc3802a1c0c req-4198121e-7617-4938-83bf-36fdf1754cc1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:28.537065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-892229f9-ee64-41b2-8e0d-8dc3802a1c0c req-4198121e-7617-4938-83bf-36fdf1754cc1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:28.538070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-892229f9-ee64-41b2-8e0d-8dc3802a1c0c req-4198121e-7617-4938-83bf-36fdf1754cc1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:28.572840 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-892229f9-ee64-41b2-8e0d-8dc3802a1c0c req-4198121e-7617-4938-83bf-36fdf1754cc1 service nova] Creating event network-changed:5adcf24a-583c-4f57-beaa-841bf1c12d27 for instance 849ad44a-7a1b-44be-aac7-2af875a2e530 on n-h2-858238-3 Nov 02 14:15:28.587278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-892229f9-ee64-41b2-8e0d-8dc3802a1c0c req-4198121e-7617-4938-83bf-36fdf1754cc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087801 Nov 02 14:15:28.594602 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3627/5258] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:29.522827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:29.523577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:29.547588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:29.548135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:29.548945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:29.549689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:29.550153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:29.550584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:29.590666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=12 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:30.417095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:15:30.417753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:15:30.418451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:15:30.419008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:15:30.419808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:15:30.440996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:30.443477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:30.446680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:30.447663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:30.448268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:30.448795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:30.494584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for project eed37e20191b4a5e817442412da9dca3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:15:30.506712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Getting quotas for user 3d487891f8d84282ae11f28a2db2b230 and project eed37e20191b4a5e817442412da9dca3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:15:30.543327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:15:30.545928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:15:30.602429 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6d13957c-d9bf-4956-943f-81db4eaff8dd tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 1.084527 Nov 02 14:15:30.605927 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3628/5259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:29 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:30.619404 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-944f622f-3ce4-4530-b3d2-056ea5e108f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.303130 Nov 02 14:15:30.621900 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1632/5260] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:15:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 3306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:15:30.636381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5b3cb6e-8ea2-4b39-81bf-374573946382 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:30.637551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5b3cb6e-8ea2-4b39-81bf-374573946382 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:30.942306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5b3cb6e-8ea2-4b39-81bf-374573946382 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:30.957531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5b3cb6e-8ea2-4b39-81bf-374573946382 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1245 microversion: 2.1 time: 0.324546 Nov 02 14:15:30.960621 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3629/5261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:30 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1245 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:31.653218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:31.653949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:31.674653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:31.681172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:31.685929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:31.687068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:31.688895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:31.690089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.003967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38aab6d9-4153-4a4b-8f21-5caafd97b144 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:32.005913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38aab6d9-4153-4a4b-8f21-5caafd97b144 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:32.198694 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3d9f8dd9-4eaa-4b40-8e83-218395cdca13 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 0.550059 Nov 02 14:15:32.214917 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1633/5262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:31 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:32.239687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38aab6d9-4153-4a4b-8f21-5caafd97b144 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:32.252771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:32.256814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:32.277513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:32.302266 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38aab6d9-4153-4a4b-8f21-5caafd97b144 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1245 microversion: 2.1 time: 0.306738 Nov 02 14:15:32.304765 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3630/5263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:31 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1245 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:32.323925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.325192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.326225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.331600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.335765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.336122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.412090 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 HTTP/1.1 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6'} Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:32.430981 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.437622 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.444619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:32.449554 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60af134f-ceec-40c8-baec-e7596240e4e8 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 404 len: 111 microversion: 2.1 time: 0.230199 Nov 02 14:15:32.452256 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1634/5264] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:15:32 2022] DELETE /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:32.459794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:32.460422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:32.478815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.486242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.487078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.487915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.488392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.488816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.527575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 HTTP/1.1 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6'} Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:32.529249 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. Nov 02 14:15:32.533722 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:32.542733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:32.543976 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6bf9274e-b243-4d55-b749-35e98381da2a tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6" status: 404 len: 111 microversion: 2.1 time: 0.088234 Nov 02 14:15:32.545455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3631/5265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:32 2022] GET /compute/v2.1/servers/fd7c5c8b-b9a7-4f1c-b73f-7a267cdcbbe6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:32.553657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:32.554444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:32.569561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.571729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.581354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.583280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.586509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.587389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.676188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:15:32.866006 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50859fbf-680c-4bb5-b253-73bdff2e3844 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "DELETE /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 204 len: 0 microversion: 2.1 time: 0.316793 Nov 02 14:15:32.869125 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1635/5266] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:15:32 2022] DELETE /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:15:32.878299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:32.879034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:32.893003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.904158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.904779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.909351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.909999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.910548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:33.259542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:33.260151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:33.275530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:33.276082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:33.276524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:33.277270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:33.277724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:33.291316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:34.306036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:34.319143 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70a52934-172c-40a4-b293-2584e4610012 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 1.445575 Nov 02 14:15:34.328614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3632/5267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:32 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:34.334158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:34.334779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:34.349897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:34.350409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:34.350996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:34.351752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:34.352215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:34.352646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:34.761279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:34.774017 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb9e6275-a175-47d9-94c9-88fbebaf8f8e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1297 microversion: 2.1 time: 0.442289 Nov 02 14:15:34.791499 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3633/5268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:34 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1297 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:34.842613 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2260c25f-8484-4cf1-9ffb-f7b5e77c1421 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 1.588185 Nov 02 14:15:34.846148 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1636/5269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:33 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:35.368253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:35.370443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:35.374153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=74 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:35.451395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:35.452518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:35.457019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:35.465566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:35.466197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:35.466714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:35.798498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:35.799134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:35.822145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:35.822636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:35.826874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:35.830022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:35.831009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:35.831830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.055081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:36.063425 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-643c9bea-13fe-47b5-a6c6-144f3f8ab218 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1303 microversion: 2.1 time: 0.269258 Nov 02 14:15:36.067450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:36.076750 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a33dbf5-444a-4d56-b6fc-09efd2d985a5 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1512 microversion: 2.1 time: 0.714138 Nov 02 14:15:36.077131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1637/5270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:35 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:36.081026 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3634/5271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:35 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1512 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:36.083922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:36.102056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:36.118078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.118912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.120042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.122361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.127199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.127987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.699831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c8b873f4-f3bf-45d5-9f99-32932aa6d1a2 req-dc10988f-48fa-4ffe-aef9-2076d431b76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511d5964-e104-402a-969a-be2812c93bdf", "name": "network-vif-deleted", "tag": "6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:36.725888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c8b873f4-f3bf-45d5-9f99-32932aa6d1a2 req-dc10988f-48fa-4ffe-aef9-2076d431b76b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.726656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c8b873f4-f3bf-45d5-9f99-32932aa6d1a2 req-dc10988f-48fa-4ffe-aef9-2076d431b76b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.728403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c8b873f4-f3bf-45d5-9f99-32932aa6d1a2 req-dc10988f-48fa-4ffe-aef9-2076d431b76b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.764901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c8b873f4-f3bf-45d5-9f99-32932aa6d1a2 req-dc10988f-48fa-4ffe-aef9-2076d431b76b service nova] Creating event network-vif-deleted:6f5ea33a-39ad-428e-9b5d-b6c20b5b6d1e for instance 511d5964-e104-402a-969a-be2812c93bdf on n-h1-858238-3 Nov 02 14:15:36.784835 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c8b873f4-f3bf-45d5-9f99-32932aa6d1a2 req-dc10988f-48fa-4ffe-aef9-2076d431b76b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089926 Nov 02 14:15:36.787190 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3635/5272] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:15:36.852915 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1413aec0-b67c-4dd1-ac86-87c70681d513 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 0.772800 Nov 02 14:15:36.854556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1638/5273] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:36 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:37.090807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:37.091864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:37.103984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:37.105309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:37.110014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.115253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.116089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:37.118516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.120437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.121987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.122650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:37.126787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.128925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:37.129988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.132183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.134389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:37.203430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.204464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.204922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:37.205391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lazy-loading 'fault' on Instance uuid 511d5964-e104-402a-969a-be2812c93bdf {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:15:37.597431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80d7d9f70e5433f9d76d5fca703f49e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa447cf682848278bbc77e70d04013c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:37.637897 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ba25062e-3a93-40af-a72e-413a4265decc tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 200 len: 1307 microversion: 2.1 time: 0.535985 Nov 02 14:15:37.639346 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1639/5274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:37 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 1307 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:37.764110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:37.796567 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-373fbe44-eb29-4975-a3c5-a74f1a5aa320 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1303 microversion: 2.1 time: 0.707593 Nov 02 14:15:37.800667 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3636/5275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:37 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1303 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:37.883072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:37.884069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:37.904563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.908006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.909135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:37.910171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:37.910810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:37.912391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:38.666761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:38.667705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] [instance: 511d5964-e104-402a-969a-be2812c93bdf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:38.684490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:38.690495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:38.691202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:38.693382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:38.694399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:38.695189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:38.737747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] HTTP exception thrown: Instance 511d5964-e104-402a-969a-be2812c93bdf could not be found. Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Request method failure captured: Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf HTTP/1.1 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnp2kdxsvoapJOAFoW86HrgkXSpOdriRr7o2wHSCuJA8RPfIqB1JNM70gigMKSA6rUq4uj4q4m-KdzYhr4NfJDTbVmFfPjD5oQRMghTsdj5WGe_NzCp9j_StNS_miJH8PpCAHWtpnOA4ZBcBzsNWGsMt81OduauBECwkCpxg6_ph3Io Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7aa447cf682848278bbc77e70d04013c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7aa447cf682848278bbc77e70d04013c"}]}] Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 7aa447cf682848278bbc77e70d04013c Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1113957557 Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: b80d7d9f70e5433f9d76d5fca703f49e Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-1113957557-project Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 511d5964-e104-402a-969a-be2812c93bdf could not be found. Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '511d5964-e104-402a-969a-be2812c93bdf'} Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511d5964-e104-402a-969a-be2812c93bdf could not be found. Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511d5964-e104-402a-969a-be2812c93bdf could not be found. Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:38.739816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511d5964-e104-402a-969a-be2812c93bdf could not be found. Nov 02 14:15:38.744711 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:15:38.754370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] Returning 404 to user: Instance 511d5964-e104-402a-969a-be2812c93bdf could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:38.756312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc7ca016-c3de-4d60-8a93-3d83e7e67384 tempest-ServersNegativeTestJSON-1113957557 tempest-ServersNegativeTestJSON-1113957557-project] 10.222.0.18 "GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf" status: 404 len: 111 microversion: 2.1 time: 0.093059 Nov 02 14:15:38.757186 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3637/5276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:38 2022] GET /compute/v2.1/servers/511d5964-e104-402a-969a-be2812c93bdf => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:15:38.833288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:38.834750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:38.847688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:38.849132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:38.849761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:38.850755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:38.856625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:38.857534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:39.261284 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-224a7c86-7490-4a10-b880-8eaa254632de tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 1.380524 Nov 02 14:15:39.263202 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1640/5277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:37 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:39.289310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e1d180fb-51af-432e-b5b9-ea117c40a371 req-1e232f4e-47ea-436e-895f-a4f6f177e98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849ad44a-7a1b-44be-aac7-2af875a2e530", "name": "network-vif-plugged", "status": "completed", "tag": "5adcf24a-583c-4f57-beaa-841bf1c12d27"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:39.318126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1d180fb-51af-432e-b5b9-ea117c40a371 req-1e232f4e-47ea-436e-895f-a4f6f177e98b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:39.318893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1d180fb-51af-432e-b5b9-ea117c40a371 req-1e232f4e-47ea-436e-895f-a4f6f177e98b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:39.320093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1d180fb-51af-432e-b5b9-ea117c40a371 req-1e232f4e-47ea-436e-895f-a4f6f177e98b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:39.355928 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e1d180fb-51af-432e-b5b9-ea117c40a371 req-1e232f4e-47ea-436e-895f-a4f6f177e98b service nova] Creating event network-vif-plugged:5adcf24a-583c-4f57-beaa-841bf1c12d27 for instance 849ad44a-7a1b-44be-aac7-2af875a2e530 on n-h2-858238-3 Nov 02 14:15:39.367874 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e1d180fb-51af-432e-b5b9-ea117c40a371 req-1e232f4e-47ea-436e-895f-a4f6f177e98b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103006 Nov 02 14:15:39.379765 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1641/5278] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:39.753416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:39.831267 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5cf873b1-8b94-4c11-b378-7ff9d3a2a448 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 0.997386 Nov 02 14:15:39.832311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3638/5279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:38 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:40.301008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:40.310134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:40.359599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:40.361564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:40.363030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:40.382495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:40.392375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:40.399809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:40.481121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:40.537336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:40.855189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:40.855817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:40.864297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:40.865216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:40.865889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:40.867037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:40.867752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:40.868397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:41.047837 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-242d4b7d-6a5d-48c1-827c-b0f79c8739ce tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1463 microversion: 2.1 time: 0.757612 Nov 02 14:15:41.065899 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1642/5280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:40 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1463 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:41.440135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:41.474594 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c793613-d3fb-4704-a13f-f5a05eab6b2e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 0.620123 Nov 02 14:15:41.476735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3639/5281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:40 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:42.077586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:42.080841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:42.110023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:42.111142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:42.113070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:42.114220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:42.115518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:42.117411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:42.506868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:42.509136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:42.525109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:42.528154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:42.529057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:42.529769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:42.530814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:42.531546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:42.535614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:42.624288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:42.897684 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-854bdb9c-9c63-43cf-95db-ff2d54ef47a0 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1647 microversion: 2.1 time: 0.825483 Nov 02 14:15:42.904818 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1643/5282] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:42 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1647 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:42.952312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:42.952904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:42.961498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:42.962176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:42.962617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:42.971366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:42.972298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:42.972400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:43.003374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:43.320176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:43.391644 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd498bb8-33fb-4e48-8950-bd94b4fc248e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 0.888402 Nov 02 14:15:43.405334 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3640/5283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:42 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:43.452113 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-85efd29f-5cbc-45ce-a31d-3a1ed0ccc424 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1647 microversion: 2.1 time: 0.511196 Nov 02 14:15:43.454730 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1644/5284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:42 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1647 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:43.482492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:43.483436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:43.494041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a7dc4b72-a8cb-4109-a1a3-941a40de723f req-9fec8498-c72c-4063-9a35-9c3c02829146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a74657-d61a-4580-9dc9-a9bded83e976", "tag": "7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:43.504884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:43.516566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:43.518298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:43.520635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a7dc4b72-a8cb-4109-a1a3-941a40de723f req-9fec8498-c72c-4063-9a35-9c3c02829146 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:43.521682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:43.523726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:43.524417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:43.533821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a7dc4b72-a8cb-4109-a1a3-941a40de723f req-9fec8498-c72c-4063-9a35-9c3c02829146 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:43.536522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a7dc4b72-a8cb-4109-a1a3-941a40de723f req-9fec8498-c72c-4063-9a35-9c3c02829146 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:43.580777 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a7dc4b72-a8cb-4109-a1a3-941a40de723f req-9fec8498-c72c-4063-9a35-9c3c02829146 service nova] Creating event network-changed:7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23 for instance c2a74657-d61a-4580-9dc9-a9bded83e976 on n-h1-858238-3 Nov 02 14:15:43.603136 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a7dc4b72-a8cb-4109-a1a3-941a40de723f req-9fec8498-c72c-4063-9a35-9c3c02829146 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107999 Nov 02 14:15:43.604702 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1645/5285] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:15:44.159320 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4871ea53-33c4-4df4-92a8-58c8b90f8c08 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1647 microversion: 2.1 time: 0.680980 Nov 02 14:15:44.165028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3641/5286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:43 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1647 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:44.186424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:44.187031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:44.213008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:44.213742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:44.214191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:44.214918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:44.215407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:44.215840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:44.248916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1258806844", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "03da18e2-62b4-4450-9368-256bd7f0e938", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:44.311686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:15:44.408325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:15:44.643025 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8cd02a83-8d5f-4289-8c04-99440c7d7e1b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 204 len: 0 microversion: 2.1 time: 0.458424 Nov 02 14:15:44.648210 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1646/5287] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:15:44 2022] DELETE /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:15:44.664606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:44.666300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:44.678482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:44.679218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:44.679936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:44.680809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:44.681428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:44.682113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:45.902041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:45.924723 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54391911-4981-46f2-aa9b-7b1d13a6a7b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 1.273327 Nov 02 14:15:45.925918 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1647/5288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:44 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:45.981723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:45.988821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:46.008828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:46.009995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:46.010887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:46.012279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:46.013200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:46.014060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:46.571647 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5ba19bf-3653-4072-8d86-ce57a1462710 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1653 microversion: 2.1 time: 0.617623 Nov 02 14:15:46.578069 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1648/5289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:45 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1653 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:46.873344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:15:46.874023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:15:46.874506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:15:46.874920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:15:46.875498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:15:46.904263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:46.904873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:46.905329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:46.906154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:46.906630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:46.907057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:46.968516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:46.970827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:46.984558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:46.987587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:15:46.988943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:46.991760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:46.995357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:46.996536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:47.002290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:15:47.003868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:47.191205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:15:47.191205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03da18e2-62b4-4450-9368-256bd7f0e938',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:15:47.401275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:47.409646 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b3c9ae9a-49c2-436d-bb4b-3b3132f3352b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 0.446528 Nov 02 14:15:47.415280 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1649/5290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:46 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:47.511682 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9492720a-1c11-423f-a392-4a9cba60a67c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.266554 Nov 02 14:15:47.527927 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3642/5291] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:15:47.533488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f0c092de-7cc0-4ed8-b4a0-79b1b1933b79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:47.534110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f0c092de-7cc0-4ed8-b4a0-79b1b1933b79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:47.602743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:47.604023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:47.626821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:47.627735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:47.628444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:47.629426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:47.630093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:47.631197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:47.842119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f0c092de-7cc0-4ed8-b4a0-79b1b1933b79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:47.858990 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f0c092de-7cc0-4ed8-b4a0-79b1b1933b79 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1071 microversion: 2.1 time: 0.331389 Nov 02 14:15:47.867308 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1650/5292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:47 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1071 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:48.145478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5f2d5db-4070-42d4-bdd5-4aaea578dae6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1653 microversion: 2.1 time: 0.546052 Nov 02 14:15:48.149217 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3643/5293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:47 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1653 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:48.437403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:48.438018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:48.455734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:48.456508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:48.457112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:48.457993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:48.460925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:48.461894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:48.893488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:48.894193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:48.969519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:48.972713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:48.973268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:48.974208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:48.975692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:48.980690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:49.378329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:49.390474 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40ae6a82-f171-49b5-b925-fada26b2327e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 0.957457 Nov 02 14:15:49.397029 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1651/5294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:48 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:49.415805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:49.425547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:49.426387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:49.435929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:49.436768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:49.437437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:49.439419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:49.439544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-396792a6-b461-4052-8fa7-50838d190500 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1169 microversion: 2.1 time: 0.552773 Nov 02 14:15:49.441061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:49.442693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:49.447018 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3644/5295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:48 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1169 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:49.475894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-18b70a6a-7f1a-407a-ac20-a66635f02bd1 req-6e277412-f87d-44af-bf4f-2e7b8a304319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849ad44a-7a1b-44be-aac7-2af875a2e530", "name": "network-vif-deleted", "tag": "5adcf24a-583c-4f57-beaa-841bf1c12d27"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:49.535469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-18b70a6a-7f1a-407a-ac20-a66635f02bd1 req-6e277412-f87d-44af-bf4f-2e7b8a304319 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:49.539575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-18b70a6a-7f1a-407a-ac20-a66635f02bd1 req-6e277412-f87d-44af-bf4f-2e7b8a304319 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:49.550172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-18b70a6a-7f1a-407a-ac20-a66635f02bd1 req-6e277412-f87d-44af-bf4f-2e7b8a304319 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:49.612790 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-18b70a6a-7f1a-407a-ac20-a66635f02bd1 req-6e277412-f87d-44af-bf4f-2e7b8a304319 service nova] Creating event network-vif-deleted:5adcf24a-583c-4f57-beaa-841bf1c12d27 for instance 849ad44a-7a1b-44be-aac7-2af875a2e530 on n-h2-858238-3 Nov 02 14:15:49.632171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-18b70a6a-7f1a-407a-ac20-a66635f02bd1 req-6e277412-f87d-44af-bf4f-2e7b8a304319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183384 Nov 02 14:15:49.641289 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3645/5296] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:50.174577 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-679b75d4-11d2-4caf-836f-768b3be40e3b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 200 len: 1448 microversion: 2.1 time: 0.775795 Nov 02 14:15:50.175554 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1652/5297] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:49 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 1448 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:50.428584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:50.429799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:50.460191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:50.460717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:50.463933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:50.468158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:50.468955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:50.475324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:50.477668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:50.478286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:50.545483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:50.547410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:50.548523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:50.552036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:50.552928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:50.555636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:50.924344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:50.933835 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5d97eef-6649-4331-9f37-649077b7074e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1187 microversion: 2.1 time: 0.465717 Nov 02 14:15:50.957010 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1653/5298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:50 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1187 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:51.206287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:51.207405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 849ad44a-7a1b-44be-aac7-2af875a2e530] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:51.238384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:51.239228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:51.239904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:51.240963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:51.241600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:51.255281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:51.285940 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] HTTP exception thrown: Instance 849ad44a-7a1b-44be-aac7-2af875a2e530 could not be found. Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Request method failure captured: Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 HTTP/1.1 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYntXZ4LA0Vzwe3r1FP5b6dgizuQ7OmNAEW9NrZgoONmIvBfV5go54wHjvqggBa8nzbA5tY7Z6blb24OeORERHfV2vrvhcwSqGLoxz3LA4v3c19sdQ72Ix8ayYrM0jlaNDSv_P61VQCBhjcs5RMOIMZlcETzmt6jhJq41MV4OluSPmSE Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1bbed77b022643c5883a42894fe5c07d Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestServerMultinode-413609437 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bbed77b022643c5883a42894fe5c07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bbed77b022643c5883a42894fe5c07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bbed77b022643c5883a42894fe5c07d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bbed77b022643c5883a42894fe5c07d"}]}] Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestServerMultinode-413609437 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1bbed77b022643c5883a42894fe5c07d Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestServerMultinode-413609437 Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestServerMultinode-413609437-project-admin Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e96819f9b14f46e8b1100c3ca1bcde3e Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestServerMultinode-413609437-project-admin Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 849ad44a-7a1b-44be-aac7-2af875a2e530 could not be found. Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '849ad44a-7a1b-44be-aac7-2af875a2e530'} Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849ad44a-7a1b-44be-aac7-2af875a2e530 could not be found. Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849ad44a-7a1b-44be-aac7-2af875a2e530 could not be found. Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:51.292145 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849ad44a-7a1b-44be-aac7-2af875a2e530 could not be found. Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Returning 404 to user: Instance 849ad44a-7a1b-44be-aac7-2af875a2e530 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:51.298444 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4b772678-0b73-46eb-b3c8-116a337f834b tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530" status: 404 len: 111 microversion: 2.1 time: 0.094399 Nov 02 14:15:51.307539 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1654/5299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:51 2022] GET /compute/v2.1/servers/849ad44a-7a1b-44be-aac7-2af875a2e530 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:51.314815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:51.317323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:51.339316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:51.342635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:51.344457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:51.358947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:51.360982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:51.366209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:51.484367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:15:51.754087 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c5f2b907-1f7a-4c17-9851-c4f5ed891e70 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 204 len: 0 microversion: 2.1 time: 0.444523 Nov 02 14:15:51.754593 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1655/5300] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:15:51 2022] DELETE /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:15:51.780134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:51.789620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:51.812156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:51.812764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:51.814110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:51.815513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:51.821508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:51.822255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:53.001449 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-07332b9d-f2b1-4206-b5f1-1e44c21691f6 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1654 microversion: 2.1 time: 1.239495 Nov 02 14:15:53.015442 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1656/5301] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:51 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1654 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:53.016191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:53.018958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:53.033608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:53.034172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:53.034609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:53.035375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:53.035832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:53.036253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:53.351062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:53.364050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-551c11c2-a466-4097-a3a1-536e69a6fbee tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 2.940971 Nov 02 14:15:53.381358 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3646/5302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:50 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 2959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:54.030034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:54.030755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:54.041812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:54.042298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:54.042731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:54.049383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:54.049908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:54.050355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:54.592443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:54.603251 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c6297e2-1c62-4ef0-9614-520fe5e5ab52 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1229 microversion: 2.1 time: 1.598630 Nov 02 14:15:54.623740 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1657/5303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:53 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1229 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:54.639997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:54.641313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:54.662764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:54.663935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:54.664697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:54.665757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:54.666448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:54.667290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:55.398751 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-202b1fa3-a83c-4db2-9893-6b9234c88c8a tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1654 microversion: 2.1 time: 1.372587 Nov 02 14:15:55.399810 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3647/5304] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:54 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1654 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:55.412840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ddf8dbb4-2907-48bc-ac90-16bef7093afb req-b1b3694d-3350-461e-b04a-2dd3985e651b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca4ce93-df71-4380-ac8f-29a510ff0ee6", "tag": "ea507852-e5fa-4cff-8185-87c1481ae4c6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:55.434066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ddf8dbb4-2907-48bc-ac90-16bef7093afb req-b1b3694d-3350-461e-b04a-2dd3985e651b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:55.434588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ddf8dbb4-2907-48bc-ac90-16bef7093afb req-b1b3694d-3350-461e-b04a-2dd3985e651b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:55.435052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ddf8dbb4-2907-48bc-ac90-16bef7093afb req-b1b3694d-3350-461e-b04a-2dd3985e651b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:55.465841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ddf8dbb4-2907-48bc-ac90-16bef7093afb req-b1b3694d-3350-461e-b04a-2dd3985e651b service nova] Creating event network-changed:ea507852-e5fa-4cff-8185-87c1481ae4c6 for instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 on n-h2-858238-3 Nov 02 14:15:55.472419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ddf8dbb4-2907-48bc-ac90-16bef7093afb req-b1b3694d-3350-461e-b04a-2dd3985e651b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070813 Nov 02 14:15:55.473700 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3648/5305] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:55.479807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b9a28248-4900-43ee-b5ca-5bad4495935b req-1ae593cb-5a68-421a-9ebb-bf2d60ffedae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a74657-d61a-4580-9dc9-a9bded83e976", "name": "network-vif-plugged", "status": "completed", "tag": "7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:55.493758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b9a28248-4900-43ee-b5ca-5bad4495935b req-1ae593cb-5a68-421a-9ebb-bf2d60ffedae service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:55.494245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b9a28248-4900-43ee-b5ca-5bad4495935b req-1ae593cb-5a68-421a-9ebb-bf2d60ffedae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:55.494667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b9a28248-4900-43ee-b5ca-5bad4495935b req-1ae593cb-5a68-421a-9ebb-bf2d60ffedae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:55.508069 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b9a28248-4900-43ee-b5ca-5bad4495935b req-1ae593cb-5a68-421a-9ebb-bf2d60ffedae service nova] Creating event network-vif-plugged:7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23 for instance c2a74657-d61a-4580-9dc9-a9bded83e976 on n-h1-858238-3 Nov 02 14:15:55.513810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b9a28248-4900-43ee-b5ca-5bad4495935b req-1ae593cb-5a68-421a-9ebb-bf2d60ffedae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038463 Nov 02 14:15:55.514762 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3649/5306] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:55.637431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:55.644837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:55.664806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:55.665655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:55.674879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:55.676032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:55.678297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:55.681469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:55.786519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:55.799848 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-97924dba-97ff-4c63-baf3-28982a67aa86 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 1.173129 Nov 02 14:15:55.801243 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1658/5307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:54 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:56.321334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:56.340188 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16431948-bc10-4457-9835-2856aa073bef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1229 microversion: 2.1 time: 0.707197 Nov 02 14:15:56.356659 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3650/5308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:55 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1229 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:56.427185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:56.437331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:56.450728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:56.451709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:56.453889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:56.455590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:56.460084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:56.461977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:56.761866 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-101acc28-5997-4ee0-a545-99d13631d1c1 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 200 len: 1612 microversion: 2.1 time: 0.338324 Nov 02 14:15:56.763083 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1659/5309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:56 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 1612 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:56.823709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:56.824897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:56.835749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:56.836416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:56.837087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:56.838017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:56.838622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:56.839221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:56.952438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:56.965897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3573d67e-041f-4719-9adb-16dfd3db5afb req-ff9012d4-8137-485b-a8ff-8b774d7c669b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe6801-6f1d-4c99-9024-f4a69f4455cf", "name": "network-vif-deleted", "tag": "89c241ad-8736-4d58-aa98-236075c532dc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:56.988513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3573d67e-041f-4719-9adb-16dfd3db5afb req-ff9012d4-8137-485b-a8ff-8b774d7c669b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:56.989426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3573d67e-041f-4719-9adb-16dfd3db5afb req-ff9012d4-8137-485b-a8ff-8b774d7c669b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:56.990037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3573d67e-041f-4719-9adb-16dfd3db5afb req-ff9012d4-8137-485b-a8ff-8b774d7c669b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:56.996395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:57.006883 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3573d67e-041f-4719-9adb-16dfd3db5afb req-ff9012d4-8137-485b-a8ff-8b774d7c669b service nova] Creating event network-vif-deleted:89c241ad-8736-4d58-aa98-236075c532dc for instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf on n-h1-858238-3 Nov 02 14:15:57.018578 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3573d67e-041f-4719-9adb-16dfd3db5afb req-ff9012d4-8137-485b-a8ff-8b774d7c669b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054970 Nov 02 14:15:57.020531 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1660/5310] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:15:57.031734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:57.367774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:57.369050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:57.379594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:57.380379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:57.381245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:57.382965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:57.383605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:57.384206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:57.849020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:58.242343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:58.263990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98e6f6f0-6439-4c57-9758-7dc07d3ed9c4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1371 microversion: 2.1 time: 1.444417 Nov 02 14:15:58.264603 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3651/5311] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:56 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1371 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:58.279265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:58.284604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-fc151418-35bd-4fc0-9af1-bf0408ffd481 req-338a4831-7342-45dd-9923-141f113a668a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe6801-6f1d-4c99-9024-f4a69f4455cf", "name": "network-vif-unplugged", "status": "completed", "tag": "89c241ad-8736-4d58-aa98-236075c532dc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:58.287528 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e2c9e9e6-ac6b-4640-895f-9cacec900d32 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1229 microversion: 2.1 time: 0.925210 Nov 02 14:15:58.291724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1661/5312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:57 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1229 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:58.302667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:58.303680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] [instance: 51fe6801-6f1d-4c99-9024-f4a69f4455cf] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:58.311588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc151418-35bd-4fc0-9af1-bf0408ffd481 req-338a4831-7342-45dd-9923-141f113a668a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:58.312310 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc151418-35bd-4fc0-9af1-bf0408ffd481 req-338a4831-7342-45dd-9923-141f113a668a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:58.312918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fc151418-35bd-4fc0-9af1-bf0408ffd481 req-338a4831-7342-45dd-9923-141f113a668a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:58.320700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:58.321206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:58.321634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:58.324684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:58.325159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:58.327653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:58.329605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fc151418-35bd-4fc0-9af1-bf0408ffd481 req-338a4831-7342-45dd-9923-141f113a668a service nova] Creating event network-vif-unplugged:89c241ad-8736-4d58-aa98-236075c532dc for instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf on n-h1-858238-3 Nov 02 14:15:58.347596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-fc151418-35bd-4fc0-9af1-bf0408ffd481 req-338a4831-7342-45dd-9923-141f113a668a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067322 Nov 02 14:15:58.348234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3652/5313] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:58.363554 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] HTTP exception thrown: Instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf could not be found. Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Request method failure captured: Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf HTTP/1.1 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYntXZ4LA0Vzwe3r1FP5b6dgizuQ7OmNAEW9NrZgoONmIvBfV5go54wHjvqggBa8nzbA5tY7Z6blb24OeORERHfV2vrvhcwSqGLoxz3LA4v3c19sdQ72Ix8ayYrM0jlaNDSv_P61VQCBhjcs5RMOIMZlcETzmt6jhJq41MV4OluSPmSE Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 1bbed77b022643c5883a42894fe5c07d Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestServerMultinode-413609437 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bbed77b022643c5883a42894fe5c07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1bbed77b022643c5883a42894fe5c07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1bbed77b022643c5883a42894fe5c07d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1bbed77b022643c5883a42894fe5c07d"}]}] Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestServerMultinode-413609437 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 1bbed77b022643c5883a42894fe5c07d Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestServerMultinode-413609437 Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestServerMultinode-413609437-project-admin Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e96819f9b14f46e8b1100c3ca1bcde3e Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestServerMultinode-413609437-project-admin Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf could not be found. Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '51fe6801-6f1d-4c99-9024-f4a69f4455cf'} Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf could not be found. Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf could not be found. Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:58.367717 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf could not be found. Nov 02 14:15:58.372684 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:15:58.374175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] Returning 404 to user: Instance 51fe6801-6f1d-4c99-9024-f4a69f4455cf could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:58.376945 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f6d11a72-ddce-4d80-ad65-93bc14577f00 tempest-TestServerMultinode-413609437 tempest-TestServerMultinode-413609437-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf" status: 404 len: 111 microversion: 2.1 time: 0.082989 Nov 02 14:15:58.380189 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1662/5314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:58 2022] GET /compute/v2.1/servers/51fe6801-6f1d-4c99-9024-f4a69f4455cf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:59.288516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:59.289790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:59.305254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.308854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.309501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.312046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.312904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.313530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.313714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:59.314331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:59.330839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.331789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.332409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.333741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.335628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.336254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.859585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:59.871813 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7976d8b4-050c-4f94-9d13-02d58d3b0343 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1564 microversion: 2.1 time: 0.589228 Nov 02 14:15:59.879999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3653/5315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:59 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1564 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:59.907214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:59.908673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:59.916451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.917203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.918140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.919534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.920199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.921733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:00.054673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:00.066286 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29c2b6a7-6a97-4e48-85a3-31a877bcf943 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1229 microversion: 2.1 time: 0.755234 Nov 02 14:16:00.069065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1663/5316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:15:59 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1229 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:00.185064 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4485bf7f-c206-4b05-944e-aabcb7f4cea9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283184 Nov 02 14:16:00.185679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3654/5317] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:15:59 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:16:01.094889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:01.095620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:01.120026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:01.120621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:01.121138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:01.121882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:01.122339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:01.123044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:01.930052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:01.952209 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b003b8c-5dc6-4b0c-bc43-aa4dcce6b144 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1229 microversion: 2.1 time: 0.857897 Nov 02 14:16:01.978275 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1664/5318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:01 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1229 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:03.006914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:03.008137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:03.020576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:03.021070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:03.021504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:03.022214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:03.022661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:03.023085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:03.704262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:03.713513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-136e8260-c9e6-4582-b272-6d9b4a9df7dc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1229 microversion: 2.1 time: 0.711379 Nov 02 14:16:03.714110 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3655/5319] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:03 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1229 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:03.779965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8a4ed403-63b6-4c78-9dc5-ecdcf7902e22 req-46cf8e7e-e72f-43d4-881d-2ec4a12f3365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a74657-d61a-4580-9dc9-a9bded83e976", "tag": "7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:03.802186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:03.804930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a4ed403-63b6-4c78-9dc5-ecdcf7902e22 req-46cf8e7e-e72f-43d4-881d-2ec4a12f3365 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:03.805425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a4ed403-63b6-4c78-9dc5-ecdcf7902e22 req-46cf8e7e-e72f-43d4-881d-2ec4a12f3365 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:03.805858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a4ed403-63b6-4c78-9dc5-ecdcf7902e22 req-46cf8e7e-e72f-43d4-881d-2ec4a12f3365 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:03.842382 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8a4ed403-63b6-4c78-9dc5-ecdcf7902e22 req-46cf8e7e-e72f-43d4-881d-2ec4a12f3365 service nova] Creating event network-changed:7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23 for instance c2a74657-d61a-4580-9dc9-a9bded83e976 on n-h1-858238-3 Nov 02 14:16:03.863227 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8a4ed403-63b6-4c78-9dc5-ecdcf7902e22 req-46cf8e7e-e72f-43d4-881d-2ec4a12f3365 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087447 Nov 02 14:16:03.865662 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1665/5320] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:04.741384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:04.742760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:04.771188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:04.772321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:04.772948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:04.773869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:04.774678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:04.775308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:05.021181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:05.045881 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab7f2639-3637-4047-9845-b4c17d697155 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.303487 Nov 02 14:16:05.046745 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3656/5321] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:04 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:06.087110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:06.088401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:06.118980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:06.120130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:06.129633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:06.130418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:06.130896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:06.131364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:06.518137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:06.551173 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2e2dad01-9ff8-4e17-88e3-9a481efe6af8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.474823 Nov 02 14:16:06.551848 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1666/5322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:06 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:07.582612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:07.583295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:07.586845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:07.605473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:07.606159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:07.606701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:07.607831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:07.608391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:07.608830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:08.073554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:08.148822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38498af8-5bfc-4e75-918d-56d8e6fd8d38 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.568005 Nov 02 14:16:08.149521 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3657/5323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:07 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:09.173512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:09.174463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:09.186939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:09.187542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:09.187909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:09.189180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:09.189636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:09.194827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:09.959270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:09.977482 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8c628514-e074-4013-b761-3225d3cb1120 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.807829 Nov 02 14:16:09.979514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1667/5324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:09 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:11.007196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:11.008678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:11.021260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.022499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.024769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.025701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.038250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.038772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.759999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:12.762219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=88 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:12.779337 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8ab878f-f30c-41d3-9153-f6732af7ea11 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 1.768988 Nov 02 14:16:12.780214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3658/5325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:11 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:13.804285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:13.804912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:13.821174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:13.821673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:13.822114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:13.822833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:13.823348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:13.823779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:14.593134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:14.617003 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-96e31f5c-f81f-41f0-be6e-26f37b9a219c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.816465 Nov 02 14:16:14.617677 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1668/5326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:13 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:15.646766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:15.648051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:15.662612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:15.663410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:15.664012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:15.664896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:15.666452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:15.671612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:16.161833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:16.177145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-377df129-fe89-4868-96bd-b005786770da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.534972 Nov 02 14:16:16.177756 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3659/5327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:15 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:16.425122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-73057669-a830-43cc-b6e4-ac8527274fe8 req-af9044b6-f7d2-4093-a184-2684c30697fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca4ce93-df71-4380-ac8f-29a510ff0ee6", "name": "network-vif-plugged", "status": "completed", "tag": "ea507852-e5fa-4cff-8185-87c1481ae4c6"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:16.454122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-73057669-a830-43cc-b6e4-ac8527274fe8 req-af9044b6-f7d2-4093-a184-2684c30697fa service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:16.455193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-73057669-a830-43cc-b6e4-ac8527274fe8 req-af9044b6-f7d2-4093-a184-2684c30697fa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:16.456010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-73057669-a830-43cc-b6e4-ac8527274fe8 req-af9044b6-f7d2-4093-a184-2684c30697fa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:16.470439 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-73057669-a830-43cc-b6e4-ac8527274fe8 req-af9044b6-f7d2-4093-a184-2684c30697fa service nova] Creating event network-vif-plugged:ea507852-e5fa-4cff-8185-87c1481ae4c6 for instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 on n-h2-858238-3 Nov 02 14:16:16.510026 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-73057669-a830-43cc-b6e4-ac8527274fe8 req-af9044b6-f7d2-4093-a184-2684c30697fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088574 Nov 02 14:16:16.512257 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1669/5328] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:17.201348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:17.201960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:17.224301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:17.224751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:17.225390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:17.226993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:17.230295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:17.231750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:18.127622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:18.136334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d012e2a-7411-4a69-968b-1f7cf3048ee2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1217 microversion: 2.1 time: 0.938932 Nov 02 14:16:18.136945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3660/5329] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:17 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1217 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:19.182453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:19.184253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:19.196471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:19.196972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:19.197419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:19.198130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:19.201648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:19.204979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:19.598866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:19.614606 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75bd66b7-890b-42a4-a95c-d1a125579eac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1405 microversion: 2.1 time: 0.435492 Nov 02 14:16:19.616064 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1670/5330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:19 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:19.651753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:19.652648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:19.671174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:19.676179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:19.676771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:19.682492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:19.683514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:19.686662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:20.063580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:20.080055 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7c4cd097-bba4-4c84-be11-1954b336f354 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1405 microversion: 2.1 time: 0.431595 Nov 02 14:16:20.083988 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3661/5331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:19 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:20.110503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1954795876"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:20.114031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:20.121615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:20.122262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:20.123298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:20.125148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:20.125803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:20.126414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:20.749521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.compute.api [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Attempting to quiesce instance before volume snapshot. Nov 02 14:16:20.770679 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.compute.api [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 02 14:16:20.924392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Creating snapshot from volume 03da18e2-62b4-4450-9368-256bd7f0e938. {{(pid=137558) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 02 14:16:23.059866 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-71cb126a-5ba5-4af5-a402-fcee1d635d22 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6/action" status: 202 len: 0 microversion: 2.1 time: 2.954841 Nov 02 14:16:23.066516 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1671/5332] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:16:20 2022] POST /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6/action => generated 0 bytes in 2962 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 14:16:25.524202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-41070656", "imageRef": "bad541c0-cc48-4042-99af-63ae3ca901ba", "flavorRef": "452", "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:25.636835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:16:26.969734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:16:26.973212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:16:26.973212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:16:26.973212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:16:26.973212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:16:26.990695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:26.991211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:26.992128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:26.992379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:26.993348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:26.993776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:27.040135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:16:27.055747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:16:27.086108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:16:27.088747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8bd003ce-f2c7-4ae5-81bb-c0a2957e0eac',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:16:27.370289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e941113-d1bb-443a-9007-4c9f27164e80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.850135 Nov 02 14:16:27.370990 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3662/5333] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:16:27.385182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-96948a6f-c9ac-432a-ac62-32076589398b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:27.385927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-96948a6f-c9ac-432a-ac62-32076589398b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:27.649264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96948a6f-c9ac-432a-ac62-32076589398b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:27.660949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-96948a6f-c9ac-432a-ac62-32076589398b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1228 microversion: 2.1 time: 0.281803 Nov 02 14:16:27.665155 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1672/5334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:27 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1228 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:28.698678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:28.699661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:28.725380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:28.726230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:28.726894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:28.735058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:28.736446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:28.737086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:29.223613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:29.237563 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41b183de-660e-4291-bf20-cc308920e58a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1224 microversion: 2.1 time: 0.551833 Nov 02 14:16:29.240022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3663/5335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:28 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1224 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:30.263267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:30.263925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:30.288811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:30.303516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:30.305042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:30.307218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:30.315669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:30.319514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:30.385785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:30.702333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:30.715669 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4ad0af74-b4a9-4bee-b4c0-5ec4e68f5e51 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1298 microversion: 2.1 time: 0.457486 Nov 02 14:16:30.725608 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1673/5336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:30 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1298 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:31.748859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:31.749442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:31.761891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:31.762388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:31.762821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:31.763558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:31.764010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:31.764438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:31.952897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:31.961971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f53c01b7-3c50-49a6-b312-54d911b6d3cd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1298 microversion: 2.1 time: 0.216982 Nov 02 14:16:31.974295 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3664/5337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:31 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1298 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:32.999360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:32.999360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:33.019849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:33.020366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:33.020837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:33.021560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:33.022030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:33.022478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:33.428195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:33.487604 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-93d0a4bb-30c9-455e-b36c-ebdd21f7b232 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1298 microversion: 2.1 time: 0.490693 Nov 02 14:16:33.489512 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1674/5338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:32 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1298 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:34.513909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:34.515725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:34.533011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:34.533562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:34.534342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:34.550504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:34.553155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:34.553609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:34.981855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "589bcc06-de71-43d1-94fa-26fecf83ef73"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:34.984423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:35.012756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=22 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:35.015587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.016270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.016722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.017526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.020050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.024659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.516126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:35.533263 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6164acac-9add-43db-8b16-9698d171eec9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 1.023149 Nov 02 14:16:35.540744 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3665/5339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:34 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:35.645611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ec1c27d8-7b72-43bd-a28d-b1fadddd16fb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665414 Nov 02 14:16:35.648753 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1675/5340] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:16:34 2022] POST /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:36.568858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:36.570116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:36.590373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:36.596378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:36.598087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:36.601110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:36.601863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:36.604659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:37.025193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:37.070600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:37.431473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:37.444411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6fa39ed1-423e-4873-ba63-30a708ecf7d3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.883003 Nov 02 14:16:37.459791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3666/5341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:36 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:38.474880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:38.475648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:38.491341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:38.493101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:38.493605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:38.494082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:38.502589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:38.503147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:38.503624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:38.636397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-16836730-84f7-4e55-be70-ae682dadb97b req-ff021268-3963-44e2-9334-dabe4d994431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210b634b-55ec-4c90-8726-24255de141d7", "tag": "2fe61367-b781-49bc-ba44-c3f6b5216889"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:38.646354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:38.658866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-16836730-84f7-4e55-be70-ae682dadb97b req-ff021268-3963-44e2-9334-dabe4d994431 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:38.659375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-16836730-84f7-4e55-be70-ae682dadb97b req-ff021268-3963-44e2-9334-dabe4d994431 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:38.659802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-16836730-84f7-4e55-be70-ae682dadb97b req-ff021268-3963-44e2-9334-dabe4d994431 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:38.695258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-16836730-84f7-4e55-be70-ae682dadb97b req-ff021268-3963-44e2-9334-dabe4d994431 service nova] Creating event network-changed:2fe61367-b781-49bc-ba44-c3f6b5216889 for instance 210b634b-55ec-4c90-8726-24255de141d7 on n-h1-858238-3 Nov 02 14:16:38.709113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-16836730-84f7-4e55-be70-ae682dadb97b req-ff021268-3963-44e2-9334-dabe4d994431 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075309 Nov 02 14:16:38.712628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3667/5342] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:16:39.711437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:39.731048 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d09f0ec9-12c9-49e8-880f-19c49fc3e063 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 1.261977 Nov 02 14:16:39.743603 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1676/5343] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:38 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:16:40.761027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:40.762915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:40.782133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:40.784034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:40.784812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:40.786833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:40.793948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:40.794800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:42.532508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:42.540709 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38e18df3-0326-492b-a8f0-02812de8f8ab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 1.782132 Nov 02 14:16:42.544455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3668/5344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:40 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:43.566003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:43.566644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:43.578665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:43.583451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:43.584031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:43.584808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:43.585301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:43.585746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:44.543720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1484670370", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "1b3002a4-af2c-480d-a789-db3e59142e26"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:44.665929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:44.668320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] validate_networks() for [('1b3002a4-af2c-480d-a789-db3e59142e26', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:16:44.687513 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7a38e74a-dc7c-40b5-9a62-0053ed769683 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 1.116749 Nov 02 14:16:44.695661 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1677/5345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:43 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:45.719670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:45.721637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:45.753703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:45.763138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:45.770017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:45.775279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:45.793066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:45.798806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:46.670620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:16:46.671229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:16:46.671612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:16:46.672187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:16:46.672613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:16:46.711750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:46.734457 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ca30710-9ef2-4eb1-bb7b-4abeedbff438 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 1.016844 Nov 02 14:16:46.752781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:46.754740 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1678/5346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:45 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:16:46.757443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:46.757936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:46.762401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:46.763716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:46.768024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:46.808727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=54 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:46.850748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Getting quotas for project 6d7b4e0beebb42358c3f821eaf12bca4. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:16:46.879988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Getting quotas for user e06f694b644d4b6194beac01db98e83d and project 6d7b4e0beebb42358c3f821eaf12bca4. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:16:46.933355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:16:46.949424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:16:47.153587 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8a1d8e2-35aa-4319-b488-7dbc339df4fc tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.922574 Nov 02 14:16:47.166751 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3669/5347] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:16:47.179505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d67a203-405c-4eb4-83e0-7a287a693bad tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:47.180614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d67a203-405c-4eb4-83e0-7a287a693bad tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:47.464314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d67a203-405c-4eb4-83e0-7a287a693bad tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:47.473307 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d67a203-405c-4eb4-83e0-7a287a693bad tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1228 microversion: 2.1 time: 0.306838 Nov 02 14:16:47.478014 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1679/5348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:47 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1228 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:47.765379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:47.769639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:47.794941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:47.797135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:47.797600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:47.802591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:47.804121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:47.806003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:48.484523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:48.502976 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5e9462ba-62db-4668-a9d8-5f89a95974b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.744302 Nov 02 14:16:48.510643 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3670/5349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:47 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:48.528920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-411dfaeb-a7a3-4952-9f4e-c73fc6c80532 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:48.531187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-411dfaeb-a7a3-4952-9f4e-c73fc6c80532 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:48.781070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-411dfaeb-a7a3-4952-9f4e-c73fc6c80532 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:48.795491 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-411dfaeb-a7a3-4952-9f4e-c73fc6c80532 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1228 microversion: 2.1 time: 0.292781 Nov 02 14:16:48.816335 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1680/5350] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:48 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1228 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:49.531575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:49.532224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:49.550671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:49.551402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:49.551842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:49.552560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:49.553015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:49.553441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:49.831662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:49.832952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:49.861384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:49.861904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:49.862367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:49.863123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:49.876962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:49.877439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:50.494272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:50.503959 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5d4b1eb-7d14-4194-845a-416624c1a2f1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.977856 Nov 02 14:16:50.506583 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3671/5351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:49 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:50.509933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:50.525923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9d32424-0521-46a8-b883-1fe30fcfd4c9 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1280 microversion: 2.1 time: 0.699417 Nov 02 14:16:50.526828 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1681/5352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:49 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1280 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:51.530142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:51.531400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:51.546179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:51.547505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:51.550062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:51.554243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:51.554763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:51.555596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:51.555795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:51.556859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:51.569349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:51.569866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:51.570324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:51.578962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:51.579783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:51.581676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:52.034124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:52.050797 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e840476-d94f-4979-9ad3-f0b631eef740 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1286 microversion: 2.1 time: 0.496607 Nov 02 14:16:52.084494 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1682/5353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:51 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1286 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:52.296223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:52.304353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db046c10-083b-4744-a506-90f05bb13dab tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.778284 Nov 02 14:16:52.304964 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3672/5354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:51 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:53.096546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:53.097105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:53.120155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:53.123047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:53.123951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:53.125175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:53.139357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:53.142275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:53.335795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:53.341541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:53.357047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:53.359851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:53.369374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:53.369374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:53.369374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:53.369374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:53.690774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:53.701996 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce6aa9bd-de60-44c3-84cd-ae5eeff14022 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1328 microversion: 2.1 time: 0.613330 Nov 02 14:16:53.708067 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1683/5355] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:53 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1328 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:54.101780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:54.113541 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-039a025d-57bb-44c5-a78b-af2a6065f78f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.782329 Nov 02 14:16:54.127349 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3673/5356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:53 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:54.736122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:54.736896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:54.751882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:54.752533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:54.755431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:54.756207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:54.756694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:54.757138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:54.929570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6ae59b36-635d-4d11-9092-5c14da460bb7 req-75ea8ed5-d238-42ec-a78f-65732a6a33b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2941f350-160e-4894-9bc5-825b94eac2d6", "tag": "fb61ab52-cea2-4b18-a899-801484a5fc37"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:54.961077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ae59b36-635d-4d11-9092-5c14da460bb7 req-75ea8ed5-d238-42ec-a78f-65732a6a33b6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:54.962207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ae59b36-635d-4d11-9092-5c14da460bb7 req-75ea8ed5-d238-42ec-a78f-65732a6a33b6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:54.963680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6ae59b36-635d-4d11-9092-5c14da460bb7 req-75ea8ed5-d238-42ec-a78f-65732a6a33b6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.006029 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6ae59b36-635d-4d11-9092-5c14da460bb7 req-75ea8ed5-d238-42ec-a78f-65732a6a33b6 service nova] Creating event network-changed:fb61ab52-cea2-4b18-a899-801484a5fc37 for instance 2941f350-160e-4894-9bc5-825b94eac2d6 on n-h2-858238-3 Nov 02 14:16:55.019580 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6ae59b36-635d-4d11-9092-5c14da460bb7 req-75ea8ed5-d238-42ec-a78f-65732a6a33b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093158 Nov 02 14:16:55.022315 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3674/5357] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:55.143986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:55.145617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:55.154294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:55.170575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:55.171610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.172605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:55.173889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:55.174554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.878191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:55.897740 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e57bb689-d5f3-4386-8879-bfb5df066e1e tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1328 microversion: 2.1 time: 1.167439 Nov 02 14:16:55.899026 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1684/5358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:54 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1328 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:55.904667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:55.907611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:55.917207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:55.917894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:55.918520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.919458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:55.920989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:55.921690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.968643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lazy-loading 'flavor' on Instance uuid c2a74657-d61a-4580-9dc9-a9bded83e976 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:16:56.070601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:56.082675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8c3ebcd-3ce8-4899-832a-6013272e4311 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.943865 Nov 02 14:16:56.084461 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3675/5359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:55 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:56.292924 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a84e3cbc-6bb0-479d-b744-2faeedc9907d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/action" status: 200 len: 32 microversion: 2.1 time: 0.390029 Nov 02 14:16:56.301368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1685/5360] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:16:55 2022] POST /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/action => generated 32 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:16:56.306471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:56.307185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:56.317801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:56.322022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:56.323902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:56.324741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:56.326348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:56.326802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:56.808887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:56.911684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:56.929398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:56.932139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:56.953009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:56.956987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:56.966028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:56.968937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:56.970777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:56.973862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:58.566058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:58.581804 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2cb1e728-76c8-4ec0-a9c0-0ee9b8584340 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 2.279496 Nov 02 14:16:58.582798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3676/5361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:56 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:16:58.598947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:58.600433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:58.617128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:58.621123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:58.621888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:58.622765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:58.623832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:58.625814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:58.733736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:58.746150 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4943cab6-a935-42dd-aca8-d5042644b0b5 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1328 microversion: 2.1 time: 1.824551 Nov 02 14:16:58.764989 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1686/5362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:56 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1328 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:59.170809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:59.184996 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb8c2ae8-de26-47b4-b135-e4bc6583b093 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1340 microversion: 2.1 time: 0.596956 Nov 02 14:16:59.189419 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3677/5363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:58 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1340 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:59.613590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:59.614455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:59.616719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:59.634329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:59.638594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:59.639360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:59.640295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:59.640949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:59.641573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:59.777718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:59.781587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:59.812450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:59.812775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:59.813614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:59.820852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:59.821578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:59.822021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:59.990439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:00.014586 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40a59199-0dec-4c3d-a409-7c164ef520b3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.405779 Nov 02 14:17:00.016209 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1687/5364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:59 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:00.223397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:00.225697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:00.247772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:00.248994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:00.251779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:00.253025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:00.255393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:00.255868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:00.313462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:00.325104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:00.347851 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-003efd1b-21fe-4e00-85dd-b4457fa602aa tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1328 microversion: 2.1 time: 0.576894 Nov 02 14:17:00.352679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3678/5365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:16:59 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1328 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:00.710919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:00.731956 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9651eed4-d193-4b7b-9ea4-d9b3fd6f6ede tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1386 microversion: 2.1 time: 0.517710 Nov 02 14:17:00.750796 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1688/5366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:00 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1386 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:01.043983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:01.044608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:01.061551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:01.062356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:01.062961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:01.063934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:01.067684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:01.068354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:01.376567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:01.377184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:01.393482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:01.393986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:01.399231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:01.400570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:01.401291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:01.403149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:01.588826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:01.606555 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4331b1b9-3484-4109-9087-d493a419585f tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.563489 Nov 02 14:17:01.607400 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3679/5367] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:01 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:01.758619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:01.759395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:01.769672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:01.770553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:01.771440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:01.772880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:01.773704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:01.774348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:02.088499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:02.102704 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b361e385-39f2-4e23-a82b-25f8bf273052 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1328 microversion: 2.1 time: 0.730476 Nov 02 14:17:02.117162 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1689/5368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:01 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1328 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:02.193614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:02.203916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-891cbb83-0e81-41fa-9c42-19996663617e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.449560 Nov 02 14:17:02.209147 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3680/5369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:01 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:02.636744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:02.637492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:02.648090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:02.651912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:02.654455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:02.656001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:02.659860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:02.660680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:02.796610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-edaa1129-aaf2-41ee-9564-3df1fff2ab0a req-628efebb-b089-4ebb-903d-f189cf4f7ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2941f350-160e-4894-9bc5-825b94eac2d6", "name": "network-vif-plugged", "status": "completed", "tag": "fb61ab52-cea2-4b18-a899-801484a5fc37"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:02.812364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-edaa1129-aaf2-41ee-9564-3df1fff2ab0a req-628efebb-b089-4ebb-903d-f189cf4f7ea7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:02.813237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-edaa1129-aaf2-41ee-9564-3df1fff2ab0a req-628efebb-b089-4ebb-903d-f189cf4f7ea7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:02.814728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-edaa1129-aaf2-41ee-9564-3df1fff2ab0a req-628efebb-b089-4ebb-903d-f189cf4f7ea7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:02.835200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-edaa1129-aaf2-41ee-9564-3df1fff2ab0a req-628efebb-b089-4ebb-903d-f189cf4f7ea7 service nova] Creating event network-vif-plugged:fb61ab52-cea2-4b18-a899-801484a5fc37 for instance 2941f350-160e-4894-9bc5-825b94eac2d6 on n-h2-858238-3 Nov 02 14:17:02.842365 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-edaa1129-aaf2-41ee-9564-3df1fff2ab0a req-628efebb-b089-4ebb-903d-f189cf4f7ea7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053580 Nov 02 14:17:02.843972 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3681/5370] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:17:03.139620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:03.140681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:03.150190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:03.150884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:03.151591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:03.152474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:03.153081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:03.154076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:03.206082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:03.229627 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f42315b2-81e1-4327-b127-ce64b9d43ee7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.596867 Nov 02 14:17:03.231301 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1690/5371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:02 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:03.255015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:03.255957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:03.265338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:03.266155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:03.266848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:03.271287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:03.272151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:03.273124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:04.289860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:04.301142 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ba523ad-5ea4-4cd3-9f3a-623a686d56fd tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1328 microversion: 2.1 time: 1.166106 Nov 02 14:17:04.301953 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3682/5372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:03 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1328 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:04.307795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:04.308757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:04.316257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:04.317098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:04.317780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:04.318913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:04.319637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:04.320317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:04.534967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:04.545589 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8419e4ae-2c9a-42e9-999a-ec72b26360c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 1.297795 Nov 02 14:17:04.551241 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1691/5373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:03 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:05.037078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:05.064639 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7526f81-95a9-499a-bd77-1ecd7e73b780 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.758502 Nov 02 14:17:05.065978 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3683/5374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:04 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:05.336360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:05.337055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:05.340886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=38 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:05.349069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.349999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.350795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.351923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.352618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.353412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.588480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:05.589754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:05.607082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.609106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.611991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.613444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.614290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.616315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.861161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:05.872950 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-df28e1fa-bfdd-4a93-9fac-9c6ecdcfc9b1 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1528 microversion: 2.1 time: 0.542587 Nov 02 14:17:05.899120 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1692/5375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:05 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1528 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:05.911594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:05.917043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:05.944409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.945093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.945792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.951581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.957944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.958221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.432943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:06.445387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:06.447057 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a7246625-59e4-4439-b4df-b04809b60858 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1528 microversion: 2.1 time: 0.546771 Nov 02 14:17:06.458492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b0d8c120-47dc-4d28-aa2f-ac5ebe660d95 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.883845 Nov 02 14:17:06.462908 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3684/5376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:05 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:06.467053 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1693/5377] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:05 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:06.477248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:06.478076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:06.502543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.504027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.512616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.515127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.516675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.518460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.589006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:06.589536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:06.602327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.612120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.612656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.613496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.614055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.615030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.644416 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] HTTP exception thrown: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Request method failure captured: Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 HTTP/1.1 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnvLw16C5jX2DvTSvIiAlCZW9xVcovaoSHO0cTjhfgykzjinauS5vn4X7J3rKmuiuA91xkqSk1GaoYk5uOoBcmEpxeVdO-qPO038I42Pe8P1aZeYbSN76O4D1fwYHsTwGQzFamhdVotMRF9-FRyswYY0UBcm0VsruN-LZvpXgEnKi3s Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: b8e7a47e8ea6463e8af27b9482ac09c8 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1376655518 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8e7a47e8ea6463e8af27b9482ac09c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b8e7a47e8ea6463e8af27b9482ac09c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8e7a47e8ea6463e8af27b9482ac09c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b8e7a47e8ea6463e8af27b9482ac09c8"}]}] Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1376655518 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: b8e7a47e8ea6463e8af27b9482ac09c8 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1376655518 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1376655518-project Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 0fcc1244bfa140ab9c33176b86c72965 Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1376655518-project Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2941f350-160e-4894-9bc5-825b94eac2d6'} Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:06.646345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:06.651464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Returning 404 to user: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:06.653499 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45e1858a-e7b3-4496-a26a-0ab00cd503dc tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 404 len: 111 microversion: 2.1 time: 0.184653 Nov 02 14:17:06.654399 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1694/5378] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:17:06 2022] DELETE /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:17:06.665170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:06.665849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:06.672334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.672837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.673994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.674831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.675332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.675770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.846807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:06.870268 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-310ccc22-94f0-4378-afb6-d359b1c77084 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.405846 Nov 02 14:17:06.879159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3685/5379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:06 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:06.912231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:06.929781 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fbccc16b-42c9-4c21-9dd0-a433a73dac84 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1528 microversion: 2.1 time: 0.266579 Nov 02 14:17:06.943616 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1695/5380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:06 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:06.958826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Action: 'update', calling method: >, body: {"server": {"name": "2941f350-160e-4894-9bc5-825b94eac2d6_new"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:06.966982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:06.982226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.982989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.983503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.984344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.984997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.985445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.008884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] HTTP exception thrown: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Request method failure captured: Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: request: PUT /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 HTTP/1.1 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 64 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnvLw16C5jX2DvTSvIiAlCZW9xVcovaoSHO0cTjhfgykzjinauS5vn4X7J3rKmuiuA91xkqSk1GaoYk5uOoBcmEpxeVdO-qPO038I42Pe8P1aZeYbSN76O4D1fwYHsTwGQzFamhdVotMRF9-FRyswYY0UBcm0VsruN-LZvpXgEnKi3s Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: b8e7a47e8ea6463e8af27b9482ac09c8 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1376655518 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8e7a47e8ea6463e8af27b9482ac09c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b8e7a47e8ea6463e8af27b9482ac09c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8e7a47e8ea6463e8af27b9482ac09c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b8e7a47e8ea6463e8af27b9482ac09c8"}]}] Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1376655518 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: b8e7a47e8ea6463e8af27b9482ac09c8 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1376655518 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1376655518-project Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 0fcc1244bfa140ab9c33176b86c72965 Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1376655518-project Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: {"server": {"name": "2941f350-160e-4894-9bc5-825b94eac2d6_new"}} Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2941f350-160e-4894-9bc5-825b94eac2d6', 'body': {'server': {'name': '2941f350-160e-4894-9bc5-825b94eac2d6_new'}}} Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:17:07.011298 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] Returning 404 to user: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c95d96c8-51f1-47be-a9e4-4e3766c68274 tempest-ServersNegativeTestMultiTenantJSON-1376655518 tempest-ServersNegativeTestMultiTenantJSON-1376655518-project] 10.222.0.18 "PUT /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 404 len: 111 microversion: 2.1 time: 0.060076 Nov 02 14:17:07.022400 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3686/5381] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 14:17:06 2022] PUT /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:17:07.024604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:07.024728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:07.049292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.049839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.050321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.051811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.051811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.052169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.127427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:17:07.268793 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c8e73af6-7fc9-4a61-bcf6-ddf8abf37e39 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 204 len: 0 microversion: 2.1 time: 0.249510 Nov 02 14:17:07.270179 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1696/5382] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:17:07 2022] DELETE /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:17:07.280775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:07.281603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:07.313244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.314060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.316738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.320385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.320776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.322309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.498812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:07.501074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:07.516168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.522106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.522989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.524064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.525043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.525789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.764945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:07.796453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-554b384a-a607-488b-8a65-621d34e92084 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1534 microversion: 2.1 time: 0.521688 Nov 02 14:17:07.797071 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3687/5383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:07 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1534 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:07.898420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:07.900496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:07.916097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.916097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.916097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.916097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.916097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.916097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.951254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:07.962325 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-113fe541-b93f-4063-a202-eb54ca7d16ac tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.470137 Nov 02 14:17:07.973786 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1697/5384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:07 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:07.973937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:08.205604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:08.264855 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-31902167-9230-4134-a470-e6874a70ea9d tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.371296 Nov 02 14:17:08.266117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3688/5385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:07 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:08.834158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:08.837542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:08.871849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:08.872708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:08.873880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:08.874675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:08.875508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:08.892180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:08.992458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:08.993892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:08.999416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:09.008419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:09.009128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:09.009766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:09.010670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:09.011321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:09.011914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:09.486893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:09.507184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c803e34e-cc38-4d8e-b256-26e9896d6218 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.515414 Nov 02 14:17:09.520944 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3689/5386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:08 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:09.534218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:09.538187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:09.553243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:09.557902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:09.558999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:09.559925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:09.561156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:09.561840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:09.732444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:09.746466 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-88f292c8-3872-4e22-ac81-40e344008817 tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1534 microversion: 2.1 time: 0.926304 Nov 02 14:17:09.747732 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1698/5387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:08 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1534 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:09.975428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:09.994873 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fde885da-ef09-4050-b060-abbb0a158bb3 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.472686 Nov 02 14:17:09.996644 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3690/5388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:09 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:10.395444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6fcfc189-af7d-4986-9f23-ffa95ae7da87 req-56c1ee8c-01ea-46ac-800d-3580bfed0344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2941f350-160e-4894-9bc5-825b94eac2d6", "name": "network-vif-deleted", "tag": "fb61ab52-cea2-4b18-a899-801484a5fc37"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:10.438207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6fcfc189-af7d-4986-9f23-ffa95ae7da87 req-56c1ee8c-01ea-46ac-800d-3580bfed0344 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.443263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6fcfc189-af7d-4986-9f23-ffa95ae7da87 req-56c1ee8c-01ea-46ac-800d-3580bfed0344 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.446699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6fcfc189-af7d-4986-9f23-ffa95ae7da87 req-56c1ee8c-01ea-46ac-800d-3580bfed0344 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.510552 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6fcfc189-af7d-4986-9f23-ffa95ae7da87 req-56c1ee8c-01ea-46ac-800d-3580bfed0344 service nova] Creating event network-vif-deleted:fb61ab52-cea2-4b18-a899-801484a5fc37 for instance 2941f350-160e-4894-9bc5-825b94eac2d6 on n-h2-858238-3 Nov 02 14:17:10.531805 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6fcfc189-af7d-4986-9f23-ffa95ae7da87 req-56c1ee8c-01ea-46ac-800d-3580bfed0344 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140551 Nov 02 14:17:10.536035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:10.536885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:10.540025 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1699/5389] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:10.551790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.552560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.553164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.554047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.555483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.556117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.773747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:10.775785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:10.794569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.794569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.794932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.796125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.796639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.797434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.868520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.869770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.870915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.872377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lazy-loading 'fault' on Instance uuid 2941f350-160e-4894-9bc5-825b94eac2d6 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:17:10.995012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06f694b644d4b6194beac01db98e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7b4e0beebb42358c3f821eaf12bca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:11.021511 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-33604457-012e-47f7-8ad6-5c1497cffeba tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 200 len: 1318 microversion: 2.1 time: 0.252539 Nov 02 14:17:11.021996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:11.025543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1700/5390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:10 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:11.036423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:11.037648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:11.046964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f5c838d2-a231-49c5-a0b7-6e753fdef1d4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.518274 Nov 02 14:17:11.048023 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3691/5391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:10 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:11.080446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:11.081933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:11.083009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:11.085039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:11.086033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:11.087271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:11.893974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-845e6e35-cc53-4c7b-bd9e-d03c1f91f9f5 req-01f51a82-4f71-4028-815e-dd766b21ba3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b634b-55ec-4c90-8726-24255de141d7", "name": "network-vif-plugged", "status": "completed", "tag": "2fe61367-b781-49bc-ba44-c3f6b5216889"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:11.925080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-845e6e35-cc53-4c7b-bd9e-d03c1f91f9f5 req-01f51a82-4f71-4028-815e-dd766b21ba3c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:11.930677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-845e6e35-cc53-4c7b-bd9e-d03c1f91f9f5 req-01f51a82-4f71-4028-815e-dd766b21ba3c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:11.932856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-845e6e35-cc53-4c7b-bd9e-d03c1f91f9f5 req-01f51a82-4f71-4028-815e-dd766b21ba3c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:11.968907 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-845e6e35-cc53-4c7b-bd9e-d03c1f91f9f5 req-01f51a82-4f71-4028-815e-dd766b21ba3c service nova] Creating event network-vif-plugged:2fe61367-b781-49bc-ba44-c3f6b5216889 for instance 210b634b-55ec-4c90-8726-24255de141d7 on n-h1-858238-3 Nov 02 14:17:11.978638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-845e6e35-cc53-4c7b-bd9e-d03c1f91f9f5 req-01f51a82-4f71-4028-815e-dd766b21ba3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088577 Nov 02 14:17:11.985126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3692/5392] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:12.051725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:12.052473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] [instance: 2941f350-160e-4894-9bc5-825b94eac2d6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:12.072174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.072704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.074008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.077389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.079536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.079990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.123861 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] HTTP exception thrown: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Request method failure captured: Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 HTTP/1.1 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnuyHKtPahVXoq4A_t0nS9aHDpcbVx62fJov9aUUKfKKfc21DpOosEWsvjRTDKUQQTkDr_xtSt5NH-6fdbQSkOwhyAmk870JiFOgRtYbWcxOhcHSnYClDXkMtoK3VLlzdF0P_sKbqm8_7vrBEtdtQ4tGGIsFJXKRvgS9bg1_lpMhpd0 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 6d7b4e0beebb42358c3f821eaf12bca4 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1096551768 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d7b4e0beebb42358c3f821eaf12bca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d7b4e0beebb42358c3f821eaf12bca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d7b4e0beebb42358c3f821eaf12bca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d7b4e0beebb42358c3f821eaf12bca4"}]}] Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1096551768 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 6d7b4e0beebb42358c3f821eaf12bca4 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1096551768 Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1096551768-project Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e06f694b644d4b6194beac01db98e83d Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1096551768-project Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2941f350-160e-4894-9bc5-825b94eac2d6'} Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:12.125634 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] Returning 404 to user: Instance 2941f350-160e-4894-9bc5-825b94eac2d6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:12.130896 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a20c14a5-19b3-41de-961d-a5c6aaa4f95b tempest-ServersNegativeTestMultiTenantJSON-1096551768 tempest-ServersNegativeTestMultiTenantJSON-1096551768-project] 10.222.0.18 "GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6" status: 404 len: 111 microversion: 2.1 time: 0.082819 Nov 02 14:17:12.131953 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3693/5393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:12 2022] GET /compute/v2.1/servers/2941f350-160e-4894-9bc5-825b94eac2d6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:17:12.147243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:12.148019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:12.165900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.167548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.172221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.173093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.174523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.175680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.538723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:12.559316 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-126fecf2-4ae6-45c6-95bb-928b3c53b7d5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 1.528258 Nov 02 14:17:12.562263 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1701/5394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:11 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:12.737220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:12.752689 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-feb8e039-e87b-48c2-9441-8e4664612f4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.616100 Nov 02 14:17:12.777334 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3694/5395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:12 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:13.586863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:13.587831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:13.598351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:13.599215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:13.599867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:13.600791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:13.601494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:13.602110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:13.785857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:13.786468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:13.803440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:13.804006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:13.804364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:13.805078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:13.805535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:13.805961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:14.165182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:14.198037 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e3adf87d-1033-4fb1-9ac6-4ff66f10534a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.604407 Nov 02 14:17:14.198895 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1702/5396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:13 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:14.229575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:14.249784 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05e0b0fb-0210-400b-8d34-dd1064d499a8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1374 microversion: 2.1 time: 0.469693 Nov 02 14:17:14.259578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3695/5397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:13 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1374 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:15.226822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:15.227721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:15.265657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.268737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.270512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.274413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.275202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.276670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.283298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:15.289081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:15.304212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.306775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.307288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.310391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.311133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.312881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.665153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:15.708698 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ee741bc2-119c-4595-8818-fe78c362ae23 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.488525 Nov 02 14:17:15.714464 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1703/5398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:15 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:15.756278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:15.764984 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6651a83a-d299-4853-a55e-deaa44159125 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1561 microversion: 2.1 time: 0.488971 Nov 02 14:17:15.766638 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3696/5399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:15 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1561 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:15.812663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:15.814864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:15.853162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.853888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.854502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.855338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.858406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.862558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.920910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:16.375788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:16.404002 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f57a098d-061b-4608-a9c0-2978dfa0f827 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1561 microversion: 2.1 time: 0.611197 Nov 02 14:17:16.405994 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1704/5400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:15 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1561 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:16.545765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:16.546364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:16.553974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:16.554702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:16.555368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:16.556443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:16.557051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:16.557716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:16.605401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:17:16.742646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:16.743340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:16.752820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:16.753254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:16.753707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:16.754436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:16.754909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:16.755385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:16.775042 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d9693cb-00c2-4be3-8c04-9952ce81c05b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 204 len: 0 microversion: 2.1 time: 0.231511 Nov 02 14:17:16.777040 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3697/5401] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:17:16 2022] DELETE /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:17:16.789703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:16.790455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:16.805180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:16.810810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:16.811664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:16.812722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:16.813370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:16.818583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:17.214198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:17.231450 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae5eb755-94fb-4a40-a892-f33bf0880389 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.493639 Nov 02 14:17:17.238959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:17.253051 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2cd188c6-4919-4d5d-85b6-bb4ff10ec742 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1567 microversion: 2.1 time: 0.469881 Nov 02 14:17:17.256460 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3698/5402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:16 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1567 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:17.272341 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1705/5403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:16 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:18.287965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:18.289904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:18.290395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:18.292450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:18.304960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:18.318114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:18.318871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:18.319493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:18.319987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:18.320848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:18.321386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:18.334155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:18.334914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:18.335665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:18.336541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:18.337504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:19.601178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:19.640469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f2ddd9ea-7a02-4007-89e4-58ca1a51739d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1567 microversion: 2.1 time: 1.360364 Nov 02 14:17:19.641422 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3699/5404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:18 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1567 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:19.674774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:19.686054 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c355911-c498-4482-b3f3-cdb89319ceaa tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 1.401451 Nov 02 14:17:19.690966 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1706/5405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:18 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:19.978139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-54d09c7e-15dd-4a9e-9f2a-90edb4ee0ced req-8c235ac8-20aa-4b06-bb80-1ab8d1619263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b634b-55ec-4c90-8726-24255de141d7", "name": "network-vif-deleted", "tag": "2fe61367-b781-49bc-ba44-c3f6b5216889"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:20.009635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54d09c7e-15dd-4a9e-9f2a-90edb4ee0ced req-8c235ac8-20aa-4b06-bb80-1ab8d1619263 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:20.010825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54d09c7e-15dd-4a9e-9f2a-90edb4ee0ced req-8c235ac8-20aa-4b06-bb80-1ab8d1619263 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:20.014552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-54d09c7e-15dd-4a9e-9f2a-90edb4ee0ced req-8c235ac8-20aa-4b06-bb80-1ab8d1619263 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:20.058240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-54d09c7e-15dd-4a9e-9f2a-90edb4ee0ced req-8c235ac8-20aa-4b06-bb80-1ab8d1619263 service nova] Creating event network-vif-deleted:2fe61367-b781-49bc-ba44-c3f6b5216889 for instance 210b634b-55ec-4c90-8726-24255de141d7 on n-h1-858238-3 Nov 02 14:17:20.074235 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-54d09c7e-15dd-4a9e-9f2a-90edb4ee0ced req-8c235ac8-20aa-4b06-bb80-1ab8d1619263 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102852 Nov 02 14:17:20.077709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3700/5406] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:20.670828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:20.671944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:20.692974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:20.693593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:20.697181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:20.699552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:20.701441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:20.701441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:20.718994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:20.720946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:20.752054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:20.752993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:20.753734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:20.754695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:20.755420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:20.756101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:20.818531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:20.830034 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7a8f6e6d-a858-4cfe-937c-98563bab3807 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1359 microversion: 2.1 time: 0.163505 Nov 02 14:17:20.849649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1707/5407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:20 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:21.854090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:21.854875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:21.865887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:21.866397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:21.871776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:21.872549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:21.873043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:21.873493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:22.040164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:22.069782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46c9e7ad-2803-4787-83df-bfa342b1472a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 1.355096 Nov 02 14:17:22.091642 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3701/5408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:20 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:22.356166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:22.364224 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2b62db69-22ef-44b9-b258-249c142169da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1359 microversion: 2.1 time: 0.514037 Nov 02 14:17:22.383785 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1708/5409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:21 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1359 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:23.099787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:23.101106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:23.108512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:23.109321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:23.109989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:23.110814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:23.111623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:23.112282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:23.391894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:23.393899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:23.422012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:23.423425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:23.423886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:23.424613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:23.425079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:23.425686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:23.598429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:23.639920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:23.656933 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0b9b3abf-b383-4500-a39c-080d4f9b0e97 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1359 microversion: 2.1 time: 0.265677 Nov 02 14:17:23.661406 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1709/5410] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:23 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:23.667756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d96ab3be-c2b1-41c9-b715-53c901afc3ec tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1735 microversion: 2.1 time: 0.570767 Nov 02 14:17:23.668639 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3702/5411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:23 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1735 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:24.688486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:24.689670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:24.697299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:24.698749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:24.705753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:24.706431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:24.709793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:24.710873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:24.711656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:24.712591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:24.713228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:24.718239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:24.718239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:24.719923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:24.723638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:24.724223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:24.996663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:25.011459 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c73d4a96-4101-4840-ac44-3224f78e08d7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1359 microversion: 2.1 time: 0.325111 Nov 02 14:17:25.023613 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1710/5412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:24 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:25.675508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:25.690638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a2c1878-0dac-407c-ab6f-545f2a1851d9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1715 microversion: 2.1 time: 0.997325 Nov 02 14:17:25.692278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3703/5413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:24 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1715 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:25.999487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:26.000610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:26.010605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.011437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.012050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.012937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.013696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.014410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.039723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:26.041242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:26.058995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.062668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.064921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.067423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.069231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.072678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.189945 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Cannot 'detach_volume' instance c2a74657-d61a-4580-9dc9-a9bded83e976 while it is in vm_state rescued Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments/589bcc06-de71-43d1-94fa-26fecf83ef73 HTTP/1.1 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'detach_volume' instance c2a74657-d61a-4580-9dc9-a9bded83e976 while it is in vm_state rescued Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': 'c2a74657-d61a-4580-9dc9-a9bded83e976', 'id': '589bcc06-de71-43d1-94fa-26fecf83ef73'} Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c2a74657-d61a-4580-9dc9-a9bded83e976 while it is in vm_state rescued Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:26.194136 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:26.200010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:26.200010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:26.200010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:26.200010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:26.200010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c2a74657-d61a-4580-9dc9-a9bded83e976 while it is in vm_state rescued Nov 02 14:17:26.200010 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:26.205220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 409 to user: Cannot 'detach_volume' instance c2a74657-d61a-4580-9dc9-a9bded83e976 while it is in vm_state rescued {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:26.207552 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f7d0a03e-afee-45d2-8bcb-18d28978a30e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments/589bcc06-de71-43d1-94fa-26fecf83ef73" status: 409 len: 152 microversion: 2.1 time: 0.213262 Nov 02 14:17:26.209450 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1711/5414] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:17:25 2022] DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments/589bcc06-de71-43d1-94fa-26fecf83ef73 => generated 152 bytes in 216 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:17:26.219844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:26.229554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:26.244731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.246704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.248790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.249794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.251730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.253008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.311790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:26.331260 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c789683b-edb5-4ebc-a7ae-cb11d5b46317 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1359 microversion: 2.1 time: 0.295420 Nov 02 14:17:26.336034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3704/5415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:26 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:26.484267 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-30c5f732-0bbf-4f77-b233-3fd547718606 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/action" status: 202 len: 0 microversion: 2.1 time: 0.268829 Nov 02 14:17:26.485850 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1712/5416] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:17:26 2022] POST /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:17:26.494022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:26.494638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:26.500837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.507276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.507951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.508936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.509544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.509791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.543863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:27.228349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:27.243411 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7dd4f9b-4371-4e0a-b265-758418023426 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1723 microversion: 2.1 time: 0.749202 Nov 02 14:17:27.260516 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3705/5417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:26 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1723 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:27.364339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:27.365686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:27.378400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:27.381069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:27.383201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:27.391795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:27.393438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:27.394141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:27.617363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:27.645133 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e26bdda5-8812-4a86-bd13-da019d5d62af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 200 len: 1359 microversion: 2.1 time: 0.285080 Nov 02 14:17:27.648992 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1713/5418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:27 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:28.273395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:28.274166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:28.287283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:28.287960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:28.288514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:28.289466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:28.292635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:28.293498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:28.677436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:28.679376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:28.690437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:28.695570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:28.696135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:28.697024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:28.697741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:28.698409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:28.730474 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 HTTP/1.1 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '210b634b-55ec-4c90-8726-24255de141d7'} Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:28.734976 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:17:28.742471 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:28.745529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:28.746760 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1bb0e74f-d11e-4619-9765-7aa5b5d95d80 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 404 len: 111 microversion: 2.1 time: 0.074663 Nov 02 14:17:28.747950 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1714/5419] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:28 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:17:28.974936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:29.004233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ac90d5e-bda7-420b-b9fe-36f102f6b3d0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1723 microversion: 2.1 time: 0.734877 Nov 02 14:17:29.008348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3706/5420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:28 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1723 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:30.041573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:30.043438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:30.077391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:30.084341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:30.084977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:30.091345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:30.092744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:30.093876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:30.457475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:30.488320 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1729 microversion: 2.1 time: 0.460071 Nov 02 14:17:30.489638 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1715/5421] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:30 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1729 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:30.516539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:30.517806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:30.530063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:30.530966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:30.532183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:30.533911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:30.535860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:30.536554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:30.721152 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208152 Nov 02 14:17:30.721785 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3707/5422] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:17:30 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:32.642657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:32.643840 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001501 Nov 02 14:17:32.644244 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1716/5423] 10.222.0.18 () {56 vars in 886 bytes} [Wed Nov 2 14:17:32 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 14:17:32.652591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:32.654333 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002300 Nov 02 14:17:32.654757 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3708/5424] 10.222.0.18 () {54 vars in 1035 bytes} [Wed Nov 2 14:17:32 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 02 14:17:32.662569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:32.663956 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04bcaa01-0d91-4e5a-aa33-8c6f03548458 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001793 Nov 02 14:17:32.664572 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1717/5425] 10.222.0.18 () {54 vars in 1041 bytes} [Wed Nov 2 14:17:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:32.674274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:32.675544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f265081f-5af9-4c09-8612-19c8b85f7d07 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002149 Nov 02 14:17:32.676055 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3709/5426] 10.222.0.18 () {56 vars in 886 bytes} [Wed Nov 2 14:17:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 14:17:34.538634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f33ed34a-3d64-4bb3-bdab-8f97611ffcaa req-456ac7d7-645b-4b33-82b2-b5330ce024dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a74657-d61a-4580-9dc9-a9bded83e976", "tag": "7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:34.585466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f33ed34a-3d64-4bb3-bdab-8f97611ffcaa req-456ac7d7-645b-4b33-82b2-b5330ce024dc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:34.586290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f33ed34a-3d64-4bb3-bdab-8f97611ffcaa req-456ac7d7-645b-4b33-82b2-b5330ce024dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:34.586961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f33ed34a-3d64-4bb3-bdab-8f97611ffcaa req-456ac7d7-645b-4b33-82b2-b5330ce024dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:34.625118 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f33ed34a-3d64-4bb3-bdab-8f97611ffcaa req-456ac7d7-645b-4b33-82b2-b5330ce024dc service nova] Creating event network-changed:7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23 for instance c2a74657-d61a-4580-9dc9-a9bded83e976 on n-h1-858238-3 Nov 02 14:17:34.646130 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f33ed34a-3d64-4bb3-bdab-8f97611ffcaa req-456ac7d7-645b-4b33-82b2-b5330ce024dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108738 Nov 02 14:17:34.647430 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1718/5427] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:36.797907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e45c0fe0-d8c4-49a0-a8b8-69429f1cec9a req-6fe47dca-2ae0-4798-8e3d-1de0bf4fc916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a74657-d61a-4580-9dc9-a9bded83e976", "tag": "7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:36.828609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e45c0fe0-d8c4-49a0-a8b8-69429f1cec9a req-6fe47dca-2ae0-4798-8e3d-1de0bf4fc916 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.829092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e45c0fe0-d8c4-49a0-a8b8-69429f1cec9a req-6fe47dca-2ae0-4798-8e3d-1de0bf4fc916 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.835569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e45c0fe0-d8c4-49a0-a8b8-69429f1cec9a req-6fe47dca-2ae0-4798-8e3d-1de0bf4fc916 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.878789 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e45c0fe0-d8c4-49a0-a8b8-69429f1cec9a req-6fe47dca-2ae0-4798-8e3d-1de0bf4fc916 service nova] Creating event network-changed:7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23 for instance c2a74657-d61a-4580-9dc9-a9bded83e976 on n-h1-858238-3 Nov 02 14:17:36.885390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e45c0fe0-d8c4-49a0-a8b8-69429f1cec9a req-6fe47dca-2ae0-4798-8e3d-1de0bf4fc916 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093065 Nov 02 14:17:36.887374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3710/5428] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:41.106661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:41.107500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:41.116691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:41.119645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:41.121086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:41.121086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:41.122439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:41.125420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:41.125896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:41.169836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:17:41.334858 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0eed2dbc-dabf-442d-bb43-8129a9cdf44c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 204 len: 0 microversion: 2.1 time: 0.234545 Nov 02 14:17:41.337691 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1719/5429] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:17:41 2022] DELETE /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:17:41.349362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:41.350256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:41.361845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:41.366252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:41.367356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:41.368176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:41.369948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:41.370582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:41.371962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:42.336711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:42.347046 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37c551a9-8d68-4606-b948-f4089154aa84 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1411 microversion: 2.1 time: 1.004561 Nov 02 14:17:42.348050 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3711/5430] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:41 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1411 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:43.372794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:43.373593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:43.387955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:43.390358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:43.392491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:43.393908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:43.396753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:43.397403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:44.132495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:44.145011 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-436f9b3b-fe9f-407f-bfc4-574130f74b86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1411 microversion: 2.1 time: 0.774719 Nov 02 14:17:44.151459 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1720/5431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:43 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1411 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:44.796873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-846d7c3c-66b7-4af7-954d-845b30e11dff req-74f82d44-f9f3-4b5e-8015-e4809d605cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca4ce93-df71-4380-ac8f-29a510ff0ee6", "name": "network-vif-deleted", "tag": "ea507852-e5fa-4cff-8185-87c1481ae4c6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:44.818171 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:17:44.818563 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Nov 02 14:17:44.878170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-846d7c3c-66b7-4af7-954d-845b30e11dff req-74f82d44-f9f3-4b5e-8015-e4809d605cfe service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:44.880646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-846d7c3c-66b7-4af7-954d-845b30e11dff req-74f82d44-f9f3-4b5e-8015-e4809d605cfe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:44.881398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-846d7c3c-66b7-4af7-954d-845b30e11dff req-74f82d44-f9f3-4b5e-8015-e4809d605cfe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:44.912734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-846d7c3c-66b7-4af7-954d-845b30e11dff req-74f82d44-f9f3-4b5e-8015-e4809d605cfe service nova] Creating event network-vif-deleted:ea507852-e5fa-4cff-8185-87c1481ae4c6 for instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 on n-h2-858238-3 Nov 02 14:17:44.921253 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-846d7c3c-66b7-4af7-954d-845b30e11dff req-74f82d44-f9f3-4b5e-8015-e4809d605cfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129111 Nov 02 14:17:44.922067 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3712/5432] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:45.172853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:45.175188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:45.189603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:45.191050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:45.192928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:45.204088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:45.210015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:45.210740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:45.349172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:45.353010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:45.365642 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60039ab6-fbde-4ca0-8524-37ff5e1cc60b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.196717 Nov 02 14:17:45.379148 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1721/5433] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:45 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:46.392924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:46.393630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:46.418476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:46.420392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:46.424530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:46.428037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:46.437026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:46.437486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:46.714633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:46.731635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85778874-e75d-416c-8fbc-78fc6d6c0303 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.343047 Nov 02 14:17:46.749368 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3713/5434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:46 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:47.758910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:47.766256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:47.775729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:47.777964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:47.781813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:47.790088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:47.791253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:47.791883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:48.087939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:48.100894 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ed82b7f-40a5-49a8-a15d-3e2e707c151b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.346995 Nov 02 14:17:48.103398 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1722/5435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:47 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:49.096835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f09b5ade-3fcb-42a0-b15e-b51768fdeb23 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: .version_select at 0x7f6f80fe7af0>, body: {"keypair": {"name": "tempest-keypair-521329370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/RyuiVIhZCmdI906Yv9KZljiI6Q/2ZcPdIoB1K+L31BsBOO9FPRzGJydvQhtVKLJE0LiXPoPBs1ttlxLv1ApSz4s3dMxpSKdOEdXHM/XWsvkxWwJKO1XWLfWSG+p9luQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:49.129728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:49.131278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:49.138638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-f09b5ade-3fcb-42a0-b15e-b51768fdeb23 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:17:49.169201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:49.174435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-f09b5ade-3fcb-42a0-b15e-b51768fdeb23 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:17:49.175812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:49.176591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:49.180068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:49.181500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:49.182540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:49.308159 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f09b5ade-3fcb-42a0-b15e-b51768fdeb23 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.632027 Nov 02 14:17:49.312335 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3714/5436] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:17:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:50.003192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:50.043588 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-63f9206e-bc44-43c2-8b79-acb09d1032f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.918999 Nov 02 14:17:50.044940 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1723/5437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:49 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:51.067071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:51.068039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:51.091530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:51.094508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:51.094508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:51.106240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:51.106240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:51.106240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:51.537945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:51.555937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a4fb71e2-cff8-4c3a-a67c-e4678dd5730a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.493578 Nov 02 14:17:51.556611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3715/5438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:51 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:52.583409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:52.584166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:52.608490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:52.613789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:52.614320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:52.617218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:52.619216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:52.621979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:52.910383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:52.928681 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7037b498-ba96-40fd-a763-2bf7d247d944 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.350497 Nov 02 14:17:52.929692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1724/5439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:52 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:53.966579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:53.967575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:53.989874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:53.990379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:53.990816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:53.991576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:53.992027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:53.992450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:54.852101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:54.875919 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-309516a4-a742-455b-8a9e-8386881c9b83 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.907098 Nov 02 14:17:54.896962 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3716/5440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:53 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:55.902895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:55.903831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:55.915853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:55.918123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:55.920197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:55.922391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:55.926185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:55.927238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:56.278004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:56.291200 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6cb19340-e85c-4861-856d-ee2a0d3985c2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 200 len: 1202 microversion: 2.1 time: 0.392136 Nov 02 14:17:56.294073 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1725/5441] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:55 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 1202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:57.052703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-203776197", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e985cf22-7fc8-4126-b885-95f60f68af89"}], "security_groups": [{"name": "tempest-securitygroup--2103747349"}], "key_name": "tempest-keypair-521329370", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:57.317689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:57.318524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:57.331741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:57.335164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:57.335850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:57.336791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:57.339189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:57.339573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:57.375867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 HTTP/1.1 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'dca4ce93-df71-4380-ac8f-29a510ff0ee6'} Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:57.381628 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:17:57.390358 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:17:57.392388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:57.393695 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-49ef9ed4-bff0-4f60-8660-6783fd2791d2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 404 len: 111 microversion: 2.1 time: 0.080634 Nov 02 14:17:57.410747 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1726/5442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:57 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:17:57.659971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] validate_networks() for [('e985cf22-7fc8-4126-b885-95f60f68af89', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:17:58.759672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:17:58.760245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:17:58.760751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:17:58.761265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:17:58.761829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:17:58.776732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:58.782040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:58.783594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:58.787475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:58.788982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:58.789665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:58.832410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=42 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:58.844792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:17:58.864823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:17:58.890437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:17:58.897959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:17:59.049386 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a588d49-d8ea-449a-94b3-5f0fd29166c5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.987298 Nov 02 14:17:59.056728 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3717/5443] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:17:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:17:59.065065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83a7f462-185d-49ea-b6f5-8abfaecb0b88 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:59.066245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-83a7f462-185d-49ea-b6f5-8abfaecb0b88 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:59.292800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-83a7f462-185d-49ea-b6f5-8abfaecb0b88 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:59.318566 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-83a7f462-185d-49ea-b6f5-8abfaecb0b88 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1240 microversion: 2.1 time: 0.260348 Nov 02 14:17:59.319578 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1727/5444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:17:59 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1240 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:59.464710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:59.466005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:59.482663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:59.484221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:59.486952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:59.491593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:59.494110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:59.496494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:59.779992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lazy-loading 'services' on Instance uuid c2a74657-d61a-4580-9dc9-a9bded83e976 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:17:59.973247 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a380e07b-5b4e-45df-b3af-caa8a9b09e57 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments/589bcc06-de71-43d1-94fa-26fecf83ef73" status: 202 len: 0 microversion: 2.1 time: 0.514525 Nov 02 14:17:59.974220 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3718/5445] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:17:59 2022] DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments/589bcc06-de71-43d1-94fa-26fecf83ef73 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:17:59.984694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:59.987605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:00.003320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:00.016195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:00.016808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:00.019327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:00.020272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:00.036319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:00.131131 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2529680e-2dd7-463b-867d-db02a6b963a8 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149630 Nov 02 14:18:00.137960 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1728/5446] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:17:59 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:00.345594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:00.350583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:00.382834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:00.386469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:00.389450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:00.390523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:00.394340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:00.396254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:00.591774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:00.610084 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b93a90ce-1173-480f-804a-1e0fbd836924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1292 microversion: 2.1 time: 0.268856 Nov 02 14:18:00.610709 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3719/5447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:00 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1292 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:01.147585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:01.150014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:01.165014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.166434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.167511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.171508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.172227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.172872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.246612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-314b192a-e13a-4bba-b4a6-5de350b63a16 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104423 Nov 02 14:18:01.247912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1729/5448] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:01 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:01.637876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:01.638624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:01.650942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.651475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.651920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.652758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.653225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.654141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.808708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:01.818314 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-caa699f0-969c-41da-b266-0a5812d3e213 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1298 microversion: 2.1 time: 0.185170 Nov 02 14:18:01.823521 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3720/5449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:01 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:01.837066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:01.842254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:01.850583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.862642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.871784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.872736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.873484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.874153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.907556 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 HTTP/1.1 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '210b634b-55ec-4c90-8726-24255de141d7'} Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:01.909900 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.914676 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.919638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:01.922167 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b28e2dcf-07f1-412e-9d77-f8467a098319 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 404 len: 111 microversion: 2.1 time: 0.089058 Nov 02 14:18:01.926635 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1730/5450] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:18:01 2022] DELETE /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:01.935059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:01.936027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 210b634b-55ec-4c90-8726-24255de141d7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:01.943693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.944192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.944637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.945475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.945939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.946416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.962397 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 HTTP/1.1 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '210b634b-55ec-4c90-8726-24255de141d7'} Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:01.964374 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. Nov 02 14:18:01.969997 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:01.971667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 210b634b-55ec-4c90-8726-24255de141d7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:01.972778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b17787c6-344b-473c-8607-5c7b7939b962 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7" status: 404 len: 111 microversion: 2.1 time: 0.041711 Nov 02 14:18:01.973898 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3721/5451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:01 2022] GET /compute/v2.1/servers/210b634b-55ec-4c90-8726-24255de141d7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:02.260644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:02.263212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:02.296116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:02.296809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:02.297381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:02.298263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:02.299673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:02.306576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:02.397867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ff035491-9d1f-4b30-953f-93f8d8e20058 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141606 Nov 02 14:18:02.402702 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1731/5452] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:02 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:02.853419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:02.854211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:02.885965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:02.886600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:02.887199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:02.893294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:02.898267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:02.899241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.394807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:03.395725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:03.420087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.420643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.421110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.421856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.422329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.427136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.462607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 HTTP/1.1 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'dca4ce93-df71-4380-ac8f-29a510ff0ee6'} Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:03.477171 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b701d488-f243-4b12-ad46-69638113e2cf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 404 len: 111 microversion: 2.1 time: 0.087961 Nov 02 14:18:03.482264 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1732/5453] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:18:03 2022] DELETE /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:18:03.485926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:03.498235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:03.554523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.555288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.555936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.558130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.558789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.561787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.635031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:03.644380 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc451807-9dd2-4e40-ac97-a0455785324c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1298 microversion: 2.1 time: 0.797240 Nov 02 14:18:03.645012 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3722/5454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:02 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1298 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:03.662156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a1c5c926-6a6b-40fe-b8aa-73444c979859 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181303 Nov 02 14:18:03.666760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:03.667419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: dca4ce93-df71-4380-ac8f-29a510ff0ee6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:03.672075 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1733/5455] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:03 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:03.695206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.695710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.696164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.696876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.697335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.697763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.730668 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 HTTP/1.1 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'dca4ce93-df71-4380-ac8f-29a510ff0ee6'} Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:03.732410 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance dca4ce93-df71-4380-ac8f-29a510ff0ee6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0dea1191-7da3-4091-bf97-157e88dc7976 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6" status: 404 len: 111 microversion: 2.1 time: 0.081866 Nov 02 14:18:03.737539 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3723/5456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:03 2022] GET /compute/v2.1/servers/dca4ce93-df71-4380-ac8f-29a510ff0ee6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:03.858662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ac53a90e-ee3f-423b-91de-77e71097eba1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: .version_select at 0x7f6f818c0ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-489749758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI81KtmsJfPyqckE1Gs7M/zgGTC7KwOUsAp2oy3u/dDmEOU2bttpVA8DMCSpyXUnzQzuNYVMFPsxRgHkc5MtBFZgcCnFX/nR8T8hu3q0EkwS9ARWZJ7stjSAO2Oib/uUAQ=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:03.909852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-ac53a90e-ee3f-423b-91de-77e71097eba1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:18:03.932562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-ac53a90e-ee3f-423b-91de-77e71097eba1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:18:03.993277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ac53a90e-ee3f-423b-91de-77e71097eba1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.138954 Nov 02 14:18:03.994881 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1734/5457] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:18:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:04.675851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:04.676516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:04.677421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:04.680640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:04.709295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:04.715786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:04.717948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:04.719447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:04.720763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:04.721822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:04.722445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:04.724585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:04.725429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:04.738500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:04.739989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:04.740871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:04.871999 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-42bf3922-12d7-4397-837b-8c41187d1a87 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198653 Nov 02 14:18:04.873187 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1735/5458] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:04 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:05.040501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:05.055088 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f977d74a-d3bc-4b5f-b14a-e40188912999 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1298 microversion: 2.1 time: 0.389789 Nov 02 14:18:05.058088 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3724/5459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:04 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1298 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:05.886048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:05.889359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:05.908552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:05.910008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:05.910008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:05.910450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:05.910913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:05.917742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:05.984589 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca221156-30f4-43f3-917b-0da15a5ec0b0 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102637 Nov 02 14:18:05.992829 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1736/5460] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:05 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:06.083344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:06.084086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:06.097194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:06.102259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:06.102822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:06.105295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:06.105881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:06.106393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:06.600343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:06.613372 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-67c0313e-71dd-4485-b5ca-9cc63e23674e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 0.536122 Nov 02 14:18:06.618202 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3725/5461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:06 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:06.998974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:07.004274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:07.030105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.032525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.033310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:07.034792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.036294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.037175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:07.114684 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-59a9949f-df49-4d5e-b6a0-d3e4f51cd8b5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121112 Nov 02 14:18:07.122661 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1737/5462] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:06 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:07.644265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:07.644898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:07.662091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.662596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.663036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:07.663779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.664246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.664686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:08.127865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:08.130195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:08.150886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:08.166233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:08.166835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:08.168522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:08.171795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:08.173745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:08.327235 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f820ff9c-3c36-44df-9d42-dc0fd2da97f2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203427 Nov 02 14:18:08.328192 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1738/5463] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:08 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:08.730084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:08.742167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fc06cb3-5c49-4f04-ac96-88c390913fff tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 1.102484 Nov 02 14:18:08.752586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3726/5464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:07 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:09.341296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:09.344805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:09.374749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:09.379566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:09.380121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:09.380898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:09.384136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:09.385779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:09.521436 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef019d3a-9cf3-4a96-a130-a1d9037018a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184701 Nov 02 14:18:09.524175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1739/5465] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:09 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:09.777977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:09.779395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:09.788079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:09.791736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:09.794186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:09.799747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:09.801746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:09.804570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:09.815217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:09.817031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:10.357793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:10.369011 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f34b66a3-6cff-4235-a359-795718970906 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 0.594758 Nov 02 14:18:10.369611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3727/5466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:09 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:10.537134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:10.540093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:10.553876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:10.556589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:10.557722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:10.560694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:10.561369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:10.563257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:10.621486 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20796e96-920b-4120-8cd7-014a5d8f7499 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088449 Nov 02 14:18:10.626956 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1740/5467] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:10 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:10.650747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0d896c47-adee-439b-a8de-673657db7e5d req-523e305e-229f-41f1-970a-926c3011d021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18825187-645a-4dc8-8608-8520f9bb2706", "tag": "b83dcb53-54a8-4e62-a7b2-2bae2915d044"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:10.675273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d896c47-adee-439b-a8de-673657db7e5d req-523e305e-229f-41f1-970a-926c3011d021 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:10.676058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d896c47-adee-439b-a8de-673657db7e5d req-523e305e-229f-41f1-970a-926c3011d021 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:10.676679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0d896c47-adee-439b-a8de-673657db7e5d req-523e305e-229f-41f1-970a-926c3011d021 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:10.705758 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0d896c47-adee-439b-a8de-673657db7e5d req-523e305e-229f-41f1-970a-926c3011d021 service nova] Creating event network-changed:b83dcb53-54a8-4e62-a7b2-2bae2915d044 for instance 18825187-645a-4dc8-8608-8520f9bb2706 on n-h2-858238-3 Nov 02 14:18:10.716590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0d896c47-adee-439b-a8de-673657db7e5d req-523e305e-229f-41f1-970a-926c3011d021 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068669 Nov 02 14:18:10.719002 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3728/5468] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:18:11.395914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:11.396817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:11.398925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:11.426262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.431438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.434798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.447505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.451193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.451736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.637885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:11.640812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:11.654372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:11.663741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.664763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.666089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.667572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.671327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.674059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.808933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4faee7a-69c2-47b1-b433-0627ac56d26a tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.178443 Nov 02 14:18:11.810218 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3729/5469] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:18:11 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976/os-volume_attachments => generated 25 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:18:11.950062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:11.956106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:11.981180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:11.995238 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05c062a3-93eb-4f37-928f-1c4708181546 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 0.603340 Nov 02 14:18:11.998068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.000747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.003001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.004722 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1741/5470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:11 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:12.006867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.008838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.012440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.131199 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Cannot 'reboot' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action HTTP/1.1 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 28 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: {"reboot": {"type": "HARD"}} Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: exception: Cannot 'reboot' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '900f3f98-e247-421a-a02b-ec33d49dc48b', 'body': {'reboot': {'type': 'HARD'}}} Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:18:12.132916 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 409 to user: Cannot 'reboot' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:12.137941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb3a118e-cb1f-4745-a38c-f256b03e4988 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action" status: 409 len: 145 microversion: 2.1 time: 0.190058 Nov 02 14:18:12.141734 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3730/5471] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:18:11 2022] POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action => generated 145 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 14:18:12.145020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:12.148161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:12.167591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.170920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.171635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.173033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.175703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.176283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.246114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:12.264089 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Cannot 'rebuild' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action HTTP/1.1 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 65 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: exception: Cannot 'rebuild' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '900f3f98-e247-421a-a02b-ec33d49dc48b', 'body': {'rebuild': {'imageRef': '48ddc6ee-c34b-4aba-b773-45942271b1d5'}}} Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:18:12.265931 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 409 to user: Cannot 'rebuild' instance 900f3f98-e247-421a-a02b-ec33d49dc48b while it is in vm_state rescued {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:12.270730 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cf29ab02-57b0-47d3-a918-547ecc437d2b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action" status: 409 len: 146 microversion: 2.1 time: 0.127025 Nov 02 14:18:12.279079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:12.279903 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1742/5472] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:18:12 2022] POST /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b/action => generated 146 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 14:18:12.281770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:12.313936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.324352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.328138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.332049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.332539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.336002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.447089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:18:12.655439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e18fe3fe-de7e-42fb-bac5-8f3d393e5064 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 204 len: 0 microversion: 2.1 time: 0.381782 Nov 02 14:18:12.657263 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3731/5473] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:18:12 2022] DELETE /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:18:12.671778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:12.672989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:12.688094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.697455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.698220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.699302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.699987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.700655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:13.028760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:13.029480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:13.037405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:13.037885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:13.038665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:13.040024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:13.040639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:13.041234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:13.705033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:13.718917 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-267cd5ba-c7c7-427d-8a54-39d338cb850e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1689 microversion: 2.1 time: 1.056963 Nov 02 14:18:13.732626 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1743/5474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:12 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1689 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:13.869142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:13.882004 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d591188-daa7-4f2e-a853-efe5ba259a50 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 0.862703 Nov 02 14:18:13.883166 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3732/5475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:13 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:14.756583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:14.757796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:14.761527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:14.772372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:14.772880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:14.773331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:14.790153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:14.790925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:14.791418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:14.906023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:14.906930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:14.920633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:14.921127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:14.921566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:14.922285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:14.922736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:14.929775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:15.394944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:15.403718 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99dd4193-4862-450e-92fc-42699e9dd6b7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1689 microversion: 2.1 time: 0.651761 Nov 02 14:18:15.414129 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1744/5476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:14 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1689 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:15.425016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:15.433864 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95eca837-8c81-40e0-afea-278eee02106a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 0.532067 Nov 02 14:18:15.448497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3733/5477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:14 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:16.446348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:16.447138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:16.461051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:16.461710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:16.478229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.478692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.484491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.485577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.496659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.496819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.498954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.499660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.500122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.501996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.502478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.503018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.593401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:18.178741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:18.191558 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-712e493d-84a6-436a-9c4c-bdee02009dc7 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1689 microversion: 2.1 time: 1.750184 Nov 02 14:18:18.195131 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1745/5478] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:16 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1689 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:18.207623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1b0d7032-e0e7-436e-8008-7740fbdc47ad req-d8812b5a-bf19-46fb-b2b2-04eeee76707a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18825187-645a-4dc8-8608-8520f9bb2706", "name": "network-vif-plugged", "status": "completed", "tag": "b83dcb53-54a8-4e62-a7b2-2bae2915d044"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:18.217001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:18.230440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-05c7e461-7e6f-4b8e-a6ae-6f0b715cb6b8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 1.773950 Nov 02 14:18:18.235336 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3734/5479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:16 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:18.247730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1b0d7032-e0e7-436e-8008-7740fbdc47ad req-d8812b5a-bf19-46fb-b2b2-04eeee76707a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:18.249952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1b0d7032-e0e7-436e-8008-7740fbdc47ad req-d8812b5a-bf19-46fb-b2b2-04eeee76707a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:18.250883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1b0d7032-e0e7-436e-8008-7740fbdc47ad req-d8812b5a-bf19-46fb-b2b2-04eeee76707a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:18.282396 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1b0d7032-e0e7-436e-8008-7740fbdc47ad req-d8812b5a-bf19-46fb-b2b2-04eeee76707a service nova] Creating event network-vif-plugged:b83dcb53-54a8-4e62-a7b2-2bae2915d044 for instance 18825187-645a-4dc8-8608-8520f9bb2706 on n-h2-858238-3 Nov 02 14:18:18.294362 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1b0d7032-e0e7-436e-8008-7740fbdc47ad req-d8812b5a-bf19-46fb-b2b2-04eeee76707a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095559 Nov 02 14:18:18.305268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1746/5480] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:18.991950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b088d2dd-b3dc-4648-9405-31b68ee5982a req-faca24aa-3a6e-4e08-93e0-7b27944540a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a74657-d61a-4580-9dc9-a9bded83e976", "name": "network-vif-deleted", "tag": "7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:19.038814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b088d2dd-b3dc-4648-9405-31b68ee5982a req-faca24aa-3a6e-4e08-93e0-7b27944540a1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.041710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b088d2dd-b3dc-4648-9405-31b68ee5982a req-faca24aa-3a6e-4e08-93e0-7b27944540a1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.043617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b088d2dd-b3dc-4648-9405-31b68ee5982a req-faca24aa-3a6e-4e08-93e0-7b27944540a1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.079590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b088d2dd-b3dc-4648-9405-31b68ee5982a req-faca24aa-3a6e-4e08-93e0-7b27944540a1 service nova] Creating event network-vif-deleted:7b0f5f7c-bb11-4d4d-acd0-2bf3bab3dd23 for instance c2a74657-d61a-4580-9dc9-a9bded83e976 on n-h1-858238-3 Nov 02 14:18:19.094679 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b088d2dd-b3dc-4648-9405-31b68ee5982a req-faca24aa-3a6e-4e08-93e0-7b27944540a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110206 Nov 02 14:18:19.096061 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3735/5481] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:19.219869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:19.221817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:19.237755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.238558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.239024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.242218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.242719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.243210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.261231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:19.262059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:19.277837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.279362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.280230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.282547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.284344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.284960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.318365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.318889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.319377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.319854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lazy-loading 'fault' on Instance uuid c2a74657-d61a-4580-9dc9-a9bded83e976 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:18:19.437993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:19.457883 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6106e634-15ee-4141-a05a-9f3e569dee1c tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 200 len: 1335 microversion: 2.1 time: 0.242689 Nov 02 14:18:19.472621 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1747/5482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:19 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 1335 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:19.615840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:19.627192 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e478d55c-4271-4ec8-9118-2dad3d0504aa tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1366 microversion: 2.1 time: 0.370896 Nov 02 14:18:19.638002 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3736/5483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:19 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:20.485695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:20.486405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: c2a74657-d61a-4580-9dc9-a9bded83e976] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:20.498436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:20.498938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:20.501421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:20.507903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:20.508419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:20.508875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:20.549008 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 could not be found. Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 HTTP/1.1 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 could not be found. Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'c2a74657-d61a-4580-9dc9-a9bded83e976'} Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 could not be found. Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 could not be found. Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:20.550705 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 could not be found. Nov 02 14:18:20.556456 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:20.559974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 404 to user: Instance c2a74657-d61a-4580-9dc9-a9bded83e976 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:20.560951 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56e3055a-f44e-4fb0-9738-04f9436ed5a5 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976" status: 404 len: 111 microversion: 2.1 time: 0.079222 Nov 02 14:18:20.565154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1748/5484] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:20 2022] GET /compute/v2.1/servers/c2a74657-d61a-4580-9dc9-a9bded83e976 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:20.570545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-824d7db3-0f95-4f11-907d-01cfcbf5b24e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '.version_select at 0x7f6f81995790>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:20.596905 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-824d7db3-0f95-4f11-907d-01cfcbf5b24e tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175977821" status: 202 len: 0 microversion: 2.1 time: 0.030214 Nov 02 14:18:20.615974 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3737/5485] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175977821 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:18:20.656202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:20.657445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:20.673127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:20.675356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:20.677400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:20.678477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:20.680346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:20.683659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:21.454812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:21.466349 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a6859fd9-36e2-4764-8d3c-508b1305ba0c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1556 microversion: 2.1 time: 0.814705 Nov 02 14:18:21.468814 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1749/5486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:20 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1556 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:21.495131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:21.495821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:21.526092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:21.527612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:21.527982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:21.528777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:21.531835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:21.532420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:21.899362 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8cbb258-d977-421c-8e4c-30f83e989823 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.408598 Nov 02 14:18:21.901030 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3738/5487] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:18:21 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:27.147909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d615b320-ea43-4b32-8705-a7cbe9a08bd2 req-27b3c848-ae9f-46d0-9fc2-06f42717fd17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18825187-645a-4dc8-8608-8520f9bb2706", "tag": "b83dcb53-54a8-4e62-a7b2-2bae2915d044"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:27.193919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d615b320-ea43-4b32-8705-a7cbe9a08bd2 req-27b3c848-ae9f-46d0-9fc2-06f42717fd17 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.194739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d615b320-ea43-4b32-8705-a7cbe9a08bd2 req-27b3c848-ae9f-46d0-9fc2-06f42717fd17 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.195491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d615b320-ea43-4b32-8705-a7cbe9a08bd2 req-27b3c848-ae9f-46d0-9fc2-06f42717fd17 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.238668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d615b320-ea43-4b32-8705-a7cbe9a08bd2 req-27b3c848-ae9f-46d0-9fc2-06f42717fd17 service nova] Creating event network-changed:b83dcb53-54a8-4e62-a7b2-2bae2915d044 for instance 18825187-645a-4dc8-8608-8520f9bb2706 on n-h2-858238-3 Nov 02 14:18:27.261930 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d615b320-ea43-4b32-8705-a7cbe9a08bd2 req-27b3c848-ae9f-46d0-9fc2-06f42717fd17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121392 Nov 02 14:18:27.263368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1750/5488] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:38.237156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:38.237745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:38.254697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:38.256706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=15 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:38.261125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:38.262951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:38.265447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:38.266429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:38.267962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:38.270893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:38.390574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:18:38.626532 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d2910ed-7dfa-464d-afff-deee8f578af6 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 204 len: 0 microversion: 2.1 time: 0.392341 Nov 02 14:18:38.627243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3739/5489] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:18:38 2022] DELETE /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:18:38.633858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=21 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:38.634775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=39 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:38.646539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:38.647870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:38.686729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:38.691848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:38.692636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:38.693597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:38.694302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:38.695034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:39.226753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:39.235612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f463a7e5-76c9-4ef9-bc67-f6b91789d24b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1506 microversion: 2.1 time: 0.603241 Nov 02 14:18:39.247975 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1751/5490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:38 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:40.277578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:40.278973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:40.294633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:40.295576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:40.300096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:40.305353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:40.309185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:40.311443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:42.207486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:42.220352 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6a1cf394-54f0-4639-9bf3-354a685b5da9 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1506 microversion: 2.1 time: 1.948724 Nov 02 14:18:42.222154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3740/5491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:40 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1506 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:43.253234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:43.254350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:43.284082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:43.285736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:43.286471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:43.291512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:43.293996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:43.295913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:43.363865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-147eb25b-f3ef-4f4d-a486-0f22b97d731f req-b4026554-c349-4187-9723-d069a9ad2a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900f3f98-e247-421a-a02b-ec33d49dc48b", "name": "network-vif-deleted", "tag": "c49418a5-9b23-42b7-92ff-e37034c0b032"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:43.382361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-147eb25b-f3ef-4f4d-a486-0f22b97d731f req-b4026554-c349-4187-9723-d069a9ad2a12 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:43.389043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-147eb25b-f3ef-4f4d-a486-0f22b97d731f req-b4026554-c349-4187-9723-d069a9ad2a12 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:43.389652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-147eb25b-f3ef-4f4d-a486-0f22b97d731f req-b4026554-c349-4187-9723-d069a9ad2a12 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:43.442836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-147eb25b-f3ef-4f4d-a486-0f22b97d731f req-b4026554-c349-4187-9723-d069a9ad2a12 service nova] Creating event network-vif-deleted:c49418a5-9b23-42b7-92ff-e37034c0b032 for instance 900f3f98-e247-421a-a02b-ec33d49dc48b on n-h1-858238-3 Nov 02 14:18:43.454189 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-147eb25b-f3ef-4f4d-a486-0f22b97d731f req-b4026554-c349-4187-9723-d069a9ad2a12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094043 Nov 02 14:18:43.459923 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3741/5492] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:18:43.942597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:43.980004 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-243c93a5-1e75-4146-9dbc-263c1c0e53eb tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 200 len: 1292 microversion: 2.1 time: 0.731692 Nov 02 14:18:43.980820 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1752/5493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:43 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 1292 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:45.021021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:45.027037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: 900f3f98-e247-421a-a02b-ec33d49dc48b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:45.065056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.072719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.080652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.088047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.091865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.092606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.185146 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b could not be found. Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b HTTP/1.1 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b could not be found. Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '900f3f98-e247-421a-a02b-ec33d49dc48b'} Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b could not be found. Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b could not be found. Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:45.189903 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b could not be found. Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 404 to user: Instance 900f3f98-e247-421a-a02b-ec33d49dc48b could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:45.199899 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a38c4bcb-aa54-4cf2-8045-3eaa6e824fe4 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b" status: 404 len: 111 microversion: 2.1 time: 0.185945 Nov 02 14:18:45.206390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:45.210499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:45.217936 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3742/5494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:45 2022] GET /compute/v2.1/servers/900f3f98-e247-421a-a02b-ec33d49dc48b => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:45.267566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.281299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.284445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.285246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.294674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.304036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.448856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:18:45.882041 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d1a4e74a-d705-485c-90b0-1736e4f5f465 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 204 len: 0 microversion: 2.1 time: 0.682299 Nov 02 14:18:45.888065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1753/5495] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:18:45 2022] DELETE /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:18:45.895850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:45.896870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:45.916710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.918323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.926562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.927838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.928549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.929188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:46.563436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:46.586428 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ba94fcd-06cb-4341-9d14-ffe7934fd633 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.694331 Nov 02 14:18:46.587562 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3743/5496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:45 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:47.619984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:47.621523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:47.649891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:47.651346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:47.652060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:47.653051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:47.653765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:47.659936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:48.243115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1788304593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-489749758", "security_groups": [{"name": "tempest-secgroup-smoke-2065242919"}], "block_device_mapping_v2": [{"uuid": "8924d1b2-f739-4658-bc21-423eb0a94a16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:48.706529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:48.723566 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c43ee92-ad77-4571-8cb2-5608d6448baf tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 1.110358 Nov 02 14:18:48.724531 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1754/5497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:47 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:48.799799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:18:49.757877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:49.759820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:49.780737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:49.786737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:49.789985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:49.792275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:49.794689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:49.797257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:50.617797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:50.629331 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5293d7a-38e8-4dfd-b360-f102900c4ad2 tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1520 microversion: 2.1 time: 0.873049 Nov 02 14:18:50.649229 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1755/5498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:49 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1520 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:51.280665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:18:51.281285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:18:51.281542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:18:51.281949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:18:51.282357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:18:51.306630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:51.307181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:51.307804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:51.308769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:51.309323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:51.309809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:51.364675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:18:51.379491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:18:51.585860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:18:51.588307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8924d1b2-f739-4658-bc21-423eb0a94a16',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:18:51.677441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:51.679189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:51.699084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:51.701224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:51.702122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:51.706120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:51.707975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:51.711727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:51.921987 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23a76390-2980-42c6-b940-bbd086269f71 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.683240 Nov 02 14:18:51.929381 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3744/5499] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:18:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 3686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:18:51.952497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d487891f8d84282ae11f28a2db2b230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed37e20191b4a5e817442412da9dca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:51.962710 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cd92d72b-b500-421a-9388-fc83d56083de tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 200 len: 1478 microversion: 2.1 time: 0.290239 Nov 02 14:18:51.968051 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1756/5500] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:51 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:51.983549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a01a358-a932-4ceb-be82-5bdd119db440 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:51.984963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a01a358-a932-4ceb-be82-5bdd119db440 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:52.323154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a01a358-a932-4ceb-be82-5bdd119db440 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:52.336257 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a01a358-a932-4ceb-be82-5bdd119db440 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1094 microversion: 2.1 time: 0.366739 Nov 02 14:18:52.337289 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1757/5501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:51 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1094 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:52.506446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3a2b1478-d294-47f8-8b60-18bf72135f15 req-c1432f7f-759a-495d-88ea-bb095ed4b069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1a31dc-9106-4288-ae94-5a4a8eab8d4d", "name": "network-vif-deleted", "tag": "99d7c39d-d198-4bcc-83bb-a6cc4e1b0c16"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:52.541201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3a2b1478-d294-47f8-8b60-18bf72135f15 req-c1432f7f-759a-495d-88ea-bb095ed4b069 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:52.542044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3a2b1478-d294-47f8-8b60-18bf72135f15 req-c1432f7f-759a-495d-88ea-bb095ed4b069 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:52.542654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3a2b1478-d294-47f8-8b60-18bf72135f15 req-c1432f7f-759a-495d-88ea-bb095ed4b069 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:52.567599 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3a2b1478-d294-47f8-8b60-18bf72135f15 req-c1432f7f-759a-495d-88ea-bb095ed4b069 service nova] Creating event network-vif-deleted:99d7c39d-d198-4bcc-83bb-a6cc4e1b0c16 for instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d on n-h2-858238-3 Nov 02 14:18:52.582767 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3a2b1478-d294-47f8-8b60-18bf72135f15 req-c1432f7f-759a-495d-88ea-bb095ed4b069 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.656336 Nov 02 14:18:52.584105 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3745/5502] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:52.989494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:52.990782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] [instance: fc1a31dc-9106-4288-ae94-5a4a8eab8d4d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:53.011457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:53.011967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:53.012418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:53.013169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:53.013650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:53.014092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:53.074949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] HTTP exception thrown: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d could not be found. Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Request method failure captured: Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d HTTP/1.1 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnsDiPeaSx2sE1Ro5imj0uS6FImjmJNWhLUaQly8TXDcCy46SKgaOK4lMlSgl72KmhWcthxHUDzAkIgOTrT_d6RbUPlIhe1r7jBe-aW6-MuWpMMvXr_CKYod9LNaf6XPe9c4eBG6Qmx3lMQJY3Gr5avqBCG1B26Fnsrb4Jld81Wv1rU Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eed37e20191b4a5e817442412da9dca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eed37e20191b4a5e817442412da9dca3"}]}] Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: eed37e20191b4a5e817442412da9dca3 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-39486340 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 3d487891f8d84282ae11f28a2db2b230 Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-39486340-project Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d could not be found. Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'fc1a31dc-9106-4288-ae94-5a4a8eab8d4d'} Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d could not be found. Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d could not be found. Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:53.083514 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d could not be found. Nov 02 14:18:53.089441 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:18:53.091726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] Returning 404 to user: Instance fc1a31dc-9106-4288-ae94-5a4a8eab8d4d could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:18:53.094281 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-30abad31-d412-438c-b247-77368ffdc82b tempest-ServerRescueNegativeTestJSON-39486340 tempest-ServerRescueNegativeTestJSON-39486340-project] 10.222.0.18 "GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d" status: 404 len: 111 microversion: 2.1 time: 0.109231 Nov 02 14:18:53.105398 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1758/5503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:52 2022] GET /compute/v2.1/servers/fc1a31dc-9106-4288-ae94-5a4a8eab8d4d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:18:53.368724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5c4dab0-bfa4-41d0-962c-ce7fa8de4512 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:53.370355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5c4dab0-bfa4-41d0-962c-ce7fa8de4512 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:53.571086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5c4dab0-bfa4-41d0-962c-ce7fa8de4512 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:53.583619 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5c4dab0-bfa4-41d0-962c-ce7fa8de4512 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1094 microversion: 2.1 time: 0.223498 Nov 02 14:18:53.589367 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3746/5504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:53 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1094 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:54.622532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:54.623757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:54.637693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:54.648446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:54.649211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:54.650323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:54.650970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:54.660905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:54.872856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:54.898662 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dfaf07c3-965c-4b27-8ffe-94736407b31e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1200 microversion: 2.1 time: 0.280523 Nov 02 14:18:54.905413 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1759/5505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:54 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1200 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:55.930535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:55.931167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:55.956317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:55.957119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:55.957726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:55.958632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:55.959280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:55.959867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:56.437844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:56.446586 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a70d8fc1-fdb6-4d27-897b-e32fcb34213c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1210 microversion: 2.1 time: 0.519867 Nov 02 14:18:56.454817 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3747/5506] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:55 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1210 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:57.470907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:57.472167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:57.487591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:57.493175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:57.494200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:57.495951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:57.499358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:57.500049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:57.710512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:57.728653 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-01060fe8-3b09-4ccb-a356-b1d8aab5cfcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1210 microversion: 2.1 time: 0.262599 Nov 02 14:18:57.730272 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1760/5507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:57 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1210 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:58.770951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:58.774800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:58.789966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:58.792028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:58.792678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:58.793645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:58.794283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:58.794967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:00.488793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:00.497661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc3758a5-d88c-4d4f-aa6b-3011dc15c9bf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 1.743418 Nov 02 14:19:00.507945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3748/5508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:18:58 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:01.080393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:01.081845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:01.094267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:01.095264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:01.095994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:01.102637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:01.103521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:01.104201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:01.157601 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b723b136-3e31-41b1-865b-ae06e62c1f46 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/ips" status: 200 len: 148 microversion: 2.1 time: 0.081163 Nov 02 14:19:01.159729 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1761/5509] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:19:01 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/ips => generated 148 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:01.536993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:01.537751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:01.549476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:01.552814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:01.553746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:01.564352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:01.579063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:01.581391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:01.583507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:02.638271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:02.652112 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9ff1381-2040-4ce3-b89d-336a4e9c5b20 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 1.121095 Nov 02 14:19:02.653352 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3749/5510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:01 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:03.110780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:03.388350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-603b26de-f51a-49b9-ae73-8b367c588607 req-f88b4f9d-135b-411a-8a1a-d2d21f51b1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2625cd05-1243-40c4-935e-27195ba7fbbd", "tag": "e50a0773-015e-4438-b277-94e55fcd5546"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:03.415913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-603b26de-f51a-49b9-ae73-8b367c588607 req-f88b4f9d-135b-411a-8a1a-d2d21f51b1e1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.416411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-603b26de-f51a-49b9-ae73-8b367c588607 req-f88b4f9d-135b-411a-8a1a-d2d21f51b1e1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.416857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-603b26de-f51a-49b9-ae73-8b367c588607 req-f88b4f9d-135b-411a-8a1a-d2d21f51b1e1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.442713 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-603b26de-f51a-49b9-ae73-8b367c588607 req-f88b4f9d-135b-411a-8a1a-d2d21f51b1e1 service nova] Creating event network-changed:e50a0773-015e-4438-b277-94e55fcd5546 for instance 2625cd05-1243-40c4-935e-27195ba7fbbd on n-h1-858238-3 Nov 02 14:19:03.449696 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-603b26de-f51a-49b9-ae73-8b367c588607 req-f88b4f9d-135b-411a-8a1a-d2d21f51b1e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345353 Nov 02 14:19:03.451479 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1762/5511] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:03.683576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:03.684817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:03.702606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:03.708752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.709699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.710349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.712297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.713151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.718300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:04.057102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:04.065691 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3721871b-0dc4-4e14-8f74-9ef3553d3c86 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 0.388519 Nov 02 14:19:04.066387 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3750/5512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:03 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:04.399812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3119c15f-c03e-4cf7-ace1-eac9b2c995f0"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:04.403146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:04.420363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:04.421105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:04.421763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:04.422700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:04.423618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:04.424342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:05.092555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:05.094001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:05.108727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:05.110461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:05.113142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:05.114249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:05.116529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:05.117917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:05.163867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5610e109-c3f0-4b2c-8b29-614fe8d58687 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768306 Nov 02 14:19:05.176514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1763/5513] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:19:04 2022] POST /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:05.467966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:05.486695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cfd127e8-09a6-418d-9cce-ccdb6971f50a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 0.398641 Nov 02 14:19:05.487540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3751/5514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:05 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:06.514415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:06.515187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:06.536137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:06.536644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:06.537096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:06.537823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:06.538297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:06.538739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:06.786804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:06.802715 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99334e94-5e06-4292-b15a-834c6ab8486b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 0.293149 Nov 02 14:19:06.803769 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1764/5515] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:06 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:07.828458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:07.829080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:07.844810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:07.851298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:07.851893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:07.852758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:07.853586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:07.855436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:08.333513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:08.341856 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efc0bfe1-56dc-4dda-bfa0-a7b285317ccd tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 0.517592 Nov 02 14:19:08.344544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3752/5516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:07 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:09.373857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:09.374482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:09.401230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:09.404915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:09.411242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:09.412735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:09.415082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:09.419931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:09.422832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:09.512982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:09.993509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:10.006911 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d7be5cd3-9776-4088-9bed-1e7909e2f367 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1278 microversion: 2.1 time: 0.636158 Nov 02 14:19:10.009681 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1765/5517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:09 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1278 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:11.035004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:11.036023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:11.048926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:11.050715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:11.052436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:11.052987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:11.055714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:11.056502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:11.058125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:11.068790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:11.922071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:11.936529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-201a1470-a8d4-4f7b-8e4e-a48463df0255 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 0.904359 Nov 02 14:19:11.940227 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3753/5518] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:11 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:12.962157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:12.962790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:12.974009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:12.974521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:12.974981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:12.975754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:12.976226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:12.979324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:13.511721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:13.546625 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e57d453-3e2f-426f-a950-b7c718b857a4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 0.562708 Nov 02 14:19:13.547748 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1766/5519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:12 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:14.571777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:14.572507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:14.583258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:14.589823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:14.590849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:14.592378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:14.593098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:14.593975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:15.198099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:15.210912 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5a86ae6-c17a-4167-b192-3d0491283dbe tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 0.643295 Nov 02 14:19:15.216141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3754/5520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:14 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:15.818730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2089892400", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "75612cf3-1b7c-4d8e-9bc7-a3d71a0c6aa1"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:15.887460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] validate_networks() for [('75612cf3-1b7c-4d8e-9bc7-a3d71a0c6aa1', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:19:16.241898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:16.242497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:16.254717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:16.255248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:16.255681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:16.256380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:16.256831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:16.257253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:17.294875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:17.312159 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-447ecc6e-196f-446a-b9bb-c62bb1ba3189 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 1.066903 Nov 02 14:19:17.312836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3755/5521] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:16 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:18.096998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:19:18.101481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:19:18.102936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:19:18.105099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:19:18.105707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:19:18.157701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:18.168922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:18.171960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:18.177459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:18.180011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:18.180741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:18.243360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Getting quotas for project 28cb5ba4a35846a5808adb24d00c0699. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:19:18.260532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Getting quotas for user 174a3318ff454f0abcde9d74e2b3ad9b and project 28cb5ba4a35846a5808adb24d00c0699. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:19:18.311196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:19:18.318954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:19:18.338792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:18.339441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:18.366060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:18.366556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:18.366988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:18.367729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:18.387113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:18.389200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:18.519643 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d2e0ec3b-aa52-423c-b051-72a765e6d7a2 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.026951 Nov 02 14:19:18.521021 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1767/5522] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 14:19:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:19:18.554708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-415bc64b-5317-4380-9e5c-c7f4a9562f23 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:18.555566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-415bc64b-5317-4380-9e5c-c7f4a9562f23 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:19.417527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-415bc64b-5317-4380-9e5c-c7f4a9562f23 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:19.435631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-415bc64b-5317-4380-9e5c-c7f4a9562f23 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:19.454069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-415bc64b-5317-4380-9e5c-c7f4a9562f23 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:19.457600 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-415bc64b-5317-4380-9e5c-c7f4a9562f23 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1262 microversion: 2.26 time: 0.923222 Nov 02 14:19:19.479129 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1768/5523] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:18 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1262 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:19.913163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:19.929672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22dd8e94-6ca9-4dbc-8876-e6eceece11ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 1.595034 Nov 02 14:19:19.932105 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3756/5524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:18 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:20.496295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:20.496933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:20.508888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.509411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.509871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:20.510604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.511074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.520077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:20.829028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:20.838227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:20.839755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:20.844731 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f3c1b482-7bd3-4ccd-8a31-cf064f14f3b8 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1314 microversion: 2.26 time: 0.352350 Nov 02 14:19:20.852168 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1769/5525] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:20 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:20.959554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:20.960570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:20.972760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.973267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.988422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:20.989197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.996186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.996639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:21.837071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:21.849570 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c1ac7cf-b2bd-474e-8f60-029771165768 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 0.894911 Nov 02 14:19:21.850189 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3757/5526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:20 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:21.887472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:21.888665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:21.918936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:21.922301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:21.926486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:21.927370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:21.930562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:21.932921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:22.063935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:22.076510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:22.078240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:22.080110 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e65781f1-e68b-48d0-890c-47b20e2158a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1320 microversion: 2.26 time: 0.201060 Nov 02 14:19:22.099972 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1770/5527] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:21 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:22.875476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:22.876174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:22.887473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:22.888075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:22.888829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:22.889919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:22.890546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:22.891177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:23.114096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:23.115800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:23.193364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:23.193364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:23.193364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:23.193364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:23.193364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:23.193364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:23.999308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:24.022784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:24.026999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:24.028468 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-14be6064-946e-42a9-87a0-8b3478384f76 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1320 microversion: 2.26 time: 0.919779 Nov 02 14:19:24.040173 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1771/5528] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:23 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1320 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:24.164600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:24.176694 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-845d8f97-9dd9-4a7d-a504-76adcac716a1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 1.305858 Nov 02 14:19:24.181821 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3758/5529] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:22 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:24.556366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4dc182f0-2bdf-4630-848e-c83020d71613 req-5da08251-2554-4bc9-90c5-ec1e3f76854d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2625cd05-1243-40c4-935e-27195ba7fbbd", "name": "network-vif-plugged", "status": "completed", "tag": "e50a0773-015e-4438-b277-94e55fcd5546"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:24.574445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4dc182f0-2bdf-4630-848e-c83020d71613 req-5da08251-2554-4bc9-90c5-ec1e3f76854d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:24.580045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4dc182f0-2bdf-4630-848e-c83020d71613 req-5da08251-2554-4bc9-90c5-ec1e3f76854d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:24.580696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4dc182f0-2bdf-4630-848e-c83020d71613 req-5da08251-2554-4bc9-90c5-ec1e3f76854d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:24.594201 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4dc182f0-2bdf-4630-848e-c83020d71613 req-5da08251-2554-4bc9-90c5-ec1e3f76854d service nova] Creating event network-vif-plugged:e50a0773-015e-4438-b277-94e55fcd5546 for instance 2625cd05-1243-40c4-935e-27195ba7fbbd on n-h1-858238-3 Nov 02 14:19:24.618870 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4dc182f0-2bdf-4630-848e-c83020d71613 req-5da08251-2554-4bc9-90c5-ec1e3f76854d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549713 Nov 02 14:19:24.619821 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1772/5530] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:25.121153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:25.142366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:25.213639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.214215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.229076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.229233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:25.235939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:25.236374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.237058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.244382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.245653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.246315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.247189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.248067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.248778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.249391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.812007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:25.821485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:25.827258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:25.829032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:25.840894 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dafc5ab2-e8f3-43df-ba68-e0d19046e4cb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1362 microversion: 2.26 time: 0.781266 Nov 02 14:19:25.841507 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3759/5531] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:25 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1362 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:25.856076 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-505a0ce7-6ea3-4239-8d97-2f46293e6538 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1266 microversion: 2.1 time: 0.631336 Nov 02 14:19:25.866511 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1773/5532] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:25 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1266 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:26.272112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b650e3d9-841a-45aa-9f2d-131d92e3f80f req-350659ed-840c-4770-850d-c2bc23fdba79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55", "tag": "21601fd2-c82d-44d6-b2e7-cb508da986f4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:26.310145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b650e3d9-841a-45aa-9f2d-131d92e3f80f req-350659ed-840c-4770-850d-c2bc23fdba79 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.310638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b650e3d9-841a-45aa-9f2d-131d92e3f80f req-350659ed-840c-4770-850d-c2bc23fdba79 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.311069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b650e3d9-841a-45aa-9f2d-131d92e3f80f req-350659ed-840c-4770-850d-c2bc23fdba79 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:26.338454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b650e3d9-841a-45aa-9f2d-131d92e3f80f req-350659ed-840c-4770-850d-c2bc23fdba79 service nova] Creating event network-changed:21601fd2-c82d-44d6-b2e7-cb508da986f4 for instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 on n-h2-858238-3 Nov 02 14:19:26.368083 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b650e3d9-841a-45aa-9f2d-131d92e3f80f req-350659ed-840c-4770-850d-c2bc23fdba79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101453 Nov 02 14:19:26.369005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3760/5533] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:26.882284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:26.886271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:26.887559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:26.888593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:26.911137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.917035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.917698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:26.918081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.918794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.920398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.922398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:26.923086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.924656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:26.925844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.929920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.933950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:27.274216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:27.286024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:27.288614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:27.289902 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a70f29e4-c05c-471d-ab8d-b6c965a66ed5 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1362 microversion: 2.26 time: 0.419879 Nov 02 14:19:27.296292 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1774/5534] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:26 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:27.340323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:27.352039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bfe267d5-c5b6-41c5-b29d-2bb7a5dab215 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1453 microversion: 2.1 time: 0.474600 Nov 02 14:19:27.355375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3761/5535] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:26 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1453 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:27.377780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:27.377780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:27.391715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:27.392511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:27.393150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:27.394070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:27.394687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:27.395617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:27.977771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:28.002954 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-667d689e-42cc-4a9a-855c-12f9b21191b4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1453 microversion: 2.1 time: 0.631345 Nov 02 14:19:28.011060 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1775/5536] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:27 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1453 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:28.320208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:28.320892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:28.335232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:28.335724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:28.337445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:28.338321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:28.339749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:28.341515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:28.850464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:28.919439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:28.930528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:28.935853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-688a5874-99e2-4619-9e2d-0db92e5219a0 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1362 microversion: 2.26 time: 0.619844 Nov 02 14:19:28.939431 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3762/5537] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:28 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:29.977685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:29.978811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:29.991921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:29.994593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:29.996852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:30.008351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:30.009132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:30.011650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:30.012389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:30.013530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:30.024863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f1be19b-5fef-4482-b5d9-b01158a93061 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: .version_select at 0x7f6f81b72160>, body: {"keypair": {"name": "tempest-keypair-1551811091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkm9voPWBpFFQs0wL+e5zDOjSgfTyfqIA0iQwoMOlUXc58Ce36Yszggec2x7RalAn09Xa2beX1tO87uLeonr6EVv2uJnDFWAk6imGmjt5wn2+RmnYqHs0UaMt37mKq8YQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:30.063374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9f1be19b-5fef-4482-b5d9-b01158a93061 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:19:30.107980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9f1be19b-5fef-4482-b5d9-b01158a93061 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:19:30.211978 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f1be19b-5fef-4482-b5d9-b01158a93061 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192419 Nov 02 14:19:30.216637 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3763/5538] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:19:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:19:31.018688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:31.030784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:31.038320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:31.039683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20603007-d48d-49ec-94c3-3b009c0e4b7e tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1362 microversion: 2.26 time: 1.067423 Nov 02 14:19:31.044070 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1776/5539] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:29 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1362 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:31.983152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-957aafce-0b46-4b29-971a-14569a86c7fa req-bbfb4c62-b056-4208-a046-a8f761c63eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55", "name": "network-vif-plugged", "status": "completed", "tag": "21601fd2-c82d-44d6-b2e7-cb508da986f4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:32.028883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-957aafce-0b46-4b29-971a-14569a86c7fa req-bbfb4c62-b056-4208-a046-a8f761c63eea service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:32.029551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-957aafce-0b46-4b29-971a-14569a86c7fa req-bbfb4c62-b056-4208-a046-a8f761c63eea service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:32.029996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-957aafce-0b46-4b29-971a-14569a86c7fa req-bbfb4c62-b056-4208-a046-a8f761c63eea service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:32.079662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:32.081079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:32.107981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:32.112445 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-957aafce-0b46-4b29-971a-14569a86c7fa req-bbfb4c62-b056-4208-a046-a8f761c63eea service nova] Creating event network-vif-plugged:21601fd2-c82d-44d6-b2e7-cb508da986f4 for instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 on n-h2-858238-3 Nov 02 14:19:32.116933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:32.120186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:32.121104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:32.123713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:32.126372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:32.137627 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-957aafce-0b46-4b29-971a-14569a86c7fa req-bbfb4c62-b056-4208-a046-a8f761c63eea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162814 Nov 02 14:19:32.145283 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3764/5540] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:32.482385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:32.503771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:32.517159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:32.520441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6d66292f-c66e-43ce-b0f3-0188df317c93 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1362 microversion: 2.26 time: 0.444734 Nov 02 14:19:32.537409 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1777/5541] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:32 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:32.991478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8c9c9fe5-9f4b-407e-9860-7a1e480a65b0 req-a08e1310-038f-4894-85d4-f5b51a8db908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2625cd05-1243-40c4-935e-27195ba7fbbd", "tag": "e50a0773-015e-4438-b277-94e55fcd5546"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:33.005481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8c9c9fe5-9f4b-407e-9860-7a1e480a65b0 req-a08e1310-038f-4894-85d4-f5b51a8db908 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:33.006166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8c9c9fe5-9f4b-407e-9860-7a1e480a65b0 req-a08e1310-038f-4894-85d4-f5b51a8db908 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:33.006835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8c9c9fe5-9f4b-407e-9860-7a1e480a65b0 req-a08e1310-038f-4894-85d4-f5b51a8db908 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:33.023034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8c9c9fe5-9f4b-407e-9860-7a1e480a65b0 req-a08e1310-038f-4894-85d4-f5b51a8db908 service nova] Creating event network-changed:e50a0773-015e-4438-b277-94e55fcd5546 for instance 2625cd05-1243-40c4-935e-27195ba7fbbd on n-h1-858238-3 Nov 02 14:19:33.029374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8c9c9fe5-9f4b-407e-9860-7a1e480a65b0 req-a08e1310-038f-4894-85d4-f5b51a8db908 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043209 Nov 02 14:19:33.030116 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3765/5542] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:33.556108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:33.557298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:33.571265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:33.572034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:33.574493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:33.582698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:33.586056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:33.586713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:34.687965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:34.702670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:34.706396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:34.708407 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-74dd0329-b6ce-440e-ac52-228b54055946 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1362 microversion: 2.26 time: 1.156047 Nov 02 14:19:34.710597 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1778/5543] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:33 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1362 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:35.740461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:35.741780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:35.754699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:35.759338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:35.759988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:35.762103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:35.763054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:35.764624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:36.777979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:36.795332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:36.797077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:36.800207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7a123787-6ac6-4ed3-b77c-2e4e609984d6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1545 microversion: 2.26 time: 1.066056 Nov 02 14:19:36.810077 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3766/5544] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:35 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1545 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:36.845433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f8204d820>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:36.866692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:36.867225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:36.867681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:36.868174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:36.885180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:36.885695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:36.886154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:36.897022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-944828912", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e985cf22-7fc8-4126-b885-95f60f68af89"}], "security_groups": [{"name": "tempest-securitygroup--1381013037"}], "key_name": "tempest-keypair-1551811091", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:36.909533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:36.910173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:36.910633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:36.985161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:36.985647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:36.986094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.023792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.024524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.025115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.103812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:37.125202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31b7259b-d2cd-42f9-a9a5-317410b72389 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-462336141" status: 201 len: 0 microversion: 2.26 time: 0.283896 Nov 02 14:19:37.134140 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1779/5545] 10.222.0.18 () {62 vars in 1377 bytes} [Wed Nov 2 14:19:36 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-462336141 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 02 14:19:37.144937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b519b4b-ae2c-4478-afc7-97e179b56bd6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f81fceaf0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:37.154926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b519b4b-ae2c-4478-afc7-97e179b56bd6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.166696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b519b4b-ae2c-4478-afc7-97e179b56bd6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.167466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b519b4b-ae2c-4478-afc7-97e179b56bd6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.194320 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b519b4b-ae2c-4478-afc7-97e179b56bd6 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-462336141" status: 204 len: 0 microversion: 2.26 time: 0.052936 Nov 02 14:19:37.195661 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1780/5546] 10.222.0.18 () {60 vars in 1358 bytes} [Wed Nov 2 14:19:37 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-462336141 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:37.214086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] validate_networks() for [('e985cf22-7fc8-4126-b885-95f60f68af89', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:19:37.215936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f8351f550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:37.237585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.238102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.239948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.240575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:37.248098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.248694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.249468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.250525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.251074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.251613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.303571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.304083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.309044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.352076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:37.409293 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c638cdb1-a698-4e00-a1c0-7c3df56075fb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 204 len: 0 microversion: 2.26 time: 0.205276 Nov 02 14:19:37.418277 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1781/5547] 10.222.0.18 () {60 vars in 1295 bytes} [Wed Nov 2 14:19:37 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:37.431012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1c7c867-e7d7-40fd-98d4-4d1799b0e8bb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f82210f70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:37.464750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c7c867-e7d7-40fd-98d4-4d1799b0e8bb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.465731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c7c867-e7d7-40fd-98d4-4d1799b0e8bb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.466339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c7c867-e7d7-40fd-98d4-4d1799b0e8bb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.491780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:37.520530 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1c7c867-e7d7-40fd-98d4-4d1799b0e8bb tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 200 len: 12 microversion: 2.26 time: 0.099854 Nov 02 14:19:37.540497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1782/5548] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 14:19:37 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 12 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:37.565111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f82434e50>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:37.595400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.597926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.599987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.601054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:37.645644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.646158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.646764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.647417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.648056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.648296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.745791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.746696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.748418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.787289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:37.787803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:37.788258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:37.870167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:37.941271 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9adcc530-9352-4566-a1cf-fb59952c0e79 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-2069012251" status: 201 len: 0 microversion: 2.26 time: 0.399493 Nov 02 14:19:37.941949 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1783/5549] 10.222.0.18 () {62 vars in 1380 bytes} [Wed Nov 2 14:19:37 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-2069012251 => generated 0 bytes in 401 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 14:19:37.963639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0db1d18a-55c8-48e0-b58b-2bc9ea0df738 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f81874af0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.003653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0db1d18a-55c8-48e0-b58b-2bc9ea0df738 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.003782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0db1d18a-55c8-48e0-b58b-2bc9ea0df738 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.004240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0db1d18a-55c8-48e0-b58b-2bc9ea0df738 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.048481 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0db1d18a-55c8-48e0-b58b-2bc9ea0df738 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 200 len: 36 microversion: 2.26 time: 0.090748 Nov 02 14:19:38.049830 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1784/5550] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 14:19:37 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 36 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:38.059983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f81874ca0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.087582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.088097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.088553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.095745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:38.110225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.110733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.111210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.111979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.112450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.112887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.170663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.171191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.171652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.232957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:38.236678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:19:38.238406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:19:38.239324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:19:38.239932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:19:38.240511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:19:38.264029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.264519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.264948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.265678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.266130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.270272 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b450b6b5-b00b-4fa9-9df5-50b9f5540462 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-2069012251" status: 204 len: 0 microversion: 2.26 time: 0.214348 Nov 02 14:19:38.271596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.277266 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1785/5551] 10.222.0.18 () {60 vars in 1364 bytes} [Wed Nov 2 14:19:38 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-2069012251 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 14:19:38.290071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c9223f8-cf36-4422-883f-06f5d9873d6b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f82135550>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.312433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c9223f8-cf36-4422-883f-06f5d9873d6b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.316447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c9223f8-cf36-4422-883f-06f5d9873d6b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.321147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c9223f8-cf36-4422-883f-06f5d9873d6b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.346842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:19:38.351014 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c9223f8-cf36-4422-883f-06f5d9873d6b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 200 len: 12 microversion: 2.26 time: 0.068545 Nov 02 14:19:38.351687 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1786/5552] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 14:19:38 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:38.363007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f8204d820>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.369054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:19:38.391681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.397220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.398965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.400736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:38.407555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:19:38.412781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:19:38.415347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.419333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.420078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.421847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.422645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.423321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.485374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.485970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.486520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.527036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:38.557026 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b3c2c5a-39f1-4246-b78b-187da3d5b415 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.664701 Nov 02 14:19:38.561107 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3767/5553] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:19:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:19:38.585674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43a74872-da15-42ce-baac-f9136ac5f504 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.586553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43a74872-da15-42ce-baac-f9136ac5f504 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:38.589290 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ed82eef-288d-417e-889b-67846832436c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 204 len: 0 microversion: 2.26 time: 0.230402 Nov 02 14:19:38.603678 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1787/5554] 10.222.0.18 () {60 vars in 1295 bytes} [Wed Nov 2 14:19:38 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:38.609882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f827c9a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.620456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.621123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.621694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.622304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:38.628698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.629360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.629928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.630788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.631444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.633759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.713259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.714757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.716341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.742240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.743026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.746079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.763662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43a74872-da15-42ce-baac-f9136ac5f504 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:38.775439 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43a74872-da15-42ce-baac-f9136ac5f504 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1241 microversion: 2.1 time: 0.194378 Nov 02 14:19:38.787430 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3768/5555] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:38 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:38.812639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:38.848836 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-62244669-d46e-447b-93f5-eaada5837266 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-1108647953" status: 201 len: 0 microversion: 2.26 time: 0.243397 Nov 02 14:19:38.854171 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1788/5556] 10.222.0.18 () {62 vars in 1380 bytes} [Wed Nov 2 14:19:38 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-1108647953 => generated 0 bytes in 250 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 14:19:38.859136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f819e1310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:38.891668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.892207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.892656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.893687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:38.927925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.928423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.928855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:38.929561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:38.930009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:38.930427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.050463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.051159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.052869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.074882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.075664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.076253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.126030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:39.165730 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8749603d-e240-433f-b0c4-915909235e1a tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-1810043740" status: 201 len: 0 microversion: 2.26 time: 0.310408 Nov 02 14:19:39.170337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3769/5557] 10.222.0.18 () {62 vars in 1380 bytes} [Wed Nov 2 14:19:38 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-1810043740 => generated 0 bytes in 313 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 02 14:19:39.178785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f817fe0d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:39.195063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.196058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.197891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.199404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:39.249909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.250416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.250871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.251619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.252090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.253034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.318982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.325509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.325980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.375559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:39.403394 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7fce005d-30dd-4ec7-96df-ed9fd75738ca tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 204 len: 0 microversion: 2.26 time: 0.229781 Nov 02 14:19:39.412675 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1789/5558] 10.222.0.18 () {60 vars in 1295 bytes} [Wed Nov 2 14:19:39 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:39.427180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16391e39-a9d0-46bf-957b-8b3757f8c5ed tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f80fe7430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:39.451443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16391e39-a9d0-46bf-957b-8b3757f8c5ed tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.453688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16391e39-a9d0-46bf-957b-8b3757f8c5ed tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.454720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16391e39-a9d0-46bf-957b-8b3757f8c5ed tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.475468 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16391e39-a9d0-46bf-957b-8b3757f8c5ed tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 200 len: 12 microversion: 2.26 time: 0.063015 Nov 02 14:19:39.483811 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3770/5559] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 14:19:39 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:39.491605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f81f9a280>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:39.500542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.501070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.501479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.501969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:39.516467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.537338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.539045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.541360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.543635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.544383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.586756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.587587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.588209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.626224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:39.655398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c27e799a-2a40-4945-b435-4e274363d92d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 204 len: 0 microversion: 2.26 time: 0.169764 Nov 02 14:19:39.662642 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1790/5560] 10.222.0.18 () {60 vars in 1295 bytes} [Wed Nov 2 14:19:39 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:39.667006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f81b6ff70>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:39.681699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.682196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.682621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.683109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:39.746469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.747137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.755811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.756581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.757054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.757479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.808315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:39.809206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:39.819544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:39.823325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.825303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.826087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.828728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.830227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.831913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.866932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.887305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.887806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.910601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:39.911111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:39.911556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:39.978380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:39.978970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:39.987886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:39.993499 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-aa001680-0d2b-4205-a7a1-e59b228405f4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1245 microversion: 2.1 time: 0.189895 Nov 02 14:19:39.996448 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1791/5561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:39 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1245 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:40.033557 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ce5a754-1f01-4b4a-970c-1ea69d13694d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-937398528" status: 201 len: 0 microversion: 2.26 time: 0.369804 Nov 02 14:19:40.040187 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3771/5562] 10.222.0.18 () {62 vars in 1377 bytes} [Wed Nov 2 14:19:39 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-937398528 => generated 0 bytes in 378 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Nov 02 14:19:40.045566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f8351f700>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:40.075254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.075789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.076258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.076771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:40.101695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.102192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.103220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.103892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.104369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.104811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.198692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.199900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.200875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.212610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.213308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.213935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.257886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:40.277154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:40.343482 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b9c90158-3cc6-43e9-bcd4-604436ca8061 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-1995924735" status: 201 len: 0 microversion: 2.26 time: 0.302062 Nov 02 14:19:40.353356 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1792/5563] 10.222.0.18 () {62 vars in 1380 bytes} [Wed Nov 2 14:19:40 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags/tempest-tag-1995924735 => generated 0 bytes in 311 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 14:19:40.367284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Action: 'update_all', calling method: .version_select at 0x7f6f81b6a430>, body: {"tags": ["tempest-tag-1991121538", "tempest-tag-108302312"]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:40.397846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.398512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.400888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.401594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:40.420196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.450079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.451329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.453909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.454535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.457786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.538324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.539711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.540817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.603850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:40.644039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f24887eb-ca1c-4eb5-9ca8-1060693d5303 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 200 len: 61 microversion: 2.26 time: 0.286075 Nov 02 14:19:40.662117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4adb942-5e69-4425-9b1d-e3a22ece2fec tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f818745e0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:40.667377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3772/5564] 10.222.0.18 () {62 vars in 1312 bytes} [Wed Nov 2 14:19:40 2022] PUT /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 61 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:40.682899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4adb942-5e69-4425-9b1d-e3a22ece2fec tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.685672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4adb942-5e69-4425-9b1d-e3a22ece2fec tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.686241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4adb942-5e69-4425-9b1d-e3a22ece2fec tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.719999 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4adb942-5e69-4425-9b1d-e3a22ece2fec tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 200 len: 61 microversion: 2.26 time: 0.065085 Nov 02 14:19:40.729956 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1793/5565] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 14:19:40 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 61 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:40.741800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '.version_select at 0x7f6f81b998b0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:40.756646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.757237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.757694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.758165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:40.786096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.786865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.789698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.791183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.794558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.796903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.837264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.838629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.839284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.867812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'flavor' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:40.901828 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-093f2796-0dc2-4a80-8f20-7dfbd2b6a6b3 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags" status: 204 len: 0 microversion: 2.26 time: 0.157683 Nov 02 14:19:40.907014 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3773/5566] 10.222.0.18 () {60 vars in 1295 bytes} [Wed Nov 2 14:19:40 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55/tags => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:40.913934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:40.914808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:40.923665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.924433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.925078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.925985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:40.926643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:40.927337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:40.958253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:19:41.018411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:41.022794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:41.038625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:41.043968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:41.045236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:41.050131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:41.050848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:41.051677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:41.101859 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ef69198-159e-4d09-ad98-0c24ad83538b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 204 len: 0 microversion: 2.26 time: 0.191446 Nov 02 14:19:41.103514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1794/5567] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 14:19:40 2022] DELETE /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 14:19:41.118177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:41.121513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:41.134913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:41.135967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:41.136415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:41.138632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:41.139159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:41.139569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:41.200977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:41.231134 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2df9f4ce-d0a5-4625-9e1d-800159a8c454 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1299 microversion: 2.1 time: 0.214550 Nov 02 14:19:41.236639 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3774/5568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:41 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:41.559857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:41.576862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:41.578729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:41.580165 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-403d4bc5-6077-4382-9dcc-32f8e30e1c4c tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1551 microversion: 2.26 time: 0.469495 Nov 02 14:19:41.583629 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1795/5569] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:41 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1551 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:42.267035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:42.267704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:42.276815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:42.287757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:42.290068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:42.291014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:42.294703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:42.295788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:42.296538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:42.482077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:42.495024 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34c04358-2793-4751-ae79-e6a8b6a5c5d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1299 microversion: 2.1 time: 0.238850 Nov 02 14:19:42.496352 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3775/5570] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:42 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:42.611598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:42.612369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:42.622432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:42.624076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:42.624762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:42.625685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:42.626807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:42.627841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:42.983843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:42.994593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:42.996902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:43.005913 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-abd1d32f-15ce-4e41-8b54-7186b4948b8b tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1551 microversion: 2.26 time: 0.400174 Nov 02 14:19:43.009074 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1796/5571] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:42 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1551 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 14:19:43.518670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:43.519891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:43.544644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:43.547337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:43.548059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:43.549292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:43.551132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:43.553396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:43.813429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2dffa2b6-9ecc-4c6e-bbdf-7ba58d101d9e req-6db51266-0322-4578-9cad-f1ddd317278b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55", "name": "network-vif-deleted", "tag": "21601fd2-c82d-44d6-b2e7-cb508da986f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:43.857782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2dffa2b6-9ecc-4c6e-bbdf-7ba58d101d9e req-6db51266-0322-4578-9cad-f1ddd317278b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:43.858844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2dffa2b6-9ecc-4c6e-bbdf-7ba58d101d9e req-6db51266-0322-4578-9cad-f1ddd317278b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:43.866593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2dffa2b6-9ecc-4c6e-bbdf-7ba58d101d9e req-6db51266-0322-4578-9cad-f1ddd317278b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:43.910413 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2dffa2b6-9ecc-4c6e-bbdf-7ba58d101d9e req-6db51266-0322-4578-9cad-f1ddd317278b service nova] Creating event network-vif-deleted:21601fd2-c82d-44d6-b2e7-cb508da986f4 for instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 on n-h2-858238-3 Nov 02 14:19:43.922713 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2dffa2b6-9ecc-4c6e-bbdf-7ba58d101d9e req-6db51266-0322-4578-9cad-f1ddd317278b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114407 Nov 02 14:19:43.929102 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1797/5572] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:19:44.040654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:44.041401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:44.074218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:44.074744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:44.075231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:44.075977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:44.076496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:44.077064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:44.165485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:44.165968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:44.166432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:44.166908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lazy-loading 'fault' on Instance uuid 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:19:44.879018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:44.881681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:44.889123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:44.891060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '174a3318ff454f0abcde9d74e2b3ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cb5ba4a35846a5808adb24d00c0699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:44.892778 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf64fe36-7c94-4959-8940-e9e355995b57 tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 200 len: 1352 microversion: 2.26 time: 0.856470 Nov 02 14:19:44.894587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1798/5573] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:44 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 1352 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 14:19:44.895884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-262bb048-359a-4d04-b916-686ca5e2111f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 1.381670 Nov 02 14:19:44.899293 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3776/5574] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:43 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:45.928842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:45.930100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:45.932047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:45.932670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] [instance: 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:45.946536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:45.947620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:45.950025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:45.950500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:45.950874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:45.951524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:45.951632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:45.952293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:45.952644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:45.952755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:45.953322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:45.954375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:45.998244 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] HTTP exception thrown: Instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 could not be found. Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Request method failure captured: Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 HTTP/1.1 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnxjXJopJVuE8V2aNceBsgKAPf_enx59Uj2GRb-0Qn2nlAxGufisMTmxfGyi0fgzSSK4NnuyO0k9Cvtt4oNblkQsxYQiWs0DMtWFidj51RrxyCyEV0xv4JOrtDH-Ai9Agt-I9Ta9EQOdilxqlUJbw5ny4C6Thg_ZCBFBAzc1Y-6Ky3U Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 28cb5ba4a35846a5808adb24d00c0699 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerTagsTestJSON-2109895544 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28cb5ba4a35846a5808adb24d00c0699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28cb5ba4a35846a5808adb24d00c0699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28cb5ba4a35846a5808adb24d00c0699"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28cb5ba4a35846a5808adb24d00c0699"}]}] Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerTagsTestJSON-2109895544 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 28cb5ba4a35846a5808adb24d00c0699 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerTagsTestJSON-2109895544 Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerTagsTestJSON-2109895544-project Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 174a3318ff454f0abcde9d74e2b3ad9b Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerTagsTestJSON-2109895544-project Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 could not be found. Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55'} Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 could not be found. Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 could not be found. Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:46.000420 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 could not be found. Nov 02 14:19:46.006217 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:19:46.028344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] Returning 404 to user: Instance 44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:19:46.035355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b067bd54-61d2-4515-b0ce-e8b5081d741d tempest-ServerTagsTestJSON-2109895544 tempest-ServerTagsTestJSON-2109895544-project] 10.222.0.18 "GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55" status: 404 len: 111 microversion: 2.26 time: 0.111081 Nov 02 14:19:46.036834 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1799/5575] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 14:19:45 2022] GET /compute/v2.1/servers/44d26c97-f2e9-4abc-a2a0-14e7b0ee1b55 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:19:46.129286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f02575c9-7a0b-455e-928d-458dfc3fb9d0 req-86733343-c4fd-4edc-bddb-901d5dfa403a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9666aaf-1f29-4e21-81bf-9ba9463ff39e", "tag": "f7a3d91d-a146-4375-a50e-490ac0a01cda"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:46.181602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f02575c9-7a0b-455e-928d-458dfc3fb9d0 req-86733343-c4fd-4edc-bddb-901d5dfa403a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:46.182218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f02575c9-7a0b-455e-928d-458dfc3fb9d0 req-86733343-c4fd-4edc-bddb-901d5dfa403a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:46.182751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f02575c9-7a0b-455e-928d-458dfc3fb9d0 req-86733343-c4fd-4edc-bddb-901d5dfa403a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:46.229850 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f02575c9-7a0b-455e-928d-458dfc3fb9d0 req-86733343-c4fd-4edc-bddb-901d5dfa403a service nova] Creating event network-changed:f7a3d91d-a146-4375-a50e-490ac0a01cda for instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e on n-h1-858238-3 Nov 02 14:19:46.250263 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f02575c9-7a0b-455e-928d-458dfc3fb9d0 req-86733343-c4fd-4edc-bddb-901d5dfa403a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131036 Nov 02 14:19:46.256040 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1800/5576] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:46.860779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:46.872587 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-69fe91c2-f229-4f8f-b75b-094f8a952b6a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 0.951231 Nov 02 14:19:46.874484 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3777/5577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:45 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:47.899247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:47.899983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:47.926044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:47.931428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:47.932045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:47.932846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:47.933345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:47.933800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:48.957990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:48.991604 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b4c8dc55-f98c-4aa8-b37f-64df0abda7ca tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 1.096422 Nov 02 14:19:48.993941 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1801/5578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:47 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:50.021252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:50.022140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:50.046246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:50.062455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:50.070442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:50.071814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:50.076937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:50.081712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:50.084348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:50.084980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:50.726923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:50.735312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90ef60da-6ea5-4e48-9337-8ba67f7131b3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 0.720891 Nov 02 14:19:50.735915 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3778/5579] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:50 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:51.766563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:51.767244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:51.801441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:51.805248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:51.805736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:51.810699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:51.811310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:51.811774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:52.952130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:52.962655 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e5e27c8-bf2e-41b7-b0d8-f5fc8dca127e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 1.200915 Nov 02 14:19:52.964092 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1802/5580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:51 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:53.994254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:53.995373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:54.012583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:54.016478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:54.019499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:54.027426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:54.028154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:54.030621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:54.242023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c999e998-d71d-44ae-9ec6-20ba57ea2df4 req-deb96e3f-613d-4ef8-9889-7262afc6821b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9666aaf-1f29-4e21-81bf-9ba9463ff39e", "name": "network-vif-plugged", "status": "completed", "tag": "f7a3d91d-a146-4375-a50e-490ac0a01cda"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:54.280756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c999e998-d71d-44ae-9ec6-20ba57ea2df4 req-deb96e3f-613d-4ef8-9889-7262afc6821b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:54.281271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c999e998-d71d-44ae-9ec6-20ba57ea2df4 req-deb96e3f-613d-4ef8-9889-7262afc6821b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:54.290562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c999e998-d71d-44ae-9ec6-20ba57ea2df4 req-deb96e3f-613d-4ef8-9889-7262afc6821b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:54.346921 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c999e998-d71d-44ae-9ec6-20ba57ea2df4 req-deb96e3f-613d-4ef8-9889-7262afc6821b service nova] Creating event network-vif-plugged:f7a3d91d-a146-4375-a50e-490ac0a01cda for instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e on n-h1-858238-3 Nov 02 14:19:54.364973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c999e998-d71d-44ae-9ec6-20ba57ea2df4 req-deb96e3f-613d-4ef8-9889-7262afc6821b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126973 Nov 02 14:19:54.381082 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1803/5581] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:19:54.850589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:54.859706 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4abe4823-52b0-45b9-bc03-d8c3fbd3a2e8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 0.870540 Nov 02 14:19:54.866515 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3779/5582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:53 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:55.892629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:55.895299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:55.917862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:55.918752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:55.923083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:55.924246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:55.925232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:55.925917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:56.275836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:56.285495 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-975c0d42-980d-4b4d-952e-cdc1608bbe4b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1367 microversion: 2.1 time: 0.405293 Nov 02 14:19:56.300324 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1804/5583] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:55 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:57.310552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:57.312011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:57.333115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:57.335759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:57.336393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:57.338147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:57.338877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:57.339492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:58.041475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:58.054417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a822812-bbb8-410a-9e09-acceb37ed334 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1558 microversion: 2.1 time: 0.745385 Nov 02 14:19:58.075231 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3780/5584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:19:57 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1558 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:58.078122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:58.078646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:58.094630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:58.095187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:58.098854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:58.099717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:58.100209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:58.100662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:58.397298 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2b7a08c6-45cc-4d5e-9de6-928aef7fec9a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.323843 Nov 02 14:19:58.398087 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1805/5585] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:19:58 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/os-interface => generated 285 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:01.090652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-22da7406-d1d2-4de6-a4e7-c41e9a81704b req-62d3c4cd-4adb-474e-a7a2-a326dad55e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9666aaf-1f29-4e21-81bf-9ba9463ff39e", "tag": "f7a3d91d-a146-4375-a50e-490ac0a01cda"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:01.115978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-22da7406-d1d2-4de6-a4e7-c41e9a81704b req-62d3c4cd-4adb-474e-a7a2-a326dad55e3e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:01.116795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-22da7406-d1d2-4de6-a4e7-c41e9a81704b req-62d3c4cd-4adb-474e-a7a2-a326dad55e3e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:01.117441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-22da7406-d1d2-4de6-a4e7-c41e9a81704b req-62d3c4cd-4adb-474e-a7a2-a326dad55e3e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:01.134841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-22da7406-d1d2-4de6-a4e7-c41e9a81704b req-62d3c4cd-4adb-474e-a7a2-a326dad55e3e service nova] Creating event network-changed:f7a3d91d-a146-4375-a50e-490ac0a01cda for instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e on n-h1-858238-3 Nov 02 14:20:01.148747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-22da7406-d1d2-4de6-a4e7-c41e9a81704b req-62d3c4cd-4adb-474e-a7a2-a326dad55e3e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061821 Nov 02 14:20:01.155176 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3781/5586] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:28.588179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:28.589948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:28.597551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:28.598923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:28.622660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:28.633522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:28.638112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:28.640312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:28.642103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:28.644142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:28.732295 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bb4ab7e8-b5bc-4941-808e-44043f8186d0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/ips" status: 200 len: 151 microversion: 2.1 time: 0.146554 Nov 02 14:20:28.734373 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1806/5587] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:20:28 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/ips => generated 151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:28.745463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=13 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:28.747657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=66,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:28.757126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3119c15f-c03e-4cf7-ace1-eac9b2c995f0"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:28.769591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:28.794755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:28.796010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:28.796681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:28.797699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:28.798306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:28.798928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:29.013576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Invalid volume: volume 3119c15f-c03e-4cf7-ace1-eac9b2c995f0 is already attached to instances: 18825187-645a-4dc8-8608-8520f9bb2706 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/os-volume_attachments HTTP/1.1 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 74 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: {"volumeAttachment": {"volumeId": "3119c15f-c03e-4cf7-ace1-eac9b2c995f0"}} Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid volume: volume 3119c15f-c03e-4cf7-ace1-eac9b2c995f0 is already attached to instances: 18825187-645a-4dc8-8608-8520f9bb2706 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': 'c9666aaf-1f29-4e21-81bf-9ba9463ff39e', 'body': {'volumeAttachment': {'volumeId': '3119c15f-c03e-4cf7-ace1-eac9b2c995f0'}}} Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3119c15f-c03e-4cf7-ace1-eac9b2c995f0 is already attached to instances: 18825187-645a-4dc8-8608-8520f9bb2706 Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:20:29.021742 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3119c15f-c03e-4cf7-ace1-eac9b2c995f0 is already attached to instances: 18825187-645a-4dc8-8608-8520f9bb2706 Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3119c15f-c03e-4cf7-ace1-eac9b2c995f0 is already attached to instances: 18825187-645a-4dc8-8608-8520f9bb2706 Nov 02 14:20:29.025191 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:29.025999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 400 to user: Invalid volume: volume 3119c15f-c03e-4cf7-ace1-eac9b2c995f0 is already attached to instances: 18825187-645a-4dc8-8608-8520f9bb2706 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:20:29.026752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-29490142-bd80-4166-8b01-9da33b01ee6d tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.285342 Nov 02 14:20:29.036209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:29.036725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:29.043083 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3782/5588] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:20:28 2022] POST /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e/os-volume_attachments => generated 174 bytes in 302 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:20:29.053061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:29.053531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:29.053988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:29.054712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:29.055209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:29.055676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:29.138775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:20:29.399611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2ba4c888-39d2-421e-a53b-46f28a795996 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 204 len: 0 microversion: 2.1 time: 0.367227 Nov 02 14:20:29.400792 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1807/5589] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:20:29 2022] DELETE /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:20:29.417551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:29.418449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:29.435878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:29.436722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:29.437844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:29.438745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:29.442762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:29.443417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:30.420060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:30.429833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cb8703e9-2dfb-465a-9f70-be7da9c06ab3 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1683 microversion: 2.1 time: 1.024415 Nov 02 14:20:30.431074 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3783/5590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:29 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1683 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:31.460171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:31.461291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:31.492127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:31.492948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:31.496175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:31.499923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:31.509166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:31.511485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:32.072057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:32.104476 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3b38e7a7-0bf9-45df-9a51-4b50ec2ef303 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1683 microversion: 2.1 time: 0.648613 Nov 02 14:20:32.107026 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1808/5591] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:31 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1683 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:33.131824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:33.132447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:33.143075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:33.144036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:33.147517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:33.148414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:33.149030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:33.150719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:33.388957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:33.404715 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16ba4e52-cb09-4d22-8ec0-57f0c13434c4 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1615 microversion: 2.1 time: 0.276894 Nov 02 14:20:33.406182 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3784/5592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:33 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1615 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:33.879969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2cd16029-6e44-43b2-99ff-949ecab32b84 req-f06d2a06-3247-4b7c-a881-badcf3c7d9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9666aaf-1f29-4e21-81bf-9ba9463ff39e", "name": "network-vif-deleted", "tag": "f7a3d91d-a146-4375-a50e-490ac0a01cda"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:33.905456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2cd16029-6e44-43b2-99ff-949ecab32b84 req-f06d2a06-3247-4b7c-a881-badcf3c7d9ea service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:33.905962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2cd16029-6e44-43b2-99ff-949ecab32b84 req-f06d2a06-3247-4b7c-a881-badcf3c7d9ea service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:33.907845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2cd16029-6e44-43b2-99ff-949ecab32b84 req-f06d2a06-3247-4b7c-a881-badcf3c7d9ea service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.003159 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2cd16029-6e44-43b2-99ff-949ecab32b84 req-f06d2a06-3247-4b7c-a881-badcf3c7d9ea service nova] Creating event network-vif-deleted:f7a3d91d-a146-4375-a50e-490ac0a01cda for instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e on n-h1-858238-3 Nov 02 14:20:34.011454 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2cd16029-6e44-43b2-99ff-949ecab32b84 req-f06d2a06-3247-4b7c-a881-badcf3c7d9ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139972 Nov 02 14:20:34.013170 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1809/5593] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:34.433947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:34.434671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:34.447512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.449574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.450107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.452597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.453663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.459870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.555588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.558502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.560131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.562232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lazy-loading 'fault' on Instance uuid c9666aaf-1f29-4e21-81bf-9ba9463ff39e {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:20:34.713642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:34.728392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5385f97-e334-42a2-a563-e509c3c58dcc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 200 len: 1331 microversion: 2.1 time: 0.300343 Nov 02 14:20:34.731477 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3785/5594] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:34 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:35.759167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:35.760475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:35.773729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:35.774481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:35.777183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:35.778272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:35.778906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:35.783221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:35.813535 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e HTTP/1.1 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'c9666aaf-1f29-4e21-81bf-9ba9463ff39e'} Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:35.819227 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:20:35.824085 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ea5f5fc0-a2ca-44a1-827c-d7c435ca5c54 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 404 len: 111 microversion: 2.1 time: 0.066027 Nov 02 14:20:35.830997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-960677ce-db19-42b7-8222-21e7bf8bd2cc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '.version_select at 0x7f6f81bc81f0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:35.835549 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1810/5595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:35 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:20:35.867123 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-960677ce-db19-42b7-8222-21e7bf8bd2cc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551811091" status: 202 len: 0 microversion: 2.1 time: 0.040960 Nov 02 14:20:35.868004 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3786/5596] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551811091 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:20:38.725046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:38.725553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:38.739897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:38.740412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:38.740866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:38.741592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:38.742059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:38.742493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:39.733610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lazy-loading 'services' on Instance uuid 18825187-645a-4dc8-8608-8520f9bb2706 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:20:39.935935 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c6ccd3bd-19d9-4e2b-925b-1da6c3f5e5a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments/3119c15f-c03e-4cf7-ace1-eac9b2c995f0" status: 202 len: 0 microversion: 2.1 time: 1.215960 Nov 02 14:20:39.942258 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1811/5597] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:20:38 2022] DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments/3119c15f-c03e-4cf7-ace1-eac9b2c995f0 => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:20:39.945994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:39.948304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:39.964524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:39.965042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:39.965485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:39.966212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:39.966665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:39.967084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:40.135485 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2c426cf-59ca-4dc7-bb83-555542e7522b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182845 Nov 02 14:20:40.141458 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3787/5598] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:39 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:41.150681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:41.153169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:41.169480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:41.170001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:41.170515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:41.171304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:41.171782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:41.172228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:41.248764 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53425be4-1652-405f-b312-965a3515a4e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103404 Nov 02 14:20:41.255737 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1812/5599] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:41 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:42.263068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:42.268393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:42.287735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:42.289236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:42.293059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:42.294444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:42.307613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:42.310159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:42.395875 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-06735c97-dbda-4663-90ed-f29f106ce21a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137535 Nov 02 14:20:42.399475 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3788/5600] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:42 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:43.411697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:43.413972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:43.434066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:43.435194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:43.436932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:43.439113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:43.443157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:43.448864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:43.557788 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca66cfb2-21de-4a38-bba4-b24a80297162 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147951 Nov 02 14:20:43.562154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1813/5601] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:43 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:44.572927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:44.576070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:44.617169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:44.617686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:44.618148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:44.628646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:44.629189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:44.633340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:44.763064 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f70fb05-dfa0-4b0a-b53d-a27e06eb04b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194285 Nov 02 14:20:44.774370 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3789/5602] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:44 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:45.788143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:45.793656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:45.819989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:45.824309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:45.825666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:45.826634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:45.828794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:45.829260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:45.919137 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f2e2fe4-1afd-4c9c-bdd4-1fea4150e924 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136091 Nov 02 14:20:45.921079 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1814/5603] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:45 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:46.932649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:46.934851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:46.967029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:46.971294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:46.973996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:46.980526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:46.984372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:46.984946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:47.076369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c00c870-62bd-4924-bebd-626b89e1d34c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147965 Nov 02 14:20:47.086832 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3790/5604] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:46 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:48.100171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:48.102618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:48.111303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:48.111802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:48.112821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:48.115928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:48.116421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:48.116871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:48.200875 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfb8cad1-ae2a-41d1-8d55-e37a9f7aa8d7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106699 Nov 02 14:20:48.204475 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1815/5605] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:48 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:49.214020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:49.218078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:49.235889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:49.238439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:49.240475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:49.241558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:49.244862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:49.245735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:49.382420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b7286af-cbe7-4cc2-acc2-2bf209402dcd tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172621 Nov 02 14:20:49.395193 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3791/5606] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:49 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:50.395958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:50.398440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:50.413375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:50.420679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:50.424503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:50.426548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:50.429972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:50.431624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:50.546981 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a0edb60f-9829-4005-ba0e-8f6ff11774e1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155818 Nov 02 14:20:50.553099 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1816/5607] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:20:50 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:20:50.711247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:50.711952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:50.733625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:50.734323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:50.735907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:50.738611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:50.739281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:50.740132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:50.832461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:20:51.057225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0529b7ba-5936-471b-92da-29141b186b1c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 204 len: 0 microversion: 2.1 time: 0.349710 Nov 02 14:20:51.065350 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3792/5608] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:20:50 2022] DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:20:51.073592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:51.074230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:51.085026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:51.085542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:51.086000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:51.099290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:51.099979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:51.100625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:51.778368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:51.786904 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-facf0625-c24e-4d1d-8152-f7266aa0ab52 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1679 microversion: 2.1 time: 0.717201 Nov 02 14:20:51.791787 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1817/5609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:51 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1679 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:52.819507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:52.820575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:52.851452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:52.855856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:52.856505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:52.865951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:52.869840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:52.873311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:53.365252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:53.375608 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e3ee51cd-f194-4b2f-b661-1dbffd36d79c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1679 microversion: 2.1 time: 0.560776 Nov 02 14:20:53.382551 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3793/5610] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:52 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1679 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:54.410874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:54.411555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:54.430754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:54.431333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:54.431816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.436556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:54.437378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:54.437987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.586624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:54.606658 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-86bd242b-1577-4a2a-bb99-6d0bd581f860 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1611 microversion: 2.1 time: 0.200374 Nov 02 14:20:54.608890 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1818/5611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:54 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1611 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:55.024581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-db9665f9-39f2-4e42-bc69-2fa2b28435bc req-23fa2099-51a3-4045-bd68-96a3ab8c329b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18825187-645a-4dc8-8608-8520f9bb2706", "name": "network-vif-deleted", "tag": "b83dcb53-54a8-4e62-a7b2-2bae2915d044"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:55.085929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-db9665f9-39f2-4e42-bc69-2fa2b28435bc req-23fa2099-51a3-4045-bd68-96a3ab8c329b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.086412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-db9665f9-39f2-4e42-bc69-2fa2b28435bc req-23fa2099-51a3-4045-bd68-96a3ab8c329b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.086841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-db9665f9-39f2-4e42-bc69-2fa2b28435bc req-23fa2099-51a3-4045-bd68-96a3ab8c329b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.129168 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-db9665f9-39f2-4e42-bc69-2fa2b28435bc req-23fa2099-51a3-4045-bd68-96a3ab8c329b service nova] Creating event network-vif-deleted:b83dcb53-54a8-4e62-a7b2-2bae2915d044 for instance 18825187-645a-4dc8-8608-8520f9bb2706 on n-h2-858238-3 Nov 02 14:20:55.150802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-db9665f9-39f2-4e42-bc69-2fa2b28435bc req-23fa2099-51a3-4045-bd68-96a3ab8c329b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137068 Nov 02 14:20:55.155427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3794/5612] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:55.632246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:55.632803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:55.652396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.653049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.653825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.654653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.655050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.655746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.843962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.845271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.845961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.849461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lazy-loading 'fault' on Instance uuid 18825187-645a-4dc8-8608-8520f9bb2706 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:20:56.347197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:56.364018 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-023f1f00-a170-4532-b649-c17dbeeb6329 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 200 len: 1330 microversion: 2.1 time: 0.736730 Nov 02 14:20:56.366132 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1819/5613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:55 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 1330 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:57.395319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:57.396652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:57.414499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:57.415387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:57.417381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:57.418312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:57.421687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:57.422341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:57.453289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 HTTP/1.1 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '18825187-645a-4dc8-8608-8520f9bb2706'} Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:57.455515 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:20:57.460501 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:20:57.463609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:20:57.464735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb813519-9198-4783-915a-762c49a46a74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 404 len: 111 microversion: 2.1 time: 0.074627 Nov 02 14:20:57.469298 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3795/5614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:20:57 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:20:57.476074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c7fb6027-03e9-4902-8db1-dd402972f718 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '.version_select at 0x7f6f81918430>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:57.522792 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c7fb6027-03e9-4902-8db1-dd402972f718 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521329370" status: 202 len: 0 microversion: 2.1 time: 0.051975 Nov 02 14:20:57.523829 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1820/5615] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 14:20:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521329370 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:20:59.963613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d853cd8-19d1-44c4-a80b-c164a3a028e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: .version_select at 0x7f6f85e68820>, body: {"keypair": {"name": "tempest-keypair-1058331152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFltxCQH8lW5r31ASjnCwXUo1ruOBEd+Av4lbr0bR5KHx2M7uTFou0jf9ZPAKVSexPxPTwK2SCabhGwHmEAO2/hIR8xGY5eyufd9GOZEkHFcS+FbDhnQllpqXrL5ydjJCQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:59.973264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:00.052049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1d853cd8-19d1-44c4-a80b-c164a3a028e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:21:00.103942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1d853cd8-19d1-44c4-a80b-c164a3a028e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:21:00.195027 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d853cd8-19d1-44c4-a80b-c164a3a028e5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237464 Nov 02 14:21:00.205503 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3796/5616] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:20:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:04.055514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-72d8ffe8-2847-4107-92c0-4a7b13fc6f3a tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1645437907", "availability_zone": "foo_zone"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:04.066266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.aggregate [None req-72d8ffe8-2847-4107-92c0-4a7b13fc6f3a tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Generated uuid 7457f973-9aab-4f7b-b952-3c8f67e81e95 for aggregate {{(pid=137558) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 14:21:04.083673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:04.135089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448507506", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e985cf22-7fc8-4126-b885-95f60f68af89"}], "security_groups": [{"name": "tempest-securitygroup--179015617"}], "key_name": "tempest-keypair-1058331152", "user_data": "}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:04.173777 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-72d8ffe8-2847-4107-92c0-4a7b13fc6f3a tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.479518 Nov 02 14:21:04.177086 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1821/5617] 10.222.0.18 () {60 vars in 1164 bytes} [Wed Nov 2 14:21:03 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:04.189199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a0d18946-2faa-4875-9999-0d0eea968d47 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:04.243907 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a0d18946-2faa-4875-9999-0d0eea968d47 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.059198 Nov 02 14:21:04.245279 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1822/5618] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 14:21:04 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:04.257341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:04.267491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:04.268274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:04.269454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:04.270268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:04.274176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:04.274827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:04.297607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:04.355471 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-448003dc-90b3-4efc-8c17-1d3cd9acb04d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102056 Nov 02 14:21:04.356319 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1823/5619] 10.222.0.18 () {58 vars in 1176 bytes} [Wed Nov 2 14:21:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:04.370960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d1c5171-8ca7-4890-bfdf-701084696559 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:04.390267 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d1c5171-8ca7-4890-bfdf-701084696559 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.021068 Nov 02 14:21:04.390953 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1824/5620] 10.222.0.18 () {58 vars in 1143 bytes} [Wed Nov 2 14:21:04 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:04.404137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-656ca215-cb36-4914-8f0e-23bdd8dd72a6 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:04.412600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] validate_networks() for [('e985cf22-7fc8-4126-b885-95f60f68af89', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:21:04.425851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-656ca215-cb36-4914-8f0e-23bdd8dd72a6 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:04.427241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-656ca215-cb36-4914-8f0e-23bdd8dd72a6 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:04.427692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-656ca215-cb36-4914-8f0e-23bdd8dd72a6 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:05.090066 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-656ca215-cb36-4914-8f0e-23bdd8dd72a6 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.690115 Nov 02 14:21:05.098767 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1825/5621] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 14:21:04 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:05.113268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-440137af-9aa8-49c3-a7c0-3dcf63260364 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:05.134060 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-440137af-9aa8-49c3-a7c0-3dcf63260364 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.032009 Nov 02 14:21:05.138272 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1826/5622] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:21:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:05.158072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d18f77c6-a177-4a2c-afee-895af11393d0 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-399097329", "availability_zone": "foo_zone"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:05.298164 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d18f77c6-a177-4a2c-afee-895af11393d0 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.152702 Nov 02 14:21:05.299528 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1827/5623] 10.222.0.18 () {60 vars in 1173 bytes} [Wed Nov 2 14:21:05 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:05.315487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8c6feeb-a24a-4255-8683-0bd38802d624 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:05.381467 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b8c6feeb-a24a-4255-8683-0bd38802d624 tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.071633 Nov 02 14:21:05.385372 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1828/5624] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 14:21:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:05.399826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45fb0c31-ce99-4764-b860-05aaf81daf5d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:05.420629 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45fb0c31-ce99-4764-b860-05aaf81daf5d tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.028762 Nov 02 14:21:05.422111 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1829/5625] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Nov 2 14:21:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:05.435372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b3940537-9e7c-479b-b7ae-67b8ac839bdf tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858238-3"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:05.461425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3940537-9e7c-479b-b7ae-67b8ac839bdf tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:05.462221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3940537-9e7c-479b-b7ae-67b8ac839bdf tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:05.463859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b3940537-9e7c-479b-b7ae-67b8ac839bdf tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:05.793553 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b3940537-9e7c-479b-b7ae-67b8ac839bdf tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.360097 Nov 02 14:21:05.795877 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1830/5626] 10.222.0.18 () {60 vars in 1194 bytes} [Wed Nov 2 14:21:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:05.811133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cc5acbf2-62b8-45b1-85d5-2c2e702fb7ce tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:05.875182 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cc5acbf2-62b8-45b1-85d5-2c2e702fb7ce tempest-TestAggregatesBasicOps-1355472815 tempest-TestAggregatesBasicOps-1355472815-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.071610 Nov 02 14:21:05.877591 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1831/5627] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 14:21:05 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 14:21:06.041237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:21:06.041705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:21:06.042057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:21:06.042465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:21:06.042868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:21:06.081555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:06.083679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:06.084299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:06.087937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:06.089009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:06.089930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:06.112905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:06.163894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:21:06.171542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:21:06.191077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:21:06.193784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:21:06.283019 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11acaac0-f136-4fcf-a019-4360aef56dee tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.153279 Nov 02 14:21:06.283743 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3797/5628] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:21:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:21:06.296954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-55b1ccdb-2620-422e-a8cd-3d88b7c07f24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:06.306640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-55b1ccdb-2620-422e-a8cd-3d88b7c07f24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:06.428176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-55b1ccdb-2620-422e-a8cd-3d88b7c07f24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:06.439392 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-55b1ccdb-2620-422e-a8cd-3d88b7c07f24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1242 microversion: 2.1 time: 0.146844 Nov 02 14:21:06.441246 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1832/5629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:06 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:07.467248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c744af3-9e38-4353-a999-3f231eb85923 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:07.468702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c744af3-9e38-4353-a999-3f231eb85923 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:07.702378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c744af3-9e38-4353-a999-3f231eb85923 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:07.717918 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c744af3-9e38-4353-a999-3f231eb85923 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1242 microversion: 2.1 time: 0.257519 Nov 02 14:21:07.727809 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3798/5630] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:07 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1242 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:08.762253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:08.763600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:08.796496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:08.798207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:08.801771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:08.803456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:08.804097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:08.808295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:09.179813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:09.213979 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-efaf0a69-3cff-49f7-a174-d89bd401eede tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1302 microversion: 2.1 time: 0.465284 Nov 02 14:21:09.227140 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1833/5631] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:08 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1302 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:10.266318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:10.267629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:10.279507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:10.280451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:10.281867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:10.282823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:10.283510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:10.284361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:10.401384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:10.433771 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7b8a02d-256f-4c93-91cd-25759e8e520c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1300 microversion: 2.1 time: 0.171655 Nov 02 14:21:10.450722 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3799/5632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:10 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:11.462490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:11.463889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:11.477472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:11.499239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:11.499722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:11.500507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:11.504685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:11.506216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:11.702601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:11.717259 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8054225a-5ad5-44ce-939b-ebf6b680ff42 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1300 microversion: 2.1 time: 0.258647 Nov 02 14:21:11.718983 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1834/5633] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:11 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1300 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:12.742068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:12.742675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:12.773077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:12.774141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:12.774587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:12.782682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:12.783214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:12.783783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:14.249981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:14.261810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b42e323d-92e9-41e3-b831-1b2acdbdb28f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 1.523547 Nov 02 14:21:14.278580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3800/5634] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:12 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:15.199221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:15.204159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8ac116a4-8595-4f67-8e18-3bd3059eaab2 req-d8cfc4ad-d7a3-4152-aa6f-d3e2f04c1924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2efdff-fb0e-498b-832f-3a82dbc5b020", "tag": "d0af9762-41da-4060-aa18-e8453994848e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:15.237807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8ac116a4-8595-4f67-8e18-3bd3059eaab2 req-d8cfc4ad-d7a3-4152-aa6f-d3e2f04c1924 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:15.238309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8ac116a4-8595-4f67-8e18-3bd3059eaab2 req-d8cfc4ad-d7a3-4152-aa6f-d3e2f04c1924 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:15.238733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8ac116a4-8595-4f67-8e18-3bd3059eaab2 req-d8cfc4ad-d7a3-4152-aa6f-d3e2f04c1924 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:15.276466 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8ac116a4-8595-4f67-8e18-3bd3059eaab2 req-d8cfc4ad-d7a3-4152-aa6f-d3e2f04c1924 service nova] Creating event network-changed:d0af9762-41da-4060-aa18-e8453994848e for instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 on n-h2-858238-3 Nov 02 14:21:15.284316 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8ac116a4-8595-4f67-8e18-3bd3059eaab2 req-d8cfc4ad-d7a3-4152-aa6f-d3e2f04c1924 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087032 Nov 02 14:21:15.285231 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1835/5635] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:15.295954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:15.297145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:15.304882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:15.305588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:15.306240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:15.313129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:15.313863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:15.314588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:15.712674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:15.723402 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-645397fc-1346-4840-b9a8-cc645a7edb60 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 0.437283 Nov 02 14:21:15.724530 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3801/5636] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:15 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:16.747265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:16.749072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:16.759696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:16.772455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:16.775140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:16.775851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:16.777046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:16.781993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:16.782671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:17.364052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:17.376948 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b443bb5a-9640-4011-b835-a44f5cb58f91 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 0.634608 Nov 02 14:21:17.391130 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1836/5637] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:16 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:18.404216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:18.404819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:18.421608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:18.429016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:18.434714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:18.435256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:18.435706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:18.436433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:18.436896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:18.437325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:18.975481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:18.985077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ecfe521-3c02-4064-8908-f7a12e6fd6ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 0.584951 Nov 02 14:21:18.986210 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3802/5638] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:18 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:20.011977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:20.012530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:20.033996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:20.035081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:20.035569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:20.038420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:20.038981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:20.040549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:20.505847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:20.530260 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-10c96008-3c0f-4d4f-a1d7-ed6b1caf931f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 0.512069 Nov 02 14:21:20.552749 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1837/5639] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:20 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:21.562460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:21.563300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:21.585497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:21.585989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:21.586421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:21.590712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:21.591480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:21.595207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:22.140995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:22.162065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a17aa157-177b-4648-acf8-73a881427178 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 0.605993 Nov 02 14:21:22.175209 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3803/5640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:21 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:22.196310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-cfac1982-d042-449e-b306-0622318b777d req-da8ea669-0ea4-4f80-a00b-9eab10996b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2efdff-fb0e-498b-832f-3a82dbc5b020", "name": "network-vif-plugged", "status": "completed", "tag": "d0af9762-41da-4060-aa18-e8453994848e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:22.217964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cfac1982-d042-449e-b306-0622318b777d req-da8ea669-0ea4-4f80-a00b-9eab10996b52 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:22.222193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cfac1982-d042-449e-b306-0622318b777d req-da8ea669-0ea4-4f80-a00b-9eab10996b52 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:22.222869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cfac1982-d042-449e-b306-0622318b777d req-da8ea669-0ea4-4f80-a00b-9eab10996b52 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:22.256569 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-cfac1982-d042-449e-b306-0622318b777d req-da8ea669-0ea4-4f80-a00b-9eab10996b52 service nova] Creating event network-vif-plugged:d0af9762-41da-4060-aa18-e8453994848e for instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 on n-h2-858238-3 Nov 02 14:21:22.274979 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-cfac1982-d042-449e-b306-0622318b777d req-da8ea669-0ea4-4f80-a00b-9eab10996b52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079105 Nov 02 14:21:22.276649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1838/5641] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:23.197702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:23.198871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:23.210610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:23.212829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:23.214789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:23.219982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:23.220681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:23.222252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:23.693714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:23.711270 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-72d6b27d-3852-4634-bd20-ad13e208c4ce tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1367 microversion: 2.1 time: 0.517003 Nov 02 14:21:23.739320 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3804/5642] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:23 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:21:24.747174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:24.747932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:24.772693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:24.773248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:24.773724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:24.781076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:24.781894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:24.785192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:25.178235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:25.191559 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-187e3bf8-07d1-4dd4-b90d-427beb704047 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1557 microversion: 2.1 time: 0.452492 Nov 02 14:21:25.192679 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1839/5643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:24 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1557 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:25.237926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:25.238727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:25.265311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:25.266175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:25.267061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:25.268333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:25.271447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:25.272598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:25.601198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e931edd1-82d2-4005-a569-9d5a9055eb20 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.370859 Nov 02 14:21:25.602132 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3805/5644] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:21:25 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-interface => generated 284 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:27.914794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:27.915400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:27.924066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:27.925676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:27.926147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:27.927206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:27.927714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:27.928157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:27.969174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:21:28.178346 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-452ef4f4-4931-4bf9-91b1-4223bba7e510 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 204 len: 0 microversion: 2.1 time: 0.610107 Nov 02 14:21:28.182883 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1840/5645] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:21:27 2022] DELETE /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:21:28.187692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:28.188421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:28.200107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:28.203708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:28.204199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:28.215900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:28.216694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:28.217375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:28.541471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:28.551868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-42af9dc9-eff7-4d38-87a5-01c3d86c8f13 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1578 microversion: 2.1 time: 0.368218 Nov 02 14:21:28.556237 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3806/5646] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:28 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1578 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:29.473053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d42ed67e-02d7-4066-954c-727096ed0806 req-23915d4b-5835-40cf-8b61-6ead0c855f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2efdff-fb0e-498b-832f-3a82dbc5b020", "tag": "d0af9762-41da-4060-aa18-e8453994848e"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:29.493650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d42ed67e-02d7-4066-954c-727096ed0806 req-23915d4b-5835-40cf-8b61-6ead0c855f1d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:29.495603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d42ed67e-02d7-4066-954c-727096ed0806 req-23915d4b-5835-40cf-8b61-6ead0c855f1d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:29.496058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d42ed67e-02d7-4066-954c-727096ed0806 req-23915d4b-5835-40cf-8b61-6ead0c855f1d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:29.532045 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d42ed67e-02d7-4066-954c-727096ed0806 req-23915d4b-5835-40cf-8b61-6ead0c855f1d service nova] Creating event network-changed:d0af9762-41da-4060-aa18-e8453994848e for instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 on n-h2-858238-3 Nov 02 14:21:29.545600 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d42ed67e-02d7-4066-954c-727096ed0806 req-23915d4b-5835-40cf-8b61-6ead0c855f1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076034 Nov 02 14:21:29.547225 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1841/5647] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:29.580360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:29.582050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:29.599124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:29.601398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:29.604279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:29.605336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:29.605928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:29.607460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:30.201807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:30.219886 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b8a8f5e-72ae-4259-9979-16a021b3c202 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1578 microversion: 2.1 time: 0.642513 Nov 02 14:21:30.224371 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3807/5648] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:29 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1578 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:31.246343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:31.247355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:31.270280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:31.275936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:31.277722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:31.283630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:31.284956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:31.291564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:31.559787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:31.584762 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a71be91-c1f6-44fb-ad97-47006500a975 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1510 microversion: 2.1 time: 0.338302 Nov 02 14:21:31.590529 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1842/5649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:31 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:32.311212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0dcb8da1-c424-40d9-a6b7-f8efd9b8a6fe req-ab02fbb6-b3b4-4d46-880a-3513fe9657e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2625cd05-1243-40c4-935e-27195ba7fbbd", "name": "network-vif-deleted", "tag": "e50a0773-015e-4438-b277-94e55fcd5546"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:32.321569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:32.338844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0dcb8da1-c424-40d9-a6b7-f8efd9b8a6fe req-ab02fbb6-b3b4-4d46-880a-3513fe9657e9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:32.342036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0dcb8da1-c424-40d9-a6b7-f8efd9b8a6fe req-ab02fbb6-b3b4-4d46-880a-3513fe9657e9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:32.345322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0dcb8da1-c424-40d9-a6b7-f8efd9b8a6fe req-ab02fbb6-b3b4-4d46-880a-3513fe9657e9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:32.382454 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0dcb8da1-c424-40d9-a6b7-f8efd9b8a6fe req-ab02fbb6-b3b4-4d46-880a-3513fe9657e9 service nova] Creating event network-vif-deleted:e50a0773-015e-4438-b277-94e55fcd5546 for instance 2625cd05-1243-40c4-935e-27195ba7fbbd on n-h1-858238-3 Nov 02 14:21:32.396323 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0dcb8da1-c424-40d9-a6b7-f8efd9b8a6fe req-ab02fbb6-b3b4-4d46-880a-3513fe9657e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089296 Nov 02 14:21:32.401795 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3808/5650] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:21:32.636178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:32.652027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:32.663576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:32.665345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:32.666264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:32.668606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:32.669814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:32.670553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:32.891416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:32.908159 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c8ee0275-db9f-437b-bcb6-af608e461aef tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.293709 Nov 02 14:21:32.910711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1843/5651] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:32 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:33.938492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:33.939352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:33.953206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:33.953704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:33.954141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:33.961821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:33.962465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:33.962919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:34.095723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:34.114982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7d8e8c9-7db0-4572-9c7f-d22c7c39dec5 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.180709 Nov 02 14:21:34.115618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3809/5652] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:33 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:35.139828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:35.140313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:35.144558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:35.150091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:35.151309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:35.151906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:35.152771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:35.153504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:35.154091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:35.192541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:35.303855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:35.321318 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-22a8d0de-469f-4ca4-a8e1-e54fadab8ce0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.186023 Nov 02 14:21:35.322472 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1844/5653] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:35 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:36.346945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:36.348839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:36.364483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:36.365350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:36.369555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:36.370556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:36.372321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:36.374983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:36.380512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=62 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:36.498327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:36.512868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a2a51b8-422b-47bc-906a-0bcb63bdedcc tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.171129 Nov 02 14:21:36.513842 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3810/5654] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:36 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:37.538104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:37.538723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:37.550248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:37.550787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:37.551218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:37.561715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:37.562383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:37.562989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:37.667249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:37.675380 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-005effe4-d2f0-4669-b584-c605156bb68e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.141114 Nov 02 14:21:37.687872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1845/5655] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:37 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:38.705321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:38.706908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:38.731070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:38.731936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:38.734647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:38.735651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:38.736499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:38.739399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:38.885664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:38.900781 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c8447d7a-e90b-4378-b55f-ae1b7ecc07d9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.203545 Nov 02 14:21:38.902028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3811/5656] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:38 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:39.934809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:39.942351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:39.964025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:39.964542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:39.968784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:39.969798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:39.979328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:39.979328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:40.218646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:40.231589 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9674d3c7-5f7f-4e84-9adc-b02c7fab6b56 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 200 len: 1225 microversion: 2.1 time: 0.301512 Nov 02 14:21:40.234458 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1846/5657] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:39 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 1225 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:41.258769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:41.259711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:41.272641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:41.273588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:41.274349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:41.275480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:41.276216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:41.276873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:41.324394 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd HTTP/1.1 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2625cd05-1243-40c4-935e-27195ba7fbbd'} Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:21:41.326007 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db5a63ca-cf8c-4d92-8835-d1f47ae90502 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 404 len: 111 microversion: 2.1 time: 0.073087 Nov 02 14:21:41.329796 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3812/5658] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:41 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:21:41.571023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1716581298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-489749758", "security_groups": [{"name": "tempest-secgroup-smoke-2065242919"}], "block_device_mapping_v2": [{"uuid": "8924d1b2-f739-4658-bc21-423eb0a94a16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:41.947656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:21:42.699930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:21:42.702668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:21:42.703876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:21:42.704841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:21:42.705541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:21:42.718227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:42.722641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:42.723413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:42.725020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:42.726148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:42.727290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:42.779567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:21:42.790604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:21:42.909102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:21:42.915626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8924d1b2-f739-4658-bc21-423eb0a94a16',volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:21:43.221335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1ce7df70-eae4-4aad-a92f-6c1b22c367f3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.654476 Nov 02 14:21:43.227632 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1847/5659] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:21:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:21:43.255278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c5b1084-43de-44fd-8745-d75398f31594 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:43.257679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c5b1084-43de-44fd-8745-d75398f31594 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:43.368943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c5b1084-43de-44fd-8745-d75398f31594 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:43.388238 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c5b1084-43de-44fd-8745-d75398f31594 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1094 microversion: 2.1 time: 0.145998 Nov 02 14:21:43.408086 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3813/5660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:43 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1094 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:44.463057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:44.466358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:44.474734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:44.475635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:44.476309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:44.478697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:44.480441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:44.483230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:44.621126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:44.631838 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-90f030c4-b2d3-4c73-8a13-b002893dfe35 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1192 microversion: 2.1 time: 0.182092 Nov 02 14:21:44.633147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1848/5661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:44 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1192 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:45.656579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:45.657198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:45.684734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:45.685450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:45.695441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:45.696470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:45.697417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:45.698150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:45.828457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:45.836871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-143a4555-7a31-4d4c-b9a3-d6ecc3415c2d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1210 microversion: 2.1 time: 0.184017 Nov 02 14:21:45.843950 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3814/5662] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:45 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1210 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:46.868482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:46.869296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:46.916343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:46.921814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:46.926041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:46.932251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:46.935474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:46.935993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:47.101061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:47.156127 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7d7c45c9-cf64-4bf4-897a-770b41251e2c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1210 microversion: 2.1 time: 0.281442 Nov 02 14:21:47.174177 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1849/5663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:46 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1210 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:48.191853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:48.193649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:48.201003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:48.201502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:48.201943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:48.202660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:48.203139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:48.203761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:48.725852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:48.741577 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e0bc29f9-5f78-475a-af89-753ebbca5e15 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1278 microversion: 2.1 time: 0.554911 Nov 02 14:21:48.744508 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3815/5664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:48 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1278 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:49.778509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:49.779585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:49.793356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:49.796342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:49.799218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:49.802478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:49.803946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:49.805843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:50.004338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2e0c5a16-f277-4140-a5ba-0b518a685808 req-c13638cb-ac68-443b-b087-ea7a8e540e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3e69f8-cff4-4271-a688-aa8526712327", "tag": "b599cc05-7f38-48c0-9955-f4aa975b28fc"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:50.035454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e0c5a16-f277-4140-a5ba-0b518a685808 req-c13638cb-ac68-443b-b087-ea7a8e540e09 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:50.037962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e0c5a16-f277-4140-a5ba-0b518a685808 req-c13638cb-ac68-443b-b087-ea7a8e540e09 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:50.041836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2e0c5a16-f277-4140-a5ba-0b518a685808 req-c13638cb-ac68-443b-b087-ea7a8e540e09 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:50.066908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2e0c5a16-f277-4140-a5ba-0b518a685808 req-c13638cb-ac68-443b-b087-ea7a8e540e09 service nova] Creating event network-changed:b599cc05-7f38-48c0-9955-f4aa975b28fc for instance cf3e69f8-cff4-4271-a688-aa8526712327 on n-h1-858238-3 Nov 02 14:21:50.086351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2e0c5a16-f277-4140-a5ba-0b518a685808 req-c13638cb-ac68-443b-b087-ea7a8e540e09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091774 Nov 02 14:21:50.087697 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3816/5665] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:50.729254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:50.749974 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4902c91a-1154-46a5-84e3-6d3a3e2ee0b8 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1278 microversion: 2.1 time: 0.984640 Nov 02 14:21:50.769845 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1850/5666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:49 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1278 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:51.783218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:51.785660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:51.797980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:51.798495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:51.799003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:51.799799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:51.800838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:51.810756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:52.334268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:52.342543 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d0cd6977-8f06-46d3-853a-fcd1f4ff36da tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1278 microversion: 2.1 time: 0.565162 Nov 02 14:21:52.343178 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3817/5667] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:51 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1278 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:53.372349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:53.373867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:53.399895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:53.402660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:53.409605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:53.410270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:53.412243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:53.412968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:53.413471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:53.413926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:54.069891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:54.092797 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a79f6779-c97d-48ad-aa76-36cb4041f79b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1278 microversion: 2.1 time: 0.726137 Nov 02 14:21:54.102350 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1851/5668] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:53 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1278 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:55.127425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:55.131650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:55.142687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:55.155993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:55.156775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:55.162417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:55.163746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:55.164391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:55.164986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:56.305074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:56.349340 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-18c793ea-46bc-4753-aed5-02e05eeb32af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1278 microversion: 2.1 time: 1.222036 Nov 02 14:21:56.354581 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3818/5669] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:55 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1278 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:21:57.384589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:57.386012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:57.401008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:57.403833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:57.404505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:57.405629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:57.407482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:57.408571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:57.694222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:57.717202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c0bc2f2-b095-4e51-88e2-46345fc37a9d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.334717 Nov 02 14:21:57.720842 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1852/5670] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:57 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:58.749851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:58.750589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:58.763985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:58.764856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:58.766363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:58.769048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:58.771183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:58.772437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:59.166309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:59.177428 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95063b99-0877-4f6d-b99a-45a6b45e9a6d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.432522 Nov 02 14:21:59.179228 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3819/5671] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:21:58 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:00.213865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:00.215205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:00.249776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:00.250537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:00.251232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:00.252181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:00.252880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:00.254217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:00.512478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:00.522394 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ec8dca4a-36c4-480e-82c5-6761aa3a0797 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.315511 Nov 02 14:22:00.524268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1853/5672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:00 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:01.547330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:01.552315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:01.562268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:01.563172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:01.563830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:01.564720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:01.566098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:01.566693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:01.866208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:01.900090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eac5ddbd-f166-4b3a-953e-f0ec08c1a454 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.356727 Nov 02 14:22:01.902980 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3820/5673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:01 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:02.926637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:02.928904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:02.953013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:02.953614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:02.954085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:02.954845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:02.955348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:02.955786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:03.156581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:03.172668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6301ffba-949b-42ee-9525-27ad5fb0d8c6 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.247986 Nov 02 14:22:03.176860 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1854/5674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:02 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:03.574314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:03.574843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:03.578383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=28 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:03.614411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:03.614915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:03.615372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:03.625299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:03.626523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:03.631086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:03.688792 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96e1dbbe-a521-420d-abb5-5f98a6b0a33f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/ips" status: 200 len: 149 microversion: 2.1 time: 0.118347 Nov 02 14:22:03.694552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3821/5675] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:22:03 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/ips => generated 149 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:04.200589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:04.201870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:04.232830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:04.234165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:04.238638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:04.243986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:04.245217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:04.248763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:04.743964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:04.759305 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ea90a9bd-67d8-46ff-8c9b-540fc2c082e4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.561062 Nov 02 14:22:04.771158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1855/5676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:04 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:05.785758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:05.786748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:05.805082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:05.808233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:05.811500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:05.812631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:05.813331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:05.814122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:06.116036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:06.133039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c05b356-328c-489f-95e5-e292d98dc661 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.352751 Nov 02 14:22:06.134157 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3822/5677] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:05 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:06.660670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97d55cc8-57f3-49d7-af27-7687e923de5c"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:06.664565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:06.681936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:06.691721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:06.692705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:06.694731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:06.702485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:06.703898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:06.704949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:06.716938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=68 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:07.156985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:07.158379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:07.174146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:07.174847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:07.175507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:07.176498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:07.177099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:07.177664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:07.211135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=62 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:07.220427 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0c737ab6-8dcb-4d00-a6e9-fa3ffa4bec39 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567530 Nov 02 14:22:07.221057 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1856/5678] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:22:06 2022] POST /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:07.631332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:07.642062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb7e2d12-05b7-475b-8328-a674e1a55682 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.489023 Nov 02 14:22:07.648453 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3823/5679] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:07 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:08.255673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-bae6171c-c663-41d6-874e-1362296a02a1 req-b4336f0a-9879-4f14-931e-49884e742230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3e69f8-cff4-4271-a688-aa8526712327", "name": "network-vif-plugged", "status": "completed", "tag": "b599cc05-7f38-48c0-9955-f4aa975b28fc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:08.282430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bae6171c-c663-41d6-874e-1362296a02a1 req-b4336f0a-9879-4f14-931e-49884e742230 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:08.284878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bae6171c-c663-41d6-874e-1362296a02a1 req-b4336f0a-9879-4f14-931e-49884e742230 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:08.287343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-bae6171c-c663-41d6-874e-1362296a02a1 req-b4336f0a-9879-4f14-931e-49884e742230 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:08.314690 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-bae6171c-c663-41d6-874e-1362296a02a1 req-b4336f0a-9879-4f14-931e-49884e742230 service nova] Creating event network-vif-plugged:b599cc05-7f38-48c0-9955-f4aa975b28fc for instance cf3e69f8-cff4-4271-a688-aa8526712327 on n-h1-858238-3 Nov 02 14:22:08.324763 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-bae6171c-c663-41d6-874e-1362296a02a1 req-b4336f0a-9879-4f14-931e-49884e742230 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072298 Nov 02 14:22:08.331995 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1857/5680] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:08.673857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:08.675256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:08.686617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:08.688139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:08.690488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:08.693074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:08.693725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:08.695609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:09.008078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:09.026013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-445de8ed-948b-45d0-9960-aa1c43cf2759 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1266 microversion: 2.1 time: 0.359384 Nov 02 14:22:09.044764 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3824/5681] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:08 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:10.052032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:10.052758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:10.064849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:10.065358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:10.065856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:10.066605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:10.067085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:10.067560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:10.422048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:10.433557 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a515a664-b29c-47ed-9f51-a445eaeb7fce tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1454 microversion: 2.1 time: 0.387309 Nov 02 14:22:10.442283 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1858/5682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:10 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1454 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:10.464438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:10.464438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:10.479633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:10.480537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:10.481148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:10.482041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:10.482583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:10.483529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:10.795495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:10.806861 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc6a1120-4b29-4f61-a9fc-ae6381319016 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1454 microversion: 2.1 time: 0.346602 Nov 02 14:22:10.809005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3825/5683] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:10 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1454 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:14.204148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-22df8f14-ae77-455a-9165-a6b2e5de1350 req-2aa03f2d-7f54-492f-8d26-fb93ba332f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3e69f8-cff4-4271-a688-aa8526712327", "tag": "b599cc05-7f38-48c0-9955-f4aa975b28fc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:14.231471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-22df8f14-ae77-455a-9165-a6b2e5de1350 req-2aa03f2d-7f54-492f-8d26-fb93ba332f66 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:14.232236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-22df8f14-ae77-455a-9165-a6b2e5de1350 req-2aa03f2d-7f54-492f-8d26-fb93ba332f66 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:14.232855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-22df8f14-ae77-455a-9165-a6b2e5de1350 req-2aa03f2d-7f54-492f-8d26-fb93ba332f66 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:14.245783 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-22df8f14-ae77-455a-9165-a6b2e5de1350 req-2aa03f2d-7f54-492f-8d26-fb93ba332f66 service nova] Creating event network-changed:b599cc05-7f38-48c0-9955-f4aa975b28fc for instance cf3e69f8-cff4-4271-a688-aa8526712327 on n-h1-858238-3 Nov 02 14:22:14.251879 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-22df8f14-ae77-455a-9165-a6b2e5de1350 req-2aa03f2d-7f54-492f-8d26-fb93ba332f66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054619 Nov 02 14:22:14.253854 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1859/5684] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:23.204243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97d55cc8-57f3-49d7-af27-7687e923de5c"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:23.206732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:23.214171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:23.214949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=17 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:23.241153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:23.241611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:23.242059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:23.250655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:23.250655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:23.250655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:23.408125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Invalid volume: volume 97d55cc8-57f3-49d7-af27-7687e923de5c is already attached to instances: fc2efdff-fb0e-498b-832f-3a82dbc5b020 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments HTTP/1.1 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 74 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: {"volumeAttachment": {"volumeId": "97d55cc8-57f3-49d7-af27-7687e923de5c"}} Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid volume: volume 97d55cc8-57f3-49d7-af27-7687e923de5c is already attached to instances: fc2efdff-fb0e-498b-832f-3a82dbc5b020 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': 'fc2efdff-fb0e-498b-832f-3a82dbc5b020', 'body': {'volumeAttachment': {'volumeId': '97d55cc8-57f3-49d7-af27-7687e923de5c'}}} Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 97d55cc8-57f3-49d7-af27-7687e923de5c is already attached to instances: fc2efdff-fb0e-498b-832f-3a82dbc5b020 Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:22:23.412862 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 97d55cc8-57f3-49d7-af27-7687e923de5c is already attached to instances: fc2efdff-fb0e-498b-832f-3a82dbc5b020 Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 97d55cc8-57f3-49d7-af27-7687e923de5c is already attached to instances: fc2efdff-fb0e-498b-832f-3a82dbc5b020 Nov 02 14:22:23.416708 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:23.420463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 400 to user: Invalid volume: volume 97d55cc8-57f3-49d7-af27-7687e923de5c is already attached to instances: fc2efdff-fb0e-498b-832f-3a82dbc5b020 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:22:23.421554 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2bf53dd4-6420-44ce-a741-3eb03b88b9b1 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221829 Nov 02 14:22:23.427574 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3826/5685] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:22:23 2022] POST /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 174 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:22:23.579213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:23.579976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:23.591126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:23.591911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:23.592612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:23.593599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:23.594344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:23.595047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:23.698811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lazy-loading 'services' on Instance uuid fc2efdff-fb0e-498b-832f-3a82dbc5b020 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:22:23.808968 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-726eb07e-5b31-44fc-9fcf-bd23c8f9fdb7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments/97d55cc8-57f3-49d7-af27-7687e923de5c" status: 202 len: 0 microversion: 2.1 time: 0.241367 Nov 02 14:22:23.810964 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1860/5686] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:22:23 2022] DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments/97d55cc8-57f3-49d7-af27-7687e923de5c => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:22:23.820659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:23.822868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:23.844355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:23.845190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:23.845803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:23.846741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:23.847430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:23.848278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:24.000207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-065687f5-c597-442b-b08b-19915f7eb153 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157164 Nov 02 14:22:24.004191 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3827/5687] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:23 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:25.015475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:25.018483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:25.040487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:25.051129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:25.067818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:25.068703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:25.069193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:25.069656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:25.242245 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9235fd23-0337-4cb2-928f-ac209748a088 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228231 Nov 02 14:22:25.244905 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1861/5688] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:25 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:26.259856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:26.262087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:26.274965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:26.279798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:26.280252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:26.280981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:26.281438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:26.281862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:26.429847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c2e7d148-321c-4d00-891a-8ad30c5badc5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177006 Nov 02 14:22:26.430445 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3828/5689] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:26 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:27.447415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:27.452946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:27.470863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:27.476202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:27.479854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:27.482339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:27.482790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:27.486207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:27.560299 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1a12bdf-4557-4ca1-9d36-3d2a80c33056 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120719 Nov 02 14:22:27.562710 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1862/5690] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:27 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:28.576045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:28.578312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:28.589954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:28.590460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:28.590958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:28.591813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:28.592488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:28.593300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:28.681562 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef664dbc-c178-4689-838c-68d920c719a0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100279 Nov 02 14:22:28.681562 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3829/5691] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:28 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:29.686964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:29.705477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:29.744134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:29.746351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:29.747078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:29.750174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:29.751004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:29.751750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:29.844493 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47823597-9e7d-45a4-b5c2-a1febf4130ad tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161415 Nov 02 14:22:29.853175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1863/5692] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:29 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:30.858653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:30.861578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:30.877287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:30.878480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:30.879867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:30.881484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:30.884145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:30.885121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:30.985056 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d10f31f8-99c7-4ada-8a5b-1e0583bbed56 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130918 Nov 02 14:22:30.990800 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3830/5693] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:30 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:32.002835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:32.006944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:32.033089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.034701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.038851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.040326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.041099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.044983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.100733 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5bac1164-6880-4d94-9ede-b96e94686c49 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102143 Nov 02 14:22:32.102180 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1864/5694] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:22:31 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:22:32.232711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:32.233262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:32.279313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.280294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.280977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.281925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.282728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.283350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.336255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:22:32.488698 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0883004c-38ab-4117-bd08-26da6a836b25 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 204 len: 0 microversion: 2.1 time: 0.268016 Nov 02 14:22:32.489718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3831/5695] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:22:32 2022] DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:22:32.501463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:32.506262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:32.523799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.526429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.527166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.528885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.529814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.530655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.893630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:32.907044 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7aed30f0-c706-463f-ae5b-1b2bcd281f1f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1681 microversion: 2.1 time: 0.410703 Nov 02 14:22:32.908995 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1865/5696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:32 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1681 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:33.934426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:33.935158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:33.950016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:33.950582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:33.951146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:33.951827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:33.952282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:33.952705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:34.258107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:34.268393 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a6786c3-68f2-49f0-a49d-ea69c22074d8 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1681 microversion: 2.1 time: 0.339389 Nov 02 14:22:34.271970 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3832/5697] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:33 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:35.294741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:35.296169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:35.309644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:35.320105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:35.320932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:35.322087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:35.322689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:35.323429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:35.685218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:35.697336 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-51e175a7-df10-4aa2-abd8-976a2b496ab2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1681 microversion: 2.1 time: 0.406792 Nov 02 14:22:35.704522 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1866/5698] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:35 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1681 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:36.433213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-dbd27559-ec19-4d1e-9653-315448d4a310 req-ddcfd37b-2766-4e50-87ea-5040d2bda705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2efdff-fb0e-498b-832f-3a82dbc5b020", "name": "network-vif-deleted", "tag": "d0af9762-41da-4060-aa18-e8453994848e"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:36.462327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dbd27559-ec19-4d1e-9653-315448d4a310 req-ddcfd37b-2766-4e50-87ea-5040d2bda705 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:36.462829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dbd27559-ec19-4d1e-9653-315448d4a310 req-ddcfd37b-2766-4e50-87ea-5040d2bda705 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:36.463293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-dbd27559-ec19-4d1e-9653-315448d4a310 req-ddcfd37b-2766-4e50-87ea-5040d2bda705 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:36.497606 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-dbd27559-ec19-4d1e-9653-315448d4a310 req-ddcfd37b-2766-4e50-87ea-5040d2bda705 service nova] Creating event network-vif-deleted:d0af9762-41da-4060-aa18-e8453994848e for instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 on n-h2-858238-3 Nov 02 14:22:36.512008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-dbd27559-ec19-4d1e-9653-315448d4a310 req-ddcfd37b-2766-4e50-87ea-5040d2bda705 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084428 Nov 02 14:22:36.521935 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3833/5699] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:36.727832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:36.729146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:36.740027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=22 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:36.742724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:36.751721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:36.752267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:36.758040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:36.758681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:36.759186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:36.781537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:36.855358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:36.858809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:36.864231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:36.864954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lazy-loading 'fault' on Instance uuid fc2efdff-fb0e-498b-832f-3a82dbc5b020 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:22:37.012634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:37.026472 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-94e17cf1-347d-4f25-afa5-a98a1599a97f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 200 len: 1332 microversion: 2.1 time: 0.302827 Nov 02 14:22:37.031486 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1867/5700] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:36 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 1332 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:38.065519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:38.067512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:38.087356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:38.087857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:38.088300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:38.089020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:38.089540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:38.091385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:38.127217 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 HTTP/1.1 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fc2efdff-fb0e-498b-832f-3a82dbc5b020'} Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:38.133075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:22:38.137347 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96bc5a55-f2da-4938-9156-fb7d4ac2c9cb tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 404 len: 111 microversion: 2.1 time: 0.073796 Nov 02 14:22:38.143494 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3834/5701] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:38 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:22:38.144132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1d6e084b-718b-41ce-a186-ba8770a231a5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '.version_select at 0x7f6f85e48ee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:38.197557 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1d6e084b-718b-41ce-a186-ba8770a231a5 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058331152" status: 202 len: 0 microversion: 2.1 time: 0.057361 Nov 02 14:22:38.198387 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1868/5702] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058331152 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:22:39.602975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-652d599f-a69f-48c1-bb1d-ac36a073ae8b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: .version_select at 0x7f6f85e2faf0>, body: {"keypair": {"name": "tempest-keypair-299600811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHn2ygYKUMdN10Iyh4Nd7DmVT3USSepAQ0koqCeT0O7Ua1fB5SksYSVq+KYrkrd7ajvnOqYcRjvcs1AmH9Be82B/o8bcYjhea6uiThC5A5iOzgaszjJL5kFsSiWBQ2uUw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:39.647256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-652d599f-a69f-48c1-bb1d-ac36a073ae8b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:22:39.667155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-652d599f-a69f-48c1-bb1d-ac36a073ae8b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:22:39.762667 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-652d599f-a69f-48c1-bb1d-ac36a073ae8b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164621 Nov 02 14:22:39.763912 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3835/5703] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:22:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:42.819031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-953369409", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e985cf22-7fc8-4126-b885-95f60f68af89"}], "security_groups": [{"name": "tempest-securitygroup--1489947120"}], "key_name": "tempest-keypair-299600811", "user_data": "}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:43.705128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] validate_networks() for [('e985cf22-7fc8-4126-b885-95f60f68af89', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:22:44.106618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:22:44.109373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:22:44.110133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:22:44.110669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:22:44.111125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:22:44.125567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:44.126106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:44.126559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:44.127672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:44.128166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:44.129145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:44.153103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:22:44.160203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Getting quotas for user d9b63b4da49945fca75e1c3965f5deb7 and project 2ea149caef504f01a3295eb80a720304. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:22:44.175534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:22:44.178010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:22:44.245298 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5725116e-66b2-47e6-89e9-158037def505 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.443701 Nov 02 14:22:44.246532 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1869/5704] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:22:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:22:44.259612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc22b614-6a35-4895-a5c1-249a13ec6753 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:44.260234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc22b614-6a35-4895-a5c1-249a13ec6753 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:44.361574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc22b614-6a35-4895-a5c1-249a13ec6753 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:44.369735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc22b614-6a35-4895-a5c1-249a13ec6753 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1240 microversion: 2.1 time: 0.115954 Nov 02 14:22:44.374012 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3836/5705] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:44 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:45.397469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:45.398070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:45.412174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:45.420032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:45.420756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:45.421668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:45.422305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:45.422906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:45.569693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:45.582569 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3929dddf-8817-41ab-b74b-3d9fcf528e6e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1292 microversion: 2.1 time: 0.186863 Nov 02 14:22:45.584753 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1870/5706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:45 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1292 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:46.611392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:46.614258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:46.624228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:46.625590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:46.626258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:46.627476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:46.628258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:46.630188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:46.757259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:46.767889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dbc6f397-1e24-4533-88ce-08d7713b1a7a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1298 microversion: 2.1 time: 0.161252 Nov 02 14:22:46.784220 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3837/5707] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:46 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:47.804196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:47.805509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:47.849619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.850559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.851507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.853739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.854642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.855556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:48.311957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:48.323034 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f10cc70c-7139-4689-89cc-e70ef6411ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1366 microversion: 2.1 time: 0.533135 Nov 02 14:22:48.329065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1871/5708] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:47 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:48.943200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b45e30f2-506f-44e2-b19f-17608bc57952 req-b7b8daff-1dc3-4b54-8789-6e935c449eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc9fb16-4924-4e01-95d9-18d5b72186f6", "tag": "aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:48.966990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b45e30f2-506f-44e2-b19f-17608bc57952 req-b7b8daff-1dc3-4b54-8789-6e935c449eb2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:48.967513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b45e30f2-506f-44e2-b19f-17608bc57952 req-b7b8daff-1dc3-4b54-8789-6e935c449eb2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:48.983766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b45e30f2-506f-44e2-b19f-17608bc57952 req-b7b8daff-1dc3-4b54-8789-6e935c449eb2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.017169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b45e30f2-506f-44e2-b19f-17608bc57952 req-b7b8daff-1dc3-4b54-8789-6e935c449eb2 service nova] Creating event network-changed:aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f for instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 on n-h2-858238-3 Nov 02 14:22:49.026723 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b45e30f2-506f-44e2-b19f-17608bc57952 req-b7b8daff-1dc3-4b54-8789-6e935c449eb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087571 Nov 02 14:22:49.029691 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3838/5709] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:49.614682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:49.615402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:49.627237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.627848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.633319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.635393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.637609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.639143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:50.025932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:50.054293 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b1b30709-3833-415d-ada9-e67b7311be58 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1366 microversion: 2.1 time: 0.709363 Nov 02 14:22:50.075179 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1872/5710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:49 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1366 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:51.089446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:51.093308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:51.118097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:51.119273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:51.119889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:51.120778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:51.121373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:51.121967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:51.358924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:51.376206 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7a4114f-54d8-414f-bfa8-dee2495e495e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1366 microversion: 2.1 time: 0.291017 Nov 02 14:22:51.376816 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3839/5711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:51 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:52.407590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:52.413462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:52.437121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:52.438652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:52.439643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:52.443371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:52.444723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:52.448408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:52.963653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:52.978747 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-92718597-2a9b-4c4c-857f-6cd57f375e6c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1366 microversion: 2.1 time: 0.577906 Nov 02 14:22:52.979432 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1873/5712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:52 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:22:54.010783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:54.011836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:54.027967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:54.048267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:54.052491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:54.053822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:54.059033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:54.062153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:54.062734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:54.157415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:54.369717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:54.965520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:54.980815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50e27fe8-2541-4a4b-b818-2f6ea933230b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1366 microversion: 2.1 time: 0.978618 Nov 02 14:22:54.986452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3840/5713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:54 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1366 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:55.640041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7b17ce2b-a176-46d5-b3aa-b222e525b910 req-4fc722dc-038d-4827-9bd5-e2397621a8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc9fb16-4924-4e01-95d9-18d5b72186f6", "name": "network-vif-plugged", "status": "completed", "tag": "aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:55.661242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:55.672885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:55.686790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7b17ce2b-a176-46d5-b3aa-b222e525b910 req-4fc722dc-038d-4827-9bd5-e2397621a8de service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:55.690980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7b17ce2b-a176-46d5-b3aa-b222e525b910 req-4fc722dc-038d-4827-9bd5-e2397621a8de service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:55.693429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7b17ce2b-a176-46d5-b3aa-b222e525b910 req-4fc722dc-038d-4827-9bd5-e2397621a8de service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:55.733387 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7b17ce2b-a176-46d5-b3aa-b222e525b910 req-4fc722dc-038d-4827-9bd5-e2397621a8de service nova] Creating event network-vif-plugged:aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f for instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 on n-h2-858238-3 Nov 02 14:22:55.746223 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7b17ce2b-a176-46d5-b3aa-b222e525b910 req-4fc722dc-038d-4827-9bd5-e2397621a8de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109457 Nov 02 14:22:55.747224 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1874/5714] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:56.013292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:56.014222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:56.036575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:56.040438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:56.040937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:56.041687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:56.046285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:56.052466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:57.087827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:57.111605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f75fc0cf-4bed-4b2b-a018-33776e372d80 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1366 microversion: 2.1 time: 1.102362 Nov 02 14:22:57.112221 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3841/5715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:56 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1366 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:58.141149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:58.142192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:58.159483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:58.160570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:58.168074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:58.170288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:58.170956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:58.171482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:58.625366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:58.642158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0f7aaa3-0bb2-49d0-b971-7c39bd5ad604 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1556 microversion: 2.1 time: 0.504853 Nov 02 14:22:58.642774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1875/5716] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:22:58 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1556 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:58.669143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:58.669750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:58.680190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:58.685952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:58.686669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:58.687622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:58.689171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:58.691061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:58.875957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f5d5fa9-f86d-4cbd-a8e8-738c424a3f79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211107 Nov 02 14:22:58.876571 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3842/5717] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:22:58 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:02.319947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5232515d-ac73-43f1-9e78-fec9d2e2faa0 req-4c9efd05-54f4-4427-a656-8665e2ef70a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc9fb16-4924-4e01-95d9-18d5b72186f6", "tag": "aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:23:02.376050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5232515d-ac73-43f1-9e78-fec9d2e2faa0 req-4c9efd05-54f4-4427-a656-8665e2ef70a8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:02.383134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5232515d-ac73-43f1-9e78-fec9d2e2faa0 req-4c9efd05-54f4-4427-a656-8665e2ef70a8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:02.385000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5232515d-ac73-43f1-9e78-fec9d2e2faa0 req-4c9efd05-54f4-4427-a656-8665e2ef70a8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:02.426292 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5232515d-ac73-43f1-9e78-fec9d2e2faa0 req-4c9efd05-54f4-4427-a656-8665e2ef70a8 service nova] Creating event network-changed:aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f for instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 on n-h2-858238-3 Nov 02 14:23:02.446372 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5232515d-ac73-43f1-9e78-fec9d2e2faa0 req-4c9efd05-54f4-4427-a656-8665e2ef70a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131812 Nov 02 14:23:02.460773 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1876/5718] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:37.237990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:37.239313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:37.248401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=5 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:37.249487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=15 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:37.253797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:37.254385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:37.254919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:37.256064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:37.256611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:37.257108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:37.295968 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7553c80b-e4c1-4d6c-84fe-224fd430102f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/ips" status: 200 len: 150 microversion: 2.1 time: 0.062747 Nov 02 14:23:37.303841 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3843/5719] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 14:23:37 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/ips => generated 150 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:39.900749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:39.902223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=43 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:39.907512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "420884c7-c9b2-46ee-8284-df623e600e94"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:23:39.910751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:39.919945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:39.920812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:39.921755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:39.922697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:39.923410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:39.924821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:40.426029 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-504d4c7c-4136-4964-8fe3-a677054db32b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "POST /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527796 Nov 02 14:23:40.427271 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1877/5720] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:23:39 2022] POST /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:54.281305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:54.281869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:54.284687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:54.285520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:54.295932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:54.305667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:54.306193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:54.307048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:54.307647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:54.308174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:54.505525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lazy-loading 'services' on Instance uuid 1cc9fb16-4924-4e01-95d9-18d5b72186f6 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:23:54.666416 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e6545a8-2e9b-4703-8f9d-e92b8228ebbf tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments/420884c7-c9b2-46ee-8284-df623e600e94" status: 202 len: 0 microversion: 2.1 time: 0.386117 Nov 02 14:23:54.668071 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3844/5721] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:23:54 2022] DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments/420884c7-c9b2-46ee-8284-df623e600e94 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:23:54.676301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:54.677107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:54.693236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:54.705121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:54.754754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:54.759585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:54.761665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:54.762626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:54.766553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:54.767231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:54.817391 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9b65ee02-f634-4794-9bb3-a47bf8eb9ed7 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143699 Nov 02 14:23:54.818455 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1878/5722] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:23:54 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:55.275888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7e19c3ce-d4a4-4365-84ec-7f5f279f3325 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Action: 'create', calling method: .version_select at 0x7f6f81365820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-784510525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9wYw01xpRMVjkWafuAJgDE9p2CFQ48XnmDzl2jAkiF9ihV3+3cEC8bDi1OfhQ20LRAuol9R49aQpHrKc/NkyWDj8iHEGutQa98wm8ICkdSc1rB7VGpWRxKFStOV1gvIw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:23:55.301848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-7e19c3ce-d4a4-4365-84ec-7f5f279f3325 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Getting quotas for project 6566700284294739bbd144ae091aa4aa. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:23:55.320208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-7e19c3ce-d4a4-4365-84ec-7f5f279f3325 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Getting quotas for user bc131dc2ee3b4bb4b99b7bb87e4f5c1f and project 6566700284294739bbd144ae091aa4aa. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:23:55.370076 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7e19c3ce-d4a4-4365-84ec-7f5f279f3325 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.436526 Nov 02 14:23:55.371162 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3845/5723] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:23:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:55.830665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:55.833204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:55.858904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:55.859980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:55.860440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:55.861158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:55.861620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:55.862049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:55.917556 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-de49caed-c5e2-45dc-a108-256de423e519 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091363 Nov 02 14:23:55.919250 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1879/5724] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:23:55 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:56.931153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:56.934219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:56.950034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:56.950819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:56.951533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:56.953576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:56.954715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:56.956780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:57.040248 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-236bb357-9784-4da6-ab6f-766df174a27f tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113090 Nov 02 14:23:57.041847 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3846/5725] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:23:56 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:58.060767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:58.067392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:58.082703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:58.083873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:58.084683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:58.086627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:58.089405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:58.092100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:58.170368 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a1a7235-6c1e-4f09-a22c-9d206c82299c tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116958 Nov 02 14:23:58.172236 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1880/5726] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:23:58 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:59.185194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:59.190005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:59.202105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:59.203273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:59.217939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:59.220682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:59.221849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:59.223631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:59.345715 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-89536a15-2b74-4c73-980c-bf7d2d339204 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164936 Nov 02 14:23:59.349623 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3847/5727] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:23:59 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:00.366803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:00.369097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:00.382083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:00.385925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:00.386651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:00.388228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:00.392395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:00.393271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:00.459799 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-13dc0d12-c25b-408e-8f4d-d1629b92b302 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096917 Nov 02 14:24:00.460776 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1881/5728] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:24:00 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:01.477595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:01.480460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:01.497950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:01.498850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:01.500037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:01.503742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:01.504470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:01.507920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:01.586122 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc417cb6-a5c4-4c5a-aa31-22b91783128a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112884 Nov 02 14:24:01.587197 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3848/5729] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:24:01 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:02.601214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:02.603661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:02.614943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:02.615850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:02.616525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:02.617949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:02.618638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:02.620167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:02.713375 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-11e97dbc-9613-4ccb-b9e2-81f6be63a599 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119119 Nov 02 14:24:02.719545 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1882/5730] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:24:02 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:03.733981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:03.737005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:03.750041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:03.753107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:03.755769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:03.756850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:03.759073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:03.759837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:03.877892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1300f08-4a18-4ece-91ad-eb52497ebfbc tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147759 Nov 02 14:24:03.879328 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3849/5731] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:24:03 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:24:04.020771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:04.022654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:04.042780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:04.049132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:04.050019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:04.050816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:04.056318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:04.057153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:04.134340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:24:04.355501 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7b216c43-d879-499f-a590-25cc988bfc05 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 204 len: 0 microversion: 2.1 time: 0.341033 Nov 02 14:24:04.357318 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1883/5732] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:24:04 2022] DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:24:04.374340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:04.375220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:04.393500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:04.394095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:04.394592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:04.395366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:04.395892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:04.396459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:04.727956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:04.740065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-415a1240-dc34-4aa0-a054-a5fa11522a0e tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1681 microversion: 2.1 time: 0.376108 Nov 02 14:24:04.744899 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3850/5733] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:04 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1681 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:05.781686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:05.782490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:05.805190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:05.805901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:05.806516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:05.807758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:05.808835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:05.809463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:06.056229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:06.076133 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41fed075-1e47-4cab-b4da-d0764724a77b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1681 microversion: 2.1 time: 0.303617 Nov 02 14:24:06.077875 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1884/5734] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:05 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:07.102345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:07.102934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:07.105807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:07.116915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:07.120051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:07.120724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:07.123768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:07.124539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:07.125818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:07.887711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63b4da49945fca75e1c3965f5deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea149caef504f01a3295eb80a720304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:07.922098 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f41afcee-74d5-43b0-95af-77f4acdb1d24 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 200 len: 1681 microversion: 2.1 time: 0.823126 Nov 02 14:24:07.941845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3851/5735] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:07 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 1681 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:08.143791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1874924953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-489749758", "security_groups": [{"name": "tempest-secgroup-smoke-2065242919"}], "block_device_mapping_v2": [{"uuid": "bcc02ed2-9686-4671-8a15-96c4f24e3d1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:08.673432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] validate_networks() for [('f2ed0efc-627e-4c66-a7e0-b2c14c2db9c3', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:24:08.913598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4bb983b7-775f-415c-ad26-ad755bef76e1 req-5e99f018-c26a-4a70-aff0-96c1f4730ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc9fb16-4924-4e01-95d9-18d5b72186f6", "name": "network-vif-deleted", "tag": "aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:08.945880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4bb983b7-775f-415c-ad26-ad755bef76e1 req-5e99f018-c26a-4a70-aff0-96c1f4730ea0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:08.946933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4bb983b7-775f-415c-ad26-ad755bef76e1 req-5e99f018-c26a-4a70-aff0-96c1f4730ea0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:08.947525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4bb983b7-775f-415c-ad26-ad755bef76e1 req-5e99f018-c26a-4a70-aff0-96c1f4730ea0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:08.984353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4bb983b7-775f-415c-ad26-ad755bef76e1 req-5e99f018-c26a-4a70-aff0-96c1f4730ea0 service nova] Creating event network-vif-deleted:aa8438e7-cb6c-4d5f-85f3-0c3a88ee833f for instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 on n-h2-858238-3 Nov 02 14:24:09.008413 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4bb983b7-775f-415c-ad26-ad755bef76e1 req-5e99f018-c26a-4a70-aff0-96c1f4730ea0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429714 Nov 02 14:24:09.017715 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3852/5736] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:24:09.027040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-349164302-access_point-80405318", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "3a7b4784-eba6-489b-b4bc-b5404749af08"}], "key_name": "tempest-TestSecurityGroupsBasicOps-784510525", "security_groups": [{"name": "tempest-secgroup_access--1780319080"}, {"name": "tempest-secgroup_general--2137873559"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:09.626048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] validate_networks() for [('3a7b4784-eba6-489b-b4bc-b5404749af08', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:24:09.836991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:24:09.837470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:24:09.837918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:24:09.838413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:24:09.838844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:24:09.857972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:09.858477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:09.858927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:09.859717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:09.860184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:09.860620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:09.906202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:24:09.916945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Getting quotas for user 860e9448f87e41728d6860fdc9a6b789 and project 91b1baae32814f429be499c2a9441613. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:24:10.069768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:24:10.072382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcc02ed2-9686-4671-8a15-96c4f24e3d1f',volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:24:10.316914 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-84475e19-1c56-46e2-96ef-d48707366af4 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.178841 Nov 02 14:24:10.319557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1885/5737] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:24:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:24:10.331711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:10.334467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:10.352171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:10.352946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:10.356186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:10.357123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:10.357962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:10.359885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:10.400642 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 HTTP/1.1 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '1cc9fb16-4924-4e01-95d9-18d5b72186f6'} Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:10.406570 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:10.411729 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:10.414622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:10.418137 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fdcfff8e-b029-4d53-aa4f-487a9dc7e79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 404 len: 111 microversion: 2.1 time: 0.095992 Nov 02 14:24:10.418927 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1886/5738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:10 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:10.428755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae60357e-f3c6-4247-9126-d1c2f716b1b7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:10.429557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae60357e-f3c6-4247-9126-d1c2f716b1b7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:10.470702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:24:10.471458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:24:10.471938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:24:10.472392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:24:10.472808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:24:10.515940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae60357e-f3c6-4247-9126-d1c2f716b1b7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:10.521176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:10.521670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:10.525051 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae60357e-f3c6-4247-9126-d1c2f716b1b7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1094 microversion: 2.1 time: 0.104186 Nov 02 14:24:10.525784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:10.526819 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1887/5739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:10 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:10.532574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57b70fb9-597e-4d3e-af5b-67437e45b9a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '.version_select at 0x7f6f85e48ee0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:10.544565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:10.546199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:10.552791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:10.581053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Getting quotas for project 6566700284294739bbd144ae091aa4aa. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:24:10.584569 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57b70fb9-597e-4d3e-af5b-67437e45b9a2 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299600811" status: 202 len: 0 microversion: 2.1 time: 0.056279 Nov 02 14:24:10.587212 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1888/5740] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 14:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299600811 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:24:10.592750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Getting quotas for user bc131dc2ee3b4bb4b99b7bb87e4f5c1f and project 6566700284294739bbd144ae091aa4aa. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:24:10.608934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:24:10.612337 n-d-858238-3 devstack@n-api.service[137559]: WARNING nova.utils [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-349164302-access_point-80405318 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-349164302-acc Nov 02 14:24:10.613494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:24:10.686434 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [ceba6743-ad8c-4bca-b702-20d91cfa053f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:24:11.554140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-69e1cd23-09f7-4004-ba21-ae19490c2a4f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:11.557490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-69e1cd23-09f7-4004-ba21-ae19490c2a4f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:11.694101 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [ceba6743-ad8c-4bca-b702-20d91cfa053f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41576. Nov 02 14:24:11.704289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-863cb027-af4f-407d-9228-b197d8e03da3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.685104 Nov 02 14:24:11.712473 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3853/5741] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:24:09 2022] POST /compute/v2.1/servers => generated 458 bytes in 2694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:24:11.726112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-891a0717-d80e-4a76-92cb-e898ca188411 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:11.740105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-69e1cd23-09f7-4004-ba21-ae19490c2a4f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:11.746422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-891a0717-d80e-4a76-92cb-e898ca188411 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:11.748386 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-69e1cd23-09f7-4004-ba21-ae19490c2a4f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1094 microversion: 2.1 time: 0.203283 Nov 02 14:24:11.750883 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1889/5742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:11 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1094 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:12.017110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-891a0717-d80e-4a76-92cb-e898ca188411 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:12.029066 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-891a0717-d80e-4a76-92cb-e898ca188411 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1291 microversion: 2.1 time: 0.306157 Nov 02 14:24:12.031922 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3854/5743] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:11 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1291 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:12.774050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a9473faa-1aed-48ce-8479-398f0e3cf241 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:12.783326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a9473faa-1aed-48ce-8479-398f0e3cf241 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:12.930154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a9473faa-1aed-48ce-8479-398f0e3cf241 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:12.939206 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a9473faa-1aed-48ce-8479-398f0e3cf241 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1094 microversion: 2.1 time: 0.169570 Nov 02 14:24:12.952535 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1890/5744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:12 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1094 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:13.059910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:13.061470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:13.078042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:13.078758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:13.079451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:13.080416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:13.081479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:13.082728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:13.206465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:13.215525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa2bfa57-5aa8-450c-91b9-9f71c6623058 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1343 microversion: 2.1 time: 0.162546 Nov 02 14:24:13.231830 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3855/5745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:13 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1343 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:13.974170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9254bc9a-6ca8-4940-b42e-8389f229420b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:13.975113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9254bc9a-6ca8-4940-b42e-8389f229420b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:14.081401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9254bc9a-6ca8-4940-b42e-8389f229420b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:14.089051 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9254bc9a-6ca8-4940-b42e-8389f229420b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1094 microversion: 2.1 time: 0.123646 Nov 02 14:24:14.089872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1891/5746] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:13 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1094 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:14.245258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:14.246831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:14.256394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:14.257502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:14.258239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:14.259686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:14.260464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:14.261160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:14.395406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:14.410611 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e82c72a-accc-4a6f-9d9d-d6b64d3588c9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1349 microversion: 2.1 time: 0.168755 Nov 02 14:24:14.446790 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3856/5747] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:14 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1349 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:15.114538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:15.116022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:15.131494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:15.132279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:15.132882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:15.134000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:15.134791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:15.135449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:15.254856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:15.268305 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-339300d0-fd01-4067-badc-06cda57dbff2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1144 microversion: 2.1 time: 0.157622 Nov 02 14:24:15.284371 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1892/5748] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:15 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1144 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:15.444730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:15.446222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:15.464134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:15.470223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:15.476135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:15.477152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:15.477779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:15.478380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:15.703243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:15.713208 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75b8ebec-d84b-4ded-9fcc-afc151330eb9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.272450 Nov 02 14:24:15.718185 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3857/5749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:15 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:16.296728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:16.297947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:16.306401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.307186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.307793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.308815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.309442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.310564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.442462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:16.452822 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-065fb38a-2996-4d01-b60d-333cbb472628 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1192 microversion: 2.1 time: 0.158163 Nov 02 14:24:16.453453 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1893/5750] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:16 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1192 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:16.459176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-86178d93-9b93-419a-9dd1-5526d0a9a6ae req-c30d91ad-47a9-455c-8b36-7098351b8b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac988b00-d631-41a5-aca6-cdc759d72b3b", "tag": "f5da2437-33ee-48ff-b75d-08ddc4eb1e91"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:16.477033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-86178d93-9b93-419a-9dd1-5526d0a9a6ae req-c30d91ad-47a9-455c-8b36-7098351b8b47 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.477527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-86178d93-9b93-419a-9dd1-5526d0a9a6ae req-c30d91ad-47a9-455c-8b36-7098351b8b47 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.477953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-86178d93-9b93-419a-9dd1-5526d0a9a6ae req-c30d91ad-47a9-455c-8b36-7098351b8b47 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.506340 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-86178d93-9b93-419a-9dd1-5526d0a9a6ae req-c30d91ad-47a9-455c-8b36-7098351b8b47 service nova] Creating event network-changed:f5da2437-33ee-48ff-b75d-08ddc4eb1e91 for instance ac988b00-d631-41a5-aca6-cdc759d72b3b on n-h2-858238-3 Nov 02 14:24:16.516806 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-86178d93-9b93-419a-9dd1-5526d0a9a6ae req-c30d91ad-47a9-455c-8b36-7098351b8b47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061059 Nov 02 14:24:16.517397 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3858/5751] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:16.569854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:16.570722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:16.595767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.597410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.599532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.600680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.601433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.602114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.636520 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 HTTP/1.1 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '1cc9fb16-4924-4e01-95d9-18d5b72186f6'} Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:16.638558 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.643064 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.654514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:16.658381 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6845eb7c-ba10-4c5e-afbb-180ae9511c5b tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 404 len: 111 microversion: 2.1 time: 0.090568 Nov 02 14:24:16.661991 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1894/5752] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:24:16 2022] DELETE /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:16.668340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:16.669615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 1cc9fb16-4924-4e01-95d9-18d5b72186f6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:16.683849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.684341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.685527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.686565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.687244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.688667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.723022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 HTTP/1.1 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '1cc9fb16-4924-4e01-95d9-18d5b72186f6'} Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:16.725237 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance 1cc9fb16-4924-4e01-95d9-18d5b72186f6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64d9f0e0-4a76-4551-a52b-bd5bb331a79a tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6" status: 404 len: 111 microversion: 2.1 time: 0.062957 Nov 02 14:24:16.730200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3859/5753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:16 2022] GET /compute/v2.1/servers/1cc9fb16-4924-4e01-95d9-18d5b72186f6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:16.745956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:16.749783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:16.766446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.766446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.766446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:16.771485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:16.774902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:16.775569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:17.182599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:17.196348 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5b3697da-42f8-45ec-8926-133ae9e6fbfd tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.457644 Nov 02 14:24:17.211486 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1895/5754] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:16 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:17.478242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:17.479495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:17.490235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:17.492939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:17.493915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:17.497462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:17.498124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:17.498678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:17.622436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:17.633225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7373558-9785-4013-b1c5-b6be8f9a1451 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1210 microversion: 2.1 time: 0.157313 Nov 02 14:24:17.634028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3860/5755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:17 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1210 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:18.222889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:18.223833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:18.236892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:18.237391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:18.240808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:18.241594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:18.242074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:18.242516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:18.613658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:18.634760 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd73935b-fe99-4c4a-9fb1-d5cf82eddabe tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.416609 Nov 02 14:24:18.647861 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1896/5756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:18 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:18.669407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:18.672108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:18.704804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:18.707116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:18.707875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:18.737045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:18.737978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:18.740913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:18.836502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:18.848130 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1496aec-081e-47f5-919b-aa55f05b46f9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1210 microversion: 2.1 time: 0.190972 Nov 02 14:24:18.864472 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3861/5757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:18 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1210 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:19.663020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:19.664164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:19.679175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:19.679679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:19.680124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:19.680898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:19.681447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:19.681886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:19.884452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:19.885101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:19.898297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:19.916470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:19.917437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:19.919673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:19.921623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:19.927289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:19.930281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:20.090079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:20.104178 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-39099dda-fa4d-4652-baf5-434c826341db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.444815 Nov 02 14:24:20.107163 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1897/5758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:19 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:20.141256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:20.151938 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e845e5bd-6a81-4449-844f-40b2eb4e7c75 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1210 microversion: 2.1 time: 0.281641 Nov 02 14:24:20.153204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3862/5759] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:19 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1210 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:21.132966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:21.133937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:21.146353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:21.146865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:21.149642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:21.151219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:21.151734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:21.152190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:21.188530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:21.189245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:21.214275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:21.221932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:21.229120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:21.230290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:21.234507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:21.235709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:21.237959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:21.658411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:21.668834 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c5ef7fda-5b00-42e7-b16e-263d30174e0a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1278 microversion: 2.1 time: 0.484555 Nov 02 14:24:21.684564 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3863/5760] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:21 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1278 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:21.702325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:21.711561 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a8a74796-860d-4f8b-83bb-ab806dbdfca2 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.582381 Nov 02 14:24:21.712801 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1898/5761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:21 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:22.621786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:22.622406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:22.625737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:22.644187 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.648315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.651136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.653000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.655699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.656259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.706400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6a60d1aa-14a0-40c5-93ba-a47a340cae08 req-e2dd8f72-e878-4d8c-81ba-51b56f847452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3c8592-5dab-4fd9-bad0-9a967d36cb8c", "tag": "15114cf7-feb6-4616-8925-693024d40107"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:22.719062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 HTTP/1.1 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fc2efdff-fb0e-498b-832f-3a82dbc5b020'} Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:22.727738 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:22.733022 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:22.737085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:22.740013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6a60d1aa-14a0-40c5-93ba-a47a340cae08 req-e2dd8f72-e878-4d8c-81ba-51b56f847452 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.747045 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7184cf8-15f1-4369-b818-9cfa02a6f9c0 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 404 len: 111 microversion: 2.1 time: 0.129518 Nov 02 14:24:22.750817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6a60d1aa-14a0-40c5-93ba-a47a340cae08 req-e2dd8f72-e878-4d8c-81ba-51b56f847452 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.750817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6a60d1aa-14a0-40c5-93ba-a47a340cae08 req-e2dd8f72-e878-4d8c-81ba-51b56f847452 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.751395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3864/5762] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:24:22 2022] DELETE /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:22.768977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:22.769766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:22.786975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.789774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.790350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.796727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.797489 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6a60d1aa-14a0-40c5-93ba-a47a340cae08 req-e2dd8f72-e878-4d8c-81ba-51b56f847452 service nova] Creating event network-changed:15114cf7-feb6-4616-8925-693024d40107 for instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c on n-h2-858238-3 Nov 02 14:24:22.800935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.801505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.809038 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6a60d1aa-14a0-40c5-93ba-a47a340cae08 req-e2dd8f72-e878-4d8c-81ba-51b56f847452 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107689 Nov 02 14:24:22.816015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:22.816932 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1899/5763] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 14:24:22.831279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:22.838657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:22.853224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.856865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.858380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.861389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.862021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.862598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.914393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:23.332219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:23.346347 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df03711a-2f4b-4dc1-8eb0-4d833e0b8371 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1278 microversion: 2.1 time: 0.593701 Nov 02 14:24:23.355721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:23.360584 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3865/5764] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:22 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1278 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:23.377280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:23.378374 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-086b303f-ca52-4054-a347-47cdb11087da tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.554653 Nov 02 14:24:23.379632 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1900/5765] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:22 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:23.391257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: fc2efdff-fb0e-498b-832f-3a82dbc5b020] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:23.398247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.398882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.399453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.431417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.432350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.433127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.459227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 HTTP/1.1 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'fc2efdff-fb0e-498b-832f-3a82dbc5b020'} Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:23.461075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. Nov 02 14:24:23.465977 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.467306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance fc2efdff-fb0e-498b-832f-3a82dbc5b020 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:23.468356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffed9765-e48d-4370-9925-140b5afa2642 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020" status: 404 len: 111 microversion: 2.1 time: 0.096218 Nov 02 14:24:23.469094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3866/5766] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:23 2022] GET /compute/v2.1/servers/fc2efdff-fb0e-498b-832f-3a82dbc5b020 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:23.477703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:23.478368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:23.491033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.494543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.495146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.503802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.504453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.507515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.538901 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e HTTP/1.1 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'c9666aaf-1f29-4e21-81bf-9ba9463ff39e'} Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:23.541683 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.545465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.550916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:23.552049 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6b0e566a-1c06-472b-80a6-5d548cb27713 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 404 len: 111 microversion: 2.1 time: 0.078413 Nov 02 14:24:23.555981 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1901/5767] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:24:23 2022] DELETE /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:24:23.561000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:23.561867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: c9666aaf-1f29-4e21-81bf-9ba9463ff39e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:23.569341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.584645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.585919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.586983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.587631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.615961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.654661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e HTTP/1.1 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'c9666aaf-1f29-4e21-81bf-9ba9463ff39e'} Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:23.657180 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. Nov 02 14:24:23.662371 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:23.665388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance c9666aaf-1f29-4e21-81bf-9ba9463ff39e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:23.668114 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62f0e262-c821-4c49-9005-fd2ae02d8b12 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e" status: 404 len: 111 microversion: 2.1 time: 0.109874 Nov 02 14:24:23.670169 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3867/5768] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:23 2022] GET /compute/v2.1/servers/c9666aaf-1f29-4e21-81bf-9ba9463ff39e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:24.383567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:24.386421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:24.425329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:24.426069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:24.431541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:24.437966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:24.449171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:24.451259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:24.451585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:24.452937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:24.453585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:24.455058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:24.455465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:24.456778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:24.457303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:24.458430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:24.458635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:24.459937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:24.797893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:24.807287 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1efade14-bde4-490d-8ad2-0458f6c5fb4a tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.407230 Nov 02 14:24:24.811986 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3868/5769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:24 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:24.839499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:24.851636 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b087e56f-edba-4056-80f1-2621d4893f70 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1278 microversion: 2.1 time: 0.471967 Nov 02 14:24:24.866134 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1902/5770] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:24 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1278 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:25.107916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-94846c69-cabd-42a4-868c-2bb10f4b29b8 req-b60ac8f8-464b-420d-8ecb-f38563fa9a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac988b00-d631-41a5-aca6-cdc759d72b3b", "name": "network-vif-plugged", "status": "completed", "tag": "f5da2437-33ee-48ff-b75d-08ddc4eb1e91"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:25.113523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94846c69-cabd-42a4-868c-2bb10f4b29b8 req-b60ac8f8-464b-420d-8ecb-f38563fa9a5e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:25.114029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94846c69-cabd-42a4-868c-2bb10f4b29b8 req-b60ac8f8-464b-420d-8ecb-f38563fa9a5e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:25.114602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94846c69-cabd-42a4-868c-2bb10f4b29b8 req-b60ac8f8-464b-420d-8ecb-f38563fa9a5e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:25.140160 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-94846c69-cabd-42a4-868c-2bb10f4b29b8 req-b60ac8f8-464b-420d-8ecb-f38563fa9a5e service nova] Creating event network-vif-plugged:f5da2437-33ee-48ff-b75d-08ddc4eb1e91 for instance ac988b00-d631-41a5-aca6-cdc759d72b3b on n-h2-858238-3 Nov 02 14:24:25.149289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-94846c69-cabd-42a4-868c-2bb10f4b29b8 req-b60ac8f8-464b-420d-8ecb-f38563fa9a5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162453 Nov 02 14:24:25.152541 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3869/5771] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:25.835213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:25.836558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:25.843910 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:25.849323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:25.850066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:25.851007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:25.852899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:25.853534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:25.854151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:25.879687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:25.881059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:25.896653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:25.897399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:25.899562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:25.900488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:25.903353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:25.903970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:26.209279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:26.228361 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-347f20c8-62ea-409c-99f1-1f4f8ca14a54 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1278 microversion: 2.1 time: 0.353851 Nov 02 14:24:26.229559 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3870/5772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:25 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1278 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:26.315662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:26.324927 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a1b10a47-3fe2-4a9b-821f-47c8fbce533d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1469 microversion: 2.1 time: 0.493621 Nov 02 14:24:26.330729 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1903/5773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:25 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:27.253316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:27.254044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:27.270206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.270706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.271170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.272307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.275616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.276576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.356178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:27.356932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:27.365361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.366138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.366814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.367492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.367690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.368099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.540118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:27.549285 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bf50b388-d06c-451e-9a1c-8e65f56c481a tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.299994 Nov 02 14:24:27.550451 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3871/5774] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:27 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:27.635158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:27.643585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae5089e7-874d-477e-bc21-cf61709bf2e9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1640 microversion: 2.1 time: 0.294696 Nov 02 14:24:27.652563 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1904/5775] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:27 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1640 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:27.666659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:27.668161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:27.674608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.675334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.675934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.677996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.678894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.678894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.865379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:27.877171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-005a400a-a0b0-4ce5-8a9c-3377e63bd90f tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1640 microversion: 2.1 time: 0.214432 Nov 02 14:24:27.878751 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3872/5776] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:27 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1640 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:27.899989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:27.900978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:27.926120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.927041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.927748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.928689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.929510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.930197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:28.577334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:28.577954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:28.597009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:28.597986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:28.598584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:28.599479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:28.600082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:28.600674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:29.249931 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-007dae6b-e294-4187-810c-739bede1e75b tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1791 microversion: 2.1 time: 1.353123 Nov 02 14:24:29.253125 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1905/5777] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:27 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1791 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:29.377606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:29.390909 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-706f25eb-4660-4097-8380-e7b2a055a05e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.818664 Nov 02 14:24:29.408333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3873/5778] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:28 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:30.424773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:30.425401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:30.444368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.445295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.445934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.446906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.450727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.451412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.628687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:30.629097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:30.639044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.639560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.639990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.640690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.641139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.650090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.653449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:30.665816 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ea97cc4d-0286-4144-88f7-e9bf02d8b2f7 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.254278 Nov 02 14:24:30.666977 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1906/5779] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:30 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:30.679521 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 HTTP/1.1 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '18825187-645a-4dc8-8608-8520f9bb2706'} Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:30.681364 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95a834a7-69d3-43e0-8352-10aeef585b79 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 404 len: 111 microversion: 2.1 time: 0.058253 Nov 02 14:24:30.686890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3874/5780] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:24:30 2022] DELETE /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:30.694850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:30.695793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] [instance: 18825187-645a-4dc8-8608-8520f9bb2706] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:30.704184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.704695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.705149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.706045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.706662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.707134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.725296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] HTTP exception thrown: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Request method failure captured: Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 HTTP/1.1 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnwM-h8MtCglsspybuR4QBYbnlkBT5pJgJ3OVd6qCoLjvFwwU_tGhsT0mG6FFfSCLOjv7BORVtEoorbRhksMqLxWcOpOgE_GWn83do2EqFVD1Y39QteVdQEYQLFJ_DxkNUSNdbJGS6617esaIQDKBdXHarXheL0KqxtWAunSIMXMcks Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2ea149caef504f01a3295eb80a720304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2ea149caef504f01a3295eb80a720304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2ea149caef504f01a3295eb80a720304"}]}] Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 2ea149caef504f01a3295eb80a720304 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1835976350 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: d9b63b4da49945fca75e1c3965f5deb7 Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-AttachVolumeNegativeTest-1835976350-project Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '18825187-645a-4dc8-8608-8520f9bb2706'} Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:24:30.727057 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] Returning 404 to user: Instance 18825187-645a-4dc8-8608-8520f9bb2706 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:24:30.732183 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5d5ce35-f56f-4015-91fa-a48c80438f74 tempest-AttachVolumeNegativeTest-1835976350 tempest-AttachVolumeNegativeTest-1835976350-project] 10.222.0.18 "GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706" status: 404 len: 111 microversion: 2.1 time: 0.038479 Nov 02 14:24:30.740225 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1907/5781] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:30 2022] GET /compute/v2.1/servers/18825187-645a-4dc8-8608-8520f9bb2706 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:24:31.696237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:31.697029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:31.705215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:31.706361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:31.707068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:31.708141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:31.708809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:31.711612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:32.196958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:32.209734 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-819558f7-e9b8-4252-9275-779a79ed8e36 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.520089 Nov 02 14:24:32.215240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3875/5782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:31 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:32.375358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9f32088c-7354-4aa9-811b-50455084ffc1 req-c725e3b0-757a-4b79-bbf8-8cd0e2ffc64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac988b00-d631-41a5-aca6-cdc759d72b3b", "tag": "f5da2437-33ee-48ff-b75d-08ddc4eb1e91"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:32.441547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f32088c-7354-4aa9-811b-50455084ffc1 req-c725e3b0-757a-4b79-bbf8-8cd0e2ffc64e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:32.449870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f32088c-7354-4aa9-811b-50455084ffc1 req-c725e3b0-757a-4b79-bbf8-8cd0e2ffc64e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:32.450358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f32088c-7354-4aa9-811b-50455084ffc1 req-c725e3b0-757a-4b79-bbf8-8cd0e2ffc64e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:32.519961 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9f32088c-7354-4aa9-811b-50455084ffc1 req-c725e3b0-757a-4b79-bbf8-8cd0e2ffc64e service nova] Creating event network-changed:f5da2437-33ee-48ff-b75d-08ddc4eb1e91 for instance ac988b00-d631-41a5-aca6-cdc759d72b3b on n-h2-858238-3 Nov 02 14:24:32.530740 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9f32088c-7354-4aa9-811b-50455084ffc1 req-c725e3b0-757a-4b79-bbf8-8cd0e2ffc64e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158984 Nov 02 14:24:32.531537 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1908/5783] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:33.239300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:33.240497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:33.266027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:33.268633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:33.269316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:33.270242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:33.271443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:33.272057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:34.241269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:34.261377 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8dd0cec5-eedb-4312-8101-0284f657fc0f tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 1.025726 Nov 02 14:24:34.280824 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3876/5784] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:33 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:35.289045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:35.289997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:35.307952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:35.309621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:35.311210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:35.315467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:35.315467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:35.315467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:35.527917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:35.545086 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-81627565-5868-4ab0-a5d2-379232955c4b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.263644 Nov 02 14:24:35.560264 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1909/5785] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:35 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:36.585457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:36.586108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:36.595901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:36.597978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:36.598584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:36.599358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:36.600026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:36.600298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:36.948646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:36.958882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c36465a5-b915-4890-859a-7ba0f6f34b49 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.379490 Nov 02 14:24:36.965221 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3877/5786] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:36 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:37.019583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-17d31283-37f1-494c-bd41-90f33ea316c4 req-df2ba6a8-b74e-4291-b240-d74accdc6def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3c8592-5dab-4fd9-bad0-9a967d36cb8c", "name": "network-vif-plugged", "status": "completed", "tag": "15114cf7-feb6-4616-8925-693024d40107"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:37.044054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-17d31283-37f1-494c-bd41-90f33ea316c4 req-df2ba6a8-b74e-4291-b240-d74accdc6def service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:37.044628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-17d31283-37f1-494c-bd41-90f33ea316c4 req-df2ba6a8-b74e-4291-b240-d74accdc6def service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:37.044979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-17d31283-37f1-494c-bd41-90f33ea316c4 req-df2ba6a8-b74e-4291-b240-d74accdc6def service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:37.088478 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-17d31283-37f1-494c-bd41-90f33ea316c4 req-df2ba6a8-b74e-4291-b240-d74accdc6def service nova] Creating event network-vif-plugged:15114cf7-feb6-4616-8925-693024d40107 for instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c on n-h2-858238-3 Nov 02 14:24:37.093928 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-17d31283-37f1-494c-bd41-90f33ea316c4 req-df2ba6a8-b74e-4291-b240-d74accdc6def service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077748 Nov 02 14:24:37.094555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1910/5787] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:37.989424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:37.990092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:38.000285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:38.000783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:38.001223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:38.006256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:38.006743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:38.007214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:38.287849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:38.299520 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2668dc98-fefb-4088-b024-9b07982d5e4c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1266 microversion: 2.1 time: 0.313546 Nov 02 14:24:38.311133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3878/5788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:37 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:39.334757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:39.338476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:39.352560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:39.354185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:39.355302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:39.357918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:39.358975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:39.360149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:39.627587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:39.640796 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8caf7e91-b7a9-4e10-92c5-6d9bcb65768e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1453 microversion: 2.1 time: 0.315115 Nov 02 14:24:39.645894 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1911/5789] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:39 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1453 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:39.687392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:39.687936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:39.696436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:39.696965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:39.697448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:39.698161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:39.698796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:39.699610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:39.880629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:39.897532 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3df720f1-9c6a-42d0-b66b-38291d29f4e9 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1453 microversion: 2.1 time: 0.224138 Nov 02 14:24:39.898137 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3879/5790] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:39 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:43.776769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6f18f02a-b2e8-4e04-871f-1bac3661bc2b req-c225b390-4424-4414-8fc1-a8d1aedb2cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3c8592-5dab-4fd9-bad0-9a967d36cb8c", "tag": "15114cf7-feb6-4616-8925-693024d40107"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:43.794163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6f18f02a-b2e8-4e04-871f-1bac3661bc2b req-c225b390-4424-4414-8fc1-a8d1aedb2cbe service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:43.794163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6f18f02a-b2e8-4e04-871f-1bac3661bc2b req-c225b390-4424-4414-8fc1-a8d1aedb2cbe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:43.794163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6f18f02a-b2e8-4e04-871f-1bac3661bc2b req-c225b390-4424-4414-8fc1-a8d1aedb2cbe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:43.840398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6f18f02a-b2e8-4e04-871f-1bac3661bc2b req-c225b390-4424-4414-8fc1-a8d1aedb2cbe service nova] Creating event network-changed:15114cf7-feb6-4616-8925-693024d40107 for instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c on n-h2-858238-3 Nov 02 14:24:43.847960 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6f18f02a-b2e8-4e04-871f-1bac3661bc2b req-c225b390-4424-4414-8fc1-a8d1aedb2cbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.484492 Nov 02 14:24:43.849166 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1912/5791] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:53.232321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-807170294", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "0c832f79-4068-40df-aae0-e26d767e5058"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:53.246628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=23 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.247744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=72 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.312942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] validate_networks() for [('0c832f79-4068-40df-aae0-e26d767e5058', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:24:53.776998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:24:53.777918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:24:53.778733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:24:53.779908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:24:53.780410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:24:53.792638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.793226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.793846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.794829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.795355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.795842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.815851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Getting quotas for project cb19a1ce6ca94d4db1ac6ab7edf27804. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:24:53.822835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Getting quotas for user 20d27233e55e4238a041ed752bdcff40 and project cb19a1ce6ca94d4db1ac6ab7edf27804. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:24:53.840088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:24:53.844514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:24:53.901614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-94ac15db-7993-4f7a-8da3-6ce2762b7f46 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674662 Nov 02 14:24:53.902604 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3880/5792] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:24:53.915698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=19 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.917471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=54 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.925634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e583997-b87a-4338-93fc-0706bdf4650a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:53.926752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e583997-b87a-4338-93fc-0706bdf4650a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:54.005474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e583997-b87a-4338-93fc-0706bdf4650a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:54.024328 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e583997-b87a-4338-93fc-0706bdf4650a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1218 microversion: 2.1 time: 0.112994 Nov 02 14:24:54.025939 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1913/5793] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:53 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:55.050063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:55.051216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:55.058541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:55.059205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:55.059640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:55.060368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:55.062379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:55.063020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:55.142877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:55.151637 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6527e19e-e922-4ff6-802d-a1c4018e8f1a tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1270 microversion: 2.1 time: 0.106313 Nov 02 14:24:55.152657 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3881/5794] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:55 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:56.179990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:56.180975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:56.192219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:56.192890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:56.193561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:56.194540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:56.195213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:56.195760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:56.561104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:56.574426 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0c7c671f-1625-45a4-ad7e-c8f417f569b8 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.398387 Nov 02 14:24:56.575573 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1914/5795] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:56 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:57.157295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4865701d-5a4a-425e-af35-c04731b75d6b req-8b3c217e-12cf-44d1-ba9d-c0dbeb133f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113de0b2-e465-41c4-a76d-400ec75a88fe", "tag": "3a3b5eea-ca08-45fe-ba4d-e7149cf8ab75"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:57.176767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4865701d-5a4a-425e-af35-c04731b75d6b req-8b3c217e-12cf-44d1-ba9d-c0dbeb133f95 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:57.177446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4865701d-5a4a-425e-af35-c04731b75d6b req-8b3c217e-12cf-44d1-ba9d-c0dbeb133f95 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:57.178514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4865701d-5a4a-425e-af35-c04731b75d6b req-8b3c217e-12cf-44d1-ba9d-c0dbeb133f95 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:57.201147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4865701d-5a4a-425e-af35-c04731b75d6b req-8b3c217e-12cf-44d1-ba9d-c0dbeb133f95 service nova] Creating event network-changed:3a3b5eea-ca08-45fe-ba4d-e7149cf8ab75 for instance 113de0b2-e465-41c4-a76d-400ec75a88fe on n-h1-858238-3 Nov 02 14:24:57.209538 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4865701d-5a4a-425e-af35-c04731b75d6b req-8b3c217e-12cf-44d1-ba9d-c0dbeb133f95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057559 Nov 02 14:24:57.210362 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3882/5796] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:24:57.601710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:57.603289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:57.617987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:57.618541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:57.619109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:57.621028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:57.622174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:57.623418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:57.823961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:57.836996 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5beea17-55ae-45cf-a489-4f938f89e291 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.241817 Nov 02 14:24:57.837819 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1915/5797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:57 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:58.870376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:58.872420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:58.900912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:58.905789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:58.908327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:58.911065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:58.914777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:58.915980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:59.244529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:59.268057 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80c8cf36-4535-4224-a025-f06a7cb7fef1 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.399005 Nov 02 14:24:59.268728 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3883/5798] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:24:58 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:00.313505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:00.314236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:00.321953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:00.322451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:00.322898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:00.323653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:00.324140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:00.324571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:00.486810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:00.495057 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bdc2259b-6877-4e34-8eab-f0825c2e4bd7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.185494 Nov 02 14:25:00.495675 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1916/5799] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:00 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:01.518799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:01.520077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:01.526764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:01.527684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:01.528344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:01.529496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:01.530363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:01.530985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:01.750108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:01.760699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0660bdb7-f858-4157-a57b-9d75017d78fd tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.245728 Nov 02 14:25:01.761288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3884/5800] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:01 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:02.784667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:02.786664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:02.793823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.794330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.794779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.795715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.796195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.796635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:03.035498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:03.051306 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-52edb68a-41c5-4520-82d9-ee1c22a2d757 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.270301 Nov 02 14:25:03.052241 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1917/5801] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:02 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:03.151013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e5ed7837-b77c-4c96-a703-ce7e4601f574 req-32ef3a24-4d97-4ef2-8335-584636d6336e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113de0b2-e465-41c4-a76d-400ec75a88fe", "name": "network-vif-plugged", "status": "completed", "tag": "3a3b5eea-ca08-45fe-ba4d-e7149cf8ab75"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:03.176167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e5ed7837-b77c-4c96-a703-ce7e4601f574 req-32ef3a24-4d97-4ef2-8335-584636d6336e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:03.176930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e5ed7837-b77c-4c96-a703-ce7e4601f574 req-32ef3a24-4d97-4ef2-8335-584636d6336e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:03.177530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e5ed7837-b77c-4c96-a703-ce7e4601f574 req-32ef3a24-4d97-4ef2-8335-584636d6336e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:03.193028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e5ed7837-b77c-4c96-a703-ce7e4601f574 req-32ef3a24-4d97-4ef2-8335-584636d6336e service nova] Creating event network-vif-plugged:3a3b5eea-ca08-45fe-ba4d-e7149cf8ab75 for instance 113de0b2-e465-41c4-a76d-400ec75a88fe on n-h1-858238-3 Nov 02 14:25:03.204846 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e5ed7837-b77c-4c96-a703-ce7e4601f574 req-32ef3a24-4d97-4ef2-8335-584636d6336e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063345 Nov 02 14:25:03.206996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3885/5802] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:25:04.081003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:04.081979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:04.088082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:04.096181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:04.097226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:04.098412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:04.103529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:04.104234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:04.104705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:04.283148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:04.294853 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-759b792d-3746-40eb-a8a5-1e6b0aa8a6b9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1318 microversion: 2.1 time: 0.219907 Nov 02 14:25:04.296034 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1918/5803] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:04 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:05.323636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:05.324643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:05.342904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:05.344940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:05.349331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:05.350262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:05.350726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:05.351718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:05.352357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:05.353164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:05.572888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:05.592921 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48c9f708-ef65-4ff3-bdf5-a67ca1c4c076 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1507 microversion: 2.1 time: 0.274654 Nov 02 14:25:05.594198 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3886/5804] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:05 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:25:17.805174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-606269714", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "5c34fde4-2a38-4d84-9cbc-3818a745cc6f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-784510525", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ac988b00-d631-41a5-aca6-cdc759d72b3b"]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:17.837161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:17.837984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=30 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:17.900213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] validate_networks() for [('5c34fde4-2a38-4d84-9cbc-3818a745cc6f', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:25:18.843778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:25:18.844411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:25:18.849006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:25:18.849006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:25:18.849006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:25:18.865313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:18.865817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:18.867312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:18.870996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:18.874362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:18.875854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:18.912090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Getting quotas for project 6566700284294739bbd144ae091aa4aa. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:25:18.919477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Getting quotas for user bc131dc2ee3b4bb4b99b7bb87e4f5c1f and project 6566700284294739bbd144ae091aa4aa. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:25:18.951789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:25:18.955477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:25:19.024950 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-811b07f7-1014-466a-abfe-00c9c6b4a9dc tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.223877 Nov 02 14:25:19.037901 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1919/5805] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:25:17 2022] POST /compute/v2.1/servers => generated 361 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:25:19.043028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d2ef3f1-2ead-4208-bfbe-1bfff872ec55 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:19.043775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d2ef3f1-2ead-4208-bfbe-1bfff872ec55 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:19.048665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:19.054821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=30 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:19.151303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d2ef3f1-2ead-4208-bfbe-1bfff872ec55 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:19.161538 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d2ef3f1-2ead-4208-bfbe-1bfff872ec55 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1240 microversion: 2.1 time: 0.121284 Nov 02 14:25:19.162149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3887/5806] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:19 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:20.190011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:20.191260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:20.210781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:20.211616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:20.212896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:20.214810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:20.215767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:20.216409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:20.374899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:20.384560 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e79ab5c-cc25-48fd-8f22-94413f9b3d40 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1292 microversion: 2.1 time: 0.199967 Nov 02 14:25:20.406197 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1920/5807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:20 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:21.410246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:21.411522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:21.438645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:21.439446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:21.441133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:21.444255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:21.453009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:21.456501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:21.607572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:21.631342 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a863d2fa-b43a-4593-a17a-ebad65e47a0d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.223731 Nov 02 14:25:21.651405 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3888/5808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:21 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:22.658339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:22.658868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:22.671034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:22.671833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:22.673430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:22.674988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:22.676005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:22.676929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:23.002721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:23.013506 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-96d3b837-1057-4886-a824-afdb4085da16 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.359174 Nov 02 14:25:23.034723 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1921/5809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:22 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:24.041721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:24.042353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:24.056989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-80743c62-78bf-4898-8b6d-953e9b08ec62 req-385e469c-9c74-4b0f-9d5b-c311994f9202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48349409-7e0b-47c8-b12a-f1f1ce3fe72f", "tag": "3f481c70-604e-4d02-a717-566f73b9a205"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:24.074561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-80743c62-78bf-4898-8b6d-953e9b08ec62 req-385e469c-9c74-4b0f-9d5b-c311994f9202 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:24.076643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:24.077318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:24.077926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:24.078813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:24.079576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:24.080271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-80743c62-78bf-4898-8b6d-953e9b08ec62 req-385e469c-9c74-4b0f-9d5b-c311994f9202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:24.080451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:24.082743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-80743c62-78bf-4898-8b6d-953e9b08ec62 req-385e469c-9c74-4b0f-9d5b-c311994f9202 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:24.113062 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-80743c62-78bf-4898-8b6d-953e9b08ec62 req-385e469c-9c74-4b0f-9d5b-c311994f9202 service nova] Creating event network-changed:3f481c70-604e-4d02-a717-566f73b9a205 for instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f on n-h1-858238-3 Nov 02 14:25:24.128199 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-80743c62-78bf-4898-8b6d-953e9b08ec62 req-385e469c-9c74-4b0f-9d5b-c311994f9202 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071107 Nov 02 14:25:24.130228 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1922/5810] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:24.233424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:24.250385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01b244f8-1959-4424-bad6-d8afc3a87a52 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.213552 Nov 02 14:25:24.251390 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3889/5811] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:24 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:25.279390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:25.281118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:25.290498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:25.291273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:25.292124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:25.293347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:25.293967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:25.294555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:25.436704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:25.449617 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c63980e3-6566-4976-acca-c25021fbe246 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.172648 Nov 02 14:25:25.452290 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1923/5812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:25 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:26.479133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:26.481045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:26.491624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:26.492118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:26.492607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:26.493367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:26.494131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:26.494566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:26.720140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:26.733132 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-deda2621-bf78-4771-b092-38976cd567af tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.258912 Nov 02 14:25:26.734594 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3890/5813] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:26 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:27.758642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:27.759575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:27.767880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:27.768747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:27.769682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:27.770684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:27.771482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:27.772277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:27.891146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:27.900302 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2cd8b96b-e0b3-4d4c-9f88-6b52d628c0db tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.146209 Nov 02 14:25:27.901950 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1924/5814] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:27 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:28.925042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:28.925617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:28.932800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:28.933286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:28.933717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:28.934417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:28.934862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:28.935345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:29.060871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:29.073476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b10b2efe-8b43-4756-987b-ed89fbc2ec09 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.152335 Nov 02 14:25:29.075267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3891/5815] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:28 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:29.258336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1f4d1823-555f-4d94-8623-51de02596ae1 req-5570ce5b-8db8-4a18-ab2c-b4992d2ca365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48349409-7e0b-47c8-b12a-f1f1ce3fe72f", "name": "network-vif-plugged", "status": "completed", "tag": "3f481c70-604e-4d02-a717-566f73b9a205"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:29.269789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:29.273769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:29.291580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1f4d1823-555f-4d94-8623-51de02596ae1 req-5570ce5b-8db8-4a18-ab2c-b4992d2ca365 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:29.292256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1f4d1823-555f-4d94-8623-51de02596ae1 req-5570ce5b-8db8-4a18-ab2c-b4992d2ca365 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:29.294330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1f4d1823-555f-4d94-8623-51de02596ae1 req-5570ce5b-8db8-4a18-ab2c-b4992d2ca365 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:29.321217 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1f4d1823-555f-4d94-8623-51de02596ae1 req-5570ce5b-8db8-4a18-ab2c-b4992d2ca365 service nova] Creating event network-vif-plugged:3f481c70-604e-4d02-a717-566f73b9a205 for instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f on n-h1-858238-3 Nov 02 14:25:29.332204 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1f4d1823-555f-4d94-8623-51de02596ae1 req-5570ce5b-8db8-4a18-ab2c-b4992d2ca365 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077477 Nov 02 14:25:29.333363 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1925/5816] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:30.100891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:30.102027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:30.104733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:30.114689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:30.115217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:30.115808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:30.116532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:30.116992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:30.117421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:30.220017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:30.230409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93f59b2c-4293-45a1-8b92-5c82baa9f263 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1298 microversion: 2.1 time: 0.134548 Nov 02 14:25:30.231191 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3892/5817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:30 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:31.255240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:31.257010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:31.265270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.265814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.266521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.268606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.271223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.271821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.410656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:31.431923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-734d7ed0-2361-4716-9458-4e42e3e4f431 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1471 microversion: 2.1 time: 0.180121 Nov 02 14:25:31.446241 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1926/5818] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:31 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:31.460134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:31.464009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:31.472958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.474486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.475670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.477456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.478499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.479518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.711914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:31.721435 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c08f9004-b7b5-462d-a19c-d1519a1cee91 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1471 microversion: 2.1 time: 0.266037 Nov 02 14:25:31.732563 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3893/5819] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:31 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:31.756944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:31.757680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:31.764303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.764892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.765418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.766241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.766787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.767337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.917654 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-191b7aa0-96bc-46a1-9b08-81164fd6672a tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1622 microversion: 2.1 time: 0.165623 Nov 02 14:25:31.920268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1927/5820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:31 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1622 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:31.944366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:31.945254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:31.952228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.952986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.953632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:31.954624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:31.955381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:31.956080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:32.509147 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5a2ecf6f-64ea-4f56-9f73-a2b55a49e013 tempest-TestSecurityGroupsBasicOps-404036188 tempest-TestSecurityGroupsBasicOps-404036188-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1909 microversion: 2.1 time: 0.569256 Nov 02 14:25:32.511057 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3894/5821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:31 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1909 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:32.604803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:32.605319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:32.621774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:32.625034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:32.628110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:32.629498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:32.631390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:32.632091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:32.697036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:25:32.803282 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c70a196-d64f-4c3a-947a-f3d08a2d0eaf tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "DELETE /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 204 len: 0 microversion: 2.1 time: 0.201967 Nov 02 14:25:32.808107 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1928/5822] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:25:32 2022] DELETE /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:25:32.815429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:32.816131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:32.832018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:32.832862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:32.833308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:32.834028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:32.834485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:32.834912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:33.016670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:33.028130 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b750a99b-0317-4b0c-9861-9afe5faf4a4e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1477 microversion: 2.1 time: 0.219418 Nov 02 14:25:33.028737 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3895/5823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:32 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:33.778879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31dd3c29-d7e4-45a5-a189-bcf1301de5e6", "device": "/dev/sdb"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:33.782801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:33.800769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:33.801553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:33.802174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:33.803312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:33.807888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:33.808610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:34.067382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:34.068874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:34.077084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:34.077932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:34.078624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:34.079594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:34.080262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:34.080887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:34.333753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:34.355434 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-91175e75-a9a9-4047-862b-19420e5a6ec3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "POST /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.579960 Nov 02 14:25:34.356410 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1929/5824] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:25:33 2022] POST /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:34.373584 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4450cff4-5a24-4b31-a52b-80ed03d34b3c tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1477 microversion: 2.1 time: 0.287302 Nov 02 14:25:34.374803 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3896/5825] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:34 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:35.357979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-99f94257-7026-4b32-b7b7-f65279092024 req-14b3a9e9-522d-46e0-9191-e459182e518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48349409-7e0b-47c8-b12a-f1f1ce3fe72f", "name": "network-vif-deleted", "tag": "3f481c70-604e-4d02-a717-566f73b9a205"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:35.402568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-99f94257-7026-4b32-b7b7-f65279092024 req-14b3a9e9-522d-46e0-9191-e459182e518d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:35.403045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:35.404213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:35.423178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:35.423677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:35.424116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:35.424879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:35.428393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-99f94257-7026-4b32-b7b7-f65279092024 req-14b3a9e9-522d-46e0-9191-e459182e518d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:35.428879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-99f94257-7026-4b32-b7b7-f65279092024 req-14b3a9e9-522d-46e0-9191-e459182e518d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:35.435226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:35.438893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:35.470102 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-99f94257-7026-4b32-b7b7-f65279092024 req-14b3a9e9-522d-46e0-9191-e459182e518d service nova] Creating event network-vif-deleted:3f481c70-604e-4d02-a717-566f73b9a205 for instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f on n-h1-858238-3 Nov 02 14:25:35.484045 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-99f94257-7026-4b32-b7b7-f65279092024 req-14b3a9e9-522d-46e0-9191-e459182e518d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134751 Nov 02 14:25:35.486623 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1930/5826] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:35.684538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:35.704679 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1628bb48-f2ff-47d7-91cd-e55133e7d5a3 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 200 len: 1325 microversion: 2.1 time: 0.306749 Nov 02 14:25:35.705569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3897/5827] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:35 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:25:36.736960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:36.739298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: 48349409-7e0b-47c8-b12a-f1f1ce3fe72f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:36.748939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:36.750220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:36.752452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:36.755345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:36.755998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:36.756804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:36.792146 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] HTTP exception thrown: Instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f could not be found. Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Request method failure captured: Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f HTTP/1.1 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn154KfejoABsbMUfR0T3p0-AMwnsHOEegUmGlMPQ9hsp_seKJZs9zAWszVabmltGd8QH6QEIB_xa0UTN1xmB4znMB3Z6FW50Pb6L8XzKKv7nyiEGbCFU15vPYN2FEuDAj2e0ZrET4pwU1UJD_PaVbiIgYsDWHSz8m1SfPBGEDuDxZw Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 6566700284294739bbd144ae091aa4aa Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-349164302 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6566700284294739bbd144ae091aa4aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6566700284294739bbd144ae091aa4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6566700284294739bbd144ae091aa4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6566700284294739bbd144ae091aa4aa"}]}] Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestSecurityGroupsBasicOps-349164302 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 6566700284294739bbd144ae091aa4aa Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-349164302 Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestSecurityGroupsBasicOps-349164302-project Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bc131dc2ee3b4bb4b99b7bb87e4f5c1f Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestSecurityGroupsBasicOps-349164302-project Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f could not be found. Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '48349409-7e0b-47c8-b12a-f1f1ce3fe72f'} Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f could not be found. Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f could not be found. Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:36.794734 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f could not be found. Nov 02 14:25:36.800067 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:36.802166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Returning 404 to user: Instance 48349409-7e0b-47c8-b12a-f1f1ce3fe72f could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:25:36.803510 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9da647d5-46f3-4eeb-b4da-792ec045a13e tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f" status: 404 len: 111 microversion: 2.1 time: 0.072616 Nov 02 14:25:36.804259 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1931/5828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:36 2022] GET /compute/v2.1/servers/48349409-7e0b-47c8-b12a-f1f1ce3fe72f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:25:44.144547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-54aaeffc-d4f5-4dd3-926b-4e772c5f38cd req-c8590b5e-6abb-4618-b73c-12e9fa0bbc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac988b00-d631-41a5-aca6-cdc759d72b3b", "tag": "f5da2437-33ee-48ff-b75d-08ddc4eb1e91"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:44.147530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:44.149159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:44.169275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:44.170116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:44.173839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:44.175426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:44.176068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:44.180058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:44.181835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-54aaeffc-d4f5-4dd3-926b-4e772c5f38cd req-c8590b5e-6abb-4618-b73c-12e9fa0bbc30 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:44.182519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-54aaeffc-d4f5-4dd3-926b-4e772c5f38cd req-c8590b5e-6abb-4618-b73c-12e9fa0bbc30 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:44.184394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-54aaeffc-d4f5-4dd3-926b-4e772c5f38cd req-c8590b5e-6abb-4618-b73c-12e9fa0bbc30 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:44.209235 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-54aaeffc-d4f5-4dd3-926b-4e772c5f38cd req-c8590b5e-6abb-4618-b73c-12e9fa0bbc30 service nova] Creating event network-changed:f5da2437-33ee-48ff-b75d-08ddc4eb1e91 for instance ac988b00-d631-41a5-aca6-cdc759d72b3b on n-h2-858238-3 Nov 02 14:25:44.228949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-54aaeffc-d4f5-4dd3-926b-4e772c5f38cd req-c8590b5e-6abb-4618-b73c-12e9fa0bbc30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093407 Nov 02 14:25:44.231995 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1932/5829] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:25:44.240373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:25:44.364850 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2d0faa4-d74b-4c5f-b995-ba62c918ee79 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 204 len: 0 microversion: 2.1 time: 0.233522 Nov 02 14:25:44.377789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:44.378670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:44.381872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3898/5830] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:25:44 2022] DELETE /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:25:44.394473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:44.396354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:44.401930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:44.403064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:44.403806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:44.404417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:44.796854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:44.807354 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc1b2083-d27e-4217-a2cc-9793d0d5896d tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1764 microversion: 2.1 time: 0.433771 Nov 02 14:25:44.817920 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1933/5831] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:44 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1764 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:45.853177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:45.854834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:45.884152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:45.884908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:45.885417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:45.886547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:45.887298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:45.887819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:46.140238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:46.148756 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b4816aa-21c1-45e3-8152-4887c9e4e2d9 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1764 microversion: 2.1 time: 0.312034 Nov 02 14:25:46.151958 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3899/5832] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:45 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1764 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:25:46.676296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-484781f4-31e1-4249-b67f-892ab5bea366 req-25e8c02e-54f0-4435-afdf-bdf08fd6d515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac988b00-d631-41a5-aca6-cdc759d72b3b", "name": "network-vif-deleted", "tag": "f5da2437-33ee-48ff-b75d-08ddc4eb1e91"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:46.693335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-484781f4-31e1-4249-b67f-892ab5bea366 req-25e8c02e-54f0-4435-afdf-bdf08fd6d515 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:46.693841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-484781f4-31e1-4249-b67f-892ab5bea366 req-25e8c02e-54f0-4435-afdf-bdf08fd6d515 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:46.694409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-484781f4-31e1-4249-b67f-892ab5bea366 req-25e8c02e-54f0-4435-afdf-bdf08fd6d515 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:46.712662 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-484781f4-31e1-4249-b67f-892ab5bea366 req-25e8c02e-54f0-4435-afdf-bdf08fd6d515 service nova] Creating event network-vif-deleted:f5da2437-33ee-48ff-b75d-08ddc4eb1e91 for instance ac988b00-d631-41a5-aca6-cdc759d72b3b on n-h2-858238-3 Nov 02 14:25:46.719943 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-484781f4-31e1-4249-b67f-892ab5bea366 req-25e8c02e-54f0-4435-afdf-bdf08fd6d515 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049129 Nov 02 14:25:46.721083 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1934/5833] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:47.181901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:47.186986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:47.204238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:47.205935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:47.215626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:47.218821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:47.220900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:47.221602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:47.334455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:47.335283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:47.335976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:47.338781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lazy-loading 'fault' on Instance uuid ac988b00-d631-41a5-aca6-cdc759d72b3b {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:25:47.407267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc131dc2ee3b4bb4b99b7bb87e4f5c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6566700284294739bbd144ae091aa4aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:47.430933 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-feaae145-b7d3-4218-8455-7e612f818795 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 200 len: 1381 microversion: 2.1 time: 0.258442 Nov 02 14:25:47.432999 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3900/5834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:47 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 1381 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:48.468879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:48.469601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] [instance: ac988b00-d631-41a5-aca6-cdc759d72b3b] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:48.477993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:48.480032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:48.480940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:48.481649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:48.482617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:48.483345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:48.483998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:48.491671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:48.513576 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] HTTP exception thrown: Instance ac988b00-d631-41a5-aca6-cdc759d72b3b could not be found. Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Request method failure captured: Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b HTTP/1.1 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn154KfejoABsbMUfR0T3p0-AMwnsHOEegUmGlMPQ9hsp_seKJZs9zAWszVabmltGd8QH6QEIB_xa0UTN1xmB4znMB3Z6FW50Pb6L8XzKKv7nyiEGbCFU15vPYN2FEuDAj2e0ZrET4pwU1UJD_PaVbiIgYsDWHSz8m1SfPBGEDuDxZw Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 6566700284294739bbd144ae091aa4aa Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-349164302 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6566700284294739bbd144ae091aa4aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6566700284294739bbd144ae091aa4aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6566700284294739bbd144ae091aa4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6566700284294739bbd144ae091aa4aa"}]}] Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestSecurityGroupsBasicOps-349164302 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 6566700284294739bbd144ae091aa4aa Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-349164302 Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestSecurityGroupsBasicOps-349164302-project Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: bc131dc2ee3b4bb4b99b7bb87e4f5c1f Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestSecurityGroupsBasicOps-349164302-project Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance ac988b00-d631-41a5-aca6-cdc759d72b3b could not be found. Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'ac988b00-d631-41a5-aca6-cdc759d72b3b'} Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac988b00-d631-41a5-aca6-cdc759d72b3b could not be found. Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac988b00-d631-41a5-aca6-cdc759d72b3b could not be found. Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:48.521132 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac988b00-d631-41a5-aca6-cdc759d72b3b could not be found. Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Returning 404 to user: Instance ac988b00-d631-41a5-aca6-cdc759d72b3b could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56a10a99-0641-4abc-b393-bf008e032da7 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b" status: 404 len: 111 microversion: 2.1 time: 0.069056 Nov 02 14:25:48.536058 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1935/5835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:25:48 2022] GET /compute/v2.1/servers/ac988b00-d631-41a5-aca6-cdc759d72b3b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:25:55.761989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12bc4976-0fb8-4f80-a5c9-7355ea2a5733 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] Calling method '.version_select at 0x7f6f80315ca0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:55.771210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:55.790803 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12bc4976-0fb8-4f80-a5c9-7355ea2a5733 tempest-TestSecurityGroupsBasicOps-349164302 tempest-TestSecurityGroupsBasicOps-349164302-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-784510525" status: 202 len: 0 microversion: 2.1 time: 0.033189 Nov 02 14:25:55.792185 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3901/5836] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-784510525 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:07.350542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:07.351077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:07.360086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:07.361564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:07.362239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:07.362696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:07.363442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:07.363911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:07.364369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:07.463464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lazy-loading 'services' on Instance uuid 113de0b2-e465-41c4-a76d-400ec75a88fe {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:26:07.550841 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fc6d5861-6274-47b7-b975-c6a1fb78584d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe/os-volume_attachments/31dd3c29-d7e4-45a5-a189-bcf1301de5e6" status: 202 len: 0 microversion: 2.1 time: 0.205527 Nov 02 14:26:07.554775 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1936/5837] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:26:07 2022] DELETE /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe/os-volume_attachments/31dd3c29-d7e4-45a5-a189-bcf1301de5e6 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:13.149291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:13.154906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:13.156248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:13.164144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:13.164708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:13.165144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:13.165833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:13.166280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:13.167213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:13.194646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:26:13.278436 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c64d83bf-3f73-4d2b-83ab-a77cf27dfa00 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 204 len: 0 microversion: 2.1 time: 0.130613 Nov 02 14:26:13.279232 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3902/5838] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:26:13 2022] DELETE /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:26:13.288669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:13.289894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:13.298175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:13.298668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:13.299131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:13.299839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:13.300299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:13.300731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:13.462798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:13.471287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae67909d-6cef-4b02-a5a0-c625555f3a65 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1513 microversion: 2.1 time: 0.187200 Nov 02 14:26:13.472555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1937/5839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:13 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:14.497199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:14.498172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:14.508319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:14.508751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:14.509186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:14.509920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:14.510377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:14.510796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:14.817579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:14.829741 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8479ae0a-504c-4fa7-80e3-1eb748b9b258 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1513 microversion: 2.1 time: 0.336868 Nov 02 14:26:14.830337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3903/5840] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:14 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1513 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:15.857606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:15.858247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:15.866618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:15.867196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:15.869157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:15.870098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:15.871040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:15.871841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:15.882838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0342f551-a1e9-4a5d-8eeb-83f70e4f92c9 req-2ded736e-75b0-4a80-90c0-9a5207ec9096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113de0b2-e465-41c4-a76d-400ec75a88fe", "name": "network-vif-deleted", "tag": "3a3b5eea-ca08-45fe-ba4d-e7149cf8ab75"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:15.912791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0342f551-a1e9-4a5d-8eeb-83f70e4f92c9 req-2ded736e-75b0-4a80-90c0-9a5207ec9096 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:15.913264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0342f551-a1e9-4a5d-8eeb-83f70e4f92c9 req-2ded736e-75b0-4a80-90c0-9a5207ec9096 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:15.913678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0342f551-a1e9-4a5d-8eeb-83f70e4f92c9 req-2ded736e-75b0-4a80-90c0-9a5207ec9096 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:15.928348 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0342f551-a1e9-4a5d-8eeb-83f70e4f92c9 req-2ded736e-75b0-4a80-90c0-9a5207ec9096 service nova] Creating event network-vif-deleted:3a3b5eea-ca08-45fe-ba4d-e7149cf8ab75 for instance 113de0b2-e465-41c4-a76d-400ec75a88fe on n-h1-858238-3 Nov 02 14:26:15.934748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0342f551-a1e9-4a5d-8eeb-83f70e4f92c9 req-2ded736e-75b0-4a80-90c0-9a5207ec9096 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059649 Nov 02 14:26:15.936205 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3904/5841] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:15.981926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:15.991976 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-65975736-5ef7-431f-9bc4-2f6826fa36d3 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 200 len: 1471 microversion: 2.1 time: 0.138500 Nov 02 14:26:15.995439 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1938/5842] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:15 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 1471 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:17.020267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:17.021760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 113de0b2-e465-41c4-a76d-400ec75a88fe] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:17.031489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:17.032380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:17.033185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:17.034137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:17.034809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:17.035480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:17.052913 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] HTTP exception thrown: Instance 113de0b2-e465-41c4-a76d-400ec75a88fe could not be found. Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Request method failure captured: Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe HTTP/1.1 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn1jfHxPD3xgcuEXvivD4o8P9DtQ2SIQqHJ7g-fqMYs7tTLwOjAf3NSXDYA0QBW6sdetJW-M7aKDO2whRaoYb964xSki1SwX8HVD1-dap1IyfGQSLsuzbBFrgIEaGlvjhtlXzsyHbyH3v2ZzoEUyVVzDPYMLQqVr5TPz6GAU9EJML34 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cb19a1ce6ca94d4db1ac6ab7edf27804 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1165329999 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb19a1ce6ca94d4db1ac6ab7edf27804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb19a1ce6ca94d4db1ac6ab7edf27804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb19a1ce6ca94d4db1ac6ab7edf27804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb19a1ce6ca94d4db1ac6ab7edf27804"}]}] Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesSnapshotTestJSON-1165329999 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cb19a1ce6ca94d4db1ac6ab7edf27804 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1165329999 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesSnapshotTestJSON-1165329999-project Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 20d27233e55e4238a041ed752bdcff40 Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesSnapshotTestJSON-1165329999-project Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 113de0b2-e465-41c4-a76d-400ec75a88fe could not be found. Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '113de0b2-e465-41c4-a76d-400ec75a88fe'} Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113de0b2-e465-41c4-a76d-400ec75a88fe could not be found. Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113de0b2-e465-41c4-a76d-400ec75a88fe could not be found. Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:17.055865 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113de0b2-e465-41c4-a76d-400ec75a88fe could not be found. Nov 02 14:26:17.062875 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:26:17.066438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Returning 404 to user: Instance 113de0b2-e465-41c4-a76d-400ec75a88fe could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:26:17.068258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6901cc44-4d8b-4132-8786-96dc85d1be5d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe" status: 404 len: 111 microversion: 2.1 time: 0.052714 Nov 02 14:26:17.069411 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3905/5843] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:17 2022] GET /compute/v2.1/servers/113de0b2-e465-41c4-a76d-400ec75a88fe => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:26:21.866670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:21.867992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:21.883877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:21.887691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:21.894854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:21.897435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-de7da459-8720-4e00-a22c-73698fd4da0b req-ad8688e7-7941-4ab9-91ec-b0959189221f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3c8592-5dab-4fd9-bad0-9a967d36cb8c", "tag": "15114cf7-feb6-4616-8925-693024d40107"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:21.906327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:21.907540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:21.908655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:21.919046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-de7da459-8720-4e00-a22c-73698fd4da0b req-ad8688e7-7941-4ab9-91ec-b0959189221f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:21.920485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-de7da459-8720-4e00-a22c-73698fd4da0b req-ad8688e7-7941-4ab9-91ec-b0959189221f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:21.922160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-de7da459-8720-4e00-a22c-73698fd4da0b req-ad8688e7-7941-4ab9-91ec-b0959189221f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:21.953762 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-de7da459-8720-4e00-a22c-73698fd4da0b req-ad8688e7-7941-4ab9-91ec-b0959189221f service nova] Creating event network-changed:15114cf7-feb6-4616-8925-693024d40107 for instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c on n-h2-858238-3 Nov 02 14:26:21.964295 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-de7da459-8720-4e00-a22c-73698fd4da0b req-ad8688e7-7941-4ab9-91ec-b0959189221f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073165 Nov 02 14:26:21.973773 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3906/5844] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:26:21.978268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:26:22.099643 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4cb21957-bcf5-4ebc-89f5-70900be86afb tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 204 len: 0 microversion: 2.1 time: 0.237498 Nov 02 14:26:22.101586 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1939/5845] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:26:21 2022] DELETE /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:26:22.116771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:22.117499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:22.137071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:22.137665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:22.138695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:22.139698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:22.142368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:22.142997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:22.553087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:22.562648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9557b720-6033-45d0-bbbc-32ac047a9298 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1577 microversion: 2.1 time: 0.455765 Nov 02 14:26:22.568486 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3907/5846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:22 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1577 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:23.597371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:23.598677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:23.611320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:23.616735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:23.617353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:23.618694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:23.619562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:23.622974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:23.944104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:23.956065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d7ad568c-c640-4386-b412-7afe510e45af tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1577 microversion: 2.1 time: 0.364837 Nov 02 14:26:23.961200 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1940/5847] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:23 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1577 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:24.983232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:24.983970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:24.995049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:24.995676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:24.996191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:25.010952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:25.010952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:25.011826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:25.105773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:25.117638 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0351f91c-27c0-45cb-bbff-6354c3e1b16b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1391 microversion: 2.1 time: 0.140339 Nov 02 14:26:25.121678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-da22dd5b-3147-4c66-8855-ebf4a098299f req-1a53fb2c-e61e-4ac7-8c68-dc5862affee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3c8592-5dab-4fd9-bad0-9a967d36cb8c", "name": "network-vif-deleted", "tag": "15114cf7-feb6-4616-8925-693024d40107"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:25.136555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3908/5848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:24 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:25.145041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-da22dd5b-3147-4c66-8855-ebf4a098299f req-1a53fb2c-e61e-4ac7-8c68-dc5862affee8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:25.145552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-da22dd5b-3147-4c66-8855-ebf4a098299f req-1a53fb2c-e61e-4ac7-8c68-dc5862affee8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:25.146002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-da22dd5b-3147-4c66-8855-ebf4a098299f req-1a53fb2c-e61e-4ac7-8c68-dc5862affee8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:25.166726 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-da22dd5b-3147-4c66-8855-ebf4a098299f req-1a53fb2c-e61e-4ac7-8c68-dc5862affee8 service nova] Creating event network-vif-deleted:15114cf7-feb6-4616-8925-693024d40107 for instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c on n-h2-858238-3 Nov 02 14:26:25.174252 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-da22dd5b-3147-4c66-8855-ebf4a098299f req-1a53fb2c-e61e-4ac7-8c68-dc5862affee8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056747 Nov 02 14:26:25.176692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1941/5849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:25.326827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1817145063", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "0c832f79-4068-40df-aae0-e26d767e5058"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:25.416738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] validate_networks() for [('0c832f79-4068-40df-aae0-e26d767e5058', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:26:25.492011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1058565461", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "6eafa34e-ef1b-4448-aa15-800c1b141c74"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:25.580817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] validate_networks() for [('6eafa34e-ef1b-4448-aa15-800c1b141c74', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:26:26.026656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:26:26.027437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:26:26.028223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:26:26.029605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:26:26.030288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:26:26.040703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:26.041485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:26.042121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:26.044553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:26.045562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:26.046377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:26.072565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Getting quotas for project cb19a1ce6ca94d4db1ac6ab7edf27804. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:26:26.082737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Getting quotas for user 20d27233e55e4238a041ed752bdcff40 and project cb19a1ce6ca94d4db1ac6ab7edf27804. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:26:26.104495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:26:26.111387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:26:26.191744 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e886aab-1c1e-41fe-84f3-78f09ed5da32 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871533 Nov 02 14:26:26.195240 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1942/5850] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:26:26.206822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:26.209132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:26.218610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:26.219409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:26.220252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:26.221163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:26.221811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:26.222408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:26.406262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:26.422616 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a0e3c45-7736-4369-93f1-fd5fb4c4e1ea tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1225 microversion: 2.1 time: 0.223898 Nov 02 14:26:26.426238 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1943/5851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:26 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1225 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:26.433067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e309615f-1ef6-4f53-8c3b-f9b0c0e88650 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:26.434197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e309615f-1ef6-4f53-8c3b-f9b0c0e88650 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:26.539347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e309615f-1ef6-4f53-8c3b-f9b0c0e88650 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:26.550479 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e309615f-1ef6-4f53-8c3b-f9b0c0e88650 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1219 microversion: 2.1 time: 0.122508 Nov 02 14:26:26.551107 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1944/5852] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:26 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:26.628051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:26:26.628603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:26:26.628937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:26:26.629348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:26:26.629759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:26:26.644612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:26.645107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:26.645550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:26.646286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:26.646742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:26.647198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:26.679373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Getting quotas for project dd3965975c9d4d8bb314a577e8220bff. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:26:26.686912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Getting quotas for user c82edaf2f6e2490491f82ec807318e93 and project dd3965975c9d4d8bb314a577e8220bff. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:26:26.702433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:26:26.706320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:26:26.779804 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-51481ae1-1ec2-4a5b-8dfa-d11bf6f3219f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511979 Nov 02 14:26:26.782530 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3909/5853] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:26:26.793551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-afc747a1-240f-4e37-b170-058116af9ec4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:26.795038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-afc747a1-240f-4e37-b170-058116af9ec4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:26.915338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-afc747a1-240f-4e37-b170-058116af9ec4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:26.953247 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-afc747a1-240f-4e37-b170-058116af9ec4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1215 microversion: 2.1 time: 0.164921 Nov 02 14:26:26.956528 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1945/5854] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:26 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:27.453509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:27.455722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:27.479603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:27.486251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:27.489064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:27.491484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:27.493637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:27.495209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:27.573122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:27.573759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:27.587514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:27.588584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:27.591474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:27.592300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:27.592795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:27.593256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:27.714743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:27.729934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed3147a7-e854-4555-a190-605d6320a1aa tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1215 microversion: 2.1 time: 0.160362 Nov 02 14:26:27.731073 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1946/5855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:27 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:27.874769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:27.887945 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-72242715-78f8-4ac4-95c1-27febbc3f0a3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1225 microversion: 2.1 time: 0.441854 Nov 02 14:26:27.898117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3910/5856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:27 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1225 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:27.981545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:27.982446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:27.990143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:27.991256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:27.991870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:27.992869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:27.993538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:27.994140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:28.105055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:28.117016 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-362e8822-2560-476b-b3be-d2b9ce74ed1f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1211 microversion: 2.1 time: 0.139540 Nov 02 14:26:28.117615 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1947/5857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:27 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:28.754480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:28.755539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:28.766475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:28.769568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:28.771941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:28.774597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:28.776685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:28.780155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:28.923870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:28.925623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:28.938354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:28.939807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:28.941884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:28.942923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:28.943839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:28.946644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:29.007710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:29.019528 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7428b0e9-6f01-42f0-84c4-f9bf40bb86df tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1279 microversion: 2.1 time: 0.269430 Nov 02 14:26:29.022469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3911/5858] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:28 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:29.146280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:29.147354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:29.162123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:29.172053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:29.189003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:29.190867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b9369a3f-7c96-44db-9f69-023480594a5d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1225 microversion: 2.1 time: 0.280557 Nov 02 14:26:29.191538 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1948/5859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:28 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1225 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:29.196699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:29.197071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:29.199551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:29.202848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:29.344796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:29.356552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b2d8c86f-59c2-4287-81ea-c0a91d96af39 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1267 microversion: 2.1 time: 0.214381 Nov 02 14:26:29.360565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3912/5860] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:29 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:30.046982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:30.047658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:30.061241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:30.061755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:30.062215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:30.066801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:30.067268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:30.067657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:30.215174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:30.215941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:30.231938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:30.232708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:30.233276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:30.235947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:30.236568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:30.238454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:30.608577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:30.619830 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cde46052-0c28-4b9e-87af-3098ca460443 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1225 microversion: 2.1 time: 0.408615 Nov 02 14:26:30.622570 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3913/5861] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:30 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1225 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:30.634206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:30.635962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:30.649591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:30.654194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:30.655501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:30.657289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:30.660062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:30.660786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:30.898983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:30.910162 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-07ef0d6e-d769-4f75-81cc-80700923f726 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.868044 Nov 02 14:26:30.911144 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1949/5862] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:30 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:31.073550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:31.082865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17a05bef-bf83-4d75-9ce5-82cb386f6214 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.457098 Nov 02 14:26:31.101079 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3914/5863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:30 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:31.645944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:31.649264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:31.672232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:31.675316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:31.676340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:31.677423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:31.678129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:31.678794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:31.717216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:31.719180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:31.719869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:31.720603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lazy-loading 'fault' on Instance uuid 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:26:31.875241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:31.887565 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d94037d6-e0b5-4d1b-a4d7-f4fd617de5e2 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 200 len: 1184 microversion: 2.1 time: 0.244852 Nov 02 14:26:31.906466 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1950/5864] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:31 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 1184 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:31.944994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-efad5edf-ff71-43a2-bd7e-a7dd1edee5bf req-c5f94c9a-24d0-4534-8235-69501b261b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc", "tag": "e8cd0b9d-753b-466e-b2b9-b237ac9f5428"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:31.947676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:31.951532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:31.960944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:31.962099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:31.962738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:31.963687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:31.964371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:31.964962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:31.977123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-efad5edf-ff71-43a2-bd7e-a7dd1edee5bf req-c5f94c9a-24d0-4534-8235-69501b261b40 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:31.977524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-efad5edf-ff71-43a2-bd7e-a7dd1edee5bf req-c5f94c9a-24d0-4534-8235-69501b261b40 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:31.980464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-efad5edf-ff71-43a2-bd7e-a7dd1edee5bf req-c5f94c9a-24d0-4534-8235-69501b261b40 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:31.993498 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-efad5edf-ff71-43a2-bd7e-a7dd1edee5bf req-c5f94c9a-24d0-4534-8235-69501b261b40 service nova] Creating event network-changed:e8cd0b9d-753b-466e-b2b9-b237ac9f5428 for instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc on n-h1-858238-3 Nov 02 14:26:32.000030 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-efad5edf-ff71-43a2-bd7e-a7dd1edee5bf req-c5f94c9a-24d0-4534-8235-69501b261b40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058241 Nov 02 14:26:32.001370 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1951/5865] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:26:32.106727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:32.107964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:32.117360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:32.118083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:32.118667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:32.119716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:32.120477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:32.126886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:32.357151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:32.365098 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce5a2d3b-914b-4d34-92d4-0009b2c0a2b7 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.427742 Nov 02 14:26:32.365794 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3915/5866] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:31 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:32.477237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:32.485970 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-468e8e99-6f92-4290-8b9a-691bfb10528e tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.383763 Nov 02 14:26:32.486712 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1952/5867] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:32 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:32.808369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-50c941e5-2b8e-4727-b404-971a1a56b1f8 req-60ec768f-0f3f-48fe-a74c-7ccbf6857abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbd4722-14fb-4975-9b11-158d5b762d35", "tag": "fe92dd42-45aa-47d3-8b6c-2771c0f445f3"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:32.820162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-50c941e5-2b8e-4727-b404-971a1a56b1f8 req-60ec768f-0f3f-48fe-a74c-7ccbf6857abd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:32.820857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-50c941e5-2b8e-4727-b404-971a1a56b1f8 req-60ec768f-0f3f-48fe-a74c-7ccbf6857abd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:32.821281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-50c941e5-2b8e-4727-b404-971a1a56b1f8 req-60ec768f-0f3f-48fe-a74c-7ccbf6857abd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:32.833169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-50c941e5-2b8e-4727-b404-971a1a56b1f8 req-60ec768f-0f3f-48fe-a74c-7ccbf6857abd service nova] Creating event network-changed:fe92dd42-45aa-47d3-8b6c-2771c0f445f3 for instance 9fbd4722-14fb-4975-9b11-158d5b762d35 on n-h1-858238-3 Nov 02 14:26:32.838525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-50c941e5-2b8e-4727-b404-971a1a56b1f8 req-60ec768f-0f3f-48fe-a74c-7ccbf6857abd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033780 Nov 02 14:26:32.840652 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3916/5868] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:32.913762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:32.914384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:32.921788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:32.922278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:32.922732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:32.923527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:32.924015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:32.924446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:32.939052 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c could not be found. Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c HTTP/1.1 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c could not be found. Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3a3c8592-5dab-4fd9-bad0-9a967d36cb8c'} Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c could not be found. Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c could not be found. Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:32.940957 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c could not be found. Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 3a3c8592-5dab-4fd9-bad0-9a967d36cb8c could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e831d50b-7f42-477c-858e-4e3b3f5ef223 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c" status: 404 len: 111 microversion: 2.1 time: 0.032928 Nov 02 14:26:32.946273 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1953/5869] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:32 2022] GET /compute/v2.1/servers/3a3c8592-5dab-4fd9-bad0-9a967d36cb8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:26:33.390882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:33.392712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:33.400349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.400839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.401339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.409578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.409937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.410365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.511669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:33.513577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:33.532081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.536113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.536970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.539316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.540183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.540886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.578194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:33.599785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:33.609665 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab8283e5-71f7-432b-8477-097b3f32c754 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.223801 Nov 02 14:26:33.629599 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3917/5870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:33 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:33.849106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:33.863587 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-43119832-bbad-4dbb-a266-965f24eb0087 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.357953 Nov 02 14:26:33.864564 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1954/5871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:33 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:34.640128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:34.641263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:34.650356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:34.650856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:34.651399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:34.652246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:34.653125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:34.653834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:34.800875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:34.809523 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5a09e06-9515-4e3e-b402-7b94449de7c6 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.174363 Nov 02 14:26:34.810658 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3918/5872] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:34 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:34.886341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:34.887611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:34.896125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:34.896715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:34.897173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:34.898277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:34.898991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:34.899627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:35.101157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:35.114905 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a73f6547-2c9d-450f-a531-7abfda69ebc4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.232915 Nov 02 14:26:35.116696 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1955/5873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:34 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:35.836016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:35.837248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:35.846958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:35.847708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:35.848332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:35.849218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:35.849839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:35.850440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:36.089550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:36.098721 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8990531b-6f9e-4e74-8906-3d89404c2219 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.268414 Nov 02 14:26:36.115237 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3919/5874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:35 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:36.143076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:36.144808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:36.153491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:36.156365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:36.157047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:36.158205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:36.159549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:36.160179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:36.160806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:36.380334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:36.390407 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ea161e5-1a84-4ab4-a871-2af19636546f tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.253215 Nov 02 14:26:36.391113 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1956/5875] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:36 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:37.133160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:37.137284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:37.139626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.144923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.161071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:37.163745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:37.164638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:37.165917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:37.166634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:37.168288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:37.174326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.413298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:37.414097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:37.417332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.418977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:37.436820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:37.439577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:37.440247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:37.441807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:37.445802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:37.447337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:37.532654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:37.542765 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ff090b1-7095-4872-ad44-7fa50aabeab9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.424588 Nov 02 14:26:37.548860 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3920/5876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:37 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:37.709260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:37.725474 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b5768986-64be-4824-940b-ce6f18c8d1a6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.315883 Nov 02 14:26:37.726457 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1957/5877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:37 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:37.827124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3c2838f2-e5e4-4a8b-a5e0-16a8c40f9d15 req-fa9a7641-ab73-4033-969c-15ac8e8f4bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc", "name": "network-vif-plugged", "status": "completed", "tag": "e8cd0b9d-753b-466e-b2b9-b237ac9f5428"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:37.837113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c2838f2-e5e4-4a8b-a5e0-16a8c40f9d15 req-fa9a7641-ab73-4033-969c-15ac8e8f4bce service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:37.837857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c2838f2-e5e4-4a8b-a5e0-16a8c40f9d15 req-fa9a7641-ab73-4033-969c-15ac8e8f4bce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:37.838444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3c2838f2-e5e4-4a8b-a5e0-16a8c40f9d15 req-fa9a7641-ab73-4033-969c-15ac8e8f4bce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:37.851028 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3c2838f2-e5e4-4a8b-a5e0-16a8c40f9d15 req-fa9a7641-ab73-4033-969c-15ac8e8f4bce service nova] Creating event network-vif-plugged:e8cd0b9d-753b-466e-b2b9-b237ac9f5428 for instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc on n-h1-858238-3 Nov 02 14:26:37.857483 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3c2838f2-e5e4-4a8b-a5e0-16a8c40f9d15 req-fa9a7641-ab73-4033-969c-15ac8e8f4bce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Nov 02 14:26:37.858576 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3921/5878] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:38.570301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:38.572583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:38.580627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:38.581353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:38.581968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:38.582937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:38.583622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:38.584060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:38.754922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:38.756210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:38.762369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:38.762857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:38.763348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:38.764049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:38.764875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:38.765305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:39.262877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:39.279270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ce5313a-b8ba-429f-ac40-761a9b590b90 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.712987 Nov 02 14:26:39.289649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1958/5879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:38 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:39.393316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:39.429841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4914654-0727-4ecf-8571-57364b12c1f4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1315 microversion: 2.1 time: 0.680198 Nov 02 14:26:39.430464 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3922/5880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:38 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:39.873928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9f45df79-3c47-4e00-858d-1d8e40ae609d req-75f60def-b386-46b3-a56f-7a47a4e451bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbd4722-14fb-4975-9b11-158d5b762d35", "name": "network-vif-plugged", "status": "completed", "tag": "fe92dd42-45aa-47d3-8b6c-2771c0f445f3"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:39.886020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f45df79-3c47-4e00-858d-1d8e40ae609d req-75f60def-b386-46b3-a56f-7a47a4e451bd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:39.887057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f45df79-3c47-4e00-858d-1d8e40ae609d req-75f60def-b386-46b3-a56f-7a47a4e451bd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:39.887525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9f45df79-3c47-4e00-858d-1d8e40ae609d req-75f60def-b386-46b3-a56f-7a47a4e451bd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:39.907602 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9f45df79-3c47-4e00-858d-1d8e40ae609d req-75f60def-b386-46b3-a56f-7a47a4e451bd service nova] Creating event network-vif-plugged:fe92dd42-45aa-47d3-8b6c-2771c0f445f3 for instance 9fbd4722-14fb-4975-9b11-158d5b762d35 on n-h1-858238-3 Nov 02 14:26:39.914112 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9f45df79-3c47-4e00-858d-1d8e40ae609d req-75f60def-b386-46b3-a56f-7a47a4e451bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044572 Nov 02 14:26:39.915160 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1959/5881] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:40.268793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:40.270120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:40.271063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e858581b-f11a-47f1-b890-0786e1e1cef5 req-04b8d413-578f-45e4-8d62-cdc6db601424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3e69f8-cff4-4271-a688-aa8526712327", "tag": "b599cc05-7f38-48c0-9955-f4aa975b28fc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:40.282378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.282937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.283499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.284258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.284766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.285438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.292819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e858581b-f11a-47f1-b890-0786e1e1cef5 req-04b8d413-578f-45e4-8d62-cdc6db601424 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.293587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e858581b-f11a-47f1-b890-0786e1e1cef5 req-04b8d413-578f-45e4-8d62-cdc6db601424 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.294227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e858581b-f11a-47f1-b890-0786e1e1cef5 req-04b8d413-578f-45e4-8d62-cdc6db601424 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.314107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:26:40.315065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e858581b-f11a-47f1-b890-0786e1e1cef5 req-04b8d413-578f-45e4-8d62-cdc6db601424 service nova] Creating event network-changed:b599cc05-7f38-48c0-9955-f4aa975b28fc for instance cf3e69f8-cff4-4271-a688-aa8526712327 on n-h1-858238-3 Nov 02 14:26:40.320667 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e858581b-f11a-47f1-b890-0786e1e1cef5 req-04b8d413-578f-45e4-8d62-cdc6db601424 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053191 Nov 02 14:26:40.327299 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1960/5882] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:26:40.333551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:40.334272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:40.341178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.341683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.342132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.342842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.343346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.343784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.453008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3437148e-df06-465e-963e-ff9aad6ee48b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 204 len: 0 microversion: 2.1 time: 0.188997 Nov 02 14:26:40.454132 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3923/5883] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:26:40 2022] DELETE /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:26:40.461651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:40.462788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:40.473946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.475802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.477267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.479666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.480630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.481303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.690868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:40.703188 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-df795bc2-371e-4798-a656-8fa0cbbb374d tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.373596 Nov 02 14:26:40.704077 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1961/5884] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:40 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:40.722673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:40.723325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:40.736577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.737638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.738245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.739168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.739788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.740382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.761590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:40.773364 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2bb30da1-c7b9-4726-9f12-4f768d85c5ae tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1501 microversion: 2.1 time: 0.316954 Nov 02 14:26:40.788975 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3924/5885] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:40 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:40.802373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:40.803131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:40.811614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.812205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.812708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.813504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:40.814245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:40.814949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:40.968094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:40.977809 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb0b1f80-6cce-4bca-ad69-a03c556753d1 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1579 microversion: 2.1 time: 0.259817 Nov 02 14:26:40.978663 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1962/5886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:40 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1579 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:41.090347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:41.100182 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e1c3c66e-6b90-4f93-8c55-6cfcbe013825 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1501 microversion: 2.1 time: 0.304191 Nov 02 14:26:41.104650 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3925/5887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:40 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1501 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:41.127511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:41.129014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:41.147265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:41.147265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:41.147265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:41.147265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:41.147265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:41.147265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:41.169279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lazy-loading 'flavor' on Instance uuid 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:26:41.253325 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0090d139-ca86-4742-a33c-82e124f011e6 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action" status: 202 len: 0 microversion: 2.1 time: 0.129778 Nov 02 14:26:41.254109 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1963/5888] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:26:41 2022] POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:41.262799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:41.263592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:41.271200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:41.271806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:41.272117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:41.272832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:41.275018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:41.275702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:41.512618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:41.520950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a382e2c1-e2f7-4396-be12-9d24bcefb8fc tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1509 microversion: 2.1 time: 0.262465 Nov 02 14:26:41.521856 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3926/5889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:41 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:41.727532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:41.728203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:41.736775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:41.737102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:41.737623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:41.738425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:41.738987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:41.739505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:41.880403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:41.889469 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76858699-5cb7-4c37-b56d-2d7721dcfa7b tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.166378 Nov 02 14:26:41.890145 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1964/5890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:41 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:42.002480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:42.003133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:42.009297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:42.009767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:42.010204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:42.010943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:42.011946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:42.012367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:42.152069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:42.160281 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6893892d-711a-43c6-a4d9-8c8a8959337b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1579 microversion: 2.1 time: 0.161839 Nov 02 14:26:42.160877 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3927/5891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:41 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:42.547680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:42.548493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:42.555552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:42.556133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:42.556669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:42.557481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:42.558531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:42.559043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:42.716036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:42.724979 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-810acde9-7151-4aa6-b66e-81de82b840c4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1509 microversion: 2.1 time: 0.180959 Nov 02 14:26:42.725581 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1965/5892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:42 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:42.914304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:42.915036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:42.922720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:42.923629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:42.924237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:42.924935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:42.925385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:42.926087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:43.091537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:43.135568 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad12d3d1-c8d5-42c1-8329-cc53bfc3f4f5 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1319 microversion: 2.1 time: 0.227046 Nov 02 14:26:43.136727 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3928/5893] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:42 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:43.186220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:43.186877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:43.194446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:43.194952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:43.195420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:43.196330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:43.196796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:43.197240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:43.448011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:43.459707 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-402f07d8-8623-4320-a6b7-c9f35adde68d tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1579 microversion: 2.1 time: 0.279651 Nov 02 14:26:43.462840 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1966/5894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:43 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1579 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:43.753180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:43.754064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:43.761487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:43.767382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:43.768446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:43.769051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:43.771923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:43.772625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:43.775990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:43.996762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1e4b9e52-058c-49a1-b48a-88b8ec9952a8 req-8004caf2-ddcf-4e81-99a5-921ec679a5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3e69f8-cff4-4271-a688-aa8526712327", "name": "network-vif-deleted", "tag": "b599cc05-7f38-48c0-9955-f4aa975b28fc"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:44.016027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1e4b9e52-058c-49a1-b48a-88b8ec9952a8 req-8004caf2-ddcf-4e81-99a5-921ec679a5bc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.016883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1e4b9e52-058c-49a1-b48a-88b8ec9952a8 req-8004caf2-ddcf-4e81-99a5-921ec679a5bc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.017557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1e4b9e52-058c-49a1-b48a-88b8ec9952a8 req-8004caf2-ddcf-4e81-99a5-921ec679a5bc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.045232 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1e4b9e52-058c-49a1-b48a-88b8ec9952a8 req-8004caf2-ddcf-4e81-99a5-921ec679a5bc service nova] Creating event network-vif-deleted:b599cc05-7f38-48c0-9955-f4aa975b28fc for instance cf3e69f8-cff4-4271-a688-aa8526712327 on n-h1-858238-3 Nov 02 14:26:44.061377 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1e4b9e52-058c-49a1-b48a-88b8ec9952a8 req-8004caf2-ddcf-4e81-99a5-921ec679a5bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068968 Nov 02 14:26:44.062242 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1967/5895] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:26:44.068214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:44.078047 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7fb757f-575a-4b58-b306-38f17941b3da tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1492 microversion: 2.1 time: 0.332602 Nov 02 14:26:44.079181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3929/5896] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:43 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1492 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:44.102521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:44.103199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:44.110498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.110820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.111282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.112223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.112845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.113439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.158417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:44.159207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:44.171216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.171708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.172215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.172978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.179652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.180186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.242262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a8a34d23-9bec-46b8-9246-ec401dce7520 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action" status: 202 len: 0 microversion: 2.1 time: 0.143248 Nov 02 14:26:44.246587 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1968/5897] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:26:44 2022] POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:44.260080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:44.261196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:44.269443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.271232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.272643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.273861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.274906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.276920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.602621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:44.613866 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe609a60-a50f-4b1d-ab59-29160f5da7de tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1508 microversion: 2.1 time: 0.458725 Nov 02 14:26:44.615041 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3930/5898] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:44 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:44.620827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:44.621640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:44.630725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.631479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.632624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.633475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.634238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.634917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.682573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:44.693883 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47acbc2f-4246-479c-8fcb-19d80b671dc2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1498 microversion: 2.1 time: 0.445416 Nov 02 14:26:44.700338 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1969/5899] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:44 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1498 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:44.722750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12e058ff-5602-44a8-bf55-beeef6db6f2b", "device": "/dev/sdb"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:44.725511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:44.736633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.740056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.740710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.741455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:44.741928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:44.743052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:44.767193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:44.791743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:44.807252 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a871deaf-c85e-4f5a-a264-c1f5a0d2ab76 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1225 microversion: 2.1 time: 0.190893 Nov 02 14:26:44.808175 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3931/5900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:44 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:45.116127 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d47b553-fd1c-40b2-b9fc-49b26dbc3378 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "POST /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397378 Nov 02 14:26:45.118099 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1970/5901] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:26:44 2022] POST /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:45.724782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:45.725952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:45.735944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.743826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.750136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.751177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.751813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.752404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.835541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:45.836190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:45.854816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.868094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.875887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.876936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.877589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.878585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:46.052143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:46.065459 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e143c540-eb1f-49f5-8113-0bf640aca44b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1225 microversion: 2.1 time: 0.235268 Nov 02 14:26:46.066064 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1971/5902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:45 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1225 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:46.108701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:46.118839 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c7c6f633-859c-4985-96c1-9b177a888c94 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1498 microversion: 2.1 time: 0.397961 Nov 02 14:26:46.136704 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3932/5903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:45 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1498 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:47.096745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:47.098048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:47.105975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.106611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.107186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.107994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.108718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.109253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.141831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:47.143340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:47.149933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.150775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.152036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.152878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.153431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.153958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.198361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:47.208949 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-faff9145-3d44-42d3-b2d8-16ee6a334d7e tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1225 microversion: 2.1 time: 0.115853 Nov 02 14:26:47.210336 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1972/5904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:47 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:47.368435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:47.377025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cff6fd09-7cf9-49e9-bece-485640eb80d4 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1501 microversion: 2.1 time: 0.239002 Nov 02 14:26:47.377613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3933/5905] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:47 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:47.400006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:47.400487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:47.425378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.426093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.426685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.427623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.428207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.428987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.466784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lazy-loading 'flavor' on Instance uuid 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:26:47.564606 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9c537cae-88c0-4c2c-8b1e-1d29ac6101f5 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action" status: 202 len: 0 microversion: 2.1 time: 0.166999 Nov 02 14:26:47.568163 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1973/5906] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:26:47 2022] POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:47.574600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:47.575780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:47.583813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.584542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.585358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.586334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:47.586951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:47.587561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.737703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:47.746258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cbe8c01c-00ea-4e70-a322-3bdb3b8e37c2 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1509 microversion: 2.1 time: 0.176145 Nov 02 14:26:47.746934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3934/5907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:47 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:48.233520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:48.234777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:48.242588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:48.243386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:48.244145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:48.256960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:48.261662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:48.262373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:48.383129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:48.409133 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d584c63f-fb15-4b69-870d-902c2e542531 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1225 microversion: 2.1 time: 0.176492 Nov 02 14:26:48.410302 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1974/5908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:48 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1225 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:48.769462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:48.770192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:48.781741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:48.783745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:48.784090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:48.784812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:48.785269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:48.785694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.432759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:49.433415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:49.445664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:49.450595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.451116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.451562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.452350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.452717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.453263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.458106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:49.465299 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3eef385e-c254-4d19-819b-46fc57755850 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1492 microversion: 2.1 time: 0.699726 Nov 02 14:26:49.469996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3935/5909] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:48 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1492 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:49.498289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:49.499242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:49.514038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.514846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.519866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.521323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.522086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.523199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.544219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.544721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.545168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.545636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lazy-loading 'fault' on Instance uuid cf3e69f8-cff4-4271-a688-aa8526712327 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:26:49.638884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860e9448f87e41728d6860fdc9a6b789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b1baae32814f429be499c2a9441613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:49.646607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b96692f-4567-496e-9c0e-7325169b7328 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action" status: 202 len: 0 microversion: 2.1 time: 0.154827 Nov 02 14:26:49.648141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3936/5910] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:26:49 2022] POST /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:49.653954 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3d0cc791-7214-4de0-8a27-098bd1109bcf tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 200 len: 1230 microversion: 2.1 time: 0.225453 Nov 02 14:26:49.667497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1975/5911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:49 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 1230 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:26:49.672907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:49.673822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:49.680599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.681514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.682168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.683036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.683664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.684406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:50.200628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:50.209505 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49b2bf59-d7c4-47f0-a179-bef88eda93d7 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1498 microversion: 2.1 time: 0.554461 Nov 02 14:26:50.210342 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3937/5912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:49 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1498 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:50.679531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:50.680643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: cf3e69f8-cff4-4271-a688-aa8526712327] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:50.692649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:50.693471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:50.694072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:50.694967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:50.695615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:50.696201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:50.715470 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance cf3e69f8-cff4-4271-a688-aa8526712327 could not be found. Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 HTTP/1.1 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance cf3e69f8-cff4-4271-a688-aa8526712327 could not be found. Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'cf3e69f8-cff4-4271-a688-aa8526712327'} Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3e69f8-cff4-4271-a688-aa8526712327 could not be found. Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3e69f8-cff4-4271-a688-aa8526712327 could not be found. Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:50.717423 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3e69f8-cff4-4271-a688-aa8526712327 could not be found. Nov 02 14:26:50.722674 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:50.724360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance cf3e69f8-cff4-4271-a688-aa8526712327 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:26:50.725596 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2449fc09-9bd5-4230-ba9a-08eb91be26c3 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327" status: 404 len: 111 microversion: 2.1 time: 0.050943 Nov 02 14:26:50.730234 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1976/5913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:50 2022] GET /compute/v2.1/servers/cf3e69f8-cff4-4271-a688-aa8526712327 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:26:51.242648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:51.243722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:51.259447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.260800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.261429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.262371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.262892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.263353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.275145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:51.276069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:51.282198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.282703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.283507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.284213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.284687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.285130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.300319 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd HTTP/1.1 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2625cd05-1243-40c4-935e-27195ba7fbbd'} Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:26:51.302179 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.307933 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.311085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:26:51.312210 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bbec28ac-fd6d-4f59-9a79-0011d8e63b2b tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 404 len: 111 microversion: 2.1 time: 0.041130 Nov 02 14:26:51.313271 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1977/5914] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:26:51 2022] DELETE /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:26:51.325570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:51.326211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] [instance: 2625cd05-1243-40c4-935e-27195ba7fbbd] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:51.333582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.334098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.334693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.335667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.336471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.337449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.355207 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] HTTP exception thrown: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Request method failure captured: Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd HTTP/1.1 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYnoOD1vTf2ETlH-oJFT7bQY0U3XwvKVxh3Cn9JW4c3Drqt7FEYYXuPIQe3CPDusjdpQQljFbvCn8WX-Al4rFGUZ6KmSwi535LHkhpnr7lXJ6PVxsOCHlbmHkvJ06ytIyDUpQigyhqe1zvGu8QUZlMxwjFcaGqE4H9Hy0rzolMwUjx0o Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/91b1baae32814f429be499c2a9441613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/91b1baae32814f429be499c2a9441613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_91b1baae32814f429be499c2a9441613"}]}] Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 91b1baae32814f429be499c2a9441613 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732748369 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 860e9448f87e41728d6860fdc9a6b789 Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestVolumeBootPattern-1732748369-project Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2625cd05-1243-40c4-935e-27195ba7fbbd'} Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:51.356777 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Returning 404 to user: Instance 2625cd05-1243-40c4-935e-27195ba7fbbd could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:26:51.361765 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-86346750-75c0-4c38-854f-b1a1502adf9c tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd" status: 404 len: 111 microversion: 2.1 time: 0.036864 Nov 02 14:26:51.364226 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1978/5915] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:51 2022] GET /compute/v2.1/servers/2625cd05-1243-40c4-935e-27195ba7fbbd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:26:51.574139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:51.587458 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0443d336-2a19-4fe2-b501-5f40dc5af432 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1498 microversion: 2.1 time: 0.346952 Nov 02 14:26:51.589277 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3938/5916] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:51 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1498 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:52.617649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:52.618275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:52.628855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:52.629362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:52.629814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:52.630531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:52.631225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:52.631836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:52.790062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:52.802093 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c56cf86a-6a41-4d57-84dc-adc603c51b3a tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1501 microversion: 2.1 time: 0.187952 Nov 02 14:26:52.802997 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1979/5917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:52 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:52.827380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:52.827943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:52.836198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:52.836695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:52.837132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:52.837852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:52.838365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:52.838801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:52.867372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:26:53.006086 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca0964eb-b71f-4a61-8604-e1e88bee41ea tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 204 len: 0 microversion: 2.1 time: 0.182403 Nov 02 14:26:53.007260 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3939/5918] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:26:52 2022] DELETE /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:26:53.015911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:53.017610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:53.028840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:53.029456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:53.029992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:53.032200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:53.033187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:53.033835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:53.285430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:53.295986 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c9d8393c-aad8-4ebe-b447-4e942abb3517 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1507 microversion: 2.1 time: 0.283889 Nov 02 14:26:53.297057 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1980/5919] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:53 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:54.326236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:54.327628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:54.336600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:54.337267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:54.338433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:54.341563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:54.342766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:54.343267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:54.597609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:54.605820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17312170-f143-40d0-a15a-ddcfa07bd702 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1507 microversion: 2.1 time: 0.287513 Nov 02 14:26:54.606417 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3940/5920] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:54 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:55.633948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:55.635978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:55.643553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:55.644424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:55.645116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:55.646095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:55.646792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:55.647498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:55.988047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:55.998721 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79de9932-bb3c-4207-9710-b91873698097 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1507 microversion: 2.1 time: 0.368622 Nov 02 14:26:55.999949 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1981/5921] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:55 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:56.234921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-74ae13af-b824-4ad1-ab91-527013036cb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] Calling method '.version_select at 0x7f6f8043fc10>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:56.298986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-74ae13af-b824-4ad1-ab91-527013036cb0 tempest-TestVolumeBootPattern-1732748369 tempest-TestVolumeBootPattern-1732748369-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-489749758" status: 202 len: 0 microversion: 2.1 time: 0.066905 Nov 02 14:26:56.307418 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3941/5922] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 14:26:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-489749758 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:56.596263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6e1429de-841f-4e25-b533-175b6970121e req-855e400a-cf61-4cc9-8ed3-0dc8f3994932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc", "name": "network-vif-deleted", "tag": "e8cd0b9d-753b-466e-b2b9-b237ac9f5428"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:56.611631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6e1429de-841f-4e25-b533-175b6970121e req-855e400a-cf61-4cc9-8ed3-0dc8f3994932 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:56.612343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6e1429de-841f-4e25-b533-175b6970121e req-855e400a-cf61-4cc9-8ed3-0dc8f3994932 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:56.613082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6e1429de-841f-4e25-b533-175b6970121e req-855e400a-cf61-4cc9-8ed3-0dc8f3994932 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:56.627408 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6e1429de-841f-4e25-b533-175b6970121e req-855e400a-cf61-4cc9-8ed3-0dc8f3994932 service nova] Creating event network-vif-deleted:e8cd0b9d-753b-466e-b2b9-b237ac9f5428 for instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc on n-h1-858238-3 Nov 02 14:26:56.634888 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6e1429de-841f-4e25-b533-175b6970121e req-855e400a-cf61-4cc9-8ed3-0dc8f3994932 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043729 Nov 02 14:26:56.640381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1982/5923] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:57.030003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:57.030615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:57.045175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:57.046973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:57.047624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:57.048556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:57.049017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:57.049447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:57.089069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:57.089567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:57.090279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:57.091088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lazy-loading 'fault' on Instance uuid 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:26:57.140908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82edaf2f6e2490491f82ec807318e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3965975c9d4d8bb314a577e8220bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:57.149708 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e548ef2-e7b4-4569-b665-ef7756b88c3b tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 200 len: 1305 microversion: 2.1 time: 0.123600 Nov 02 14:26:57.150371 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3942/5924] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:57 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:58.174850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:58.176957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] [instance: 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:58.184274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:58.185052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:58.185502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:58.186220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:58.186715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:58.187167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:58.203814 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] HTTP exception thrown: Instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc could not be found. Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Request method failure captured: Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc HTTP/1.1 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn4OvJla7EAh-qL6a3Y0h6irHoTEb7qoNim4YHY67XRu25Pz1t51umJzkE1VOZ67TOvJ3sx7P656L7CcTdi_OFe0HsHqcwRLXb5j3JLEKfxXR7UB181ddusDAmJlgAKgRaTOLpb7J-qnYS0-UwCNofu-v7PQw3yd2gdi2XwNWruorR8 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: dd3965975c9d4d8bb314a577e8220bff Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestServerAdvancedOps-400224569 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd3965975c9d4d8bb314a577e8220bff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dd3965975c9d4d8bb314a577e8220bff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dd3965975c9d4d8bb314a577e8220bff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dd3965975c9d4d8bb314a577e8220bff"}]}] Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestServerAdvancedOps-400224569 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: dd3965975c9d4d8bb314a577e8220bff Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestServerAdvancedOps-400224569 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestServerAdvancedOps-400224569-project Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: c82edaf2f6e2490491f82ec807318e93 Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestServerAdvancedOps-400224569-project Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc could not be found. Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc'} Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc could not be found. Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc could not be found. Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:26:58.205532 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc could not be found. Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] Returning 404 to user: Instance 6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-974204df-d014-4d9f-b5ec-b0d8d92f3b53 tempest-TestServerAdvancedOps-400224569 tempest-TestServerAdvancedOps-400224569-project] 10.222.0.18 "GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc" status: 404 len: 111 microversion: 2.1 time: 0.037752 Nov 02 14:26:58.214878 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1983/5925] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:26:58 2022] GET /compute/v2.1/servers/6c6d66f8-08e3-4cd3-b21c-97fb11ba30bc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:27:18.389953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:18.390748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:18.398621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:18.405447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:18.407243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:18.407742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:18.408175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:18.408918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:18.409454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:18.409903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:18.607924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lazy-loading 'services' on Instance uuid 9fbd4722-14fb-4975-9b11-158d5b762d35 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:27:18.775833 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03b83da5-f743-43c2-bfec-6a46e93ccc6c tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35/os-volume_attachments/12e058ff-5602-44a8-bf55-beeef6db6f2b" status: 202 len: 0 microversion: 2.1 time: 0.390326 Nov 02 14:27:18.776799 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3943/5926] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:27:18 2022] DELETE /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35/os-volume_attachments/12e058ff-5602-44a8-bf55-beeef6db6f2b => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:27:25.857023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:25.858880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:25.861938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=55 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:25.865790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:25.873261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:25.875405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:25.875861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:25.876588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:25.877059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:25.880434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:25.919268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:27:26.040007 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c93c8df2-1812-4ef2-821b-c9a261e6dc93 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 204 len: 0 microversion: 2.1 time: 0.192295 Nov 02 14:27:26.041071 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1984/5927] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:27:25 2022] DELETE /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:27:26.058744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:26.059484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:26.075908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:26.076393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:26.077014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:26.077881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:26.078332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:26.078793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:26.264915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:26.279211 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-303d5da5-364a-433d-9f62-c87be12e46d2 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1514 microversion: 2.1 time: 0.232840 Nov 02 14:27:26.280603 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3944/5928] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:26 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:27.305800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:27.306613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:27.313922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.314338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.314975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.315728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.316187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.316784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.469965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:27.483294 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d42573ae-1d14-4a35-be9e-4f1e8ac5bbc9 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1514 microversion: 2.1 time: 0.181029 Nov 02 14:27:27.483883 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1985/5929] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:27 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:28.511522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:28.512483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:28.525004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:28.525317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:28.525753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:28.526443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:28.526896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:28.527498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:28.658203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d27233e55e4238a041ed752bdcff40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19a1ce6ca94d4db1ac6ab7edf27804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:28.672528 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-216c01a3-6269-4223-b385-bd696fd939d0 tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 200 len: 1472 microversion: 2.1 time: 0.165778 Nov 02 14:27:28.672528 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3945/5930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:28 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:28.681194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-af5151ac-6f00-4217-a196-091b2e38e986 req-624bf2e8-daf9-4612-ada2-8d7366c6dcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbd4722-14fb-4975-9b11-158d5b762d35", "name": "network-vif-deleted", "tag": "fe92dd42-45aa-47d3-8b6c-2771c0f445f3"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:28.692719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-af5151ac-6f00-4217-a196-091b2e38e986 req-624bf2e8-daf9-4612-ada2-8d7366c6dcd2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:28.693241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-af5151ac-6f00-4217-a196-091b2e38e986 req-624bf2e8-daf9-4612-ada2-8d7366c6dcd2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:28.694773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-af5151ac-6f00-4217-a196-091b2e38e986 req-624bf2e8-daf9-4612-ada2-8d7366c6dcd2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:28.709850 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-af5151ac-6f00-4217-a196-091b2e38e986 req-624bf2e8-daf9-4612-ada2-8d7366c6dcd2 service nova] Creating event network-vif-deleted:fe92dd42-45aa-47d3-8b6c-2771c0f445f3 for instance 9fbd4722-14fb-4975-9b11-158d5b762d35 on n-h1-858238-3 Nov 02 14:27:28.715628 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-af5151ac-6f00-4217-a196-091b2e38e986 req-624bf2e8-daf9-4612-ada2-8d7366c6dcd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040469 Nov 02 14:27:28.716480 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1986/5931] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:29.695716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:29.696680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] [instance: 9fbd4722-14fb-4975-9b11-158d5b762d35] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:29.706384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:29.707217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:29.707851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:29.708651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:29.709174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:29.710217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:29.726525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] HTTP exception thrown: Instance 9fbd4722-14fb-4975-9b11-158d5b762d35 could not be found. Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Request method failure captured: Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 HTTP/1.1 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn1jfHxPD3xgcuEXvivD4o8P9DtQ2SIQqHJ7g-fqMYs7tTLwOjAf3NSXDYA0QBW6sdetJW-M7aKDO2whRaoYb964xSki1SwX8HVD1-dap1IyfGQSLsuzbBFrgIEaGlvjhtlXzsyHbyH3v2ZzoEUyVVzDPYMLQqVr5TPz6GAU9EJML34 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: cb19a1ce6ca94d4db1ac6ab7edf27804 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1165329999 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb19a1ce6ca94d4db1ac6ab7edf27804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cb19a1ce6ca94d4db1ac6ab7edf27804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cb19a1ce6ca94d4db1ac6ab7edf27804"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cb19a1ce6ca94d4db1ac6ab7edf27804"}]}] Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesSnapshotTestJSON-1165329999 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: cb19a1ce6ca94d4db1ac6ab7edf27804 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1165329999 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesSnapshotTestJSON-1165329999-project Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 20d27233e55e4238a041ed752bdcff40 Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesSnapshotTestJSON-1165329999-project Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 9fbd4722-14fb-4975-9b11-158d5b762d35 could not be found. Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '9fbd4722-14fb-4975-9b11-158d5b762d35'} Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbd4722-14fb-4975-9b11-158d5b762d35 could not be found. Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbd4722-14fb-4975-9b11-158d5b762d35 could not be found. Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:27:29.728398 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbd4722-14fb-4975-9b11-158d5b762d35 could not be found. Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] Returning 404 to user: Instance 9fbd4722-14fb-4975-9b11-158d5b762d35 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:27:29.734104 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6c2e11f6-4c56-4671-b215-c3eae021d5ac tempest-VolumesSnapshotTestJSON-1165329999 tempest-VolumesSnapshotTestJSON-1165329999-project] 10.222.0.18 "GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35" status: 404 len: 111 microversion: 2.1 time: 0.039704 Nov 02 14:27:29.735248 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3946/5932] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:29 2022] GET /compute/v2.1/servers/9fbd4722-14fb-4975-9b11-158d5b762d35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:27:46.488682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:46.489977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:46.495517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-976310817", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:46.552358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] validate_networks() for None {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:27:46.866908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:27:46.866908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:27:46.867233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:27:46.867726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:27:46.868219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:27:46.878239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:46.878849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:46.879431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:46.881240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:46.881934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:46.882466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:46.901227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Getting quotas for project d1848b03f0bd49c9802747e0e7f239a6. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:27:46.906836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Getting quotas for user 31ad20b21d9b4200ba8839725b4bac68 and project d1848b03f0bd49c9802747e0e7f239a6. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:27:46.920221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:27:46.923055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:27:46.972065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1d95be6a-0a29-4743-8015-b9e8bda96a29 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485215 Nov 02 14:27:46.978789 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1987/5933] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:27:46.992738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efb2482e-a1cd-4abe-bf42-9ad9897797fb tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:46.993352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efb2482e-a1cd-4abe-bf42-9ad9897797fb tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:46.996032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:46.997397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:47.064001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efb2482e-a1cd-4abe-bf42-9ad9897797fb tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:47.072015 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efb2482e-a1cd-4abe-bf42-9ad9897797fb tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1214 microversion: 2.1 time: 0.091846 Nov 02 14:27:47.073841 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3947/5934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:46 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:48.096954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:48.097488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:48.105127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.105630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.106078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.106789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.107293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.107741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.182277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:48.192546 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-66ebdcde-3e88-4106-b8a0-da28ef0c098e tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1266 microversion: 2.1 time: 0.100301 Nov 02 14:27:48.193967 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1988/5935] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:48 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:49.219756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:49.221223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:49.231114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:49.231914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:49.232786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:49.233687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:49.234758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:49.235381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:49.448788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:49.456865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-83f9deae-f444-473f-8552-510a1114ba0d tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.243731 Nov 02 14:27:49.457446 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3948/5936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:49 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:50.067086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-0c9208a7-e29b-4481-b12e-014f952c8b17 req-21d4dd07-4671-44fa-b46d-3ac5d2a0a815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6910f5-abb6-4313-a171-75135c52c648", "tag": "6999b700-3eef-4118-b2a1-08f53b4773ca"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:50.080891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0c9208a7-e29b-4481-b12e-014f952c8b17 req-21d4dd07-4671-44fa-b46d-3ac5d2a0a815 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:50.081664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0c9208a7-e29b-4481-b12e-014f952c8b17 req-21d4dd07-4671-44fa-b46d-3ac5d2a0a815 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:50.083408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0c9208a7-e29b-4481-b12e-014f952c8b17 req-21d4dd07-4671-44fa-b46d-3ac5d2a0a815 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:50.108247 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-0c9208a7-e29b-4481-b12e-014f952c8b17 req-21d4dd07-4671-44fa-b46d-3ac5d2a0a815 service nova] Creating event network-changed:6999b700-3eef-4118-b2a1-08f53b4773ca for instance bc6910f5-abb6-4313-a171-75135c52c648 on n-h1-858238-3 Nov 02 14:27:50.114939 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-0c9208a7-e29b-4481-b12e-014f952c8b17 req-21d4dd07-4671-44fa-b46d-3ac5d2a0a815 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053520 Nov 02 14:27:50.115952 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1989/5937] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:50.480490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:50.482135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:50.490902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:50.491686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:50.492300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:50.493172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:50.493836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:50.494670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:50.970769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:50.982201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db5e2272-f99e-4fd7-af30-b8cd94ddb0c0 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.506041 Nov 02 14:27:50.983262 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3949/5938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:50 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:27:52.014166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:52.014890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:52.022713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:52.023257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:52.023711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:52.024430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:52.024904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:52.025349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:52.289515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:52.299428 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a05dff40-a48f-4e2b-8d3c-17f116428909 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.290661 Nov 02 14:27:52.300550 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1990/5939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:52 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:53.323534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:53.324757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:53.332723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:53.333438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:53.334047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:53.334736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:53.335379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:53.335946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:53.520380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:53.528904 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-14bf7ee6-44bc-48f3-b63d-0fe157052fbe tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.209265 Nov 02 14:27:53.543653 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3950/5940] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:53 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:54.554755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:54.555336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:54.562763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:54.563312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:54.563786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:54.564522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:54.564986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:54.565417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:54.723158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:54.739305 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5874c749-e559-48e8-9670-1b7f4bca3e25 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.188657 Nov 02 14:27:54.740203 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1991/5941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:54 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:55.764060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:55.764680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:55.772399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:55.773137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:55.773728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:55.774570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:55.775206 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:55.775782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:55.964672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5119550c-e6ec-4413-a543-b435efc289dc req-5d225892-ee0e-484e-8739-c728b643dae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6910f5-abb6-4313-a171-75135c52c648", "name": "network-vif-plugged", "status": "completed", "tag": "6999b700-3eef-4118-b2a1-08f53b4773ca"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:55.979768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5119550c-e6ec-4413-a543-b435efc289dc req-5d225892-ee0e-484e-8739-c728b643dae2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:55.980245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5119550c-e6ec-4413-a543-b435efc289dc req-5d225892-ee0e-484e-8739-c728b643dae2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:55.982018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5119550c-e6ec-4413-a543-b435efc289dc req-5d225892-ee0e-484e-8739-c728b643dae2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:56.030115 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5119550c-e6ec-4413-a543-b435efc289dc req-5d225892-ee0e-484e-8739-c728b643dae2 service nova] Creating event network-vif-plugged:6999b700-3eef-4118-b2a1-08f53b4773ca for instance bc6910f5-abb6-4313-a171-75135c52c648 on n-h1-858238-3 Nov 02 14:27:56.042910 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5119550c-e6ec-4413-a543-b435efc289dc req-5d225892-ee0e-484e-8739-c728b643dae2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082374 Nov 02 14:27:56.047971 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1992/5942] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:56.063119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:56.073075 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9825077-1e6e-438c-8dd9-715fd497e507 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.312721 Nov 02 14:27:56.075063 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3951/5943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:55 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:57.098805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:57.100275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:57.102661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:57.103594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:57.111248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:57.112279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:57.112279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:57.115015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:57.115015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:57.115015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:57.267529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:57.284176 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3fac24a6-d28a-45b0-b54b-31462dd96866 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1314 microversion: 2.1 time: 0.190253 Nov 02 14:27:57.300401 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1993/5944] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:57 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:58.307585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:58.308110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:58.310834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:58.317047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:58.317527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:58.318026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:58.318722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:58.319202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:58.319623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:58.454615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:58.464153 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5518f277-2b9b-431f-83e8-dcbe8746ff1b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1463 microversion: 2.1 time: 0.160397 Nov 02 14:27:58.464859 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3952/5945] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:58 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:58.511956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:58.512471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:58.519508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:58.519997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:58.520447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:58.521149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:58.521617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:58.522163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:58.548336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:27:58.634229 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-014f45de-7863-46aa-a826-84c297c14870 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 204 len: 0 microversion: 2.1 time: 0.125776 Nov 02 14:27:58.635272 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1994/5946] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:27:58 2022] DELETE /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:27:58.645304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:58.646049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:58.653680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:58.654167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:58.654694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:58.655649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:58.656110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:58.656629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:58.813329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:58.822607 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b6ba37a-798a-4499-b1cc-dd6866ebac71 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1469 microversion: 2.1 time: 0.183031 Nov 02 14:27:58.823565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3953/5947] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:58 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:59.846900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:59.849076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:59.857487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:59.858066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:59.858731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:59.859846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:59.860527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:59.861033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.007180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:00.015973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38e8525c-13af-4481-bab0-e019e8f1331c tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1469 microversion: 2.1 time: 0.173551 Nov 02 14:28:00.016565 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1995/5948] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:27:59 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:28:00.854096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-753325d0-86d8-41b2-88c7-72e6eae4f57e req-9603165d-2f66-480b-b793-3b628e53ce2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6910f5-abb6-4313-a171-75135c52c648", "name": "network-vif-deleted", "tag": "6999b700-3eef-4118-b2a1-08f53b4773ca"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:00.870594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-753325d0-86d8-41b2-88c7-72e6eae4f57e req-9603165d-2f66-480b-b793-3b628e53ce2e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.871418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-753325d0-86d8-41b2-88c7-72e6eae4f57e req-9603165d-2f66-480b-b793-3b628e53ce2e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.872037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-753325d0-86d8-41b2-88c7-72e6eae4f57e req-9603165d-2f66-480b-b793-3b628e53ce2e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.887248 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-753325d0-86d8-41b2-88c7-72e6eae4f57e req-9603165d-2f66-480b-b793-3b628e53ce2e service nova] Creating event network-vif-deleted:6999b700-3eef-4118-b2a1-08f53b4773ca for instance bc6910f5-abb6-4313-a171-75135c52c648 on n-h1-858238-3 Nov 02 14:28:00.893632 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-753325d0-86d8-41b2-88c7-72e6eae4f57e req-9603165d-2f66-480b-b793-3b628e53ce2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042832 Nov 02 14:28:00.897475 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3954/5949] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:01.046662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:01.047482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:01.075231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:01.078926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:01.080053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:01.083126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:01.085768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:01.086259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:01.138388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:01.138963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:01.139597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:01.140282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lazy-loading 'fault' on Instance uuid bc6910f5-abb6-4313-a171-75135c52c648 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:28:01.196449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ad20b21d9b4200ba8839725b4bac68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1848b03f0bd49c9802747e0e7f239a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:01.209128 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0824aeea-6e3a-4132-9266-d92b15bdb7a4 tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 200 len: 1304 microversion: 2.1 time: 0.166912 Nov 02 14:28:01.209990 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1996/5950] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:01 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:02.238917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:02.239923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] [instance: bc6910f5-abb6-4313-a171-75135c52c648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:02.252399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:02.252879 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:02.253908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:02.260629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:02.261101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:02.261530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:02.289228 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] HTTP exception thrown: Instance bc6910f5-abb6-4313-a171-75135c52c648 could not be found. Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Request method failure captured: Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 HTTP/1.1 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn5gGQ9KJHRpp9TXSDZ_1LN3FzTe5Qf-zCYg0d7EWRwpYe_aOJuPvfd5YRfblId2fLzcrDgnC-htEDnyCLS4aTtsdgVLk1-o6fQ8YX8kvkjgXR-fzv8sTpznkOxo1c2KOKm7YWTGbd16JujJM0Qal8ik3f19x1G_yfgSynyeoYju8Bw Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: d1848b03f0bd49c9802747e0e7f239a6 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-VolumesNegativeTest-905926643 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d1848b03f0bd49c9802747e0e7f239a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d1848b03f0bd49c9802747e0e7f239a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d1848b03f0bd49c9802747e0e7f239a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d1848b03f0bd49c9802747e0e7f239a6"}]}] Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-VolumesNegativeTest-905926643 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: d1848b03f0bd49c9802747e0e7f239a6 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-VolumesNegativeTest-905926643 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-VolumesNegativeTest-905926643-project Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 31ad20b21d9b4200ba8839725b4bac68 Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-VolumesNegativeTest-905926643-project Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance bc6910f5-abb6-4313-a171-75135c52c648 could not be found. Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'bc6910f5-abb6-4313-a171-75135c52c648'} Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc6910f5-abb6-4313-a171-75135c52c648 could not be found. Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc6910f5-abb6-4313-a171-75135c52c648 could not be found. Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:02.290886 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc6910f5-abb6-4313-a171-75135c52c648 could not be found. Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] Returning 404 to user: Instance bc6910f5-abb6-4313-a171-75135c52c648 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:02.296805 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13b7f4fe-0387-4798-858c-e0f5a588d28b tempest-VolumesNegativeTest-905926643 tempest-VolumesNegativeTest-905926643-project] 10.222.0.18 "GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648" status: 404 len: 111 microversion: 2.1 time: 0.061430 Nov 02 14:28:02.298941 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3955/5951] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:02 2022] GET /compute/v2.1/servers/bc6910f5-abb6-4313-a171-75135c52c648 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:22.265023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:22.266396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:22.535723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-566d63e3-9a9a-4a5b-a556-fbf5d17b2052 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: .version_select at 0x7f6f85e66ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1207545379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7xZM6VTwyG627a7nrjpMndagSewfHt9QK5nRI1Q1UxgjXctYKULHoVhCy22kT9wL5r8zTHQyqedSgeUkSzUbOwNcAE1bKzFXKNoBv88CIzEqknqbrnFxNjstYmtTi/HA=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:22.551375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-566d63e3-9a9a-4a5b-a556-fbf5d17b2052 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:28:22.559930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-566d63e3-9a9a-4a5b-a556-fbf5d17b2052 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:28:22.586559 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-566d63e3-9a9a-4a5b-a556-fbf5d17b2052 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.326491 Nov 02 14:28:22.587644 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1997/5952] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:28:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:31.224597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc133f0e-ac3a-4e4b-985e-215ee62347dd tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'create', calling method: .version_select at 0x7f6f8039a430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-69565016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI5z0sq23d9K0d1nJNOS7r55UAW0zKFDNCvMC+6B1EuZ+4WsoToR3LF6agkB/XXBqzD9AoJGnR/iN2BkLtA7HtwyspS+St9hjdOlfovXgxAm0Sv1GOmyOk+Dlc4kfFsUA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:31.255244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=20 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:31.255952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=40 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:31.287618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fc133f0e-ac3a-4e4b-985e-215ee62347dd tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for project c2e6753524d84c849840fa530c8ed903. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:28:31.296802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-fc133f0e-ac3a-4e4b-985e-215ee62347dd tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for user e4c0bd6bb7f4427f8fb921ab79f26c8d and project c2e6753524d84c849840fa530c8ed903. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:28:31.369847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc133f0e-ac3a-4e4b-985e-215ee62347dd tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.149872 Nov 02 14:28:31.371275 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3956/5953] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:28:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:32.998140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:32.999333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:33.004713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2066312863", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "fe4d0caf-7177-4b91-a0b1-e8ace3c3ec40"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1207545379", "security_groups": [{"name": "tempest-secgroup-smoke-937270019"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:33.256181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] validate_networks() for [('fe4d0caf-7177-4b91-a0b1-e8ace3c3ec40', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:28:33.883480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1373505929", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "462eeed2-62f6-49de-a12b-2dfbdd313935"}], "key_name": "tempest-TestNetworkBasicOps-69565016", "security_groups": [{"name": "tempest-secgroup-smoke-1358407156"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:34.147989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:28:34.148530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:28:34.148892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:28:34.149323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:28:34.149739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:28:34.164036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] validate_networks() for [('462eeed2-62f6-49de-a12b-2dfbdd313935', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:28:34.165252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.165846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.166808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.167993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.174038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.177227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.221373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:28:34.230772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:28:34.269238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:28:34.279878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:28:34.389733 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-71e62dc5-777e-44cb-a156-dc9c65b84f1a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.393184 Nov 02 14:28:34.398182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1998/5954] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:28:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:28:34.403942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f8700f5d-61a9-4f90-8d5d-f7fc90058450 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:34.405382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f8700f5d-61a9-4f90-8d5d-f7fc90058450 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:34.598987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f8700f5d-61a9-4f90-8d5d-f7fc90058450 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:34.614987 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f8700f5d-61a9-4f90-8d5d-f7fc90058450 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1267 microversion: 2.1 time: 0.215185 Nov 02 14:28:34.618960 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 1999/5955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:34 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:34.933590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:28:34.934810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:28:34.935677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:28:34.936326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:28:34.936972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:28:34.949396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.950482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.951122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.952317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.957350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.957809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.993209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for project c2e6753524d84c849840fa530c8ed903. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:28:35.001092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for user e4c0bd6bb7f4427f8fb921ab79f26c8d and project c2e6753524d84c849840fa530c8ed903. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:28:35.021180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:28:35.024173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:28:35.139474 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-082120e2-ad6b-4d1e-8119-b199fbd33a77 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.264488 Nov 02 14:28:35.140726 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3957/5956] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:28:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:28:35.156327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-94617491-f16f-4cec-be72-89f19dc9188e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:35.160283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-94617491-f16f-4cec-be72-89f19dc9188e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:35.273618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-94617491-f16f-4cec-be72-89f19dc9188e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:35.287064 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-94617491-f16f-4cec-be72-89f19dc9188e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1247 microversion: 2.1 time: 0.138030 Nov 02 14:28:35.287689 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2000/5957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:35 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1247 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:35.646772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:35.651612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:35.667554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:35.670295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:35.671194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:35.672567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:35.673345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:35.673969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:35.761517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:35.776145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-95320785-dc54-472f-92fd-03a61ebb4e88 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1263 microversion: 2.1 time: 0.136930 Nov 02 14:28:35.792352 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3958/5958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:35 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:36.310989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:36.312340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:36.334058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.334583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.335045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.335819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.336298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.352752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.500373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:36.510874 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-83ea22c2-529b-4e3d-84d8-c39110b905ec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1243 microversion: 2.1 time: 0.203617 Nov 02 14:28:36.511837 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2001/5959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:36 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1243 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:36.802509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:36.803361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:36.810174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.811403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.812095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.813612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.814302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.814972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.918581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:36.943046 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-26f20c36-82d4-434e-b358-f6685d016b89 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1325 microversion: 2.1 time: 0.144638 Nov 02 14:28:36.947796 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3959/5960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:36 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1325 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:37.535939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:37.536725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:37.547015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:37.548174 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:37.548932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:37.550090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:37.550796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:37.551336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:37.722026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:37.735300 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a66c9c65-4768-4312-ae89-443e463a8b97 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1305 microversion: 2.1 time: 0.204239 Nov 02 14:28:37.736214 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2002/5961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:37 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:37.971190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:37.972493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:37.979595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:37.980086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:37.981207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:37.982161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:37.982814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:37.983557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:38.221477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:38.240883 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-21169b2a-1acf-42b2-be77-9f7ed4f8ac7f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1392 microversion: 2.1 time: 0.274675 Nov 02 14:28:38.243793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3960/5962] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:37 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:38.697677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-96fe49ca-c7a4-4e5a-a311-7a3689e71074 req-a55b1146-c820-44a1-a439-42ebca3bf789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:38.723296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-96fe49ca-c7a4-4e5a-a311-7a3689e71074 req-a55b1146-c820-44a1-a439-42ebca3bf789 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:38.723787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-96fe49ca-c7a4-4e5a-a311-7a3689e71074 req-a55b1146-c820-44a1-a439-42ebca3bf789 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:38.724225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-96fe49ca-c7a4-4e5a-a311-7a3689e71074 req-a55b1146-c820-44a1-a439-42ebca3bf789 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:38.752529 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-96fe49ca-c7a4-4e5a-a311-7a3689e71074 req-a55b1146-c820-44a1-a439-42ebca3bf789 service nova] Creating event network-changed:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h1-858238-3 Nov 02 14:28:38.763057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:38.763979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:38.776567 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-96fe49ca-c7a4-4e5a-a311-7a3689e71074 req-a55b1146-c820-44a1-a439-42ebca3bf789 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073185 Nov 02 14:28:38.777778 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2003/5963] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:38.779382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:38.780067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:38.780667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:38.782242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:38.782961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:38.784044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.071596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:39.082391 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6364295a-2072-473f-a320-d7eb9ac2d2a0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.323138 Nov 02 14:28:39.082982 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3961/5964] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:38 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:39.193296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-83995e17-1f6c-40f3-a030-10f259872be8 req-e58fd9d9-1d2a-4539-ac52-07aa01fdf575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016ec747-11c4-4847-99a3-7ccc7727f06c", "tag": "19c2d978-2a3c-495d-abd2-53caf473a477"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:39.204864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-83995e17-1f6c-40f3-a030-10f259872be8 req-e58fd9d9-1d2a-4539-ac52-07aa01fdf575 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:39.205461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-83995e17-1f6c-40f3-a030-10f259872be8 req-e58fd9d9-1d2a-4539-ac52-07aa01fdf575 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:39.205905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-83995e17-1f6c-40f3-a030-10f259872be8 req-e58fd9d9-1d2a-4539-ac52-07aa01fdf575 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.221359 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-83995e17-1f6c-40f3-a030-10f259872be8 req-e58fd9d9-1d2a-4539-ac52-07aa01fdf575 service nova] Creating event network-changed:19c2d978-2a3c-495d-abd2-53caf473a477 for instance 016ec747-11c4-4847-99a3-7ccc7727f06c on n-h1-858238-3 Nov 02 14:28:39.227329 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-83995e17-1f6c-40f3-a030-10f259872be8 req-e58fd9d9-1d2a-4539-ac52-07aa01fdf575 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038279 Nov 02 14:28:39.228554 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2004/5965] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:39.267535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:39.268457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:39.277829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:39.280798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:39.283293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.285561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:39.287126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:39.287844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.899572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:39.908290 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0717599f-3534-46c2-9a20-747ab0b3985f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1392 microversion: 2.1 time: 0.646249 Nov 02 14:28:39.909015 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3962/5966] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:39 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1392 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:40.106562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.107302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.114136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.114625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.115066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.115786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.116252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.116686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.259323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:40.267780 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a94c24eb-47d4-4f10-89ad-7ddc43694d67 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.166232 Nov 02 14:28:40.268366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2005/5967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:40.932562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.933308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.944744 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.949265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.950277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.951207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.951831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.952455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.269497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:41.281835 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3da8548a-4395-45e6-8882-fd55d6fab084 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1392 microversion: 2.1 time: 0.352646 Nov 02 14:28:41.282452 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3963/5968] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1392 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:41.291636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.292351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.301634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.307456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.308169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.309407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.310079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.310692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.514361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:41.523081 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dfc75bda-a617-4af6-a2d8-f321b28024b2 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.235482 Nov 02 14:28:41.523989 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2006/5969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:41 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:42.305569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:42.306412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:42.313335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:42.313810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:42.314237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:42.314944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:42.315428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:42.315839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:42.460636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:42.470341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4589c2d2-3cd2-4d6e-b318-1b28c74c9831 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1392 microversion: 2.1 time: 0.168704 Nov 02 14:28:42.474789 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3964/5970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:42 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:42.547884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:42.548511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:42.555557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:42.556109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:42.556503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:42.557208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:42.557674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:42.558108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:42.705754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:42.714466 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9e86cf8-db43-4f8d-8dc6-57adff2888e4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.170369 Nov 02 14:28:42.715828 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2007/5971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:42 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:43.493168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:43.493831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:43.501457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:43.501940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:43.502373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:43.503060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:43.503542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:43.503964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:43.642763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:43.651746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-311409a7-b7eb-4461-9de5-74b0c1471759 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1392 microversion: 2.1 time: 0.162491 Nov 02 14:28:43.652336 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3965/5972] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:43 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:43.738613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:43.739256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:43.746218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:43.746649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:43.747117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:43.747840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:43.748306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:43.748738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:43.883661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:43.892044 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-db45ace4-f039-4509-9bdf-6b9d98405e83 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.158051 Nov 02 14:28:43.892621 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2008/5973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:43 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:44.309772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-499a4e3d-a562-4d78-82ef-091dfa85d4b1 req-a1d84afe-8bdc-4c2c-8ef9-b2bb56f37a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "name": "network-vif-plugged", "status": "completed", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:44.320797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-499a4e3d-a562-4d78-82ef-091dfa85d4b1 req-a1d84afe-8bdc-4c2c-8ef9-b2bb56f37a73 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:44.321490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-499a4e3d-a562-4d78-82ef-091dfa85d4b1 req-a1d84afe-8bdc-4c2c-8ef9-b2bb56f37a73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:44.321923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-499a4e3d-a562-4d78-82ef-091dfa85d4b1 req-a1d84afe-8bdc-4c2c-8ef9-b2bb56f37a73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.335201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-499a4e3d-a562-4d78-82ef-091dfa85d4b1 req-a1d84afe-8bdc-4c2c-8ef9-b2bb56f37a73 service nova] Creating event network-vif-plugged:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h1-858238-3 Nov 02 14:28:44.341317 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-499a4e3d-a562-4d78-82ef-091dfa85d4b1 req-a1d84afe-8bdc-4c2c-8ef9-b2bb56f37a73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035523 Nov 02 14:28:44.342112 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3966/5974] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:44.675740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:44.676629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:44.678981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:44.684885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:44.685508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:44.686067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.686969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:44.687536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:44.688038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.830851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:44.838937 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1821f4f2-19dd-41ba-9632-d507a175e734 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1392 microversion: 2.1 time: 0.167170 Nov 02 14:28:44.840167 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2009/5975] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:44 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:44.916594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:44.917401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:44.924106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:44.924648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:44.925143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.925887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:44.926397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:44.926880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.969260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:45.010754 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:45.072600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:45.082611 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-777d9d13-ac1c-4132-ad0e-159ef929b676 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.170304 Nov 02 14:28:45.083259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3967/5976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:44 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:45.863557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:45.864177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:45.866243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:45.872761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:45.873255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:45.873702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:45.875010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:45.877010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:45.877472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:46.024859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:46.034833 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-25788c80-6c05-4a01-a254-eb5ecff473ba tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1564 microversion: 2.1 time: 0.175633 Nov 02 14:28:46.035560 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2010/5977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:45 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:46.062859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:46.065043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:46.072410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:46.072994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:46.073552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:46.074943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:46.075524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:46.076025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:46.106625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:46.107710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:46.114829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:46.115452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:46.116269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:46.117215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:46.118114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:46.118771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:46.281250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:46.294140 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-11d0ba48-36e1-4b11-9483-d6d453281050 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1564 microversion: 2.1 time: 0.237812 Nov 02 14:28:46.295141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3968/5978] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:46 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:46.341970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:46.352125 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-176d4123-b6bd-40fa-891e-13c7d393bc72 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.249723 Nov 02 14:28:46.353177 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2011/5979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:46 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:46.367421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-80edea12-899b-4417-9b01-877d95b97b9d req-29295299-16fb-46f9-a19f-cbb15e191482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ec747-11c4-4847-99a3-7ccc7727f06c", "name": "network-vif-plugged", "status": "completed", "tag": "19c2d978-2a3c-495d-abd2-53caf473a477"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:46.378133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-80edea12-899b-4417-9b01-877d95b97b9d req-29295299-16fb-46f9-a19f-cbb15e191482 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:46.378629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-80edea12-899b-4417-9b01-877d95b97b9d req-29295299-16fb-46f9-a19f-cbb15e191482 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:46.379076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-80edea12-899b-4417-9b01-877d95b97b9d req-29295299-16fb-46f9-a19f-cbb15e191482 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:46.392648 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-80edea12-899b-4417-9b01-877d95b97b9d req-29295299-16fb-46f9-a19f-cbb15e191482 service nova] Creating event network-vif-plugged:19c2d978-2a3c-495d-abd2-53caf473a477 for instance 016ec747-11c4-4847-99a3-7ccc7727f06c on n-h1-858238-3 Nov 02 14:28:46.397761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-80edea12-899b-4417-9b01-877d95b97b9d req-29295299-16fb-46f9-a19f-cbb15e191482 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034270 Nov 02 14:28:46.398848 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3969/5980] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:28:47.375237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:47.375871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:47.383005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:47.383574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:47.384137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:47.384804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:47.385328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:47.385772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:47.601925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:47.610976 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-244ded06-5668-44b5-b779-4402fe2d8ec8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1373 microversion: 2.1 time: 0.239728 Nov 02 14:28:47.623118 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2012/5981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:47 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1373 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:48.178755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:48.180061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:48.180308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c2b17672-31c2-40d5-ba35-09237cb34cb5 req-d58e3b73-d3bc-423a-8502-8e0b3391abdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:48.187891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.188650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.189248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:48.190130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.190741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.191355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:48.194588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c2b17672-31c2-40d5-ba35-09237cb34cb5 req-d58e3b73-d3bc-423a-8502-8e0b3391abdd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.195235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c2b17672-31c2-40d5-ba35-09237cb34cb5 req-d58e3b73-d3bc-423a-8502-8e0b3391abdd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.195882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c2b17672-31c2-40d5-ba35-09237cb34cb5 req-d58e3b73-d3bc-423a-8502-8e0b3391abdd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:48.214509 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c2b17672-31c2-40d5-ba35-09237cb34cb5 req-d58e3b73-d3bc-423a-8502-8e0b3391abdd service nova] Creating event network-changed:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h1-858238-3 Nov 02 14:28:48.221278 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c2b17672-31c2-40d5-ba35-09237cb34cb5 req-d58e3b73-d3bc-423a-8502-8e0b3391abdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045298 Nov 02 14:28:48.222771 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2013/5982] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:48.447714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:48.457341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-99cae853-495e-467c-93b5-ac79c94e59f9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1564 microversion: 2.1 time: 0.283660 Nov 02 14:28:48.469024 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3970/5983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:48 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1564 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:48.638143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:48.639529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:48.646135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.646880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.647530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:48.648408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.649040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.649634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:48.908034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:48.918797 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed482176-5c29-4b09-8961-7ccff80794fa tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1545 microversion: 2.1 time: 0.288479 Nov 02 14:28:48.920040 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2014/5984] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:48 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1545 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:48.941976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:48.942997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:48.950243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.951088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.951797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:48.952942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:48.953628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:48.954277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:49.481104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:49.489185 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-63bf86bd-853c-439e-bde5-cff3fbeda3b4 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1545 microversion: 2.1 time: 0.551015 Nov 02 14:28:49.490001 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3971/5985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:28:48 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1545 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:51.212544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-36ad181c-5813-4fa9-97b2-d739969f7fe7 req-af184ddd-b112-479b-abec-73e19c1a7f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016ec747-11c4-4847-99a3-7ccc7727f06c", "tag": "19c2d978-2a3c-495d-abd2-53caf473a477"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:51.224301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-36ad181c-5813-4fa9-97b2-d739969f7fe7 req-af184ddd-b112-479b-abec-73e19c1a7f59 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:51.225193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-36ad181c-5813-4fa9-97b2-d739969f7fe7 req-af184ddd-b112-479b-abec-73e19c1a7f59 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:51.225904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-36ad181c-5813-4fa9-97b2-d739969f7fe7 req-af184ddd-b112-479b-abec-73e19c1a7f59 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:51.240928 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-36ad181c-5813-4fa9-97b2-d739969f7fe7 req-af184ddd-b112-479b-abec-73e19c1a7f59 service nova] Creating event network-changed:19c2d978-2a3c-495d-abd2-53caf473a477 for instance 016ec747-11c4-4847-99a3-7ccc7727f06c on n-h1-858238-3 Nov 02 14:28:51.247188 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-36ad181c-5813-4fa9-97b2-d739969f7fe7 req-af184ddd-b112-479b-abec-73e19c1a7f59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038808 Nov 02 14:28:51.248366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2015/5986] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:15.890606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:15.892854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:15.895857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:15.896335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=78 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:15.902702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:15.903225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:15.903699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:15.904452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:15.904903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:15.905317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:15.967896 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d41886e6-52c0-49cf-92f6-68ac92aad0c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action" status: 200 len: 24558 microversion: 2.1 time: 0.081917 Nov 02 14:29:15.975227 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3972/5987] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:29:15 2022] POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action => generated 24558 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:29:17.538550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:17.541107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:17.543550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:17.544236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=76 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:17.551761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:17.552272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:17.552723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:17.553445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:17.553912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:17.554357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:17.611757 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-10b035a9-fc4e-40a9-a1a6-52cac54f5a42 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c/action" status: 200 len: 24568 microversion: 2.1 time: 0.077423 Nov 02 14:29:17.618958 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2016/5988] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:29:17 2022] POST /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c/action => generated 24568 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:29:25.520603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76d18c55-5778-41b4-a653-36a3d8094642 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Action: 'create', calling method: .version_select at 0x7f6f8039a310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1441792475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRBTjQIydGFbpKHgJO1B5Mq0mCpVuhV86ih3ZHxMt/2pDiNGQSr4B/+38C6tMbsOz8FJlF8UjXr3dfA2WhVmLFwsc3uGSedMb3OaMGSyXsoeXOSpU/aXmM9UWPiPKe+RA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:25.538164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-76d18c55-5778-41b4-a653-36a3d8094642 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Getting quotas for project af5dc20ea2f94f2198915c9559da1221. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:25.543913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-76d18c55-5778-41b4-a653-36a3d8094642 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Getting quotas for user 6ff2f2df6ee44a6185902067e6204868 and project af5dc20ea2f94f2198915c9559da1221. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:25.568626 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76d18c55-5778-41b4-a653-36a3d8094642 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052257 Nov 02 14:29:25.569223 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3973/5989] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:29:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:26.597358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-612368562", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0ab20828-e0bb-400f-aefc-753ff79bf8b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1441792475", "security_groups": [{"name": "tempest-secgroup-smoke-191729143"}], "networks": [{"uuid": "4273ed7e-c738-4cd7-98e5-fca7f3b14495"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:26.712505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] validate_networks() for [('4273ed7e-c738-4cd7-98e5-fca7f3b14495', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:29:27.090662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:29:27.091119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:29:27.091621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:29:27.092041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:29:27.092467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:29:27.101333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.101825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.102280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.103013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.103516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.103931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.120413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Getting quotas for project af5dc20ea2f94f2198915c9559da1221. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:27.126427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Getting quotas for user 6ff2f2df6ee44a6185902067e6204868 and project af5dc20ea2f94f2198915c9559da1221. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:27.128425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:27.132909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:27.133869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:27.141116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.141606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.142046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.142747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.143230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.143661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.185920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:29:27.188248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ab20828-e0bb-400f-aefc-753ff79bf8b8',volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:29:27.327013 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-baed7b1e-5883-4ffb-ae48-e29a9815d539 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733511 Nov 02 14:29:27.328062 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2017/5990] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:29:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:29:27.340781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f3f86100-a283-4a6c-bb93-e5b0c484e154 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:27.341721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f3f86100-a283-4a6c-bb93-e5b0c484e154 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:27.385574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f50f2b6-d704-4135-b0d6-88f08c099bc1 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1834 microversion: 2.1 time: 0.258409 Nov 02 14:29:27.386572 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3974/5991] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:27 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1834 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:27.410926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f3f86100-a283-4a6c-bb93-e5b0c484e154 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:27.411725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:27.412337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:27.418548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.419619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.420055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.420751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.421198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.421608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.424819 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f3f86100-a283-4a6c-bb93-e5b0c484e154 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1098 microversion: 2.1 time: 0.088515 Nov 02 14:29:27.425627 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2018/5992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:27 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1098 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:27.565331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:27.573313 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d8dfbb57-1a7d-4f10-a2c6-f7932ef466b9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1683 microversion: 2.1 time: 0.165489 Nov 02 14:29:27.574477 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3975/5993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:27 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:27.689093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:27.691553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:27.699449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.699872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.700346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.701128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:27.701735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:27.702127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:27.757151 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0752225a-b60c-419b-a779-ca46ef2def3a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action" status: 200 len: 32622 microversion: 2.1 time: 0.072202 Nov 02 14:29:27.757906 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2019/5994] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:29:27 2022] POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action => generated 32622 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:29:28.035916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:28.036492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:28.043243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.043724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.044734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.045411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.045857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.046278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.087045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ba2b43d46cd041deb62cbf8326cb5584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f18e6b89440938327906857000c40', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:28.087696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] flavor_id is None. Assuming migration. {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 14:29:28.088139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:29:28.268632 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0a9018dc-9b4c-484f-a967-57329c42be9b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action" status: 202 len: 0 microversion: 2.1 time: 0.237247 Nov 02 14:29:28.269243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3976/5995] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:29:28 2022] POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:29:28.279254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:28.280417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:28.287866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.288465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.289313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.290117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.290911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.291384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.448869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:28.449874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:28.454436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:28.458318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.459076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.459605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.460334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.460794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.461366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.464697 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57f901bc-4678-4a16-a3c6-9bfaaeb0019f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1692 microversion: 2.1 time: 0.190828 Nov 02 14:29:28.466735 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2020/5996] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:28 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:28.565739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:28.575030 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f91e0728-3681-4865-bd6d-c9a6b2d0089c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1196 microversion: 2.1 time: 0.130682 Nov 02 14:29:28.576235 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3977/5997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:28 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1196 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:29.491650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:29.493063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:29.514908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:29.515455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:29.515904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:29.516628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:29.517093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:29.517570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:29.601934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:29.602601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:29.612085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:29.612584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:29.613013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:29.613958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:29.614586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:29.623467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:29.844371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:29.857450 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53870c0b-010d-4b3b-a684-2f69daa94f59 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1692 microversion: 2.1 time: 0.368772 Nov 02 14:29:29.871843 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2021/5998] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:29 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1692 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:29.884523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:29.894819 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dcb48c53-9da7-4e78-9485-c19cb1a8cddc tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1281 microversion: 2.1 time: 0.300076 Nov 02 14:29:29.895763 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3978/5999] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:29 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:30.615168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-130c30dd-2256-46a0-ad3f-cd26a4c57966 req-4a60197c-6d24-4f4b-abaf-85b0668cd652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:30.630106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-130c30dd-2256-46a0-ad3f-cd26a4c57966 req-4a60197c-6d24-4f4b-abaf-85b0668cd652 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:30.631200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-130c30dd-2256-46a0-ad3f-cd26a4c57966 req-4a60197c-6d24-4f4b-abaf-85b0668cd652 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:30.631836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-130c30dd-2256-46a0-ad3f-cd26a4c57966 req-4a60197c-6d24-4f4b-abaf-85b0668cd652 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:30.644678 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-130c30dd-2256-46a0-ad3f-cd26a4c57966 req-4a60197c-6d24-4f4b-abaf-85b0668cd652 service nova] Creating event network-changed:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:29:30.650850 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-130c30dd-2256-46a0-ad3f-cd26a4c57966 req-4a60197c-6d24-4f4b-abaf-85b0668cd652 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134822 Nov 02 14:29:30.652127 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2022/6000] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:30.883129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:30.883779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:30.892603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:30.893554 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:30.894167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:30.897577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:30.898296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:30.899064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:30.922752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:30.923672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:30.933439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:30.939396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:30.940201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:30.941725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:30.942441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:30.943160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:31.160428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:31.166463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:31.169287 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92931fef-a3b8-4a04-95c0-0d7c602b9d78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1692 microversion: 2.1 time: 0.291126 Nov 02 14:29:31.178674 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b848632e-c63f-4e69-9a2a-31e42fd7bb21 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1281 microversion: 2.1 time: 0.263315 Nov 02 14:29:31.180606 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2023/6001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:30 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1281 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:31.183651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3979/6002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:30 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1692 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:32.208434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:32.209103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:32.209505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:32.209995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:32.216967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:32.217454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:32.217890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:32.218130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:32.218599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:32.218818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:32.219049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:32.219469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:32.219593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:32.220338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:32.220909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:32.221419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:32.424041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:32.426228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:32.432669 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-699f519d-aa0b-4954-b5f8-04fed14f5a04 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1281 microversion: 2.1 time: 0.228091 Nov 02 14:29:32.433503 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3980/6003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:32 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:32.434958 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a41debf0-0ba6-4ad8-9332-d72edbe4c140 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.230379 Nov 02 14:29:32.435656 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2024/6004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:32 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:33.455326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:33.455963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:33.459137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:33.459830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:33.463929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:33.464419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:33.464859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:33.466094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:33.466742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:33.467278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:33.467823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:33.468413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:33.468969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:33.469764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:33.470441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:33.470972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:33.665239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:33.675723 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-043964d2-8d95-4358-a0ed-bdf0a422d15d tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1281 microversion: 2.1 time: 0.224200 Nov 02 14:29:33.679122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:33.683031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3981/6005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:33 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:33.692545 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a424104-b4d7-4710-bdde-bde0fe7652dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.237206 Nov 02 14:29:33.693213 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2025/6006] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:33 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:34.704792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:34.705355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:34.712550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:34.713098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:34.713572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:34.714279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:34.714729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:34.715179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:34.716603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:34.717261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:34.724788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:34.725275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:34.725719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:34.726422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:34.726883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:34.727343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:34.918020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:34.922508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:34.926537 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df6465dd-d6f8-4942-baf1-d51c781de4c2 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.225657 Nov 02 14:29:34.927670 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3982/6007] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:34 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:34.931280 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-63314da5-73c2-4a87-997d-b5f113a8379a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.218858 Nov 02 14:29:34.932115 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2026/6008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:34 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:35.951144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:35.957355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:35.958627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:35.961420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:35.972442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:35.979476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:35.979980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:35.981408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:35.982132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:35.982558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:35.983221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:35.984190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:35.985132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:35.986124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:35.986791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:35.987481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:35.988313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:36.213543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:36.217254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:36.223162 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5582ce7b-6999-46bc-9bd7-9b8435d54f7a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.277085 Nov 02 14:29:36.223768 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3983/6009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:35 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:36.226301 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eacb083c-07d5-473f-af47-3b64559bcc75 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.273178 Nov 02 14:29:36.227049 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2027/6010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:35 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:36.738407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-775b9a2c-4659-46ed-bdb7-fa11c5ac2622 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'create', calling method: .version_select at 0x7f6f80ae5ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2144546528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWe5HrvUkEj2t8qdDR22he4a8galdB/AtpLZ2xPJV0nsY6VruTGxg+p9bqXWDu3E+QdVbTZjU54E3Gk1pwxdpVmmcKJRJRw7AEtxiSdfWsGoehKNx+jA55bydAAoZPjkg=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:36.754198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-775b9a2c-4659-46ed-bdb7-fa11c5ac2622 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for project c2e6753524d84c849840fa530c8ed903. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:36.759269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-775b9a2c-4659-46ed-bdb7-fa11c5ac2622 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for user e4c0bd6bb7f4427f8fb921ab79f26c8d and project c2e6753524d84c849840fa530c8ed903. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:36.784505 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-775b9a2c-4659-46ed-bdb7-fa11c5ac2622 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.050116 Nov 02 14:29:36.785149 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3984/6011] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:29:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:37.246143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:37.247646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:37.250549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:37.254918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:37.256478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:37.256944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:37.257095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:37.257666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:37.258423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:37.259178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:37.259676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:37.270515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:37.271170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:37.271708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:37.272771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:37.273453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:37.273953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:37.427500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:37.543017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:37.545548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:37.555008 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-59432d3e-21b5-4318-bb82-e8bab43a56f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.312610 Nov 02 14:29:37.555765 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2028/6012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:37 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:37.562429 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b97ac0a-c7aa-489b-8bb2-1cc6bf5062f2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.316545 Nov 02 14:29:37.563652 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3985/6013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:37 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:37.973316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1437529039", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7a3a91be-39c9-416d-bdf6-8f293ea2cce7"}], "key_name": "tempest-TestNetworkBasicOps-2144546528", "security_groups": [{"name": "tempest-secgroup-smoke-115269958"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:38.085419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] validate_networks() for [('7a3a91be-39c9-416d-bdf6-8f293ea2cce7', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:29:38.484725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:29:38.485295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:29:38.485832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:29:38.486335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:29:38.486836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:29:38.496974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:38.497573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:38.498096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:38.498915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:38.499488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:38.500020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:38.521716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for project c2e6753524d84c849840fa530c8ed903. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:38.527551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for user e4c0bd6bb7f4427f8fb921ab79f26c8d and project c2e6753524d84c849840fa530c8ed903. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:38.540700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:29:38.543047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:29:38.581138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:38.582190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:38.589966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:38.590452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:38.591115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:38.592277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c74c72c9-e507-478b-89a1-a115775a813c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.622814 Nov 02 14:29:38.592624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:38.592959 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2029/6014] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:29:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:29:38.593426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:38.594018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:38.597535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:38.598169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:38.604784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:38.605294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:38.606299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:38.607027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:38.607540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:38.607985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:38.832173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:38.835931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:38.845277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0456283-74cc-4612-8676-702a6a89936e tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.268488 Nov 02 14:29:38.850438 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-01aeb8cc-9cfb-4dc1-81b7-72ae4e950a25 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.256398 Nov 02 14:29:38.852556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2030/6015] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:38 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:38.861042 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3986/6016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:38 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:38.865286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cd6abbd5-09e8-47b3-b6a0-90c96a645fc8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:38.866111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cd6abbd5-09e8-47b3-b6a0-90c96a645fc8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:38.945050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cd6abbd5-09e8-47b3-b6a0-90c96a645fc8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:38.954317 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cd6abbd5-09e8-47b3-b6a0-90c96a645fc8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1249 microversion: 2.1 time: 0.100326 Nov 02 14:29:38.955369 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2031/6017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:38 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:39.870640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:39.872057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:39.876046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:39.876634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:39.881249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:39.881895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:39.882549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:39.883896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:39.884362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:39.884893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:39.885011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:39.885399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:39.886027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:39.886591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:39.887592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:39.887592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:40.090093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:40.096512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:40.098519 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9640bc0b-c04a-42ff-a085-4057a320ed94 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.231949 Nov 02 14:29:40.099139 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3987/6018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:39 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:40.103682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:40.104271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:40.106934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d7b6191-f140-466c-8228-0c9209679961 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.235464 Nov 02 14:29:40.108073 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2032/6019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:39 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:40.117685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:40.118182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:40.118620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:40.119357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:40.119814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:40.120241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:40.188695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:40.197425 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1f6ca68a-fd2d-42ea-85d3-e126b22f7fec tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1309 microversion: 2.1 time: 0.097296 Nov 02 14:29:40.198007 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3988/6020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:40 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:41.126815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:41.128290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:41.131773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:41.132477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:41.140216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.140723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.141162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.141929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.142339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.142435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.142923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.143616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.144388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.144927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.145234 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.145426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.359269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:41.362946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:41.364542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:41.368707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03194e0a-ca77-4d5b-b992-39636f8b2101 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.242855 Nov 02 14:29:41.369305 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3989/6021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:41 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:41.374831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:41.375470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:41.383185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.383890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.384576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.385424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.386064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.386628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.387465 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d80529ed-9c53-4b71-9ea6-b479b8545f05 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.264712 Nov 02 14:29:41.388507 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2033/6022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:41 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:41.537277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:41.545712 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75da79d4-a568-45c3-acf9-2a5265be0bf0 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.175073 Nov 02 14:29:41.546300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3990/6023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:41 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:41.749247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-98bdf6bd-14fd-4108-8931-66ccc20915aa req-07b83278-cb10-4ea2-b57d-bc66cb1b53f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d73dc4a-c890-4cf0-bb66-c10942096520", "tag": "e80bbbb2-5626-492c-8d09-b60f32e386a1"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:41.759452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-98bdf6bd-14fd-4108-8931-66ccc20915aa req-07b83278-cb10-4ea2-b57d-bc66cb1b53f7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.759982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-98bdf6bd-14fd-4108-8931-66ccc20915aa req-07b83278-cb10-4ea2-b57d-bc66cb1b53f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.760431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-98bdf6bd-14fd-4108-8931-66ccc20915aa req-07b83278-cb10-4ea2-b57d-bc66cb1b53f7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.773993 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-98bdf6bd-14fd-4108-8931-66ccc20915aa req-07b83278-cb10-4ea2-b57d-bc66cb1b53f7 service nova] Creating event network-changed:e80bbbb2-5626-492c-8d09-b60f32e386a1 for instance 3d73dc4a-c890-4cf0-bb66-c10942096520 on n-h2-858238-3 Nov 02 14:29:41.780050 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-98bdf6bd-14fd-4108-8931-66ccc20915aa req-07b83278-cb10-4ea2-b57d-bc66cb1b53f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034633 Nov 02 14:29:41.780675 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2034/6024] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:42.394395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:42.395013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:42.402297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.403507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.403944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.404735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.405189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.405608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.412066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:42.413376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:42.427989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.428294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.428901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.429634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.430105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.430543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.627735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:42.636455 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84407a1f-3e73-4791-a1e5-793b34ba2d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.246135 Nov 02 14:29:42.636644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:42.637912 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3991/6025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:42 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:42.643023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:42.643453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:42.648649 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5e12162d-96ab-4ea0-a82c-70c2ee999cf6 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.241311 Nov 02 14:29:42.649256 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2035/6026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:42 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:42.649578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.650117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.650506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.651233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.651684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.652105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.800605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:42.809035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c05ce62-996e-4c91-afaf-82ded98f6452 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.169669 Nov 02 14:29:42.809796 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3992/6027] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:42 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:43.659709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:43.660456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:43.667231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.667879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.668325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.669020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.669485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.669916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.672898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:43.673564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:43.680398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.680889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.681317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.682014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.682464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.682888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.869409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:43.877798 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-51fa2cef-eec2-4d30-942a-bb38031fb0ac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.221900 Nov 02 14:29:43.878384 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2036/6028] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:43 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:43.880119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:43.883551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:43.884185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:43.890779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.891401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.892001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.892721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.893191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.893630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.898473 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d651e6ef-0613-4a61-bdd3-693eafbf8f14 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.229284 Nov 02 14:29:43.899302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3993/6029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:43 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:44.039032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:44.045862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:44.050817 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4febe083-6563-4629-b729-fa193600d008 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.171180 Nov 02 14:29:44.059590 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2037/6030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:43 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:44.082606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-99d2c32d-0b5b-42f4-9f83-8ef1889e69e9 req-f383b154-2595-433a-b1ab-b990b7e59d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "name": "network-vif-plugged", "status": "completed", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:44.092018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-99d2c32d-0b5b-42f4-9f83-8ef1889e69e9 req-f383b154-2595-433a-b1ab-b990b7e59d58 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.092488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-99d2c32d-0b5b-42f4-9f83-8ef1889e69e9 req-f383b154-2595-433a-b1ab-b990b7e59d58 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.092914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-99d2c32d-0b5b-42f4-9f83-8ef1889e69e9 req-f383b154-2595-433a-b1ab-b990b7e59d58 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:44.104023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-99d2c32d-0b5b-42f4-9f83-8ef1889e69e9 req-f383b154-2595-433a-b1ab-b990b7e59d58 service nova] Creating event network-vif-plugged:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:29:44.109261 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-99d2c32d-0b5b-42f4-9f83-8ef1889e69e9 req-f383b154-2595-433a-b1ab-b990b7e59d58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110192 Nov 02 14:29:44.110145 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3994/6031] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:44.901797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:44.902962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:44.910248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.910739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.911209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:44.911911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.912372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.912806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:44.923014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:44.923977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:44.930935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.931535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.932006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:44.932669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.933122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.933556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:45.124856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:45.133228 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20d0824b-d9db-4e51-8aca-76efadfa5988 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.235195 Nov 02 14:29:45.133929 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2038/6032] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:44 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:45.139124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:45.139754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:45.143260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:45.146646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:45.147183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:45.147642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:45.148367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:45.148846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:45.149294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:45.154664 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b4094292-80d0-46f2-8820-38a39c38cc4a tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1269 microversion: 2.1 time: 0.236310 Nov 02 14:29:45.155212 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3995/6033] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:44 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:45.288672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:45.296388 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-517e9870-6866-42b6-a3cc-e077a7fc8a0e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.161374 Nov 02 14:29:45.297141 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2039/6034] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:45 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:46.158748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:46.159416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:46.162238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:46.168580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.169068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.169500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.170195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.170640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.171086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.177874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:46.178495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:46.186180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.186677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.187135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.188218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.188686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.189118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.383667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:46.392900 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-990b7a56-4427-49b4-9dbd-5b9d7098c700 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.238688 Nov 02 14:29:46.393606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3996/6035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:46 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:46.393713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:46.398775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:46.399600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:46.404107 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e0f6ca1-afc0-4872-9494-cd02248d1fd4 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1458 microversion: 2.1 time: 0.230114 Nov 02 14:29:46.418283 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2040/6036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:46 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1458 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:46.421272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.421880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.421949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.423309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.424101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.424667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.428103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:46.428877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:46.435017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.435706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.436124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.436857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.437337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.437781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.645802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:46.649361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:46.654746 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-68943631-03f0-4bd1-a320-736d6bbb8192 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1458 microversion: 2.1 time: 0.230678 Nov 02 14:29:46.655372 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2041/6037] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:46 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1458 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:46.658462 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-17a2ae98-798f-414b-9c73-c6b71160593f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.263473 Nov 02 14:29:46.659141 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3997/6038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:46 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:47.418217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:47.419031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:47.428693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:47.429196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:47.429649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:47.430369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:47.430840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:47.431321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:47.672934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:47.681028 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-07a29f6c-dcf3-4ff3-bf30-56b997a05f34 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.267175 Nov 02 14:29:47.681620 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2042/6039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:47 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:47.681746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:47.682367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:47.684416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:47.691369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:47.691853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:47.692286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:47.692972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:47.693448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:47.693870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:47.925739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:47.935736 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db4bb3bd-ea53-4e47-9ba4-2364b4f2d9b9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.257623 Nov 02 14:29:47.936456 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3998/6040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:47 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:48.032422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1cd3abc3-d063-4f6d-9815-7fda4afc11d9 req-56031a29-2125-4440-ae30-cc188f886a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d73dc4a-c890-4cf0-bb66-c10942096520", "name": "network-vif-plugged", "status": "completed", "tag": "e80bbbb2-5626-492c-8d09-b60f32e386a1"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:48.041116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:48.043932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1cd3abc3-d063-4f6d-9815-7fda4afc11d9 req-56031a29-2125-4440-ae30-cc188f886a3a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:48.044709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1cd3abc3-d063-4f6d-9815-7fda4afc11d9 req-56031a29-2125-4440-ae30-cc188f886a3a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:48.045468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1cd3abc3-d063-4f6d-9815-7fda4afc11d9 req-56031a29-2125-4440-ae30-cc188f886a3a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:48.061709 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1cd3abc3-d063-4f6d-9815-7fda4afc11d9 req-56031a29-2125-4440-ae30-cc188f886a3a service nova] Creating event network-vif-plugged:e80bbbb2-5626-492c-8d09-b60f32e386a1 for instance 3d73dc4a-c890-4cf0-bb66-c10942096520 on n-h2-858238-3 Nov 02 14:29:48.068397 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1cd3abc3-d063-4f6d-9815-7fda4afc11d9 req-56031a29-2125-4440-ae30-cc188f886a3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039565 Nov 02 14:29:48.069583 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2043/6041] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:48.703743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:48.709170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:48.709916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:48.726861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:48.729205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:48.731767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:48.733051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:48.733534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:48.734265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:48.738143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1b49aa10-2de1-40b4-ae53-e135f88ffdbb req-0cf2ecab-e780-436c-af38-d898205f6c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:48.764068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1b49aa10-2de1-40b4-ae53-e135f88ffdbb req-0cf2ecab-e780-436c-af38-d898205f6c20 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:48.764919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1b49aa10-2de1-40b4-ae53-e135f88ffdbb req-0cf2ecab-e780-436c-af38-d898205f6c20 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:48.765363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1b49aa10-2de1-40b4-ae53-e135f88ffdbb req-0cf2ecab-e780-436c-af38-d898205f6c20 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:48.797427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1b49aa10-2de1-40b4-ae53-e135f88ffdbb req-0cf2ecab-e780-436c-af38-d898205f6c20 service nova] Creating event network-changed:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:29:48.805533 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1b49aa10-2de1-40b4-ae53-e135f88ffdbb req-0cf2ecab-e780-436c-af38-d898205f6c20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186603 Nov 02 14:29:48.806613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 3999/6042] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:48.950625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:48.963924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:48.965861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:48.973612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:48.975038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:48.976043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:48.976991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:48.977656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:48.978282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:49.011714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:49.027627 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41dbedb3-6bfb-4310-8c5c-be191dbb52e7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.324135 Nov 02 14:29:49.040945 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2044/6043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:48 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:49.260715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:49.291022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9d36130-815d-4434-be68-1c34837a9d29 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1374 microversion: 2.1 time: 0.333422 Nov 02 14:29:49.293115 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4000/6044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:48 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1374 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:50.052123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:50.057444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:50.064574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.065190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.065748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.074365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.074977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.075690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.309338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:50.314665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:50.318533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:50.329986 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-211f731a-5230-4a06-8946-e0b1dcff4955 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.281641 Nov 02 14:29:50.331797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.332535 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2045/6045] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:50 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:50.333329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.333841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.334869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.335595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.336212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.545001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:50.553001 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8a56ae02-faec-4073-bc03-86833082d943 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1546 microversion: 2.1 time: 0.242071 Nov 02 14:29:50.553586 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4001/6046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:50 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:50.576983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:50.577633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:50.584084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.584577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.585022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.585728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.586189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.586619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.720981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:50.728931 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7251f949-25c8-47ea-9e7e-88e60a8c6ff3 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1546 microversion: 2.1 time: 0.156913 Nov 02 14:29:50.729490 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2046/6047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:50 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:50.832494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}, {"name": "network-changed", "server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:50.842088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.842568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.842980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.856321 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] Creating event network-changed:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:29:50.856748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] Creating event network-changed:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:29:50.864477 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7aac2e3d-2d3b-4b4a-9d45-6fcb3a255845 req-d8aaf162-b362-482e-aa7c-be0cedc2f26e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035613 Nov 02 14:29:50.865214 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4002/6048] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:51.356877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:51.357426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:51.364299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:51.364791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:51.365235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:51.365967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:51.366429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:51.366864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:51.518036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:51.526163 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6d4537f8-65e5-4000-8a56-64dfabf93127 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.173829 Nov 02 14:29:51.527468 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2047/6049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:51 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:52.551918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:52.552645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:52.558890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:52.559398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:52.559829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:52.560523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:52.560974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:52.561393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:52.701256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:52.709221 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1300f877-0700-48ed-9484-95c85f8f3af7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.162462 Nov 02 14:29:52.710100 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4003/6050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:52 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:53.735143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:53.735744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:53.742779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:53.743331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:53.743764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:53.744464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:53.744927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:53.745418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:53.882664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:53.891318 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-92c68329-1e18-42b9-a5aa-c7dfde537cbc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.160599 Nov 02 14:29:53.904266 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2048/6051] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:53 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:54.915707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:54.916222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:54.924100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:54.924588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:54.925031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:54.925731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:54.926179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:54.926599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:55.084628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:55.092379 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9974b870-e874-4b81-830c-75a0fff1a5c3 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.180925 Nov 02 14:29:55.092952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4004/6052] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:54 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:56.127693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:56.128377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:56.136717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:56.137360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:56.137738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:56.138521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:56.138922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:56.139444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:56.297160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:56.306180 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e79d070f-a34a-458e-80a7-e730612f4c8b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.183588 Nov 02 14:29:56.306768 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2049/6053] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:56 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:57.330621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:57.331388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:57.338156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:57.339405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:57.340128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:57.341228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:57.341864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:57.342297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:57.488250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:57.496820 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91e08ec1-dd75-44ec-84cc-b2e499d80847 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.170195 Nov 02 14:29:57.497398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4005/6054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:57 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:58.521046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:58.521676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:58.529763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:58.530252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:58.530697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:58.531445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:58.531911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:58.532373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:58.679574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:58.687781 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9f3d8c3-fe9f-47cc-8eb4-d84cf47fd7a0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1697 microversion: 2.1 time: 0.170611 Nov 02 14:29:58.688469 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2050/6055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:58 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:59.715801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:59.716444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:59.724410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:59.725083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:59.725528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:59.726336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:59.726807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:59.727381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:59.899353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:59.909948 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92e483a5-73de-4849-9632-fb048a1266f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1696 microversion: 2.1 time: 0.200159 Nov 02 14:29:59.910747 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4006/6056] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:29:59 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:00.035756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "name": "network-vif-unplugged", "status": "completed", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:00.046371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:00.046859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:00.047335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:00.060431 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] Creating event network-vif-unplugged:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h2-858238-3 Nov 02 14:30:00.066011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:30:00.078050 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4f802234-b63a-4055-af03-f31e21d78827 req-892904a0-8580-47a4-8575-c54ce88ff02f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048315 Nov 02 14:30:00.078850 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2051/6057] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:00.934792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:00.935523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:00.943742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:00.944979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:00.945761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:00.946775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:00.947459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:00.948633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:01.101691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:01.110539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2eb072ac-a982-424f-8ca5-cf06c89a5f50 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1696 microversion: 2.1 time: 0.179868 Nov 02 14:30:01.111146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4007/6058] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:00 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:02.102155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:02.113117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:02.113612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:02.114065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:02.126410 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] Creating event network-changed:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h2-858238-3 Nov 02 14:30:02.132360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:30:02.141769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:02.142593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:02.143630 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-fd14b1f4-f2a5-40b7-b31f-313ea8f559aa req-de42a153-bbde-4cf2-8eb2-c0f90c976de2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048279 Nov 02 14:30:02.144256 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2052/6059] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:02.151612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:02.152132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:02.152559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:02.153287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:02.153791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:02.154215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:02.177626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=100 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:02.398474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:02.419754 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9a12a96-fdad-45c8-b56c-341f47fdd913 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1694 microversion: 2.1 time: 0.281722 Nov 02 14:30:02.420633 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4008/6060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:02 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1694 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:03.450053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:03.450802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:03.457576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:03.458078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:03.458527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:03.459274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:03.460014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:03.460457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:03.662868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:03.673942 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04d5516b-ad19-4118-bc91-0b8faf90d617 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1694 microversion: 2.1 time: 0.227636 Nov 02 14:30:03.673942 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2053/6061] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:03 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:04.696427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:04.697016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:04.704898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.705386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.705832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.706551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.707009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.707468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.859170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:04.868853 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6578d2be-6d74-4620-9cb1-efe22c87b290 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1691 microversion: 2.1 time: 0.176646 Nov 02 14:30:04.869439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4009/6062] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:04 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:04.893659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:04.894395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:04.903184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.903761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.904658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.906130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.906976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.907786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.973927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:04.988649 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f90352f-d062-4a1d-8744-490e4e0a825e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action" status: 204 len: 0 microversion: 2.1 time: 0.099194 Nov 02 14:30:04.989329 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2054/6063] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:30:04 2022] POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:30:05.001487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:05.002139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:05.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:05.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:05.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:05.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:05.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:05.012368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:05.297376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:05.307529 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cd3523c-59aa-4d69-8789-d5a289719c9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1691 microversion: 2.1 time: 0.313194 Nov 02 14:30:05.308133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4010/6064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:04 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:06.155293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "name": "network-vif-plugged", "status": "completed", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:06.166957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:06.167591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:06.168271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:06.180750 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] Creating event network-vif-plugged:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h2-858238-3 Nov 02 14:30:06.187216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:30:06.202051 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-25dce6c3-79c4-47f8-a4d6-3f9bd3b11b39 req-b2432398-0a29-4dd1-95d6-373b2b7e60af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051405 Nov 02 14:30:06.205914 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2055/6065] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:06.333965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:06.334694 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:06.341644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:06.342197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:06.342643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:06.344097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:06.344565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:06.344996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:06.532883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:06.541766 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e024158-6aca-4445-830a-ee67117ec910 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1691 microversion: 2.1 time: 0.211971 Nov 02 14:30:06.542542 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4011/6066] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:06 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:07.566782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:07.567567 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:07.574835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:07.575368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:07.575834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:07.576529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:07.576994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:07.577426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:07.722060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:07.730516 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c1d6e921-dd1b-4fb4-bf88-49f55df78873 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1683 microversion: 2.1 time: 0.168830 Nov 02 14:30:07.731154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2056/6067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:07 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:21.727032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:21.729042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:21.731671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=31 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:21.732343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=20 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:21.739857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:21.740343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:21.740945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:21.741903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:21.742440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:21.742863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:21.775296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:30:21.904037 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57f4f04e-d96d-4e75-a48b-1ebd96a17d44 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 204 len: 0 microversion: 2.1 time: 0.180963 Nov 02 14:30:21.905247 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4012/6068] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:30:21 2022] DELETE /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:30:21.915740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:21.917842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:21.924720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=27 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:21.925702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:21.928204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:21.928906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:21.929650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:21.930528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:21.931204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:21.931779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:22.109000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:22.128242 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31f4e393-2ad8-48bc-98aa-bca2522f544a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1552 microversion: 2.1 time: 0.218229 Nov 02 14:30:22.128847 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2057/6069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:21 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1552 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:23.158242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:23.168105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:23.177901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:23.178400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:23.178839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:23.179587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:23.180194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:23.180620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:23.352363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:23.361110 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7d32e458-b860-4f3f-a349-9e642f0ed079 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1552 microversion: 2.1 time: 0.209489 Nov 02 14:30:23.361711 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4013/6070] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:23 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1552 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:24.228213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1e4d4b21-f8fd-46f6-8e3f-155e87aa471a req-f07de556-42bd-452d-b48d-64f4099dbc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d73dc4a-c890-4cf0-bb66-c10942096520", "name": "network-vif-deleted", "tag": "e80bbbb2-5626-492c-8d09-b60f32e386a1"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:24.239445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1e4d4b21-f8fd-46f6-8e3f-155e87aa471a req-f07de556-42bd-452d-b48d-64f4099dbc00 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:24.240099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1e4d4b21-f8fd-46f6-8e3f-155e87aa471a req-f07de556-42bd-452d-b48d-64f4099dbc00 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:24.240626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1e4d4b21-f8fd-46f6-8e3f-155e87aa471a req-f07de556-42bd-452d-b48d-64f4099dbc00 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:24.252907 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1e4d4b21-f8fd-46f6-8e3f-155e87aa471a req-f07de556-42bd-452d-b48d-64f4099dbc00 service nova] Creating event network-vif-deleted:e80bbbb2-5626-492c-8d09-b60f32e386a1 for instance 3d73dc4a-c890-4cf0-bb66-c10942096520 on n-h2-858238-3 Nov 02 14:30:24.260195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1e4d4b21-f8fd-46f6-8e3f-155e87aa471a req-f07de556-42bd-452d-b48d-64f4099dbc00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Nov 02 14:30:24.260825 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2058/6071] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:24.385753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:24.386363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:24.393507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:24.393970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:24.394412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:24.395166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:24.395624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:24.396077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:24.435870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:24.436357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:24.436792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:24.437314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lazy-loading 'fault' on Instance uuid 3d73dc4a-c890-4cf0-bb66-c10942096520 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:30:24.486532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:24.497963 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7847e1ea-1397-45de-a20f-a166a3e81a60 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 200 len: 1339 microversion: 2.1 time: 0.116698 Nov 02 14:30:24.498567 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4014/6072] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:24 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:25.523627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:25.524303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 3d73dc4a-c890-4cf0-bb66-c10942096520] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:25.530441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:25.530929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:25.531395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:25.532210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:25.532773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:25.533209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:25.548331 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] HTTP exception thrown: Instance 3d73dc4a-c890-4cf0-bb66-c10942096520 could not be found. Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Request method failure captured: Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 HTTP/1.1 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn6FUVr5xaafABEe5EBptNiBOTJstCbura-nAKOunb95Oz8o5PRJBuKjbxQUy1mvLIWGC_WdyN3xjuTTtA2MVOqWR_MetlzSbSaOp74pLAdbFtgsjUNxFoPyxxSOTjdMLolKYFtEdoSOsH1PJ8AK1Zm90ZeOdA7TAAGDxuYeUVLpb5o Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c2e6753524d84c849840fa530c8ed903 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c2e6753524d84c849840fa530c8ed903"}]}] Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c2e6753524d84c849840fa530c8ed903 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestNetworkBasicOps-1174629021-project Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e4c0bd6bb7f4427f8fb921ab79f26c8d Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestNetworkBasicOps-1174629021-project Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3d73dc4a-c890-4cf0-bb66-c10942096520 could not be found. Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3d73dc4a-c890-4cf0-bb66-c10942096520'} Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d73dc4a-c890-4cf0-bb66-c10942096520 could not be found. Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d73dc4a-c890-4cf0-bb66-c10942096520 could not be found. Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:25.550492 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d73dc4a-c890-4cf0-bb66-c10942096520 could not be found. Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Returning 404 to user: Instance 3d73dc4a-c890-4cf0-bb66-c10942096520 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-917985fc-de77-45e0-9d40-e9fb8c04878c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520" status: 404 len: 111 microversion: 2.1 time: 0.033399 Nov 02 14:30:25.554894 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2059/6073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:25 2022] GET /compute/v2.1/servers/3d73dc4a-c890-4cf0-bb66-c10942096520 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:30:25.731662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7377f55-f284-4b0d-ba6d-1617b666ce87 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '.version_select at 0x7f6f804533a0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:25.761487 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7377f55-f284-4b0d-ba6d-1617b666ce87 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2144546528" status: 202 len: 0 microversion: 2.1 time: 0.035398 Nov 02 14:30:25.762138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4015/6074] 10.222.0.18 () {58 vars in 1257 bytes} [Wed Nov 2 14:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2144546528 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:30:26.902282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:26.902973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:26.903848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d9d06f3a-f837-4d16-994d-dfab1c42bea3 req-eb28218f-95b5-44ea-88cd-cb9c044d0e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:26.922130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.922638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.923082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.923810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.924718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.924718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.933741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d9d06f3a-f837-4d16-994d-dfab1c42bea3 req-eb28218f-95b5-44ea-88cd-cb9c044d0e53 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.934476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d9d06f3a-f837-4d16-994d-dfab1c42bea3 req-eb28218f-95b5-44ea-88cd-cb9c044d0e53 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.935043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d9d06f3a-f837-4d16-994d-dfab1c42bea3 req-eb28218f-95b5-44ea-88cd-cb9c044d0e53 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.963603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d9d06f3a-f837-4d16-994d-dfab1c42bea3 req-eb28218f-95b5-44ea-88cd-cb9c044d0e53 service nova] Creating event network-changed:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:30:26.970848 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d9d06f3a-f837-4d16-994d-dfab1c42bea3 req-eb28218f-95b5-44ea-88cd-cb9c044d0e53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075950 Nov 02 14:30:26.971717 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4016/6075] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:26.982544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:30:27.093613 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dd69ab90-b428-4908-9f54-82804e38d63c tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 204 len: 0 microversion: 2.1 time: 0.202049 Nov 02 14:30:27.094346 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2060/6076] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:30:26 2022] DELETE /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:30:27.110752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:27.111936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:27.131828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:27.134258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:27.136355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:27.138163 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:27.140229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:27.140908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:27.404983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:27.421438 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff4c17c2-f326-4755-ade0-79ee72eca143 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1583 microversion: 2.1 time: 0.321165 Nov 02 14:30:27.427189 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4017/6077] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:27 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1583 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:28.428382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:28.429172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:28.438438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:28.438438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:28.438438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.438438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:28.438438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:28.440625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.448552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:28.449383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:28.457739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:28.458229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:28.458867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.459629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:28.460411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:28.461066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.474939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:30:28.610202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4cd2cbd2-f773-4f36-8a1e-f730e7589e0d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "DELETE /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 204 len: 0 microversion: 2.1 time: 0.187783 Nov 02 14:30:28.610911 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2061/6078] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:30:28 2022] DELETE /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:30:28.630087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:28.631554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:28.645693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:28.646926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:28.647777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.648917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:28.649753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:28.649904 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:28.650297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.668097 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba970717-2622-41d2-82e4-51503a8459f9 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1583 microversion: 2.1 time: 0.223655 Nov 02 14:30:28.677666 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4018/6079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:28 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1583 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:28.836243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:28.846269 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50462300-1e44-4226-9669-c7ebb49684e6 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1670 microversion: 2.1 time: 0.228220 Nov 02 14:30:28.847228 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2062/6080] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:28 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:29.010826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-af35be86-c574-4169-80a4-aae5410771cb req-d4d332ca-4689-42f1-8f8b-fbc554eeeaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016ec747-11c4-4847-99a3-7ccc7727f06c", "tag": "19c2d978-2a3c-495d-abd2-53caf473a477"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:29.020933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-af35be86-c574-4169-80a4-aae5410771cb req-d4d332ca-4689-42f1-8f8b-fbc554eeeaa0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.021466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-af35be86-c574-4169-80a4-aae5410771cb req-d4d332ca-4689-42f1-8f8b-fbc554eeeaa0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.021971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-af35be86-c574-4169-80a4-aae5410771cb req-d4d332ca-4689-42f1-8f8b-fbc554eeeaa0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.034973 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-af35be86-c574-4169-80a4-aae5410771cb req-d4d332ca-4689-42f1-8f8b-fbc554eeeaa0 service nova] Creating event network-changed:19c2d978-2a3c-495d-abd2-53caf473a477 for instance 016ec747-11c4-4847-99a3-7ccc7727f06c on n-h1-858238-3 Nov 02 14:30:29.041415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-af35be86-c574-4169-80a4-aae5410771cb req-d4d332ca-4689-42f1-8f8b-fbc554eeeaa0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034221 Nov 02 14:30:29.043144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4019/6081] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:29.705265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:29.706029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:29.713586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.714096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.714646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.715469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.716006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.716513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.874346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:29.876228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:29.887436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.888347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.889003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.889862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.891155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.891726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.920125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:29.928563 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8a3ffacf-2144-429b-8d67-072160981883 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1464 microversion: 2.1 time: 0.227421 Nov 02 14:30:29.929153 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2063/6082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:29 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1464 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:30.133785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:30.146210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e444a650-ea7f-4635-8075-a2137735f1d9 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1670 microversion: 2.1 time: 0.276188 Nov 02 14:30:30.147408 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4020/6083] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:29 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1670 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:30.952470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:30.953788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:30.961890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:30.962481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:30.963001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:30.963929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:30.964559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:30.965107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:31.033539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:31.044156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f8756e08-d54d-4eaa-a44a-ea2a61c0bd81 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1229 microversion: 2.1 time: 0.095489 Nov 02 14:30:31.045050 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2064/6084] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:30 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:31.058385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f", "name": "network-vif-deleted", "tag": "98a0b7cf-9fe1-4edb-a7c2-27a098ac6442"}, {"server_uuid": "016ec747-11c4-4847-99a3-7ccc7727f06c", "name": "network-vif-deleted", "tag": "19c2d978-2a3c-495d-abd2-53caf473a477"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:31.072950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:31.073372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:31.073795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:31.088684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] Creating event network-vif-deleted:98a0b7cf-9fe1-4edb-a7c2-27a098ac6442 for instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f on n-h2-858238-3 Nov 02 14:30:31.089427 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] Creating event network-vif-deleted:19c2d978-2a3c-495d-abd2-53caf473a477 for instance 016ec747-11c4-4847-99a3-7ccc7727f06c on n-h1-858238-3 Nov 02 14:30:31.101971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0c5b52be-b75b-4aac-a43e-50cfed0150b1 req-29a04c1f-9beb-4715-91a5-fc3d1186af31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047345 Nov 02 14:30:31.103659 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4021/6085] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:30:31.169749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:31.170399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:31.176805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:31.177300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:31.177772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:31.178476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:31.178979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:31.179416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:31.212691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:31.213184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:31.213631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:31.214085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lazy-loading 'fault' on Instance uuid 016ec747-11c4-4847-99a3-7ccc7727f06c {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:30:31.260282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:31.268398 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-26863cd6-7fee-4b89-9afc-8af26a35e867 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 200 len: 1337 microversion: 2.1 time: 0.102432 Nov 02 14:30:31.269012 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2065/6086] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:31 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 1337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:32.069736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:32.070336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:32.077509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:32.077989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:32.078763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:32.079588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:32.080047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:32.080475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:32.165381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:32.173840 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b9fa66c-3a97-4f5b-b566-988c4123b89b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1229 microversion: 2.1 time: 0.109142 Nov 02 14:30:32.174439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4022/6087] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:32 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:32.293795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:32.294429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: 016ec747-11c4-4847-99a3-7ccc7727f06c] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:32.301566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:32.302068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:32.302518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:32.303273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:32.303738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:32.304176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:32.322054 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] HTTP exception thrown: Instance 016ec747-11c4-4847-99a3-7ccc7727f06c could not be found. Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Request method failure captured: Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c HTTP/1.1 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn6FUVr5xaafABEe5EBptNiBOTJstCbura-nAKOunb95Oz8o5PRJBuKjbxQUy1mvLIWGC_WdyN3xjuTTtA2MVOqWR_MetlzSbSaOp74pLAdbFtgsjUNxFoPyxxSOTjdMLolKYFtEdoSOsH1PJ8AK1Zm90ZeOdA7TAAGDxuYeUVLpb5o Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c2e6753524d84c849840fa530c8ed903 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c2e6753524d84c849840fa530c8ed903"}]}] Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c2e6753524d84c849840fa530c8ed903 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestNetworkBasicOps-1174629021-project Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e4c0bd6bb7f4427f8fb921ab79f26c8d Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestNetworkBasicOps-1174629021-project Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 016ec747-11c4-4847-99a3-7ccc7727f06c could not be found. Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '016ec747-11c4-4847-99a3-7ccc7727f06c'} Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016ec747-11c4-4847-99a3-7ccc7727f06c could not be found. Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016ec747-11c4-4847-99a3-7ccc7727f06c could not be found. Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:32.323687 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016ec747-11c4-4847-99a3-7ccc7727f06c could not be found. Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Returning 404 to user: Instance 016ec747-11c4-4847-99a3-7ccc7727f06c could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8d062f3e-7e47-4d0f-8c5d-0a4ae3103352 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c" status: 404 len: 111 microversion: 2.1 time: 0.035918 Nov 02 14:30:32.327239 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2066/6088] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:32 2022] GET /compute/v2.1/servers/016ec747-11c4-4847-99a3-7ccc7727f06c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:30:32.506175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6158e038-7056-449d-9f99-56e4161ed80a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '.version_select at 0x7f6f8039a550>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:32.528263 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6158e038-7056-449d-9f99-56e4161ed80a tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-69565016" status: 202 len: 0 microversion: 2.1 time: 0.026292 Nov 02 14:30:32.529196 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4023/6089] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 14:30:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-69565016 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:30:33.198010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:33.198842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:33.204874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.205448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.205963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:33.206674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.207157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.207595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:33.569462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:33.578087 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d380d82b-6e28-45d4-a0ec-e5995ebf8a97 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1229 microversion: 2.1 time: 0.384653 Nov 02 14:30:33.578670 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2067/6090] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:33 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1229 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:33.972252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:33.974313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:33.984641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.985451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.986089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:33.987785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.988998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.989929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:34.093149 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bacf9556-6fde-4e0c-962d-88260ce14a78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action" status: 200 len: 24558 microversion: 2.1 time: 0.124011 Nov 02 14:30:34.094692 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4024/6091] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:30:33 2022] POST /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720/action => generated 24558 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:30:34.606097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:34.606881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:34.614225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:34.615111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:34.615781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:34.616727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:34.617422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:34.618893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:34.660936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:34.661814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:34.662483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:34.663336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lazy-loading 'fault' on Instance uuid 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:30:34.733880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2f2df6ee44a6185902067e6204868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5dc20ea2f94f2198915c9559da1221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:34.743666 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c94c0977-cf96-4918-9963-7f26eee48231 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 200 len: 1234 microversion: 2.1 time: 0.141581 Nov 02 14:30:34.746203 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2068/6092] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:34 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 1234 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:35.773122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:35.774328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] [instance: 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:35.782325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:35.783175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:35.783688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:35.784467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:35.784990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:35.785476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:35.803523 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] HTTP exception thrown: Instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f could not be found. Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Request method failure captured: Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f HTTP/1.1 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn5AOj72NB0crbtDCuaSZIxrWCPbMW46_vctxM5XuOnjkyIfsXcG67L2cGyDlzT9hDNz1ZVCUNgZbj_MnO9ymDD2HpJdmnTs6a5nqT4XOMien2MAr_eQ768wWNvvgR1b93Der9yVY3bnoRFnZ6lpvdDrc3PFH4BcqdGw9pFp-DkuDUE Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: af5dc20ea2f94f2198915c9559da1221 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestVolumeBackupRestore-867364821 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5dc20ea2f94f2198915c9559da1221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af5dc20ea2f94f2198915c9559da1221"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5dc20ea2f94f2198915c9559da1221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af5dc20ea2f94f2198915c9559da1221"}]}] Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestVolumeBackupRestore-867364821 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: af5dc20ea2f94f2198915c9559da1221 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestVolumeBackupRestore-867364821 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestVolumeBackupRestore-867364821-project Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 6ff2f2df6ee44a6185902067e6204868 Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestVolumeBackupRestore-867364821-project Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f could not be found. Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f'} Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f could not be found. Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f could not be found. Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:35.805816 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f could not be found. Nov 02 14:30:35.809553 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:35.811710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Returning 404 to user: Instance 6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:35.812800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6fd8f63-2928-4608-ac93-3f985aff70f5 tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f" status: 404 len: 111 microversion: 2.1 time: 0.044535 Nov 02 14:30:35.813525 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4025/6093] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:35 2022] GET /compute/v2.1/servers/6ab17bac-cd3b-47c6-ba00-1ef7798a2f2f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:30:36.000775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6e21fe0-2434-4305-9b4c-fe5a5234213b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] Calling method '.version_select at 0x7f6f85e559d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:36.044690 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f6e21fe0-2434-4305-9b4c-fe5a5234213b tempest-TestVolumeBackupRestore-867364821 tempest-TestVolumeBackupRestore-867364821-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1441792475" status: 202 len: 0 microversion: 2.1 time: 0.052707 Nov 02 14:30:36.048542 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2069/6094] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 14:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1441792475 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:30:40.350538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:40.352374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:40.372684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:40.374072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:40.375955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:40.379255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:40.380702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:40.381590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:40.813495 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec8a4c92-0d55-4bc3-a70b-d04b7f8f2990 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1834 microversion: 2.1 time: 0.467061 Nov 02 14:30:40.819041 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4026/6095] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:40 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1834 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:43.395454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:43.396057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:43.407048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d81d8f4c-a5f0-417e-89d2-82a6dfbf24d5 req-030c989c-d0b1-46cd-904e-626b44bc8f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:43.429650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:43.433289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:43.436379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:43.437436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:43.438063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d81d8f4c-a5f0-417e-89d2-82a6dfbf24d5 req-030c989c-d0b1-46cd-904e-626b44bc8f88 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:43.439084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d81d8f4c-a5f0-417e-89d2-82a6dfbf24d5 req-030c989c-d0b1-46cd-904e-626b44bc8f88 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:43.439856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:43.440988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d81d8f4c-a5f0-417e-89d2-82a6dfbf24d5 req-030c989c-d0b1-46cd-904e-626b44bc8f88 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:43.443471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:43.486513 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d81d8f4c-a5f0-417e-89d2-82a6dfbf24d5 req-030c989c-d0b1-46cd-904e-626b44bc8f88 service nova] Creating event network-changed:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h2-858238-3 Nov 02 14:30:43.508438 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d81d8f4c-a5f0-417e-89d2-82a6dfbf24d5 req-030c989c-d0b1-46cd-904e-626b44bc8f88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107696 Nov 02 14:30:43.509661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4027/6096] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:30:43.521772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:30:43.642331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:43.694384 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-597c301b-9c17-4f80-80b4-0b69d51e6919 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 204 len: 0 microversion: 2.1 time: 0.304186 Nov 02 14:30:43.696449 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2070/6097] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:30:43 2022] DELETE /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:30:43.719721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:43.720835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:43.732213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:43.733075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:43.733719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:43.735862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:43.736569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:43.739726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:44.321364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:44.336356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-84f0e8d5-8d84-4dcf-b4e3-b589ac0936b7 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1689 microversion: 2.1 time: 0.631838 Nov 02 14:30:44.336979 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4028/6098] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:43 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1689 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:44.982684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b7695e10-8205-4c22-9fee-2b88907c2bf7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'create', calling method: .version_select at 0x7f6f80e9a9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-787388278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlbIKUyXg7RU606yeg9R9ZOFlP6QjdbKsgwJlWBQpsqe9NXApxmJDAjCrQgJe2t/FwTcadpTLMa40jl9sZb0HiFMlWyyb8Yj/ZICJroZ90ovl5P3iNayvnzN9jLg8RCNQ=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:45.021225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b7695e10-8205-4c22-9fee-2b88907c2bf7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for project c2e6753524d84c849840fa530c8ed903. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:30:45.050912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b7695e10-8205-4c22-9fee-2b88907c2bf7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for user e4c0bd6bb7f4427f8fb921ab79f26c8d and project c2e6753524d84c849840fa530c8ed903. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:30:45.091473 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b7695e10-8205-4c22-9fee-2b88907c2bf7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.115377 Nov 02 14:30:45.092943 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2071/6099] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:30:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:45.360494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:45.361706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:45.373428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:45.377043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:45.377168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:45.377868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:45.379559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:45.380385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:45.824643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:45.834084 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04149ea8-2a8c-4e6f-a6ea-ec6c02050f8d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1689 microversion: 2.1 time: 0.477720 Nov 02 14:30:45.845091 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4029/6100] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:45 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1689 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:46.176223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-96640b25-5ab2-4810-9dd0-955c7bbb60b3 req-b39b5ffd-473f-4327-b187-b149f4350848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720", "name": "network-vif-deleted", "tag": "901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:46.206348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-96640b25-5ab2-4810-9dd0-955c7bbb60b3 req-b39b5ffd-473f-4327-b187-b149f4350848 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:46.207674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-96640b25-5ab2-4810-9dd0-955c7bbb60b3 req-b39b5ffd-473f-4327-b187-b149f4350848 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:46.208148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-96640b25-5ab2-4810-9dd0-955c7bbb60b3 req-b39b5ffd-473f-4327-b187-b149f4350848 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:46.231179 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-96640b25-5ab2-4810-9dd0-955c7bbb60b3 req-b39b5ffd-473f-4327-b187-b149f4350848 service nova] Creating event network-vif-deleted:901a9b2f-43ec-48b7-93bd-0c81e1d8c6f4 for instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 on n-h2-858238-3 Nov 02 14:30:46.257413 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-96640b25-5ab2-4810-9dd0-955c7bbb60b3 req-b39b5ffd-473f-4327-b187-b149f4350848 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091604 Nov 02 14:30:46.267696 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2072/6101] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:46.861734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:46.864638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:46.880459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:46.882174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:46.885239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:46.886333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:46.891460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:46.895564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:47.034281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:47.034774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:47.035255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:47.035713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lazy-loading 'fault' on Instance uuid e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:30:47.218286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:47.230116 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57e2b9a9-273b-4261-a30e-f83f7fbecd49 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 200 len: 1357 microversion: 2.1 time: 0.373122 Nov 02 14:30:47.231711 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4030/6102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:46 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 1357 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:48.194314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-635096133", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "553b9d8a-b7cf-4602-a437-1ebf2e1ab9bd"}], "key_name": "tempest-TestNetworkBasicOps-787388278", "security_groups": [{"name": "tempest-secgroup-smoke-1403707959"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:48.262721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:48.264657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:48.274822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:48.275426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:48.276179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:48.277157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:48.278314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:48.279154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:48.297842 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] HTTP exception thrown: Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 could not be found. Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Request method failure captured: Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 HTTP/1.1 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn6FT2ebFHeyGiDvpYZmHWZUEitQxVm9UdzRVMUNqPozVytZZFVegvhUcTwUUsS3e8zH4r_zJI72SrAy3p6YFswAWKuZDmTLiHnxkOvtkq_wKzmlKfHuGrT5mrR0Gqlrn3SGKUJckwsBgOhTviMnsMZoaHTBo6X2ALAxNRvtyMaEi9E Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac42cae4bc7144a29f8dbe098bf93945"}]}] Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ad99063111344e0d87dc99a96b2de8f9 Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 could not be found. Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720'} Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 could not be found. Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 could not be found. Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:48.299779 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 could not be found. Nov 02 14:30:48.306588 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:30:48.312240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Returning 404 to user: Instance e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:48.314937 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70de728d-8e99-46d3-bc96-cf0279a4a4c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720" status: 404 len: 111 microversion: 2.1 time: 0.063639 Nov 02 14:30:48.316450 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4031/6103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:48 2022] GET /compute/v2.1/servers/e83d11e2-fc3d-4dc1-b0e3-b9626ddd7720 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:30:48.664813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] validate_networks() for [('553b9d8a-b7cf-4602-a437-1ebf2e1ab9bd', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:30:49.154727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:30:49.155307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:30:49.155666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:30:49.156445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:30:49.156933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:30:49.166340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:49.166860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:49.167333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:49.168060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:49.168517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:49.168949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:49.186878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for project c2e6753524d84c849840fa530c8ed903. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:30:49.193209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Getting quotas for user e4c0bd6bb7f4427f8fb921ab79f26c8d and project c2e6753524d84c849840fa530c8ed903. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:30:49.207385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:30:49.209825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:30:49.259181 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b8c35e40-6064-414d-9cc6-3bcf41bbe899 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.069820 Nov 02 14:30:49.260724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2073/6104] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:30:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:30:49.271875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ed5423d-0b45-4171-a616-0ea4a1ba3b01 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:49.272487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ed5423d-0b45-4171-a616-0ea4a1ba3b01 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:49.338183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ed5423d-0b45-4171-a616-0ea4a1ba3b01 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:49.347540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ed5423d-0b45-4171-a616-0ea4a1ba3b01 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1247 microversion: 2.1 time: 0.079447 Nov 02 14:30:49.353442 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4032/6105] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:49 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:50.370038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:50.370652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:50.379128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:50.379600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:50.380049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:50.380778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:50.381249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:50.381690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:50.463614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:50.474437 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-de109e34-cd2c-4557-abb2-36c84fb311dc tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1299 microversion: 2.1 time: 0.108252 Nov 02 14:30:50.475563 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2074/6106] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:50 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:51.498000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:51.499343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:51.508075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:51.509011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:51.509656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:51.510591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:51.511303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:51.512051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:51.536308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:51.588040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:51.596188 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fcd16ed5-e350-4476-a2bd-6c8df88c285d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1305 microversion: 2.1 time: 0.102061 Nov 02 14:30:51.613871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4033/6107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:51 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:52.622620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:52.623440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:52.626502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:52.647672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:52.648259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:52.648728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:52.649487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:52.658084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:52.658634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:52.955721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:52.974992 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c81ee0d1-14c1-495d-ab10-34a3d165e9c8 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.355711 Nov 02 14:30:52.976908 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2075/6108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:52 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:54.006262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:54.007840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:54.010055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:54.021916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:54.022692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:54.023162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:54.024079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:54.024541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:54.024963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:54.318084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:54.327952 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-906e2e27-9169-44ed-981d-d7aa282356b5 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.329439 Nov 02 14:30:54.328877 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4034/6109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:53 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:54.991172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ba49da4f-f34a-43d5-9853-c4e3edeae6f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '.version_select at 0x7f6f80f59a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:55.013347 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ba49da4f-f34a-43d5-9853-c4e3edeae6f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1207545379" status: 202 len: 0 microversion: 2.1 time: 0.026396 Nov 02 14:30:55.016101 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2076/6110] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 14:30:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1207545379 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:30:55.055898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a3dad1a6-bdc5-4c43-ad2d-6f89bae93469 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: .version_select at 0x7f6f80189940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-792416006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+X97kqJXQsavvWJjBdyAVgZsNyj6ZebbjfA6lJvrlQ0+t9pOrt9AVkOrvJ6zFja6hBx1kSAtJqG+Xg1dIs7L8A+ngT/MoNdU218JsYsR8PgWsjKaHO1ejar5ubkjOlAA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:55.076552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a3dad1a6-bdc5-4c43-ad2d-6f89bae93469 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:30:55.082599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a3dad1a6-bdc5-4c43-ad2d-6f89bae93469 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:30:55.110585 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a3dad1a6-bdc5-4c43-ad2d-6f89bae93469 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060572 Nov 02 14:30:55.111221 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4035/6111] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:30:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:55.243108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-439ff256-862d-4e83-bf44-d2a816ca15f0 req-7d8a90c5-f1fb-46b6-8c99-335fc55c9d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6681d4f-9464-4726-8eb9-b4ef8d770d58", "tag": "6f750333-db7f-4cd6-85ef-ca3313705aa5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:55.258296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-439ff256-862d-4e83-bf44-d2a816ca15f0 req-7d8a90c5-f1fb-46b6-8c99-335fc55c9d29 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:55.259018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-439ff256-862d-4e83-bf44-d2a816ca15f0 req-7d8a90c5-f1fb-46b6-8c99-335fc55c9d29 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:55.259747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-439ff256-862d-4e83-bf44-d2a816ca15f0 req-7d8a90c5-f1fb-46b6-8c99-335fc55c9d29 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:55.271335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-439ff256-862d-4e83-bf44-d2a816ca15f0 req-7d8a90c5-f1fb-46b6-8c99-335fc55c9d29 service nova] Creating event network-changed:6f750333-db7f-4cd6-85ef-ca3313705aa5 for instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 on n-h1-858238-3 Nov 02 14:30:55.281664 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-439ff256-862d-4e83-bf44-d2a816ca15f0 req-7d8a90c5-f1fb-46b6-8c99-335fc55c9d29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042546 Nov 02 14:30:55.283262 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2077/6112] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:55.352244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:55.353180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:55.363605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:55.364398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:55.368534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:55.369484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:55.370703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:55.371354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:55.564287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:55.581800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef1c79ca-1149-4434-ab18-f4123a7c969e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.233894 Nov 02 14:30:55.582716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4036/6113] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:55 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:56.607596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:56.609142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:56.615572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:56.616082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:56.616545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:56.617267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:56.617773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:56.618219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:56.788810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:56.797158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-049e86d6-149f-4361-b9b9-8fa3bc7adc89 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.194806 Nov 02 14:30:56.798116 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2078/6114] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:56 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:57.823396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:57.824023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:57.832585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:57.833453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:57.833896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:57.834620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:57.835815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:57.836379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:57.983748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:57.993004 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f90308b-d4d5-45d7-bb12-d45ddd08a15d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.174887 Nov 02 14:30:57.994046 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4037/6115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:57 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:59.016859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:59.017712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:59.025781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:59.026274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:59.026710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:59.027476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:59.027941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:59.028547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:59.180039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:59.196778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:59.201204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:59.210780 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b82cc1fa-280f-4322-a88a-74178c71031e tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.195074 Nov 02 14:30:59.210780 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2079/6116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:30:59 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:00.233557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:00.234268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:00.241766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:00.242657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:00.243241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:00.244580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:00.245280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:00.246177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:00.405593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:00.417612 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7d8c09ef-dad4-435b-9041-94c297ea8310 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.188281 Nov 02 14:31:00.419331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4038/6117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:00 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:01.213572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b063fabf-4a22-49fc-b4ff-d6130a0138d6 req-16feb6bc-2e93-40ae-9a1d-049a79239edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6681d4f-9464-4726-8eb9-b4ef8d770d58", "name": "network-vif-plugged", "status": "completed", "tag": "6f750333-db7f-4cd6-85ef-ca3313705aa5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:01.251602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b063fabf-4a22-49fc-b4ff-d6130a0138d6 req-16feb6bc-2e93-40ae-9a1d-049a79239edc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:01.252879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b063fabf-4a22-49fc-b4ff-d6130a0138d6 req-16feb6bc-2e93-40ae-9a1d-049a79239edc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:01.253490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b063fabf-4a22-49fc-b4ff-d6130a0138d6 req-16feb6bc-2e93-40ae-9a1d-049a79239edc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:01.277458 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b063fabf-4a22-49fc-b4ff-d6130a0138d6 req-16feb6bc-2e93-40ae-9a1d-049a79239edc service nova] Creating event network-vif-plugged:6f750333-db7f-4cd6-85ef-ca3313705aa5 for instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 on n-h1-858238-3 Nov 02 14:31:01.290761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b063fabf-4a22-49fc-b4ff-d6130a0138d6 req-16feb6bc-2e93-40ae-9a1d-049a79239edc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092425 Nov 02 14:31:01.291643 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2080/6118] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:31:01.446356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:01.447718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:01.466777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:01.467948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:01.468474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:01.469301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:01.470041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:01.470656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:01.675177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:01.689014 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be48a91e-e09b-4db5-adad-d339de7aa6eb tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.250269 Nov 02 14:31:01.690684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4039/6119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:01 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:02.551447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-59784163", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "e8c2ec8c-c9bd-47ca-b2a7-31e73f243d23"}], "key_name": "tempest-TestNetworkAdvancedServerOps-792416006", "security_groups": [{"name": "tempest-secgroup-smoke-52877394"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:02.687201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] validate_networks() for [('e8c2ec8c-c9bd-47ca-b2a7-31e73f243d23', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:31:02.713479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:02.714024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:02.729430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:02.730112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:02.730692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:02.731665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:02.732449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:02.733237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:02.962013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:02.991950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46e4b9ce-fdf2-41d5-a0f7-a0512c7dbd1d tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1373 microversion: 2.1 time: 0.282429 Nov 02 14:31:02.993150 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4040/6120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:02 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1373 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:03.265133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:31:03.265580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:31:03.266308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:31:03.266516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:31:03.266953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:31:03.277988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:03.278484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:03.279139 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:03.279743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:03.280211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:03.280649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:03.310427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:31:03.320706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:31:03.336111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:31:03.338895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:31:03.389336 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b5cb3575-defa-4897-bbb2-9494feaaaf9f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.843080 Nov 02 14:31:03.390270 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2081/6121] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:31:02 2022] POST /compute/v2.1/servers => generated 404 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:31:03.401634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a5ea38c8-faf2-48a9-a8ce-850f58fa2854 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:03.402146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a5ea38c8-faf2-48a9-a8ce-850f58fa2854 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:03.460273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a5ea38c8-faf2-48a9-a8ce-850f58fa2854 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:03.468042 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a5ea38c8-faf2-48a9-a8ce-850f58fa2854 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1264 microversion: 2.1 time: 0.070293 Nov 02 14:31:03.468616 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4041/6122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:03 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1264 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:04.017585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:04.018239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:04.027123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.028432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.028990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.029847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.030390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.031017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.204783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:04.214011 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2969710-3947-41b8-bef1-d03fa24bdfbe tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1546 microversion: 2.1 time: 0.201051 Nov 02 14:31:04.214619 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2082/6123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:04 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:04.239549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:04.240909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:04.250657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.251123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.251720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.252581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.253183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.253784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.424127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:04.433394 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce43b1a3-45b6-40c8-af96-3de626b1e6f7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1546 microversion: 2.1 time: 0.199245 Nov 02 14:31:04.434329 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4042/6124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:04 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:04.491625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:04.492257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:04.498916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.499457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.499909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.500645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.501114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.501769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.589562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:04.598186 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-885e3773-2f79-4a16-8c48-f430bc8f0d9a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1316 microversion: 2.1 time: 0.110142 Nov 02 14:31:04.598791 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2083/6125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:04 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:05.622247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:05.624113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:05.634114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:05.637956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:05.638644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:05.639905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:05.642475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:05.643166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:06.209990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:06.218571 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d5670a92-9ffb-4919-91d3-82e43dd5b074 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.600040 Nov 02 14:31:06.219267 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4043/6126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:05 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:06.560799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c1427c6e-dd77-4672-8cc8-b1257f7355e0 req-33d5bdaa-ec3d-470c-92c4-6b8f2fe472f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:06.579728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c1427c6e-dd77-4672-8cc8-b1257f7355e0 req-33d5bdaa-ec3d-470c-92c4-6b8f2fe472f5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:06.580643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c1427c6e-dd77-4672-8cc8-b1257f7355e0 req-33d5bdaa-ec3d-470c-92c4-6b8f2fe472f5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:06.581389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c1427c6e-dd77-4672-8cc8-b1257f7355e0 req-33d5bdaa-ec3d-470c-92c4-6b8f2fe472f5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:06.595436 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c1427c6e-dd77-4672-8cc8-b1257f7355e0 req-33d5bdaa-ec3d-470c-92c4-6b8f2fe472f5 service nova] Creating event network-changed:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:31:06.601449 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c1427c6e-dd77-4672-8cc8-b1257f7355e0 req-33d5bdaa-ec3d-470c-92c4-6b8f2fe472f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046710 Nov 02 14:31:06.602147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2084/6127] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:31:06.774749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-560c2751-84f0-4211-bd04-47cbc1693052 req-30974601-6cc6-48c9-9330-3ff1d0f41814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6681d4f-9464-4726-8eb9-b4ef8d770d58", "tag": "6f750333-db7f-4cd6-85ef-ca3313705aa5"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:06.786594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-560c2751-84f0-4211-bd04-47cbc1693052 req-30974601-6cc6-48c9-9330-3ff1d0f41814 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:06.787948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-560c2751-84f0-4211-bd04-47cbc1693052 req-30974601-6cc6-48c9-9330-3ff1d0f41814 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:06.788580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-560c2751-84f0-4211-bd04-47cbc1693052 req-30974601-6cc6-48c9-9330-3ff1d0f41814 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:07.102020 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-560c2751-84f0-4211-bd04-47cbc1693052 req-30974601-6cc6-48c9-9330-3ff1d0f41814 service nova] Creating event network-changed:6f750333-db7f-4cd6-85ef-ca3313705aa5 for instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 on n-h1-858238-3 Nov 02 14:31:07.108191 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-560c2751-84f0-4211-bd04-47cbc1693052 req-30974601-6cc6-48c9-9330-3ff1d0f41814 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337899 Nov 02 14:31:07.109054 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4044/6128] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:07.242697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:07.243835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:07.250374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:07.251183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:07.251872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:07.253305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:07.253973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:07.254661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:07.407307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:07.419004 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-32fda2bf-ee3d-4fae-890a-b14a3b2d7d28 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.175881 Nov 02 14:31:07.419004 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2085/6129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:07 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:08.438439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:08.439166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:08.446659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:08.447167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:08.447607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:08.448305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:08.448760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:08.449177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:08.582328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:08.590753 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59038d94-85a7-4b47-a7f4-db0163e5b301 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.157343 Nov 02 14:31:08.591354 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4045/6130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:08 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:09.613407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:09.614029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:09.621078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:09.621575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:09.622022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:09.622723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:09.623215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:09.623654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:09.761127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:09.768867 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7da46fc7-91d7-4f21-98fd-67d144f5b5f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.159518 Nov 02 14:31:09.769436 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2086/6131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:09 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:10.792294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:10.792904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:10.799871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:10.800357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:10.800796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:10.801496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:10.801946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:10.802371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:10.941740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:10.950154 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f5c3af3e-c71c-439c-a4f1-ba59e5b645fd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.161715 Nov 02 14:31:10.950741 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4046/6132] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:10 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:11.973847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:11.975074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:11.981922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:11.982419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:11.982876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:11.983615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:11.984083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:11.984519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:12.116490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:12.124209 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5c18c550-7937-42af-9248-a73d8f62e089 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.154301 Nov 02 14:31:12.124777 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2087/6133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:11 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:12.363296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-afbd28ad-46bf-49ad-8292-7f6d851d05bd req-6382a5d8-1c6d-4a72-bcdd-01236fdc303f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "name": "network-vif-plugged", "status": "completed", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:12.375027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-afbd28ad-46bf-49ad-8292-7f6d851d05bd req-6382a5d8-1c6d-4a72-bcdd-01236fdc303f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:12.376147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-afbd28ad-46bf-49ad-8292-7f6d851d05bd req-6382a5d8-1c6d-4a72-bcdd-01236fdc303f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:12.376589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-afbd28ad-46bf-49ad-8292-7f6d851d05bd req-6382a5d8-1c6d-4a72-bcdd-01236fdc303f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:12.388547 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-afbd28ad-46bf-49ad-8292-7f6d851d05bd req-6382a5d8-1c6d-4a72-bcdd-01236fdc303f service nova] Creating event network-vif-plugged:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:31:12.393545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-afbd28ad-46bf-49ad-8292-7f6d851d05bd req-6382a5d8-1c6d-4a72-bcdd-01236fdc303f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Nov 02 14:31:12.395416 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4047/6134] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:13.148321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:13.148947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:13.156086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:13.156701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:13.157159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:13.157874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:13.158349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:13.158822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:13.298253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:13.301054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:13.308910 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-80cbaa60-8f71-4446-b9f3-297ea1845029 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1388 microversion: 2.1 time: 0.165043 Nov 02 14:31:13.309505 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2088/6135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:13 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:14.334936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:14.335574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:14.338596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:14.344218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:14.344695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:14.345126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:14.345950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:14.346413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:14.346836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:14.495069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:14.503008 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-568bee62-fb16-4ffe-b489-be6e3664863e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1560 microversion: 2.1 time: 0.173480 Nov 02 14:31:14.503614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4048/6136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:14 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:14.525410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:14.526028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:14.527876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:14.534009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:14.534505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:14.534953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:14.535684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:14.536152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:14.537132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:14.539691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=73 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:14.670478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:14.678835 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-01b906ee-fba2-4b36-8f69-fa1a2c8361cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1560 microversion: 2.1 time: 0.157497 Nov 02 14:31:14.679468 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2089/6137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:14 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:16.263413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:16.264023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:16.265258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e1cf4954-8f45-4585-adf9-025878b549a8 req-a86c3a8e-fe2a-4e69-b5fe-3258524bc244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:16.272212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:16.272718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:16.273359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:16.274078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:16.274538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:16.275308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:16.277195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1cf4954-8f45-4585-adf9-025878b549a8 req-a86c3a8e-fe2a-4e69-b5fe-3258524bc244 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:16.277357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1cf4954-8f45-4585-adf9-025878b549a8 req-a86c3a8e-fe2a-4e69-b5fe-3258524bc244 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:16.278128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e1cf4954-8f45-4585-adf9-025878b549a8 req-a86c3a8e-fe2a-4e69-b5fe-3258524bc244 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:16.292569 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e1cf4954-8f45-4585-adf9-025878b549a8 req-a86c3a8e-fe2a-4e69-b5fe-3258524bc244 service nova] Creating event network-changed:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:31:16.297683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e1cf4954-8f45-4585-adf9-025878b549a8 req-a86c3a8e-fe2a-4e69-b5fe-3258524bc244 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035973 Nov 02 14:31:16.298583 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2090/6138] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:31:16.634555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:16.642885 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d461c04f-ed79-439d-a512-f434415079da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1560 microversion: 2.1 time: 0.383515 Nov 02 14:31:16.643549 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4049/6139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:16 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1560 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:31.121957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:31.122719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=7 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:31.127362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:31.129620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:31.137458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:31.137951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:31.138396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:31.139109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:31.139670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:31.140050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:31.222235 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1b561ce5-953f-4215-ad75-530deff30182 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58/action" status: 200 len: 24568 microversion: 2.1 time: 0.102248 Nov 02 14:31:31.222918 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2091/6140] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:31:31 2022] POST /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58/action => generated 24568 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:39.897748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:39.899979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:39.903674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:39.904336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=78 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:39.910290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:39.910798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:39.911284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:39.911958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:39.912519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:39.912836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:39.970887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-99baf602-4ba0-4a77-9c47-a85093fecf24 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action" status: 200 len: 24565 microversion: 2.1 time: 0.076821 Nov 02 14:31:39.971615 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4050/6141] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:31:39 2022] POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:42.265756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:42.268351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:42.271534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:42.272202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:42.279792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:42.280288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:42.280740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:42.281448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:42.281914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:42.282349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:42.337762 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-84c6afe3-5d52-4fa4-a6cd-0ec22a72674f tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "POST /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58/action" status: 200 len: 32644 microversion: 2.1 time: 0.076811 Nov 02 14:31:42.338411 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2092/6142] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:31:42 2022] POST /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58/action => generated 32644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:43.460377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:43.460965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:43.463261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c2a1ff84-1d94-4aa4-b2b7-77421d55b6ec req-c20a3872-775b-4e95-ac91-2bf6371e6148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6681d4f-9464-4726-8eb9-b4ef8d770d58", "tag": "6f750333-db7f-4cd6-85ef-ca3313705aa5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:43.470057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.470501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.471160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.471885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.472339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.472945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.475027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c2a1ff84-1d94-4aa4-b2b7-77421d55b6ec req-c20a3872-775b-4e95-ac91-2bf6371e6148 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.475546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c2a1ff84-1d94-4aa4-b2b7-77421d55b6ec req-c20a3872-775b-4e95-ac91-2bf6371e6148 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.476110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c2a1ff84-1d94-4aa4-b2b7-77421d55b6ec req-c20a3872-775b-4e95-ac91-2bf6371e6148 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.488130 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c2a1ff84-1d94-4aa4-b2b7-77421d55b6ec req-c20a3872-775b-4e95-ac91-2bf6371e6148 service nova] Creating event network-changed:6f750333-db7f-4cd6-85ef-ca3313705aa5 for instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 on n-h1-858238-3 Nov 02 14:31:43.494134 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c2a1ff84-1d94-4aa4-b2b7-77421d55b6ec req-c20a3872-775b-4e95-ac91-2bf6371e6148 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035264 Nov 02 14:31:43.495958 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2093/6143] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:43.504079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:31:43.607284 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5380ada-7fc1-45e2-9906-f7991c0beced tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 204 len: 0 microversion: 2.1 time: 0.150913 Nov 02 14:31:43.608204 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4051/6144] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:31:43 2022] DELETE /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:31:43.617360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:43.618082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:43.625285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.626019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.626681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.627508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.627969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.628552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.777893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:43.785888 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-14705d98-9ec4-47e0-9c2d-35e86bf79c6b tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1670 microversion: 2.1 time: 0.173239 Nov 02 14:31:43.786465 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2094/6145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:43 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:44.810838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:44.812226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:44.823342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:44.823833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:44.824265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:44.824996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:44.825446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:44.825867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:44.961912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:44.971198 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-30a31f06-df9d-4b81-899a-7eca5281540c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1670 microversion: 2.1 time: 0.164922 Nov 02 14:31:44.971984 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4052/6146] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:44 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:45.515241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6fa7dfe0-a0f2-42e2-8063-1585c386e47b req-bc97f679-e11d-4d01-93bb-0fa8ab8d9626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6681d4f-9464-4726-8eb9-b4ef8d770d58", "name": "network-vif-deleted", "tag": "6f750333-db7f-4cd6-85ef-ca3313705aa5"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:45.526004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6fa7dfe0-a0f2-42e2-8063-1585c386e47b req-bc97f679-e11d-4d01-93bb-0fa8ab8d9626 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:45.526497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6fa7dfe0-a0f2-42e2-8063-1585c386e47b req-bc97f679-e11d-4d01-93bb-0fa8ab8d9626 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:45.526942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6fa7dfe0-a0f2-42e2-8063-1585c386e47b req-bc97f679-e11d-4d01-93bb-0fa8ab8d9626 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:45.538827 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6fa7dfe0-a0f2-42e2-8063-1585c386e47b req-bc97f679-e11d-4d01-93bb-0fa8ab8d9626 service nova] Creating event network-vif-deleted:6f750333-db7f-4cd6-85ef-ca3313705aa5 for instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 on n-h1-858238-3 Nov 02 14:31:45.543975 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6fa7dfe0-a0f2-42e2-8063-1585c386e47b req-bc97f679-e11d-4d01-93bb-0fa8ab8d9626 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Nov 02 14:31:45.544594 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2095/6147] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:31:45.994981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:45.995787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:46.003854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.004448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.004951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.005728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.006250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.006685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.047323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.048034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.048465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.048911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lazy-loading 'fault' on Instance uuid a6681d4f-9464-4726-8eb9-b4ef8d770d58 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:31:46.091818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c0bd6bb7f4427f8fb921ab79f26c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e6753524d84c849840fa530c8ed903', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:46.098893 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d27dc97-6274-4c60-a795-ecee9418fc58 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 200 len: 1337 microversion: 2.1 time: 0.107827 Nov 02 14:31:46.099491 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4053/6148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:45 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:46.337307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:46.337946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:46.345157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.345657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.346105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.346845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.347346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.347816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.480202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-14c95006-b2e3-416d-b7bc-8bc15614bd96 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1829 microversion: 2.1 time: 0.147503 Nov 02 14:31:46.480786 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2096/6149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:46 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1829 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:46.502892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:46.503520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:46.509528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.510009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.510441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.511147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.511602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.512583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.650709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:46.662653 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2deeb270-9944-4f77-b9ad-812098e580b4 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1678 microversion: 2.1 time: 0.163510 Nov 02 14:31:46.663278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4054/6150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:46 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:46.758669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:46.760989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:46.768084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.768585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.769069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.769775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:46.770251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:46.770690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.825604 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d82639dd-4415-462e-8186-982f0c58e6c0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action" status: 200 len: 32635 microversion: 2.1 time: 0.070138 Nov 02 14:31:46.826308 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2097/6151] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:31:46 2022] POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:31:47.065545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:47.066160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:47.073162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.073651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.074095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.075403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.075858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.076280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.103681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ba2b43d46cd041deb62cbf8326cb5584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f18e6b89440938327906857000c40', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:47.104272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] flavor_id is None. Assuming migration. {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 14:31:47.104716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:31:47.123273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:47.123997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] [instance: a6681d4f-9464-4726-8eb9-b4ef8d770d58] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:47.131235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.131738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.132201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.132893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.133358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.133851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.151224 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] HTTP exception thrown: Instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 could not be found. Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Request method failure captured: Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 HTTP/1.1 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn6FUVr5xaafABEe5EBptNiBOTJstCbura-nAKOunb95Oz8o5PRJBuKjbxQUy1mvLIWGC_WdyN3xjuTTtA2MVOqWR_MetlzSbSaOp74pLAdbFtgsjUNxFoPyxxSOTjdMLolKYFtEdoSOsH1PJ8AK1Zm90ZeOdA7TAAGDxuYeUVLpb5o Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: c2e6753524d84c849840fa530c8ed903 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c2e6753524d84c849840fa530c8ed903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c2e6753524d84c849840fa530c8ed903"}]}] Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: c2e6753524d84c849840fa530c8ed903 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestNetworkBasicOps-1174629021 Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestNetworkBasicOps-1174629021-project Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e4c0bd6bb7f4427f8fb921ab79f26c8d Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestNetworkBasicOps-1174629021-project Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 could not be found. Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'a6681d4f-9464-4726-8eb9-b4ef8d770d58'} Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 could not be found. Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 could not be found. Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:31:47.152935 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 could not be found. Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Returning 404 to user: Instance a6681d4f-9464-4726-8eb9-b4ef8d770d58 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cda47d1c-9bd2-444f-9acd-b9fb7f38f64c tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58" status: 404 len: 111 microversion: 2.1 time: 0.036223 Nov 02 14:31:47.157386 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2098/6152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:47 2022] GET /compute/v2.1/servers/a6681d4f-9464-4726-8eb9-b4ef8d770d58 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:31:47.231900 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6c86e89-cb89-46cc-bcbd-0993a1686e2b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action" status: 202 len: 0 microversion: 2.1 time: 0.169942 Nov 02 14:31:47.235668 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4055/6153] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:31:47 2022] POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:31:47.240865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:47.241504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:47.248731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.249239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.249692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.250407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.250877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.251347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.396244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cdad2753-321d-4c67-b121-cc9aa69292e7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] Calling method '.version_select at 0x7f6f802505e0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:47.426469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cdad2753-321d-4c67-b121-cc9aa69292e7 tempest-TestNetworkBasicOps-1174629021 tempest-TestNetworkBasicOps-1174629021-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-787388278" status: 202 len: 0 microversion: 2.1 time: 0.034230 Nov 02 14:31:47.427418 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4056/6154] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Nov 2 14:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-787388278 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:31:47.442100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:47.450681 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7bde6583-634a-40c4-baed-f7f2511e7067 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1687 microversion: 2.1 time: 0.213724 Nov 02 14:31:47.454905 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2099/6155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:47 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:48.475523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:48.477358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:48.484650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:48.485137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:48.485569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:48.486923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:48.486923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:48.487467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:48.937936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:48.947748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7dfb4c0f-8d04-4de1-8861-88576d01552a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1687 microversion: 2.1 time: 0.476949 Nov 02 14:31:48.948352 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4057/6156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:48 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1687 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:49.972760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:49.973390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:49.981374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:49.981785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:49.982237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:49.982992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:49.983486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:49.984128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:50.180630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:50.189322 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-28887028-0327-4ea7-b239-c38ee056b7cc tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.220335 Nov 02 14:31:50.189841 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2100/6157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:49 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:51.214002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:51.214865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:51.224240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:51.225101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:51.225922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:51.226892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:51.227562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:51.228124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:51.470354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:51.478966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19a2b2ce-a32a-4fab-9807-8d9b578e11ad tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.268848 Nov 02 14:31:51.479854 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4058/6158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:51 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:52.503862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:52.504611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:52.511644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:52.512159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:52.512681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:52.513467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:52.514095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:52.514732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:52.658750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:52.667450 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-806b2a03-426d-44cf-a23f-7e852b1fced2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.167454 Nov 02 14:31:52.668551 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2101/6159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:52 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:53.693104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:53.693634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:53.701047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:53.701529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:53.701970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:53.702657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:53.703115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:53.703556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:53.837992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:53.845735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8012648-b218-4dad-bb43-c0fe0e60ca0e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.156883 Nov 02 14:31:53.846313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4059/6160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:53 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:54.868993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:54.869517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:54.876455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:54.876945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:54.877388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:54.878081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:54.878543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:54.878977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:55.012403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:55.020441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9ffd4a57-0ddb-4e5a-b22d-b66823921a07 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.155403 Nov 02 14:31:55.021024 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2102/6161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:54 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:56.045107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:56.045719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:56.052797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:56.053280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:56.053715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:56.054410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:56.054862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:56.055320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:56.190597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:56.198778 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0801cb14-4953-4756-b938-c4a785c24ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.158253 Nov 02 14:31:56.199890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4060/6162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:56 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:57.223247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:57.223868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:57.230956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:57.231477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:57.231921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.232621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:57.233082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:57.233518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.367635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:57.376295 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cf95ced3-3215-4a34-b764-76435ee23d39 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.156949 Nov 02 14:31:57.376874 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2103/6163] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:57 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:58.404164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:58.404885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:58.411810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:58.412316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:58.412761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:58.413473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:58.413927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:58.414352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:58.552092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:58.559964 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f622ca38-f347-43d9-b118-2a4f5bc26b12 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.160340 Nov 02 14:31:58.560549 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4061/6164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:58 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:59.584667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:59.585324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:59.592737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:59.593236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:59.593684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:59.594383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:59.594849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:59.595315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:59.728600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:59.736992 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-78edd358-bebb-448f-9cd5-81c21a90fa8e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.156279 Nov 02 14:31:59.737555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2104/6165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:31:59 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:00.761495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:00.762001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:00.770645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:00.770645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:00.770645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:00.770980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:00.771344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:00.771765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:00.913796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:00.922542 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-92ef5fd9-308a-4802-8278-18f937b47fbf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.164994 Nov 02 14:32:00.923178 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4062/6166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:00 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:01.946582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:01.947419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:01.955045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:01.955576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:01.956019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:01.956724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:01.957184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:01.957615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:02.098187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:02.106173 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cb1f6152-f735-4348-8cfe-28418e68169d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1692 microversion: 2.1 time: 0.163407 Nov 02 14:32:02.106762 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2105/6167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:01 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:02.619347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "name": "network-vif-unplugged", "status": "completed", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:02.630859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:02.631343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:02.631777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:02.644362 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] Creating event network-vif-unplugged:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h1-858238-3 Nov 02 14:32:02.650196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:32:02.662272 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cde0496c-3297-4d7a-a742-10290a3d0af0 req-99c75ecc-ac67-473d-8071-c27fafa88a50 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046943 Nov 02 14:32:02.663310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4063/6168] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:03.131020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:03.132693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:03.139422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:03.139920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:03.140366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:03.141066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:03.141672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:03.142115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:03.384172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:03.393738 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cc23bd7f-a964-4fd5-9092-e193bc48d80c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1691 microversion: 2.1 time: 0.266578 Nov 02 14:32:03.394456 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2106/6169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:03 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1691 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:04.419442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:04.419946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:04.426190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:04.426674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:04.427127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:04.427851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:04.428305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:04.428729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:04.449024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:04.567290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:04.575312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-346092bb-17cf-4b65-b975-6243b3ebed54 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1689 microversion: 2.1 time: 0.161249 Nov 02 14:32:04.576408 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4064/6170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:04 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:04.687470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:04.697740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:04.698221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:04.698661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:04.710791 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] Creating event network-changed:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h1-858238-3 Nov 02 14:32:04.716074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:32:04.731790 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-4149eed5-d2c0-4723-96e6-aeee119fa7d6 req-4391f8c2-51e5-4b19-b316-24ca4bfa5ae8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043242 Nov 02 14:32:04.731790 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2107/6171] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:05.601682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:05.602297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:05.610542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:05.611354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:05.611883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:05.612666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:05.613381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:05.613876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:05.747798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:05.755846 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b8d4c52-879c-4adf-9ec2-6e9d771c7376 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1686 microversion: 2.1 time: 0.159032 Nov 02 14:32:05.756375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4065/6172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:05 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:05.779963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:05.780596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:05.786758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:05.787290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:05.787735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:05.788432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:05.788896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:05.789330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:05.895479 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-33353f75-ddff-4b86-a1a9-65f5c9f2661b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action" status: 202 len: 0 microversion: 2.1 time: 0.120842 Nov 02 14:32:05.896085 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2108/6173] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:32:05 2022] POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:32:05.904684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:05.905312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:05.911520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:05.912189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:05.912457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:05.913159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:05.913612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:05.914039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:06.112665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:06.120484 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4626f84-9735-45ec-a9c8-22fdcd77fb5f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1685 microversion: 2.1 time: 0.220164 Nov 02 14:32:06.121076 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4066/6174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:05 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:07.146604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:07.147350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:07.153626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:07.154127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:07.154575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:07.155322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:07.155450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "name": "network-vif-plugged", "status": "completed", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:07.155860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:07.156218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:07.166548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:07.167656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:07.168080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:07.183236 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] Creating event network-vif-plugged:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h1-858238-3 Nov 02 14:32:07.189652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:32:07.202013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-26838b37-7c02-47cb-9216-7e4c4c48b4a6 req-d065923a-ad4d-4d50-97f5-304a1d2de79f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049654 Nov 02 14:32:07.202996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4067/6175] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:07.300101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:07.302454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:07.309118 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f978a4b-c3fa-449a-9d2a-1d64664dc9b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1685 microversion: 2.1 time: 0.167704 Nov 02 14:32:07.309691 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2109/6176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:07 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:08.335015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:08.335765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:08.343027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:08.343571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:08.344010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:08.344716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:08.345173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:08.345602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:08.489386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:08.497340 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-939546da-991d-438a-9abd-e651e52a9566 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1685 microversion: 2.1 time: 0.167475 Nov 02 14:32:08.497926 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4068/6177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:08 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:09.073944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "name": "network-vif-unplugged", "status": "completed", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:09.084844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:09.085325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:09.085759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:09.098057 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] Creating event network-vif-unplugged:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:32:09.103476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:32:09.114690 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3189e553-6c94-46af-b17c-a58627896335 req-f01951f1-8dc3-4a6d-8f20-8c8e0cd03bd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044886 Nov 02 14:32:09.115280 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2110/6178] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:09.522057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:09.522700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:09.530863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:09.531474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:09.531925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:09.532645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:09.533104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:09.533566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:09.680003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:09.687747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-438a9b6b-367a-4d8d-b7d0-697d88237664 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1685 microversion: 2.1 time: 0.169696 Nov 02 14:32:09.688330 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4069/6179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:09 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:10.713541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:10.714169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:10.721013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:10.721508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:10.721959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:10.722669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:10.723160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:10.723602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:10.868707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:10.877476 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-584cba99-fba1-494e-97db-e8647aa6de01 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1685 microversion: 2.1 time: 0.169160 Nov 02 14:32:10.878073 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2111/6180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:10 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:11.131517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:11.137278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:11.143530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:11.144007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:11.144427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:11.161239 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] Creating event network-changed:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:32:11.167047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:32:11.178401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-476cfc5d-0bd0-48ce-8bbd-1f4c42b7a1f9 req-d5863ee8-eeac-44ab-be4e-1b1fa272ff9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050650 Nov 02 14:32:11.179348 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4070/6181] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:11.901563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:11.902767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:11.910687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:11.911262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:11.911715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:11.912433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:11.912897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:11.913337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:12.108290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:12.116203 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e3fe682-3cbd-4231-8429-1fe978119134 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1678 microversion: 2.1 time: 0.218981 Nov 02 14:32:12.116769 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2112/6182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:11 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:14.663978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-0582cb25-f69c-4c41-8e4c-6b76cbd6404f req-8d1508db-4fe9-42ef-bd33-c680757ed07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "name": "network-vif-plugged", "status": "completed", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:14.674340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0582cb25-f69c-4c41-8e4c-6b76cbd6404f req-8d1508db-4fe9-42ef-bd33-c680757ed07f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:14.674817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0582cb25-f69c-4c41-8e4c-6b76cbd6404f req-8d1508db-4fe9-42ef-bd33-c680757ed07f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:14.676102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-0582cb25-f69c-4c41-8e4c-6b76cbd6404f req-8d1508db-4fe9-42ef-bd33-c680757ed07f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:14.688478 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-0582cb25-f69c-4c41-8e4c-6b76cbd6404f req-8d1508db-4fe9-42ef-bd33-c680757ed07f service nova] Creating event network-vif-plugged:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:32:14.693990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-0582cb25-f69c-4c41-8e4c-6b76cbd6404f req-8d1508db-4fe9-42ef-bd33-c680757ed07f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035229 Nov 02 14:32:14.694892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4071/6183] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:36.320572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:36.322766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:36.325453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=46 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:36.326141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=17 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:36.333350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:36.333846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:36.334320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:36.335023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:36.335518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:36.335949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:36.389488 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a98e7465-ebf2-4892-adc6-6d1d86c4b075 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action" status: 200 len: 62799 microversion: 2.1 time: 0.072850 Nov 02 14:32:36.390158 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2113/6184] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:32:36 2022] POST /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3/action => generated 62799 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:32:42.565785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:42.566480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:42.568960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:42.569607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=36 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:42.575672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:42.576152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:42.576585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:42.577282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:42.578225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:42.578655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:42.707889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-33d27f7f-f9b9-4046-9bb8-3c8a9b49732b tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1829 microversion: 2.1 time: 0.146482 Nov 02 14:32:42.708501 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4072/6185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:42 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1829 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:43.573208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:43.573806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:43.576920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b40200d8-3eb9-466f-8c9f-67a01b5b0890 req-de322039-bf90-468c-9fd6-09b546328d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:43.583379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:43.583877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:43.584321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:43.585024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:43.585486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:43.585918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:43.587630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b40200d8-3eb9-466f-8c9f-67a01b5b0890 req-de322039-bf90-468c-9fd6-09b546328d09 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:43.587831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b40200d8-3eb9-466f-8c9f-67a01b5b0890 req-de322039-bf90-468c-9fd6-09b546328d09 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:43.588836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b40200d8-3eb9-466f-8c9f-67a01b5b0890 req-de322039-bf90-468c-9fd6-09b546328d09 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:43.601233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b40200d8-3eb9-466f-8c9f-67a01b5b0890 req-de322039-bf90-468c-9fd6-09b546328d09 service nova] Creating event network-changed:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:32:43.606480 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b40200d8-3eb9-466f-8c9f-67a01b5b0890 req-de322039-bf90-468c-9fd6-09b546328d09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039933 Nov 02 14:32:43.607121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4073/6186] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:43.617596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:32:43.720408 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-140ce97a-50bb-4a25-b13a-79702a329656 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 204 len: 0 microversion: 2.1 time: 0.156208 Nov 02 14:32:43.721300 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2114/6187] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:32:43 2022] DELETE /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:32:43.730698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:43.731396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:43.739405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:43.739905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:43.740350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:43.741074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:43.741537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:43.741970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:43.899190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:43.908013 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e02299f-ba2a-49bf-b4b1-c76b43b966b8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1684 microversion: 2.1 time: 0.182027 Nov 02 14:32:43.908605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4074/6188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:43 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:32:44.933462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:44.934097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:44.943079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:44.943658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:44.944151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:44.944971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:44.945427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:44.945906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:45.088197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:45.097521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d83a8992-010a-4935-9209-1ca0fcffdd06 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1684 microversion: 2.1 time: 0.168707 Nov 02 14:32:45.098124 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2115/6189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:44 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:45.643740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-490c112c-57cc-42d5-8932-0308d7f65634 req-513bbb90-6a61-4ab6-bd88-84a8b8536ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30506a85-93a2-43f4-bd25-253b6aeb77e3", "name": "network-vif-deleted", "tag": "72081ca5-70bf-4332-800a-0cbc5190cf42"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:45.654667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-490c112c-57cc-42d5-8932-0308d7f65634 req-513bbb90-6a61-4ab6-bd88-84a8b8536ce5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:45.655161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-490c112c-57cc-42d5-8932-0308d7f65634 req-513bbb90-6a61-4ab6-bd88-84a8b8536ce5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:45.655583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-490c112c-57cc-42d5-8932-0308d7f65634 req-513bbb90-6a61-4ab6-bd88-84a8b8536ce5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:45.667845 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-490c112c-57cc-42d5-8932-0308d7f65634 req-513bbb90-6a61-4ab6-bd88-84a8b8536ce5 service nova] Creating event network-vif-deleted:72081ca5-70bf-4332-800a-0cbc5190cf42 for instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 on n-h2-858238-3 Nov 02 14:32:45.673390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-490c112c-57cc-42d5-8932-0308d7f65634 req-513bbb90-6a61-4ab6-bd88-84a8b8536ce5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033324 Nov 02 14:32:45.674227 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4075/6190] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:46.121935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:46.122564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:46.129295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:46.129786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:46.130225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:46.130927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:46.131417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:46.131847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:46.164805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:46.165225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:46.165672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:46.166130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lazy-loading 'fault' on Instance uuid 30506a85-93a2-43f4-bd25-253b6aeb77e3 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:32:46.208364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:46.215382 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5910af46-19d4-4ba2-bbf0-0fe286639dce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 200 len: 1354 microversion: 2.1 time: 0.097365 Nov 02 14:32:46.215950 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2116/6191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:46 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 1354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:47.241443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:47.243328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 30506a85-93a2-43f4-bd25-253b6aeb77e3] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:47.248347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:47.248832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:47.249267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:47.250644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:47.251113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:47.251547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:47.264898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] HTTP exception thrown: Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 could not be found. Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Request method failure captured: Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 HTTP/1.1 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn6FT2ebFHeyGiDvpYZmHWZUEitQxVm9UdzRVMUNqPozVytZZFVegvhUcTwUUsS3e8zH4r_zJI72SrAy3p6YFswAWKuZDmTLiHnxkOvtkq_wKzmlKfHuGrT5mrR0Gqlrn3SGKUJckwsBgOhTviMnsMZoaHTBo6X2ALAxNRvtyMaEi9E Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac42cae4bc7144a29f8dbe098bf93945"}]}] Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ad99063111344e0d87dc99a96b2de8f9 Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 could not be found. Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '30506a85-93a2-43f4-bd25-253b6aeb77e3'} Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 could not be found. Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 could not be found. Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:32:47.266528 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 could not be found. Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Returning 404 to user: Instance 30506a85-93a2-43f4-bd25-253b6aeb77e3 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff7d739e-7013-4834-8314-b22362bb1cce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3" status: 404 len: 111 microversion: 2.1 time: 0.031779 Nov 02 14:32:47.270651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4076/6192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:47 2022] GET /compute/v2.1/servers/30506a85-93a2-43f4-bd25-253b6aeb77e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:32:50.589660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-12cdd042-7274-46d5-b9b1-13f8d7adbca5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '.version_select at 0x7f6f8057fb80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:50.612151 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-12cdd042-7274-46d5-b9b1-13f8d7adbca5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-792416006" status: 202 len: 0 microversion: 2.1 time: 0.026862 Nov 02 14:32:50.612933 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2117/6193] 10.222.0.18 () {58 vars in 1281 bytes} [Wed Nov 2 14:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-792416006 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:32:50.645102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aab0d1bc-f58f-4725-aa1a-1712f01fab03 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: .version_select at 0x7f6f80144ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1179859414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfqlHUBOn6eWHv0ML9Fn1e1dnMSWURm82fx7q4eJAs7unvv3WhucU/N+IAk5LJPydEirPvQrTIINuaAf+esvohd1bU+SOzlGLFta1xi7vJpNXAdUduwKS9jVVEqIZQvHg=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:50.663008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-aab0d1bc-f58f-4725-aa1a-1712f01fab03 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:32:50.668273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-aab0d1bc-f58f-4725-aa1a-1712f01fab03 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:32:50.692635 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aab0d1bc-f58f-4725-aa1a-1712f01fab03 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051431 Nov 02 14:32:50.693243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4077/6194] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:32:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:56.509440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-330070982", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "1b3d8f7a-e669-438b-9f17-4ad1505a8f1f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1179859414", "security_groups": [{"name": "tempest-secgroup-smoke-575338543"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:56.528359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:56.655011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] validate_networks() for [('1b3d8f7a-e669-438b-9f17-4ad1505a8f1f', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:32:57.084711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:32:57.085343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:32:57.085834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:32:57.086262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:32:57.086695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:32:57.098776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:57.099300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:57.100961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:57.101546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:57.102008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:57.102624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:57.122042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:32:57.128331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:32:57.142349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:32:57.144718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:32:57.196042 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79162e0e-fb3a-4cc4-8834-589b6a83f338 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.692381 Nov 02 14:32:57.196219 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2118/6195] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:32:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:32:57.209528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b426f1c-0055-4422-97d9-e4923f4b1fe1 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:57.210468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b426f1c-0055-4422-97d9-e4923f4b1fe1 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:57.256693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:57.283951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b426f1c-0055-4422-97d9-e4923f4b1fe1 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:57.290836 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b426f1c-0055-4422-97d9-e4923f4b1fe1 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1266 microversion: 2.1 time: 0.086961 Nov 02 14:32:57.291450 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4078/6196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:57 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:58.315488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:58.316792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:58.327593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:58.328438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:58.329097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:58.330068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:58.330733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:58.331422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:58.407775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:58.442645 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7dbd92ef-ddaf-4b5f-b7fb-fbca2bdfcf7c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1326 microversion: 2.1 time: 0.132625 Nov 02 14:32:58.443289 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2119/6197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:58 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:59.466397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:59.467147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:59.476098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:59.476593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:59.477043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:59.477749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:59.478207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:59.478634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:59.701741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:59.714614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-79707e47-ce8b-4f8d-acd7-b281a81045c9 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1391 microversion: 2.1 time: 0.252138 Nov 02 14:32:59.715881 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4079/6198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:32:59 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:00.055657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-dab381d0-9c5e-49a3-828d-d5b6f505e045 req-3ebc218f-07bd-4b5f-a1e2-7d034a414ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:00.067277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-dab381d0-9c5e-49a3-828d-d5b6f505e045 req-3ebc218f-07bd-4b5f-a1e2-7d034a414ce9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:00.067803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-dab381d0-9c5e-49a3-828d-d5b6f505e045 req-3ebc218f-07bd-4b5f-a1e2-7d034a414ce9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:00.068252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-dab381d0-9c5e-49a3-828d-d5b6f505e045 req-3ebc218f-07bd-4b5f-a1e2-7d034a414ce9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:00.079914 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-dab381d0-9c5e-49a3-828d-d5b6f505e045 req-3ebc218f-07bd-4b5f-a1e2-7d034a414ce9 service nova] Creating event network-changed:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h1-858238-3 Nov 02 14:33:00.085012 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-dab381d0-9c5e-49a3-828d-d5b6f505e045 req-3ebc218f-07bd-4b5f-a1e2-7d034a414ce9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033069 Nov 02 14:33:00.085771 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2120/6199] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:00.738730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:00.739269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:00.746071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:00.746542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:00.746970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:00.747691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:00.748141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:00.748562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:00.886604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:00.894312 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-083ba9ba-1ce4-40eb-a4e3-e9735c449e31 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1391 microversion: 2.1 time: 0.159775 Nov 02 14:33:00.894942 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4080/6200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:00 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:01.918310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:01.919055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:01.926673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:01.927225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:01.927854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:01.928555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:01.929019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:01.929463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:02.139738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:02.147331 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c7ac5c5-9d38-4d0d-9af6-843b2fdd5412 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1391 microversion: 2.1 time: 0.233330 Nov 02 14:33:02.147906 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2121/6201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:01 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:03.169891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:03.170544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:03.178045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:03.178531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:03.178966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:03.179692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:03.180146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:03.180574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:03.319140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:03.327002 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01d6e491-ebdb-4ccf-a6a7-51649e3cf48e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1391 microversion: 2.1 time: 0.161095 Nov 02 14:33:03.327811 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4081/6202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:03 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:04.350391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:04.351017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:04.357925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:04.358427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:04.359030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:04.359694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:04.360164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:04.360614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:04.496154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:04.504191 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-20585a2d-244d-457a-be87-2368abf272eb tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1391 microversion: 2.1 time: 0.157689 Nov 02 14:33:04.504766 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2122/6203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:04 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:05.398774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f849baf7-9de2-4b42-866b-eefa4cb99445 req-c5d4e5db-a9f1-49f3-8f0b-2dca68c53d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "name": "network-vif-plugged", "status": "completed", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:05.409839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f849baf7-9de2-4b42-866b-eefa4cb99445 req-c5d4e5db-a9f1-49f3-8f0b-2dca68c53d1d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:05.410203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f849baf7-9de2-4b42-866b-eefa4cb99445 req-c5d4e5db-a9f1-49f3-8f0b-2dca68c53d1d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:05.410633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f849baf7-9de2-4b42-866b-eefa4cb99445 req-c5d4e5db-a9f1-49f3-8f0b-2dca68c53d1d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:05.423395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f849baf7-9de2-4b42-866b-eefa4cb99445 req-c5d4e5db-a9f1-49f3-8f0b-2dca68c53d1d service nova] Creating event network-vif-plugged:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h1-858238-3 Nov 02 14:33:05.428503 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f849baf7-9de2-4b42-866b-eefa4cb99445 req-c5d4e5db-a9f1-49f3-8f0b-2dca68c53d1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033558 Nov 02 14:33:05.429429 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4082/6204] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:05.527406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:05.528024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:05.535393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:05.536085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:05.536529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:05.537229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:05.537804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:05.538245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:05.673922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:05.681792 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d52b7c1-52fb-4fab-8de5-648c2e80739b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1391 microversion: 2.1 time: 0.158391 Nov 02 14:33:05.682371 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2123/6205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:05 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:06.707582 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:06.709319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:06.723954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:06.724623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:06.725153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:06.725982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:06.726536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:06.727055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:06.865539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:06.873447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-054838cf-ee10-43da-97ae-b31126e10c9b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1563 microversion: 2.1 time: 0.171846 Nov 02 14:33:06.874029 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4083/6206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:06 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:06.896039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:06.896670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:06.899478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:06.905074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:06.906101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:06.906550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:06.907282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:06.907747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:06.908182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:07.044779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:07.053236 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af3f3dab-e4a5-46ab-829e-9997e82bffe2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1563 microversion: 2.1 time: 0.161093 Nov 02 14:33:07.053805 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2124/6207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:06 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:09.067955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:09.069101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:09.070528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3a21a57a-9a5f-4720-aa5c-ea168309709e req-56df7a52-ace2-4644-b545-093b3cc1077d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:09.071799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:09.076338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:09.078321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:09.080147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:09.080816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:09.081418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:09.082281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:09.082941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:09.083563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:09.086424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3a21a57a-9a5f-4720-aa5c-ea168309709e req-56df7a52-ace2-4644-b545-093b3cc1077d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:09.086920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3a21a57a-9a5f-4720-aa5c-ea168309709e req-56df7a52-ace2-4644-b545-093b3cc1077d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:09.087377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3a21a57a-9a5f-4720-aa5c-ea168309709e req-56df7a52-ace2-4644-b545-093b3cc1077d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:09.103167 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3a21a57a-9a5f-4720-aa5c-ea168309709e req-56df7a52-ace2-4644-b545-093b3cc1077d service nova] Creating event network-changed:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h1-858238-3 Nov 02 14:33:09.109513 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3a21a57a-9a5f-4720-aa5c-ea168309709e req-56df7a52-ace2-4644-b545-093b3cc1077d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042892 Nov 02 14:33:09.110774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2125/6208] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:09.315572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:09.324050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0985013b-e78a-4b37-b69b-761eb4fb8757 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1563 microversion: 2.1 time: 0.260592 Nov 02 14:33:09.324646 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4084/6209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:09 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:34.598887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:34.599660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:34.712949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:34.715380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:34.722161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:34.722658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:34.723117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:34.723828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:34.724295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:34.724729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:34.776954 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a4f62ae1-4c02-4840-9335-5f182c08acce tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action" status: 200 len: 24565 microversion: 2.1 time: 0.183356 Nov 02 14:33:34.777561 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2126/6210] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:33:34 2022] POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action => generated 24565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:33:45.822347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:45.822918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:45.825567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:45.826274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=32 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:45.832890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:45.833400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:45.833960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:45.834650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:45.835125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:45.835545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:45.968416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:45.976211 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9c578243-fd0f-4d30-831b-ac3dd11ef01c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1681 microversion: 2.1 time: 0.158531 Nov 02 14:33:45.976791 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4085/6211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:45 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:46.076524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:46.078830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:46.081734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:46.082406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:33:46.089291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:46.089788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:46.090233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:46.091463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:46.091931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:46.092370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:46.144229 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7d618bee-324d-4b38-a6c7-8618493553c8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action" status: 200 len: 32639 microversion: 2.1 time: 0.071871 Nov 02 14:33:46.144869 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2127/6212] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:33:46 2022] POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action => generated 32639 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:33:46.442081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:46.442727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:46.448738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:46.449213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:46.449643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:46.450839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:46.451592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:46.452209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:46.580796 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ff0023d-7e23-49ff-a6bb-190f4ab2d23e tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1832 microversion: 2.1 time: 0.252824 Nov 02 14:33:46.581385 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4086/6213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:46 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1832 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:46.610729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:46.613330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:46.620428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:46.620928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:46.621380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:46.622641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:46.623147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:46.623592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:46.660876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lazy-loading 'flavor' on Instance uuid 41f7606a-5779-4e7e-ae5d-a1523353df34 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:33:46.673404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Going to try to live migrate instance to another host {{(pid=137558) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 14:33:47.909830 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6787c857-31e1-4d5d-b6cd-afdaffa9a607 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action" status: 202 len: 0 microversion: 2.1 time: 1.303245 Nov 02 14:33:47.910704 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2128/6214] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:33:46 2022] POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:33:47.919939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:47.920584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:47.927896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:47.928394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:47.928826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:47.929536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:47.929996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:47.930478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:48.078319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:48.086225 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9606324a-b067-46c8-8760-e0f24dc1889b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.170351 Nov 02 14:33:48.087128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4087/6215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:47 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:33:48.965070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6c917e8e-550e-4ed5-b219-8a8c9b7b4877 req-e1164d0c-8394-4c42-8c82-1e80f979fa71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "name": "network-vif-unplugged", "status": "completed", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:48.976547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6c917e8e-550e-4ed5-b219-8a8c9b7b4877 req-e1164d0c-8394-4c42-8c82-1e80f979fa71 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:48.977036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6c917e8e-550e-4ed5-b219-8a8c9b7b4877 req-e1164d0c-8394-4c42-8c82-1e80f979fa71 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:48.977476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6c917e8e-550e-4ed5-b219-8a8c9b7b4877 req-e1164d0c-8394-4c42-8c82-1e80f979fa71 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:48.989003 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6c917e8e-550e-4ed5-b219-8a8c9b7b4877 req-e1164d0c-8394-4c42-8c82-1e80f979fa71 service nova] Creating event network-vif-unplugged:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h1-858238-3 Nov 02 14:33:48.994502 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6c917e8e-550e-4ed5-b219-8a8c9b7b4877 req-e1164d0c-8394-4c42-8c82-1e80f979fa71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033383 Nov 02 14:33:48.995289 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2129/6216] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:49.111823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:49.112436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:49.119468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:49.119930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:49.120398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:49.121038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:49.121493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:49.122499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:49.258278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:49.266802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5da712ab-e12a-4e4f-9d84-5990bf62cda2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.158978 Nov 02 14:33:49.267420 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4088/6217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:49 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:50.292783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:50.293433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:50.301612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:50.302155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:50.302670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:50.303464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:50.304144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:50.304649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:50.459485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:50.468630 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-676853be-d42b-4175-834b-87c416913173 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.180425 Nov 02 14:33:50.469209 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2130/6218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:50 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:51.011205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2ef07b9d-884a-4edf-92ad-a1d0f0f11107 req-96a3bb5b-4ee5-4dbc-96c4-cf70c2973339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:51.022710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2ef07b9d-884a-4edf-92ad-a1d0f0f11107 req-96a3bb5b-4ee5-4dbc-96c4-cf70c2973339 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:51.023225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2ef07b9d-884a-4edf-92ad-a1d0f0f11107 req-96a3bb5b-4ee5-4dbc-96c4-cf70c2973339 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:51.023666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2ef07b9d-884a-4edf-92ad-a1d0f0f11107 req-96a3bb5b-4ee5-4dbc-96c4-cf70c2973339 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:51.038672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2ef07b9d-884a-4edf-92ad-a1d0f0f11107 req-96a3bb5b-4ee5-4dbc-96c4-cf70c2973339 service nova] Creating event network-changed:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h1-858238-3 Nov 02 14:33:51.044297 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2ef07b9d-884a-4edf-92ad-a1d0f0f11107 req-96a3bb5b-4ee5-4dbc-96c4-cf70c2973339 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036979 Nov 02 14:33:51.044919 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4089/6219] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:51.493048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:51.493826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:51.501411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:51.501924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:51.502381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:51.503124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:51.503605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:51.504042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:51.712748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:51.722258 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-addd7355-b709-4561-a3c4-3b086e91e557 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.233344 Nov 02 14:33:51.722855 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2131/6220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:51 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:52.752656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:52.753542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:52.763038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:52.763601 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:52.764059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:52.764815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:52.765291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:52.765732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:52.935622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:52.946837 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0387c00f-2b8b-492f-9fb4-c591e4443c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.202262 Nov 02 14:33:52.947565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4090/6221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:52 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:53.970798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:53.971483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:53.978238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:53.978724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:53.979196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:53.979887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:53.980348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:53.980779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:54.122346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:54.130850 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bdce5b06-cc89-41f1-9534-757be7f1c3dd tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.163898 Nov 02 14:33:54.131502 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2132/6222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:53 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:55.156057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:55.156912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:55.163500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:55.163995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:55.164440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:55.165155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:55.165616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:55.166115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:55.301259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:55.309166 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6838d039-0e26-45b4-af66-721209c8c114 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1691 microversion: 2.1 time: 0.157782 Nov 02 14:33:55.309762 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4091/6223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:55 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:56.333557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:56.334175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:56.341654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.342144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.342581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.343301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.343760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.344186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.481882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:56.489640 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2ac51bc-96df-46c2-8151-96a31a82c20f tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1681 microversion: 2.1 time: 0.160105 Nov 02 14:33:56.490208 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2133/6224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:56 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:56.513881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:56.514478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:56.521472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.521953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.522389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.523081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.523567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.523992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.653447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-646a6777-5cab-420f-9bba-e7fee6d8e7f3 tempest-TestNetworkAdvancedServerOps-1860270388 tempest-TestNetworkAdvancedServerOps-1860270388-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1832 microversion: 2.1 time: 0.143364 Nov 02 14:33:56.654144 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4092/6225] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:56 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1832 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:33:56.678221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:56.678947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:56.686093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.687452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.688243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.689030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.689579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.690097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.821677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:56.829830 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-77307deb-4548-4954-b99a-d0fa8bf46f47 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1681 microversion: 2.1 time: 0.155566 Nov 02 14:33:56.830404 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2134/6226] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:56 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:33:56.925287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:56.927605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:56.933703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.934819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.935283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.936006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:56.936458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:56.936884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:56.987299 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0f669be-17bf-4568-9a8f-acb2db9fa8d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action" status: 200 len: 38635 microversion: 2.1 time: 0.065784 Nov 02 14:33:56.988117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4093/6227] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:33:56 2022] POST /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34/action => generated 38635 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:33:58.237997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:58.238630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:58.240491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ebedb883-f543-4b41-a09b-a5574d82d290 req-297318ba-1c0f-41da-9936-0a227d2b1446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:33:58.246294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:58.246941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:58.247479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:58.248391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:58.248860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:58.249341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:58.252046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ebedb883-f543-4b41-a09b-a5574d82d290 req-297318ba-1c0f-41da-9936-0a227d2b1446 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:58.252743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ebedb883-f543-4b41-a09b-a5574d82d290 req-297318ba-1c0f-41da-9936-0a227d2b1446 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:58.253322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ebedb883-f543-4b41-a09b-a5574d82d290 req-297318ba-1c0f-41da-9936-0a227d2b1446 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:58.265539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ebedb883-f543-4b41-a09b-a5574d82d290 req-297318ba-1c0f-41da-9936-0a227d2b1446 service nova] Creating event network-changed:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h2-858238-3 Nov 02 14:33:58.271016 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ebedb883-f543-4b41-a09b-a5574d82d290 req-297318ba-1c0f-41da-9936-0a227d2b1446 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Nov 02 14:33:58.272128 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4094/6228] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:33:58.278459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:33:58.382658 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6a08ce6f-1714-45cc-a30a-53f42d458d4a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 204 len: 0 microversion: 2.1 time: 0.148457 Nov 02 14:33:58.384599 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2135/6229] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:33:58 2022] DELETE /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:33:58.395001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:58.397027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:58.409465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:58.409950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:58.410486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:58.411475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:58.411799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:58.412231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:58.572704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:58.583218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd506acb-e868-4f8e-8a6b-31214ed01eac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1687 microversion: 2.1 time: 0.192941 Nov 02 14:33:58.583969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4095/6230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:58 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:33:59.610486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:33:59.611230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:33:59.618700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:59.619201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:59.619397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:59.620106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:59.620579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:59.621017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:59.654292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:33:59.655294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:33:59.655747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:33:59.656216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lazy-loading 'fault' on Instance uuid 41f7606a-5779-4e7e-ae5d-a1523353df34 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:33:59.703241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:33:59.710289 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b57b4a17-15a3-4d21-8881-9ddb5a325e78 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 200 len: 1356 microversion: 2.1 time: 0.104141 Nov 02 14:33:59.710854 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2136/6231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:33:59 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:00.286316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3b84bf00-920b-4d43-922e-e4df72d725d2 req-b725a654-0bac-480e-966b-832d02484576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f7606a-5779-4e7e-ae5d-a1523353df34", "name": "network-vif-deleted", "tag": "4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:00.297220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3b84bf00-920b-4d43-922e-e4df72d725d2 req-b725a654-0bac-480e-966b-832d02484576 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:00.297691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3b84bf00-920b-4d43-922e-e4df72d725d2 req-b725a654-0bac-480e-966b-832d02484576 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:00.298110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3b84bf00-920b-4d43-922e-e4df72d725d2 req-b725a654-0bac-480e-966b-832d02484576 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:00.308936 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3b84bf00-920b-4d43-922e-e4df72d725d2 req-b725a654-0bac-480e-966b-832d02484576 service nova] Creating event network-vif-deleted:4ef9d3ec-d53c-44c0-87ad-26d9c4abce0a for instance 41f7606a-5779-4e7e-ae5d-a1523353df34 on n-h2-858238-3 Nov 02 14:34:00.313902 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3b84bf00-920b-4d43-922e-e4df72d725d2 req-b725a654-0bac-480e-966b-832d02484576 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Nov 02 14:34:00.314479 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4096/6232] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:00.734232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:00.734851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 41f7606a-5779-4e7e-ae5d-a1523353df34] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:00.741727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:00.742216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:00.742687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:00.743409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:00.743871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:00.744304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:00.757589 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] HTTP exception thrown: Instance 41f7606a-5779-4e7e-ae5d-a1523353df34 could not be found. Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Request method failure captured: Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 HTTP/1.1 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYn6FT2ebFHeyGiDvpYZmHWZUEitQxVm9UdzRVMUNqPozVytZZFVegvhUcTwUUsS3e8zH4r_zJI72SrAy3p6YFswAWKuZDmTLiHnxkOvtkq_wKzmlKfHuGrT5mrR0Gqlrn3SGKUJckwsBgOhTviMnsMZoaHTBo6X2ALAxNRvtyMaEi9E Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac42cae4bc7144a29f8dbe098bf93945"}]}] Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: ad99063111344e0d87dc99a96b2de8f9 Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 41f7606a-5779-4e7e-ae5d-a1523353df34 could not be found. Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '41f7606a-5779-4e7e-ae5d-a1523353df34'} Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f7606a-5779-4e7e-ae5d-a1523353df34 could not be found. Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f7606a-5779-4e7e-ae5d-a1523353df34 could not be found. Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:34:00.759228 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f7606a-5779-4e7e-ae5d-a1523353df34 could not be found. Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Returning 404 to user: Instance 41f7606a-5779-4e7e-ae5d-a1523353df34 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6011bb64-44e3-4149-8e8b-0abe5398655c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34" status: 404 len: 111 microversion: 2.1 time: 0.030333 Nov 02 14:34:00.764065 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2137/6233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:00 2022] GET /compute/v2.1/servers/41f7606a-5779-4e7e-ae5d-a1523353df34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:34:04.124978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff3219a9-d127-4c22-b3c4-a1d91a9ea662 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '.version_select at 0x7f6f85df7430>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:04.148711 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff3219a9-d127-4c22-b3c4-a1d91a9ea662 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1179859414" status: 202 len: 0 microversion: 2.1 time: 0.029573 Nov 02 14:34:04.149520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4097/6234] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 14:34:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1179859414 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:34:04.180870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2aced758-7e03-40d1-9384-57132b80377e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: .version_select at 0x7f6f805a0dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1118607700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGMq2c1n0RGkFhwStJPnBmGGYqA+9AadRd4tBp+QARYLLsljp2rgTGl5sfEd1a9ecVrTOSjshE76/WSV0P/KR+O+WfmozRscQTVP5lxGRAoQmksufg/dBxQEKBOr4yzJA=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:04.204355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2aced758-7e03-40d1-9384-57132b80377e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:34:04.209905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-2aced758-7e03-40d1-9384-57132b80377e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:34:04.235037 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2aced758-7e03-40d1-9384-57132b80377e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058362 Nov 02 14:34:04.235688 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2138/6235] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:34:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:10.127795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-787637651", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "97fc8c34-445f-4cc5-a81b-3beac0b388a6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1118607700", "security_groups": [{"name": "tempest-secgroup-smoke-322026268"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:10.241048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] validate_networks() for [('97fc8c34-445f-4cc5-a81b-3beac0b388a6', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:34:10.303418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=58 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:10.694510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:34:10.694940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:34:10.695451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:34:10.695869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:34:10.696290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:34:10.705968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:10.706457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:10.706923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:10.707711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:10.708178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:10.708600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:10.727441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:34:10.733070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Getting quotas for user ad99063111344e0d87dc99a96b2de8f9 and project ac42cae4bc7144a29f8dbe098bf93945. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:34:10.746385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:34:10.748862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:34:10.797428 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0245eaa2-2be7-4557-b01c-a184ee709e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.674690 Nov 02 14:34:10.804584 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4098/6236] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:34:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:34:10.807809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:10.813518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9b4bf30-f1fc-4678-ba02-3f59c2aaf3da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:10.814416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9b4bf30-f1fc-4678-ba02-3f59c2aaf3da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:10.876741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9b4bf30-f1fc-4678-ba02-3f59c2aaf3da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:10.885879 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9b4bf30-f1fc-4678-ba02-3f59c2aaf3da tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1266 microversion: 2.1 time: 0.079511 Nov 02 14:34:10.887755 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2139/6237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:10 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:34:11.910747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:11.911409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:11.918539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:11.919298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:11.919881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:11.924460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:11.929259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:11.930077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:12.010130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:12.019585 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-240e6c83-3bd5-44d5-a59a-5cf3407dd547 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1326 microversion: 2.1 time: 0.113373 Nov 02 14:34:12.020306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4099/6238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:11 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:34:13.044092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:13.044738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:13.051636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:13.052200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:13.052714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:13.053488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:13.054038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:13.054539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:13.483195 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:13.491284 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f0583888-4fb8-4275-b032-845b8e1688e0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.451713 Nov 02 14:34:13.491872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2140/6239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:13 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:13.519190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-781e8bbc-4cd9-4db7-8a8a-ae3870b03e1d req-02b1f344-fb31-4e56-b211-794de1123bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:13.531189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-781e8bbc-4cd9-4db7-8a8a-ae3870b03e1d req-02b1f344-fb31-4e56-b211-794de1123bf5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:13.532238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-781e8bbc-4cd9-4db7-8a8a-ae3870b03e1d req-02b1f344-fb31-4e56-b211-794de1123bf5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:13.532755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-781e8bbc-4cd9-4db7-8a8a-ae3870b03e1d req-02b1f344-fb31-4e56-b211-794de1123bf5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:13.546368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-781e8bbc-4cd9-4db7-8a8a-ae3870b03e1d req-02b1f344-fb31-4e56-b211-794de1123bf5 service nova] Creating event network-changed:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:34:13.551990 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-781e8bbc-4cd9-4db7-8a8a-ae3870b03e1d req-02b1f344-fb31-4e56-b211-794de1123bf5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036981 Nov 02 14:34:13.552818 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4100/6240] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:14.516355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:14.516976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:14.523897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:14.524392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:14.524838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:14.525534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:14.526001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:14.526437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:14.659455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:14.667077 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfb7d698-e07b-4bd8-9e76-2537a5c0b99b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.154597 Nov 02 14:34:14.668162 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2141/6241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:14 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:15.691470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:15.692175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:15.698957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:15.699478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:15.699916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:15.700615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:15.701068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:15.701488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:15.838801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:15.847250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1abf1e41-c468-4be2-98f1-e4fa93d45b92 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.160512 Nov 02 14:34:15.847996 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4101/6242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:15 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:16.871010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:16.871671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:16.874303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:16.879621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:16.880120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:16.880569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:16.881269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:16.881739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:16.882177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:17.012824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:17.020646 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-16718c1d-714d-46fc-9e90-c30ddc959fca tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.154021 Nov 02 14:34:17.021355 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2142/6243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:16 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:18.044487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:18.045102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:18.047923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:18.053421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:18.053914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:18.054358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:18.055111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:18.055578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:18.056003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:18.198269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:18.206222 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-030875f7-a321-40e6-9415-9347c89e5609 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.165805 Nov 02 14:34:18.206805 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4102/6244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:18 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:19.230624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:19.231404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:19.238041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:19.238532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:19.238973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:19.239702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:19.240169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:19.240627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:19.368409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:19.376124 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-370d4581-4f2f-426a-a6a6-7a3d275aa0e6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.150111 Nov 02 14:34:19.376686 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2143/6245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:19 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:19.808537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b645a47d-23f1-4135-a74b-fbcbd521a994 req-28911445-61ea-4142-8a75-3e2e664f8c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "name": "network-vif-plugged", "status": "completed", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:19.819322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b645a47d-23f1-4135-a74b-fbcbd521a994 req-28911445-61ea-4142-8a75-3e2e664f8c42 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:19.819804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b645a47d-23f1-4135-a74b-fbcbd521a994 req-28911445-61ea-4142-8a75-3e2e664f8c42 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:19.820231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b645a47d-23f1-4135-a74b-fbcbd521a994 req-28911445-61ea-4142-8a75-3e2e664f8c42 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:19.835590 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b645a47d-23f1-4135-a74b-fbcbd521a994 req-28911445-61ea-4142-8a75-3e2e664f8c42 service nova] Creating event network-vif-plugged:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:34:19.840745 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b645a47d-23f1-4135-a74b-fbcbd521a994 req-28911445-61ea-4142-8a75-3e2e664f8c42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036922 Nov 02 14:34:19.841358 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4103/6246] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:20.399844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:20.400497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:20.408440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:20.408941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:20.409392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:20.410108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:20.410577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:20.411014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:20.544189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:20.552009 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ffaa9a44-9669-4182-9abf-4dac753a59f0 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1391 microversion: 2.1 time: 0.156312 Nov 02 14:34:20.552599 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2144/6247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:20 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:21.572463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:21.573266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:21.579319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:21.580015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:21.586789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:21.587296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:21.587730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:21.588421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:21.588869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:21.589965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:21.723424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:21.731170 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cfee0d4b-1c12-444d-93be-2971f120417b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1563 microversion: 2.1 time: 0.159658 Nov 02 14:34:21.731744 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4104/6248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:21 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:21.753086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:21.753676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:21.755754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:21.762808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:21.763359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:21.763811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:21.764526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:21.764993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:21.765431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:21.897186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:21.905019 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dedeeb8a-9e7b-4ae6-9375-70525afdf0d5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1563 microversion: 2.1 time: 0.155991 Nov 02 14:34:21.905567 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2145/6249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:21 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:23.471059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:23.471700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:23.480491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:23.480978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:23.481532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:23.482229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:23.482837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:23.483479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:23.484022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c38d0d0d-3e57-46bd-9a92-a7027caf5e54 req-2c923b58-cdfb-4458-8dde-2da559749e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:23.495221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c38d0d0d-3e57-46bd-9a92-a7027caf5e54 req-2c923b58-cdfb-4458-8dde-2da559749e24 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:23.495802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c38d0d0d-3e57-46bd-9a92-a7027caf5e54 req-2c923b58-cdfb-4458-8dde-2da559749e24 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:23.496315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c38d0d0d-3e57-46bd-9a92-a7027caf5e54 req-2c923b58-cdfb-4458-8dde-2da559749e24 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:23.508044 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c38d0d0d-3e57-46bd-9a92-a7027caf5e54 req-2c923b58-cdfb-4458-8dde-2da559749e24 service nova] Creating event network-changed:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:34:23.513329 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c38d0d0d-3e57-46bd-9a92-a7027caf5e54 req-2c923b58-cdfb-4458-8dde-2da559749e24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034142 Nov 02 14:34:23.514025 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2146/6250] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:23.728153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:23.737574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0c080fa-656f-4c7d-a1f9-abaaac1a1698 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1563 microversion: 2.1 time: 0.270692 Nov 02 14:34:23.738292 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4105/6251] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:23 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1563 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:47.035203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=9 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:47.035956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=38 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:47.040890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:47.043641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:47.050818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:47.051344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:47.051795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:47.052479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:47.052938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:47.053370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:47.108422 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c5e30a62-7335-4cb7-b61f-1252b21ae592 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421/action" status: 200 len: 24572 microversion: 2.1 time: 0.075367 Nov 02 14:34:47.109096 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2147/6252] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:34:47 2022] POST /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:34:58.185039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:58.188093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:58.190376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:58.191088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=36 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:58.198959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:58.199466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:58.199901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:58.200591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:58.201046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:58.201469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:58.279698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:34:58.280120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:34:58.280588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:34:58.281019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:34:58.281427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:34:58.342688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:58.348569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:58.349059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:58.349529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:58.350240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:58.350693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:58.351136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:58.377329 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da9c8ba9-08b6-4e99-930f-76d03eba7401 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421/action" status: 202 len: 1137 microversion: 2.1 time: 0.196490 Nov 02 14:34:58.377988 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4106/6253] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:34:58 2022] POST /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421/action => generated 1137 bytes in 198 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:34:58.400805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:58.401594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:58.404972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:58.405642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:58.412317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:58.412817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:58.413267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:58.413985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:58.414457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:58.414900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:58.553027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:58.561604 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ffd2c7b3-9021-4bcd-b867-fbf9bebd31f5 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.165698 Nov 02 14:34:58.562432 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2148/6254] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:58 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:59.586982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:59.588126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:59.596087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:59.596574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:59.597009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:59.597707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:59.598156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:59.598590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:59.735829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:59.743797 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e2ba85f-ed84-492e-86c6-6d69469d487a tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.160783 Nov 02 14:34:59.744377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4107/6255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:34:59 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:35:00.768635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:00.769260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:00.776756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:00.777253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:00.777705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:00.778408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:00.778879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:00.779350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:00.909108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:00.917494 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ef4dc8c-358e-49d5-a5fd-c04f2d8b871c tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.153006 Nov 02 14:35:00.918064 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2149/6256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:00 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:01.941151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:01.941705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:01.948967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:01.949450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:01.949883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:01.950580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:01.951063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:01.951514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:02.102235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:02.112503 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f320f43a-5d84-4406-80e3-f3ff44ef7dc2 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.175628 Nov 02 14:35:02.113094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4108/6257] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:01 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:03.136691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:03.137317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:03.144265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:03.144756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:03.145203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:03.145894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:03.146355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:03.146785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:03.275563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:03.283230 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7a8e90f4-c54f-4da2-9f1b-a148019ea283 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.150528 Nov 02 14:35:03.283793 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2150/6258] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:03 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:04.307358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:04.307970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:04.315185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:04.315677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:04.316105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:04.316795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:04.317242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:04.317662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:04.453377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:04.461282 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-88500625-fd00-4e67-a6e7-02cc8349f341 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.158018 Nov 02 14:35:04.461859 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4109/6259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:04 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:05.484820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:05.485444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:05.492430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:05.492956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:05.493998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:05.494703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:05.495209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:05.495677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:05.625020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:05.632716 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d8bf062-eec9-4f6e-8441-02617a7e6f65 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.151887 Nov 02 14:35:05.633276 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2151/6260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:05 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:06.656674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:06.657286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:06.664111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:06.664593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:06.665022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:06.666266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:06.666717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:06.667157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:06.799611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:06.807924 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78d8acf9-1b6b-421d-9c33-ee945871c027 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.155252 Nov 02 14:35:06.808509 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4110/6261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:06 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:07.834496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:07.835291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:07.842756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:07.843298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:07.843747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:07.844446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:07.844908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:07.845343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:07.991973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:07.999993 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bb527471-87f9-47b5-a985-10bac382966e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.169689 Nov 02 14:35:08.000565 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2152/6262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:07 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:09.025440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:09.026065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:09.033083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:09.033571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:09.034016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:09.034714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:09.035210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:09.035641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:09.167449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:09.175642 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd04cb7b-ee40-4d09-a909-95f669e5edac tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.154849 Nov 02 14:35:09.176224 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4111/6263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:09 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:10.200246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:10.200862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:10.207898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:10.208385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:10.208829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:10.209518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:10.209979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:10.210407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:10.345134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:10.352922 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-72a57ed8-0b05-49e7-bb1e-a1f679676ae8 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.156612 Nov 02 14:35:10.353483 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2153/6264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:10 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:35:11.376358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:11.376970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:11.384481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:11.384965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:11.385401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:11.386104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:11.386555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:11.386981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:11.521242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:11.529662 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-86bc6446-6920-4af8-840f-b3b34a9e8b51 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.157243 Nov 02 14:35:11.530238 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4112/6265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:11 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:12.553479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:12.554102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:12.560993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:12.561487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:12.562198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:12.562915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:12.563390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:12.563827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:12.694680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:12.702920 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c48824a9-6605-4dcf-b523-1855ed70b42d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.153397 Nov 02 14:35:12.703519 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2154/6266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:12 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:13.727079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:13.728346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:13.734883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:13.735397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:13.736113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:13.736804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:13.737253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:13.737675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:13.871815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:13.879605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-96aa8b89-f280-431f-95b0-6b460e889ada tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.156775 Nov 02 14:35:13.880188 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4113/6267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:13 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:14.903275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:14.903901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:14.910794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:14.911320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:14.911773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:14.912473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:14.912939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:14.913377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:15.045393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:15.053521 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a3eb1983-263d-49e8-9b7b-017c68dc6aaf tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1691 microversion: 2.1 time: 0.154788 Nov 02 14:35:15.054086 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2155/6268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:14 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:16.078054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:16.078573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:16.085134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:16.085617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:16.086056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:16.087292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:16.087755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:16.088178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:16.236443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:16.245077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4b9e0431-c0f9-426b-bad2-4dc650b9d965 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1697 microversion: 2.1 time: 0.171120 Nov 02 14:35:16.245679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4114/6269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:16 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:17.270358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:17.271211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:17.278052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:17.278631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:17.279852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:17.280684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:17.281263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:17.281785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:17.428674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:17.437340 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a4d698c-a2a1-479d-9ddc-0755edf21e64 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1697 microversion: 2.1 time: 0.170983 Nov 02 14:35:17.437918 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2156/6270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:17 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:18.266500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-6336b134-09df-4362-a560-ea4878246aad req-53d59fd0-58d2-4e83-bebd-12b0f24981a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "name": "network-vif-unplugged", "status": "completed", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:35:18.276662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6336b134-09df-4362-a560-ea4878246aad req-53d59fd0-58d2-4e83-bebd-12b0f24981a6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:18.277144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6336b134-09df-4362-a560-ea4878246aad req-53d59fd0-58d2-4e83-bebd-12b0f24981a6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:18.277577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-6336b134-09df-4362-a560-ea4878246aad req-53d59fd0-58d2-4e83-bebd-12b0f24981a6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:18.289239 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-6336b134-09df-4362-a560-ea4878246aad req-53d59fd0-58d2-4e83-bebd-12b0f24981a6 service nova] Creating event network-vif-unplugged:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:35:18.295053 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-6336b134-09df-4362-a560-ea4878246aad req-53d59fd0-58d2-4e83-bebd-12b0f24981a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109439 Nov 02 14:35:18.295715 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4115/6271] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:35:18.461602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:18.462228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:18.469169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:18.469662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:18.470108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:18.470812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:18.471413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:18.471860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:18.605061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:18.613136 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-29009a44-6e7d-4030-b4ae-368d7e689f1d tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1682 microversion: 2.1 time: 0.155800 Nov 02 14:35:18.613717 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2157/6272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:18 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:20.314254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c2b00a92-f305-448d-bd1f-82f964e4601b req-a5be249d-d13d-4d7e-82e5-b11a60568dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "name": "network-vif-plugged", "status": "completed", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:35:20.324268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2b00a92-f305-448d-bd1f-82f964e4601b req-a5be249d-d13d-4d7e-82e5-b11a60568dae service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:20.324738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2b00a92-f305-448d-bd1f-82f964e4601b req-a5be249d-d13d-4d7e-82e5-b11a60568dae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:20.325160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c2b00a92-f305-448d-bd1f-82f964e4601b req-a5be249d-d13d-4d7e-82e5-b11a60568dae service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:20.337031 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c2b00a92-f305-448d-bd1f-82f964e4601b req-a5be249d-d13d-4d7e-82e5-b11a60568dae service nova] Creating event network-vif-plugged:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:35:20.342240 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c2b00a92-f305-448d-bd1f-82f964e4601b req-a5be249d-d13d-4d7e-82e5-b11a60568dae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033295 Nov 02 14:35:20.343055 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4116/6273] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:35:42.816620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:35:42.818814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:42.821516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=20 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:42.822189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=60 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:42.828539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:42.829043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:42.829489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:42.830258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:42.830714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:42.831179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:42.883155 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-635be778-f552-4bfa-9e1f-dac4d6ccea1b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "POST /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421/action" status: 200 len: 24568 microversion: 2.1 time: 0.070455 Nov 02 14:35:42.883804 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2158/6274] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:35:42 2022] POST /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:35:55.004641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:55.005235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:55.007681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=26 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:55.008344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:55.017677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:55.018476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:35:55.025930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:55.026434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:55.026901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:55.027835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:55.028303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:55.028860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:55.057693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:35:55.085179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-03faded8-71f4-4e95-b5e2-c9c308db22f0 req-fb69e34b-9f60-4d70-8db4-27c884230dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:35:55.104680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-03faded8-71f4-4e95-b5e2-c9c308db22f0 req-fb69e34b-9f60-4d70-8db4-27c884230dbf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:55.105498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-03faded8-71f4-4e95-b5e2-c9c308db22f0 req-fb69e34b-9f60-4d70-8db4-27c884230dbf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:55.106127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-03faded8-71f4-4e95-b5e2-c9c308db22f0 req-fb69e34b-9f60-4d70-8db4-27c884230dbf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:55.119611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-03faded8-71f4-4e95-b5e2-c9c308db22f0 req-fb69e34b-9f60-4d70-8db4-27c884230dbf service nova] Creating event network-changed:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:35:55.128489 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-03faded8-71f4-4e95-b5e2-c9c308db22f0 req-fb69e34b-9f60-4d70-8db4-27c884230dbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115500 Nov 02 14:35:55.129658 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2159/6275] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:35:55.166401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e623e50-3195-4145-8b7a-f01d81deabd6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 204 len: 0 microversion: 2.1 time: 0.165204 Nov 02 14:35:55.168372 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4117/6276] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:35:54 2022] DELETE /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:35:55.182065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:55.185152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:55.195112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:55.195112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:55.195112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:55.195112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:55.195112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:55.195112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:55.402711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:55.417912 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f42b4b7e-b7bc-4cf1-9efb-607dd213037b tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1688 microversion: 2.1 time: 0.239785 Nov 02 14:35:55.417912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2160/6277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:55 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:56.442644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:56.443381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:56.450241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:56.450728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:56.451189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:56.451895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:56.452347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:56.452770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:56.676859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad99063111344e0d87dc99a96b2de8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac42cae4bc7144a29f8dbe098bf93945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:35:56.684641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-652e8463-9a13-4e15-b999-45efe2be353e tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 200 len: 1688 microversion: 2.1 time: 0.246251 Nov 02 14:35:56.685219 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4118/6278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:56 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:35:57.084087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-79690a42-6b04-418c-838b-25f424021bbe req-b83f62eb-0b37-410a-8dc4-19bacfcbfa4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5029378d-e3a6-468a-9e95-538df2555421", "name": "network-vif-deleted", "tag": "bbcd8034-babf-483d-9602-6540045b8e47"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:35:57.093780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-79690a42-6b04-418c-838b-25f424021bbe req-b83f62eb-0b37-410a-8dc4-19bacfcbfa4a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:57.094280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-79690a42-6b04-418c-838b-25f424021bbe req-b83f62eb-0b37-410a-8dc4-19bacfcbfa4a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:57.094725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-79690a42-6b04-418c-838b-25f424021bbe req-b83f62eb-0b37-410a-8dc4-19bacfcbfa4a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:57.106010 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-79690a42-6b04-418c-838b-25f424021bbe req-b83f62eb-0b37-410a-8dc4-19bacfcbfa4a service nova] Creating event network-vif-deleted:bbcd8034-babf-483d-9602-6540045b8e47 for instance 5029378d-e3a6-468a-9e95-538df2555421 on n-h1-858238-3 Nov 02 14:35:57.110717 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-79690a42-6b04-418c-838b-25f424021bbe req-b83f62eb-0b37-410a-8dc4-19bacfcbfa4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094202 Nov 02 14:35:57.111358 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2161/6279] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:35:57.708913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:35:57.709533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] [instance: 5029378d-e3a6-468a-9e95-538df2555421] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:35:57.716537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:57.717020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:57.717457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:57.718137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:35:57.718592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:35:57.719025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:35:57.733419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] HTTP exception thrown: Instance 5029378d-e3a6-468a-9e95-538df2555421 could not be found. Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Request method failure captured: Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 HTTP/1.1 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYn6FT2ebFHeyGiDvpYZmHWZUEitQxVm9UdzRVMUNqPozVytZZFVegvhUcTwUUsS3e8zH4r_zJI72SrAy3p6YFswAWKuZDmTLiHnxkOvtkq_wKzmlKfHuGrT5mrR0Gqlrn3SGKUJckwsBgOhTviMnsMZoaHTBo6X2ALAxNRvtyMaEi9E Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ac42cae4bc7144a29f8dbe098bf93945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ac42cae4bc7144a29f8dbe098bf93945"}]}] Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ac42cae4bc7144a29f8dbe098bf93945 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1592795928 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ad99063111344e0d87dc99a96b2de8f9 Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1592795928-project Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5029378d-e3a6-468a-9e95-538df2555421 could not be found. Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5029378d-e3a6-468a-9e95-538df2555421'} Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5029378d-e3a6-468a-9e95-538df2555421 could not be found. Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5029378d-e3a6-468a-9e95-538df2555421 could not be found. Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:35:57.735075 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5029378d-e3a6-468a-9e95-538df2555421 could not be found. Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Returning 404 to user: Instance 5029378d-e3a6-468a-9e95-538df2555421 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38f27f4c-af8a-4eb1-aac9-b6188a7d47f6 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421" status: 404 len: 111 microversion: 2.1 time: 0.031584 Nov 02 14:35:57.739035 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4119/6280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:35:57 2022] GET /compute/v2.1/servers/5029378d-e3a6-468a-9e95-538df2555421 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:36:01.101649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ba56179-6d1f-4bd6-b747-e1d65b740c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] Calling method '.version_select at 0x7f6f80f59c10>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:01.124913 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ba56179-6d1f-4bd6-b747-e1d65b740c67 tempest-TestNetworkAdvancedServerOps-1592795928 tempest-TestNetworkAdvancedServerOps-1592795928-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1118607700" status: 202 len: 0 microversion: 2.1 time: 0.027365 Nov 02 14:36:01.125497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2162/6281] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 14:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1118607700 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:25.826865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:25.827655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:25.939005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1686491955", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:26.161761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] validate_networks() for None {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:36:26.739712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:36:26.740149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:36:26.740612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:36:26.741021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:36:26.741436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:36:26.750973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:26.751494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:26.751931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:26.752664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:26.753120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:26.753545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:26.770049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Getting quotas for project f24012a26a874056a808404c9f9335f6. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:36:26.775447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Getting quotas for user 92648062096b412aabd54f4403233909 and project f24012a26a874056a808404c9f9335f6. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:36:26.788610 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:36:26.790862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:36:26.837244 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2172356-5639-4800-bc3a-e6badcf6bc18 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015500 Nov 02 14:36:26.838231 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4120/6282] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:36:26.848835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:26.849622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:26.855844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ded56015-a2ec-4d09-9526-ab04b9fdf182 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:26.856598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ded56015-a2ec-4d09-9526-ab04b9fdf182 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:26.915292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ded56015-a2ec-4d09-9526-ab04b9fdf182 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:26.923063 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ded56015-a2ec-4d09-9526-ab04b9fdf182 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1222 microversion: 2.1 time: 0.076062 Nov 02 14:36:26.923664 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2163/6283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:26 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:27.945965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:27.946579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:27.955374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:27.955943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:27.956456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:27.957427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:27.957888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:27.958317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:28.023900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:28.032447 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5efb82c8-ad75-4279-8bae-f40ab9dd84e0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1282 microversion: 2.1 time: 0.090333 Nov 02 14:36:28.033138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4121/6284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:27 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:29.056645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:29.057265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:29.060278 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:36:29.060420 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 (ip 10.222.0.18) !!! Nov 02 14:36:29.068372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.068868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.069313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.070019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.070482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.070919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.207823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:29.216541 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8b0531c1-2b7a-4ced-b857-21b8ea1ea335 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.163775 Nov 02 14:36:29.217109 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2164/6285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:29 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:29.460193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d0a473a8-07ef-45cf-be6a-36d13dbe2d65 req-481e7aa2-d94d-4cfd-8fc2-9e0d9f7c1c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eedfccb-b516-45a5-8a89-d30a0d3d6b84", "tag": "43a09325-49ce-40ae-b428-253af7ca96d9"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:29.471066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d0a473a8-07ef-45cf-be6a-36d13dbe2d65 req-481e7aa2-d94d-4cfd-8fc2-9e0d9f7c1c73 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.471572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d0a473a8-07ef-45cf-be6a-36d13dbe2d65 req-481e7aa2-d94d-4cfd-8fc2-9e0d9f7c1c73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.472177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d0a473a8-07ef-45cf-be6a-36d13dbe2d65 req-481e7aa2-d94d-4cfd-8fc2-9e0d9f7c1c73 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.487892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d0a473a8-07ef-45cf-be6a-36d13dbe2d65 req-481e7aa2-d94d-4cfd-8fc2-9e0d9f7c1c73 service nova] Creating event network-changed:43a09325-49ce-40ae-b428-253af7ca96d9 for instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 on n-h1-858238-3 Nov 02 14:36:29.493239 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d0a473a8-07ef-45cf-be6a-36d13dbe2d65 req-481e7aa2-d94d-4cfd-8fc2-9e0d9f7c1c73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Nov 02 14:36:29.493856 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4122/6286] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:30.241050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:30.241683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:30.248984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:30.249482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:30.249933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:30.250641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:30.251138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:30.251581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:30.378812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:30.386702 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-73204308-16ec-4cff-b0ce-05ecab67d8ee tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.149630 Nov 02 14:36:30.387306 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2165/6287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:30 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:31.412561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:31.413947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:31.421237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:31.421812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:31.422316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:31.423080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:31.423617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:31.424104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:31.561855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:31.569889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7764fe00-552d-476b-9b10-9ac09cd23072 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.162437 Nov 02 14:36:31.570410 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4123/6288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:31 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:32.593472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:32.594006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:32.600818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:32.601304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:32.601747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:32.602445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:32.602902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:32.603365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:32.729570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:32.737287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c1931feb-8dfd-4a72-a0f9-05a5050afa62 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.148357 Nov 02 14:36:32.737862 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2166/6289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:32 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:33.760219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:33.761418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:33.768270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:33.768752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:33.769189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:33.769896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:33.770337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:33.770760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:33.904223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:33.912055 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03d2135c-77b0-4f6b-a2e0-385c02d5ccc2 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.155794 Nov 02 14:36:33.912626 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4124/6290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:33 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:34.934712 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:34.935365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:34.942607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:34.943125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:34.943571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:34.944273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:34.944741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:34.945181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:35.074748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:35.082530 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a0c40a23-82b9-49cd-a194-02a4b96c46d3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.152517 Nov 02 14:36:35.083147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2167/6291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:34 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:36.106322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:36.106833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:36.113945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:36.114430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:36.114883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:36.115618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:36.116078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:36.116505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:36.253831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:36.263003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1c3bda07-386e-4f32-ab51-cfc874e2d18a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.161297 Nov 02 14:36:36.263729 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4125/6292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:36 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:36.451497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b1063b4d-a722-47e5-ae97-381de67549b5 req-5d84c341-d8e5-4046-b69d-8a2f7f6b66a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eedfccb-b516-45a5-8a89-d30a0d3d6b84", "name": "network-vif-plugged", "status": "completed", "tag": "43a09325-49ce-40ae-b428-253af7ca96d9"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:36.463056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b1063b4d-a722-47e5-ae97-381de67549b5 req-5d84c341-d8e5-4046-b69d-8a2f7f6b66a8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:36.463706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b1063b4d-a722-47e5-ae97-381de67549b5 req-5d84c341-d8e5-4046-b69d-8a2f7f6b66a8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:36.464165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b1063b4d-a722-47e5-ae97-381de67549b5 req-5d84c341-d8e5-4046-b69d-8a2f7f6b66a8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:36.476030 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b1063b4d-a722-47e5-ae97-381de67549b5 req-5d84c341-d8e5-4046-b69d-8a2f7f6b66a8 service nova] Creating event network-vif-plugged:43a09325-49ce-40ae-b428-253af7ca96d9 for instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 on n-h1-858238-3 Nov 02 14:36:36.481728 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b1063b4d-a722-47e5-ae97-381de67549b5 req-5d84c341-d8e5-4046-b69d-8a2f7f6b66a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034214 Nov 02 14:36:36.482350 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2168/6293] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:37.285915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:37.286530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:37.288559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:37.289406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:37.295921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:37.296405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:37.296842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:37.297867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:37.297984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:37.298409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:37.434000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:37.442131 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-777a5797-3b06-478e-9336-8dcc18e3f7c0 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1322 microversion: 2.1 time: 0.160098 Nov 02 14:36:37.442715 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4126/6294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:37 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:38.462239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:38.467968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:38.468688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:38.475196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:38.475692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:38.476141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:38.476843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:38.477311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:38.477770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:38.607599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:38.615447 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ff80ef96-df0c-4e03-b095-970cadae27e3 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1472 microversion: 2.1 time: 0.154183 Nov 02 14:36:38.616033 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2169/6295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:38 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:38.691125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc635e31-ee9f-42c1-b4d3-41d4aa0d0f6d tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Calling method '.version_select at 0x7f6f85e90670>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:38.757442 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc635e31-ee9f-42c1-b4d3-41d4aa0d0f6d tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/e5e4b1a3809041838fb50e8e3b6bd3b0" status: 200 len: 371 microversion: 2.1 time: 0.119984 Nov 02 14:36:38.758028 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4127/6296] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 14:36:38 2022] GET /compute/v2.1/os-quota-sets/e5e4b1a3809041838fb50e8e3b6bd3b0 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:38.769998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e573899-2430-4988-95d3-ca6a5ea7951b tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1907567887", "id": 1485842302, "os-flavor-access:is_public": "True"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:38.787631 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e573899-2430-4988-95d3-ca6a5ea7951b tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021322 Nov 02 14:36:38.788223 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2170/6297] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:36:38 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:38.801448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1485842302"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:38.803737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:38.810412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:38.811175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:38.811613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:38.812300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:38.812752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:38.813168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:38.902828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a54df48f9f3e453dae59cce9c38393d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4b1a3809041838fb50e8e3b6bd3b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:38.908964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1907567887 {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:36:38.915458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:38.915927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:38.916373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:38.917686 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:38.918128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:38.918543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:38.939627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Getting quotas for project f24012a26a874056a808404c9f9335f6. Resources: {'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:36:38.944502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Getting quotas for user 92648062096b412aabd54f4403233909 and project f24012a26a874056a808404c9f9335f6. Resources: {'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:36:38.956883 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] ram quota exceeded for e5e4b1a3809041838fb50e8e3b6bd3b0, tried to resize instance. Nov 02 14:36:38.957390 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Request method failure captured: Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84/action HTTP/1.1 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 39 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoBptJmLdLT18HksKLd3_tkkHeD_rDl0jd39jMj1uOY9bAEvSsXpj33NbCELa78NBxR8-WFq-hdvyc0XWNOnR3Tf3exV0u1cwgc-eSdJl8Lv8hlrapW5DFl4FOa1s1tJsedVYee0jIMS86ptLhOJPhm40PlJZnoZS3t--aLReA4UCns Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: e5e4b1a3809041838fb50e8e3b6bd3b0 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1565030844 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,admin,reader Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,admin,reader Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e5e4b1a3809041838fb50e8e3b6bd3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e5e4b1a3809041838fb50e8e3b6bd3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e5e4b1a3809041838fb50e8e3b6bd3b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e5e4b1a3809041838fb50e8e3b6bd3b0"}]}] Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1565030844 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: e5e4b1a3809041838fb50e8e3b6bd3b0 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1565030844 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-1565030844-project-admin Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: a54df48f9f3e453dae59cce9c38393d4 Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1565030844-project-admin Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: {"resize": {"flavorRef": "1485842302"}} Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5eedfccb-b516-45a5-8a89-d30a0d3d6b84', 'body': {'resize': {'flavorRef': '1485842302'}}} Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:36:38.959458 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7f3d856-b99d-46c2-9fca-029648aac3fa tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84/action" status: 403 len: 118 microversion: 2.1 time: 0.163735 Nov 02 14:36:38.963631 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4128/6298] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:36:38 2022] POST /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:36:38.971126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f0daf336-417c-466d-a11f-600a7cc94aed tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:38.987791 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f0daf336-417c-466d-a11f-600a7cc94aed tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1485842302" status: 202 len: 0 microversion: 2.1 time: 0.020488 Nov 02 14:36:38.988369 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2171/6299] 10.222.0.18 () {58 vars in 1161 bytes} [Wed Nov 2 14:36:38 2022] DELETE /compute/v2.1/flavors/1485842302 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:38.997342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4f4a7e9b-7088-44d6-858e-ecb607a918f7 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:39.018448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4f4a7e9b-7088-44d6-858e-ecb607a918f7 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025762 Nov 02 14:36:39.019005 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4129/6300] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:36:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:39.039505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f69ef0a7-8c7f-4ab4-8386-d1de67c10484 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Calling method '.version_select at 0x7f6f80f6e790>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:39.112277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f69ef0a7-8c7f-4ab4-8386-d1de67c10484 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/e5e4b1a3809041838fb50e8e3b6bd3b0" status: 200 len: 371 microversion: 2.1 time: 0.076429 Nov 02 14:36:39.112866 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2172/6301] 10.222.0.18 () {58 vars in 1242 bytes} [Wed Nov 2 14:36:39 2022] GET /compute/v2.1/os-quota-sets/e5e4b1a3809041838fb50e8e3b6bd3b0 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:39.125093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-97ce0a5c-cdde-4a34-951c-3ca5ec43dae2 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-40092417", "id": 141470821, "os-flavor-access:is_public": "True"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:39.143385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-97ce0a5c-cdde-4a34-951c-3ca5ec43dae2 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.022006 Nov 02 14:36:39.143957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4130/6302] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:36:39 2022] POST /compute/v2.1/flavors => generated 432 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:39.156345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "141470821"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:39.158755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:39.164858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.165350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.165797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.166492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.166952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.167418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.349806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a54df48f9f3e453dae59cce9c38393d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e4b1a3809041838fb50e8e3b6bd3b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:39.356088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-40092417 {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:36:39.363089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.363597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.364040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.364768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.365227 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.365657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.386937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Getting quotas for project f24012a26a874056a808404c9f9335f6. Resources: {'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:36:39.392083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Getting quotas for user 92648062096b412aabd54f4403233909 and project f24012a26a874056a808404c9f9335f6. Resources: {'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:36:39.404529 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.compute.api [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] cores quota exceeded for e5e4b1a3809041838fb50e8e3b6bd3b0, tried to resize instance. Nov 02 14:36:39.405075 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Request method failure captured: Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84/action HTTP/1.1 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 38 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoBptJmLdLT18HksKLd3_tkkHeD_rDl0jd39jMj1uOY9bAEvSsXpj33NbCELa78NBxR8-WFq-hdvyc0XWNOnR3Tf3exV0u1cwgc-eSdJl8Lv8hlrapW5DFl4FOa1s1tJsedVYee0jIMS86ptLhOJPhm40PlJZnoZS3t--aLReA4UCns Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: e5e4b1a3809041838fb50e8e3b6bd3b0 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1565030844 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,admin,reader Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,admin,reader Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e5e4b1a3809041838fb50e8e3b6bd3b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e5e4b1a3809041838fb50e8e3b6bd3b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e5e4b1a3809041838fb50e8e3b6bd3b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e5e4b1a3809041838fb50e8e3b6bd3b0"}]}] Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1565030844 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: e5e4b1a3809041838fb50e8e3b6bd3b0 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1565030844 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersAdminNegativeTestJSON-1565030844-project-admin Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: a54df48f9f3e453dae59cce9c38393d4 Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1565030844-project-admin Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: {"resize": {"flavorRef": "141470821"}} Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '5eedfccb-b516-45a5-8a89-d30a0d3d6b84', 'body': {'resize': {'flavorRef': '141470821'}}} Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:36:39.407189 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-34fa29a5-c7b1-4d96-8d5d-e83f03caac18 tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84/action" status: 403 len: 113 microversion: 2.1 time: 0.256146 Nov 02 14:36:39.411042 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2173/6303] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:36:39 2022] POST /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84/action => generated 113 bytes in 258 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:36:39.417281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7ff6e8b7-f229-4375-b0fa-7db8daab833b tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:39.434165 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7ff6e8b7-f229-4375-b0fa-7db8daab833b tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/141470821" status: 202 len: 0 microversion: 2.1 time: 0.020587 Nov 02 14:36:39.434789 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4131/6304] 10.222.0.18 () {58 vars in 1158 bytes} [Wed Nov 2 14:36:39 2022] DELETE /compute/v2.1/flavors/141470821 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:39.443217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f2205afe-5874-4208-83de-d867e87a94ec tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:39.464428 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f2205afe-5874-4208-83de-d867e87a94ec tempest-ServersAdminNegativeTestJSON-1565030844 tempest-ServersAdminNegativeTestJSON-1565030844-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024930 Nov 02 14:36:39.465062 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2174/6305] 10.222.0.18 () {58 vars in 1146 bytes} [Wed Nov 2 14:36:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:39.486356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:39.486876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:39.492938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.493430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.493946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.495284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.495750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.496179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.521919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:36:39.596672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85cd2cc0-99ab-44b5-8235-ff2b9823ed6a tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 204 len: 0 microversion: 2.1 time: 0.113970 Nov 02 14:36:39.597552 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4132/6306] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:36:39 2022] DELETE /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:36:39.606423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:39.607055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:39.613955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.614453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.614907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.615645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:39.616116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:39.616557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:39.758564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:39.766270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2c147277-babd-47d2-8700-e38836be17e9 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1478 microversion: 2.1 time: 0.164253 Nov 02 14:36:39.766830 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2175/6307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:39 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:40.790474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:40.791123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:40.798783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:40.799309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:40.799749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:40.800444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:40.800900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:40.801326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:40.935162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92648062096b412aabd54f4403233909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24012a26a874056a808404c9f9335f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:40.943378 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-389f986a-2320-46b2-b379-f786102a2b73 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 200 len: 1478 microversion: 2.1 time: 0.157231 Nov 02 14:36:40.943965 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4133/6308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:40 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:41.348055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d0879683-9cfc-40e8-9228-36d3f1504290 req-52656d84-db28-4766-82fe-4f042ebff467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eedfccb-b516-45a5-8a89-d30a0d3d6b84", "name": "network-vif-deleted", "tag": "43a09325-49ce-40ae-b428-253af7ca96d9"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:41.359839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d0879683-9cfc-40e8-9228-36d3f1504290 req-52656d84-db28-4766-82fe-4f042ebff467 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:41.360420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d0879683-9cfc-40e8-9228-36d3f1504290 req-52656d84-db28-4766-82fe-4f042ebff467 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:41.360936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d0879683-9cfc-40e8-9228-36d3f1504290 req-52656d84-db28-4766-82fe-4f042ebff467 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:41.374922 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d0879683-9cfc-40e8-9228-36d3f1504290 req-52656d84-db28-4766-82fe-4f042ebff467 service nova] Creating event network-vif-deleted:43a09325-49ce-40ae-b428-253af7ca96d9 for instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 on n-h1-858238-3 Nov 02 14:36:41.380850 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d0879683-9cfc-40e8-9228-36d3f1504290 req-52656d84-db28-4766-82fe-4f042ebff467 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 Nov 02 14:36:41.381782 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2176/6309] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:41.967498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:41.968192 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] [instance: 5eedfccb-b516-45a5-8a89-d30a0d3d6b84] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:41.974983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:41.975489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:41.975940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:41.976604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:41.977049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:41.977469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:41.991374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] HTTP exception thrown: Instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 could not be found. Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Request method failure captured: Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 HTTP/1.1 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoBpQCoKXQAlx1o65fLTJwpyqP7pMGJ1ektLYnUSSFlj2owS7TZw1aWs57bbWRvipphRgdXD_8pDnZVHDlaMc0_8j72IiMyx4xIMR2dz07u63NkYkoBYuRXC9V0cp9KZBcSuIEpGmyQ5rMjEYF3gk6JtnbzXqkdVsnokDf4sHguQI8E Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f24012a26a874056a808404c9f9335f6 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1823870623 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f24012a26a874056a808404c9f9335f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f24012a26a874056a808404c9f9335f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f24012a26a874056a808404c9f9335f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f24012a26a874056a808404c9f9335f6"}]}] Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1823870623 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f24012a26a874056a808404c9f9335f6 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1823870623 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersAdminNegativeTestJSON-1823870623-project Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 92648062096b412aabd54f4403233909 Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1823870623-project Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 could not be found. Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5eedfccb-b516-45a5-8a89-d30a0d3d6b84'} Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 could not be found. Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 could not be found. Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:41.992935 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 could not be found. Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] Returning 404 to user: Instance 5eedfccb-b516-45a5-8a89-d30a0d3d6b84 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1245c202-9422-4121-bde1-71482d6ce159 tempest-ServersAdminNegativeTestJSON-1823870623 tempest-ServersAdminNegativeTestJSON-1823870623-project] 10.222.0.18 "GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84" status: 404 len: 111 microversion: 2.1 time: 0.031285 Nov 02 14:36:41.997475 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4134/6310] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:41 2022] GET /compute/v2.1/servers/5eedfccb-b516-45a5-8a89-d30a0d3d6b84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:36:48.353427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1394743904", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "872c30a3-a72e-4d79-9ffa-8a4a2ddda21b"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:48.515193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] validate_networks() for [('872c30a3-a72e-4d79-9ffa-8a4a2ddda21b', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:36:48.896056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:36:48.896056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:36:48.896340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:36:48.896764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:36:48.897182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:36:48.907343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:48.907837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:48.908325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:48.909000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:48.909487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:48.909916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:48.927019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Getting quotas for project 271d4456081945e098a6de846b9943b8. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:36:48.932272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Getting quotas for user 64100393111b4c9eb81075a0960512aa and project 271d4456081945e098a6de846b9943b8. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:36:48.945140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:36:48.947583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:36:48.999499 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a98dd2cb-1ee9-47b0-85f1-f2a6e845f2db tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768838 Nov 02 14:36:49.001111 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2177/6311] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:36:49.028225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8eecd3e1-423a-4238-bab0-2aad3e76189d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:49.029592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8eecd3e1-423a-4238-bab0-2aad3e76189d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:49.032400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:49.033089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:49.090474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8eecd3e1-423a-4238-bab0-2aad3e76189d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:49.097603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8eecd3e1-423a-4238-bab0-2aad3e76189d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1215 microversion: 2.1 time: 0.086119 Nov 02 14:36:49.098194 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4135/6312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:49 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:36:50.121095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:50.121731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:50.131036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:50.131569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:50.132019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:50.132733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:50.133202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:50.133647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:50.199638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:50.207926 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb44a5e1-a13d-461f-83a6-de57564d7bbe tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1267 microversion: 2.1 time: 0.091288 Nov 02 14:36:50.209111 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2178/6313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:50 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:51.233029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:51.234265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:51.241562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:51.242250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:51.242685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:51.243532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:51.244608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:51.245228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:51.391367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:51.399456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bef0b7aa-8e64-4b62-ac8f-4e2733525567 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1315 microversion: 2.1 time: 0.170377 Nov 02 14:36:51.400051 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4136/6314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:51 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:51.723156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-344d103c-abd2-49e2-a3e4-1cf1e5e113a5 req-1bb8b1b7-c311-49cf-b275-4f533313fe4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63830e59-2646-4363-92e1-0841ce420e46", "tag": "e3264920-9f0c-41a3-a4d2-7c90d8219896"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:51.736833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-344d103c-abd2-49e2-a3e4-1cf1e5e113a5 req-1bb8b1b7-c311-49cf-b275-4f533313fe4d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:51.738151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-344d103c-abd2-49e2-a3e4-1cf1e5e113a5 req-1bb8b1b7-c311-49cf-b275-4f533313fe4d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:51.738814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-344d103c-abd2-49e2-a3e4-1cf1e5e113a5 req-1bb8b1b7-c311-49cf-b275-4f533313fe4d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:51.757575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-344d103c-abd2-49e2-a3e4-1cf1e5e113a5 req-1bb8b1b7-c311-49cf-b275-4f533313fe4d service nova] Creating event network-changed:e3264920-9f0c-41a3-a4d2-7c90d8219896 for instance 63830e59-2646-4363-92e1-0841ce420e46 on n-h1-858238-3 Nov 02 14:36:51.763335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-344d103c-abd2-49e2-a3e4-1cf1e5e113a5 req-1bb8b1b7-c311-49cf-b275-4f533313fe4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044910 Nov 02 14:36:51.764439 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2179/6315] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:52.421886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:52.422498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:52.429346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:52.429827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:52.430266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:52.430951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:52.431426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:52.432347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:52.564113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:52.571810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02ee4d4c-864e-40c3-b571-38519904d0f7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1315 microversion: 2.1 time: 0.153901 Nov 02 14:36:52.573191 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4137/6316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:52 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:53.597781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:53.598791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:53.606160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:53.606659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:53.607119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:53.607835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:53.608303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:53.608743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:53.736722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:53.744449 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-237110a8-8860-453f-a6bd-1436a82c1b94 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1315 microversion: 2.1 time: 0.152670 Nov 02 14:36:53.745021 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2180/6317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:53 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:54.768132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:54.768787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:54.776132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:54.776616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:54.777053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:54.777750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:54.778205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:54.778635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:54.913793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:54.922551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-34eaaef2-ce6b-449f-aaaf-c2bb4bf54777 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1315 microversion: 2.1 time: 0.158314 Nov 02 14:36:54.923170 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4138/6318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:54 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:55.946437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:55.947581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:55.954441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:55.954937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:55.955411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:55.956116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:55.956583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:55.957021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:56.089502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:56.097297 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-35b61d12-9fd5-426e-8a70-852f07d2f698 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1315 microversion: 2.1 time: 0.154845 Nov 02 14:36:56.097859 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2181/6319] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:55 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:36:56.516501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7855bf55-f9d4-410e-a1af-9728ae865380 req-fc5cefb2-e286-4e24-8a75-e6391b1f8857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63830e59-2646-4363-92e1-0841ce420e46", "name": "network-vif-plugged", "status": "completed", "tag": "e3264920-9f0c-41a3-a4d2-7c90d8219896"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:56.522561 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:56.529427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7855bf55-f9d4-410e-a1af-9728ae865380 req-fc5cefb2-e286-4e24-8a75-e6391b1f8857 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:56.529910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7855bf55-f9d4-410e-a1af-9728ae865380 req-fc5cefb2-e286-4e24-8a75-e6391b1f8857 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:56.530330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7855bf55-f9d4-410e-a1af-9728ae865380 req-fc5cefb2-e286-4e24-8a75-e6391b1f8857 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:56.534490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:56.543621 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7855bf55-f9d4-410e-a1af-9728ae865380 req-fc5cefb2-e286-4e24-8a75-e6391b1f8857 service nova] Creating event network-vif-plugged:e3264920-9f0c-41a3-a4d2-7c90d8219896 for instance 63830e59-2646-4363-92e1-0841ce420e46 on n-h1-858238-3 Nov 02 14:36:56.549941 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7855bf55-f9d4-410e-a1af-9728ae865380 req-fc5cefb2-e286-4e24-8a75-e6391b1f8857 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037271 Nov 02 14:36:56.550728 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4139/6320] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:57.120708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:57.121241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:57.124093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:57.129671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:57.130173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:57.130627 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:57.131377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:57.131876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:57.132305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:57.137945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=76 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:57.270957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:57.278612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7b46cea0-d1ce-4102-a264-138a4eb13074 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1315 microversion: 2.1 time: 0.162475 Nov 02 14:36:57.279221 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2182/6321] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:57 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:58.304664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:58.305368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:58.313844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.314331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.315054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.315485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.315951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.316358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.446372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:58.454207 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-054fc5d6-fe52-42e1-827a-5ff7468f40ee tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1502 microversion: 2.1 time: 0.155241 Nov 02 14:36:58.454789 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4140/6322] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:58 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:58.477179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:58.480111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:58.486877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.487427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.487879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.488578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.489041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.489476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.562747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:58.568091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Old instance type m1.heat2, new instance type m1.heat {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:36:58.574548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:36:58.574980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:36:58.575500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:36:58.575923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:36:58.576349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:36:58.683016 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2a57e992-446b-4079-8f82-727ae4d616ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "POST /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46/action" status: 202 len: 0 microversion: 2.1 time: 0.209538 Nov 02 14:36:58.683668 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2183/6323] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:36:58 2022] POST /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:58.692108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:58.692719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:58.698655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.699155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.699603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.700273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.700718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.701133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.874077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:58.881920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fba9c02a-8ef7-4f61-90e8-ee1d8ad6dbdd tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1511 microversion: 2.1 time: 0.193779 Nov 02 14:36:58.882742 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4141/6324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:58 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:36:59.906108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:59.906737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:59.908645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=5 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:59.909504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:59.918168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:59.918747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:59.919445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:59.919929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:59.920403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:59.920841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:00.068504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:00.077357 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3ed75db3-01e9-4b04-a499-22fbc22e323c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1511 microversion: 2.1 time: 0.175150 Nov 02 14:37:00.077948 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2184/6325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:36:59 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:01.101725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:01.102330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:01.104298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:01.110465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:01.110944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:01.111415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:01.112114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:01.112562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:01.112988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:01.242166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:01.250574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-504baf40-4fa5-436b-b26a-5c91d8f569d3 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.152828 Nov 02 14:37:01.251173 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4142/6326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:01 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:02.274497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:02.275135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:02.282024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:02.282532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:02.282957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:02.283684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:02.284146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:02.284579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:02.412717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:02.421107 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-864cf73f-742e-4e12-8e11-e230de0de30d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.150483 Nov 02 14:37:02.421686 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2185/6327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:02 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:03.445078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:03.445695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:03.453183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:03.453663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:03.454098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:03.454789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:03.455286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:03.455715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:03.592609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:03.600702 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fac62c17-6e77-4b28-a90a-ea802840b533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.159557 Nov 02 14:37:03.601288 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4143/6328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:03 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:04.625583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:04.626293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:04.633010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:04.633495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:04.633937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:04.635316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:04.635775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:04.636206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:04.764157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:04.771823 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-faf26e62-9972-4ffa-b8a7-baa257c15949 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.150817 Nov 02 14:37:04.772393 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2186/6329] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:04 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:05.795081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:05.795704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:05.802467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:05.802944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:05.803405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:05.804091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:05.804540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:05.804961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:05.942998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:05.951532 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fdf640a2-fec1-4d2e-8a71-4c5e7501de38 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.160218 Nov 02 14:37:05.951978 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4144/6330] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:05 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:06.974536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:06.975082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:06.982004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:06.982654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:06.982954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:06.983682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:06.984149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:06.984587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:07.116354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:07.124960 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0f474506-1924-4143-92d7-63dbf571f8ff tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.154502 Nov 02 14:37:07.125538 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2187/6331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:06 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:08.149411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:08.150662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:08.157498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:08.157974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:08.158406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:08.159123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:08.159573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:08.159996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:08.287890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:08.295669 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8e150337-cd6e-449c-bc0a-7c4f57f6be4c tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.150252 Nov 02 14:37:08.296241 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4145/6332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:08 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:09.318927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:09.319611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:09.326689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:09.327215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:09.327665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:09.328361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:09.328830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:09.329270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:09.463360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:09.471604 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ff70bd5a-29f7-4c88-85f5-103518584cb4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.156724 Nov 02 14:37:09.472185 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2188/6333] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:09 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:10.496288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:10.496900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:10.503843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.504328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.504765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.505456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.505909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.506333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.637275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:10.645070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a64f2d54-d5ef-4a98-bade-6fd43c8a0a19 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.153193 Nov 02 14:37:10.645640 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4146/6334] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:10 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:11.668785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:11.669485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:11.676378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:11.676874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:11.677322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:11.678021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:11.678485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:11.678922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:11.810619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:11.818445 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4977cbfd-0550-4eac-b8e0-368399749bc5 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.153671 Nov 02 14:37:11.819013 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2189/6335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:11 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:12.842085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:12.842621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:12.849510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:12.849988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:12.850423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:12.851128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:12.851586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:12.852036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:12.982539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:12.990317 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53c8b5df-bcc7-4071-8e68-3f1f3ba5b436 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.152241 Nov 02 14:37:12.990892 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4147/6336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:12 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:37:14.014468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:14.015031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:14.021881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:14.022374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:14.022820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:14.023552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:14.024019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:14.024458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:14.160543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:14.168347 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-633ea10a-482b-4b91-9523-d84d003e7285 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.157881 Nov 02 14:37:14.168929 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2190/6337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:14 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:15.191987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:15.192603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:15.199776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:15.200269 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:15.200705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:15.201391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:15.201845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:15.202268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:15.331338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:15.339205 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6da5c75-e352-4d5a-9f32-2cf9029ab533 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.151312 Nov 02 14:37:15.339776 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4148/6338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:15 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:16.362495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:16.363138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:16.369941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:16.370430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:16.370874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:16.371596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:16.372059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:16.372489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:16.501952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:16.510451 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c9590787-761b-4f30-9a8f-f1fce1554fd1 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.151830 Nov 02 14:37:16.511021 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2191/6339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:16 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:17.533538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:17.534155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:17.541590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:17.542069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:17.542502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:17.543215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:17.543668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:17.544094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:17.678671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:17.686823 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c97dae9-d745-4ff3-a8af-e568ee1defa7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.157161 Nov 02 14:37:17.687450 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4149/6340] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:17 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:18.710661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:18.711267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:18.718464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:18.718950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:18.719426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:18.720116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:18.720575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:18.721005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:18.851169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:18.859505 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-84be8f33-382f-4720-b1d8-4fa0ea73e53b tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.152768 Nov 02 14:37:18.860071 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2192/6341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:18 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:19.883500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:19.884664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:19.891548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:19.892031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:19.892464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:19.893155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:19.893608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:19.894030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:20.029107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:20.036893 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-33f76bf7-b06b-4cbe-b698-faff5fbd4045 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.157607 Nov 02 14:37:20.037470 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4150/6342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:19 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:21.060937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:21.061561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:21.068529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:21.069027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:21.069478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:21.070181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:21.070650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:21.071693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:21.202824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:21.210682 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb081bf8-4a05-4e3a-94d5-99e9544844d8 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.153911 Nov 02 14:37:21.211280 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2193/6343] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:21 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:22.233828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:22.234445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:22.241342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:22.241836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:22.242253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:22.243003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:22.243481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:22.243905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:22.372486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:22.380292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-90c846d7-2544-4180-9718-c86372bbb530 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.150391 Nov 02 14:37:22.380871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4151/6344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:22 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:23.404525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:23.405147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:23.412552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:23.413053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:23.413492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:23.414193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:23.414654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:23.415692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:23.545708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:23.553399 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-69b7acb9-5f65-48ab-a13f-816adf874ad4 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.152844 Nov 02 14:37:23.553970 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2194/6345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:23 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:24.576865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:24.577478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:24.584479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:24.584959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:24.585395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:24.586080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:24.586536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:24.586958 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:24.715772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:24.723520 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-40fc7d4e-8d29-4c80-8520-928c9da8c952 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.150535 Nov 02 14:37:24.724101 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4152/6346] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:24 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:25.747429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:25.747999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:25.754777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:25.755366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:25.755834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:25.756530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:25.756991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:25.757424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:25.890905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:25.898822 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bca1a65b-8057-42e9-beb4-8729d8800ff9 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.155924 Nov 02 14:37:25.899682 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2195/6347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:25 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:26.922586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:26.923227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:26.930245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:26.930728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:26.931196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:26.931893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:26.932347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:26.932770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:27.060900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:27.068616 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f949045f-e5b4-4a20-9831-a3cf648c6369 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1516 microversion: 2.1 time: 0.150006 Nov 02 14:37:27.069199 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4153/6348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:26 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:28.092548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:28.093178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:28.096037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=32 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:28.101593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:28.102095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:28.102549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:28.103295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:28.103764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:28.104199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:28.106938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:28.182479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63830e59-2646-4363-92e1-0841ce420e46", "name": "network-vif-unplugged", "status": "completed", "tag": "e3264920-9f0c-41a3-a4d2-7c90d8219896"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:28.194188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:28.194740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:28.195451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:28.209096 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] Creating event network-vif-unplugged:e3264920-9f0c-41a3-a4d2-7c90d8219896 for instance 63830e59-2646-4363-92e1-0841ce420e46 on n-h2-858238-3 Nov 02 14:37:28.215579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] Instance 63830e59-2646-4363-92e1-0841ce420e46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:37:28.228683 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-515ec802-6061-4491-8d93-a1c04b6e0a03 req-438f89df-b4c8-4dcb-929f-2c6740bd21fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050381 Nov 02 14:37:28.229653 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4154/6349] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:28.257777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:28.266201 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d41abf3-0644-4a48-a69f-c19f5b918ade tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1515 microversion: 2.1 time: 0.177630 Nov 02 14:37:28.267192 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2196/6350] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:28 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:29.292177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:29.292883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:29.294892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=32 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:29.300496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:29.300983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:29.301421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:29.302118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:29.302576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:29.303003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:29.307257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=90 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:29.444966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:29.452849 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ff68ced8-fef7-4b94-8e12-d8ff40d06c33 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1513 microversion: 2.1 time: 0.166381 Nov 02 14:37:29.453441 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4155/6351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:29 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:30.255736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63830e59-2646-4363-92e1-0841ce420e46", "tag": "e3264920-9f0c-41a3-a4d2-7c90d8219896"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:30.266708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:30.267216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:30.267652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:30.279757 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] Creating event network-changed:e3264920-9f0c-41a3-a4d2-7c90d8219896 for instance 63830e59-2646-4363-92e1-0841ce420e46 on n-h2-858238-3 Nov 02 14:37:30.286410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] Instance 63830e59-2646-4363-92e1-0841ce420e46 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:37:30.298435 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-88dc1b58-e50c-4a52-a5b1-7fdc81d02b2d req-d73c670a-af82-4389-a1db-1fec48dd137c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046167 Nov 02 14:37:30.299190 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2197/6352] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:30.477284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:30.478628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:30.486197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:30.486697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:30.487161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:30.488085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:30.488547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:30.488979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:30.645869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:30.658050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ba6c1ba-39c8-4a01-8031-8f37debbcb85 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1513 microversion: 2.1 time: 0.184803 Nov 02 14:37:30.658979 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4156/6353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:30 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:31.683877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:31.684597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:31.692167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:31.692657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:31.693104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:31.693794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:31.694256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:31.694687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:31.830291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:31.839030 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8ece5394-82ef-4549-b1e3-d9203657af23 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1510 microversion: 2.1 time: 0.159730 Nov 02 14:37:31.839809 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2198/6354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:31 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:31.862560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:31.863070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:31.870399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:31.870881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:31.871343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:31.872034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:31.872742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:31.873253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:31.901856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:37:31.955078 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Found an unconfirmed migration during delete, id: 16, status: finished Nov 02 14:37:33.733899 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c65842d3-6387-4dd3-95bc-4f828ea2c46e tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "DELETE /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 204 len: 0 microversion: 2.1 time: 1.874959 Nov 02 14:37:33.734956 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4157/6355] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:37:31 2022] DELETE /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 0 bytes in 1877 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:37:33.743252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:33.743911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:33.751132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:33.751830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:33.752056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:33.752900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:33.753290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:33.753730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:33.890591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:33.898527 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-70c02496-bfb2-4525-a3ae-e251460f6ae7 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1502 microversion: 2.1 time: 0.159202 Nov 02 14:37:33.899138 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2199/6356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:33 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:34.164348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9fc1f58d-de86-48fa-9a75-79e729fa4dee req-236406b2-9737-45f5-b962-6a6deef980a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63830e59-2646-4363-92e1-0841ce420e46", "name": "network-vif-plugged", "status": "completed", "tag": "e3264920-9f0c-41a3-a4d2-7c90d8219896"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:34.176621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9fc1f58d-de86-48fa-9a75-79e729fa4dee req-236406b2-9737-45f5-b962-6a6deef980a2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:34.177304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9fc1f58d-de86-48fa-9a75-79e729fa4dee req-236406b2-9737-45f5-b962-6a6deef980a2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:34.177828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9fc1f58d-de86-48fa-9a75-79e729fa4dee req-236406b2-9737-45f5-b962-6a6deef980a2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:34.192561 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9fc1f58d-de86-48fa-9a75-79e729fa4dee req-236406b2-9737-45f5-b962-6a6deef980a2 service nova] Creating event network-vif-plugged:e3264920-9f0c-41a3-a4d2-7c90d8219896 for instance 63830e59-2646-4363-92e1-0841ce420e46 on n-h2-858238-3 Nov 02 14:37:34.199511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9fc1f58d-de86-48fa-9a75-79e729fa4dee req-236406b2-9737-45f5-b962-6a6deef980a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039073 Nov 02 14:37:34.199511 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4158/6357] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:34.922465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:34.923116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:34.930304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:34.931503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:34.931998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:34.932723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:34.933198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:34.933637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:35.085997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64100393111b4c9eb81075a0960512aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271d4456081945e098a6de846b9943b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:35.094581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c16e8b84-5f9b-43cd-a4fc-f423aa36a270 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 200 len: 1502 microversion: 2.1 time: 0.176151 Nov 02 14:37:35.095181 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2200/6358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:34 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:35.573562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c1b33e5d-ce25-4d9d-8710-e0989806d664 req-3bb91126-f262-4933-a261-78ab468af862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63830e59-2646-4363-92e1-0841ce420e46", "name": "network-vif-deleted", "tag": "e3264920-9f0c-41a3-a4d2-7c90d8219896"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:35.583946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1b33e5d-ce25-4d9d-8710-e0989806d664 req-3bb91126-f262-4933-a261-78ab468af862 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:35.584428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1b33e5d-ce25-4d9d-8710-e0989806d664 req-3bb91126-f262-4933-a261-78ab468af862 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:35.585005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1b33e5d-ce25-4d9d-8710-e0989806d664 req-3bb91126-f262-4933-a261-78ab468af862 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:35.597674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c1b33e5d-ce25-4d9d-8710-e0989806d664 req-3bb91126-f262-4933-a261-78ab468af862 service nova] Creating event network-vif-deleted:e3264920-9f0c-41a3-a4d2-7c90d8219896 for instance 63830e59-2646-4363-92e1-0841ce420e46 on n-h2-858238-3 Nov 02 14:37:35.609885 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c1b33e5d-ce25-4d9d-8710-e0989806d664 req-3bb91126-f262-4933-a261-78ab468af862 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042185 Nov 02 14:37:35.610506 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4159/6359] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:36.119134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:36.119708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:36.126532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.127022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.127516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.128207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.128669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.129100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.142934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] HTTP exception thrown: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Request method failure captured: Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 HTTP/1.1 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoCAZT6YMkOW69OOu05-3FTE5YZA2PLV13cHumlLs5yFewO0qwmG8A8aPTs_AyjugVyc_8PqE9ubGCe_C5U18mucTtgxVPsneeQOZ3CFf-tAynmvqCDa0qjPSe9fogA_QxNfhiRCrNEgJ-vys0GRPt_FrGMxM7uNhnCgO6qIuPezoV8 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 271d4456081945e098a6de846b9943b8 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/271d4456081945e098a6de846b9943b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/271d4456081945e098a6de846b9943b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/271d4456081945e098a6de846b9943b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_271d4456081945e098a6de846b9943b8"}]}] Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 271d4456081945e098a6de846b9943b8 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-DeleteServersTestJSON-1051965660-project Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 64100393111b4c9eb81075a0960512aa Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-DeleteServersTestJSON-1051965660-project Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '63830e59-2646-4363-92e1-0841ce420e46'} Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:37:36.144615 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Returning 404 to user: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eccafe30-0e42-4df5-a261-d27b24a4c74d tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 404 len: 111 microversion: 2.1 time: 0.031454 Nov 02 14:37:36.149542 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2201/6360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:36 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:37:36.161783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:36.162374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:36.168717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.169458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.170036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.170772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.171272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.171727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.185789 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] HTTP exception thrown: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Request method failure captured: Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 HTTP/1.1 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoCAZT6YMkOW69OOu05-3FTE5YZA2PLV13cHumlLs5yFewO0qwmG8A8aPTs_AyjugVyc_8PqE9ubGCe_C5U18mucTtgxVPsneeQOZ3CFf-tAynmvqCDa0qjPSe9fogA_QxNfhiRCrNEgJ-vys0GRPt_FrGMxM7uNhnCgO6qIuPezoV8 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 271d4456081945e098a6de846b9943b8 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/271d4456081945e098a6de846b9943b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/271d4456081945e098a6de846b9943b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/271d4456081945e098a6de846b9943b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_271d4456081945e098a6de846b9943b8"}]}] Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 271d4456081945e098a6de846b9943b8 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-DeleteServersTestJSON-1051965660-project Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 64100393111b4c9eb81075a0960512aa Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-DeleteServersTestJSON-1051965660-project Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '63830e59-2646-4363-92e1-0841ce420e46'} Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:37:36.187471 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Returning 404 to user: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9bdfd749-792e-4cbe-8775-a5d1ce0d87d6 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "DELETE /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 404 len: 111 microversion: 2.1 time: 0.031847 Nov 02 14:37:36.191125 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4160/6361] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:37:36 2022] DELETE /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:37:36.198058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:36.198729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] [instance: 63830e59-2646-4363-92e1-0841ce420e46] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:36.204686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.205173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.205616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.206304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:36.206765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:36.207225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:36.220458 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] HTTP exception thrown: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Request method failure captured: Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 HTTP/1.1 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoCAZT6YMkOW69OOu05-3FTE5YZA2PLV13cHumlLs5yFewO0qwmG8A8aPTs_AyjugVyc_8PqE9ubGCe_C5U18mucTtgxVPsneeQOZ3CFf-tAynmvqCDa0qjPSe9fogA_QxNfhiRCrNEgJ-vys0GRPt_FrGMxM7uNhnCgO6qIuPezoV8 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 271d4456081945e098a6de846b9943b8 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/271d4456081945e098a6de846b9943b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/271d4456081945e098a6de846b9943b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/271d4456081945e098a6de846b9943b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_271d4456081945e098a6de846b9943b8"}]}] Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 271d4456081945e098a6de846b9943b8 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051965660 Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-DeleteServersTestJSON-1051965660-project Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 64100393111b4c9eb81075a0960512aa Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-DeleteServersTestJSON-1051965660-project Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '63830e59-2646-4363-92e1-0841ce420e46'} Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:37:36.221961 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] Returning 404 to user: Instance 63830e59-2646-4363-92e1-0841ce420e46 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-710da6fa-06d3-48dc-ab79-4b6381e77362 tempest-DeleteServersTestJSON-1051965660 tempest-DeleteServersTestJSON-1051965660-project] 10.222.0.18 "GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46" status: 404 len: 111 microversion: 2.1 time: 0.029763 Nov 02 14:37:36.226147 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2202/6362] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:36 2022] GET /compute/v2.1/servers/63830e59-2646-4363-92e1-0841ce420e46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:37:45.090354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-702325536", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ecbe5c88-ff74-4166-9155-5cad43724f45"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:45.146622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] validate_networks() for [('ecbe5c88-ff74-4166-9155-5cad43724f45', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:37:45.523743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:37:45.524793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:37:45.525282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:37:45.525690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:37:45.526122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:37:45.534947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:45.535463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:45.535892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:45.536615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:45.537061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:45.537493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:45.554489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Getting quotas for project bd21e44bc4e1485589bbb4f8f67e00cf. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:37:45.559963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Getting quotas for user 4c38044c7fa54c7eb578b9410e355968 and project bd21e44bc4e1485589bbb4f8f67e00cf. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:37:45.573552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:37:45.575888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:37:45.628477 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b5346016-665b-4b9b-bf3f-65ef598ed01c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666205 Nov 02 14:37:45.629540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4161/6363] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:37:45.644584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ec0fcc12-f18c-412a-9e1d-483827c60236 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:45.645219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ec0fcc12-f18c-412a-9e1d-483827c60236 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:45.705986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ec0fcc12-f18c-412a-9e1d-483827c60236 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:45.717234 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ec0fcc12-f18c-412a-9e1d-483827c60236 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1217 microversion: 2.1 time: 0.078948 Nov 02 14:37:45.717912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2203/6364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:45 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:37:46.742677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:46.743533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:46.750996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:46.751715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:46.752287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:46.753147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:46.753593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:46.754162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:46.841519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:46.850540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c091637c-947d-409c-b5bf-a4426cae8a18 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1287 microversion: 2.1 time: 0.114011 Nov 02 14:37:46.851146 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4162/6365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:46 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:37:47.876272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:47.876984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:47.885097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=31 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:47.888272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:47.888784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:47.889243 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:47.889978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:47.890452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:47.890903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:48.066920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:48.076262 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-316f873e-cfae-4889-82b0-cacdf27860dc tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.205669 Nov 02 14:37:48.077180 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2204/6366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:47 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:48.254816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c751a0f6-4955-4542-a2bc-fc00ac66cd87 req-19027571-0e03-4c2d-82d9-5d1bcc41320a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2008e28f-0828-4383-8ffd-ba7c69b01604", "tag": "bb22f579-6de2-4001-be00-7032a7a05369"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:48.271368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c751a0f6-4955-4542-a2bc-fc00ac66cd87 req-19027571-0e03-4c2d-82d9-5d1bcc41320a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:48.272960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c751a0f6-4955-4542-a2bc-fc00ac66cd87 req-19027571-0e03-4c2d-82d9-5d1bcc41320a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:48.273760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c751a0f6-4955-4542-a2bc-fc00ac66cd87 req-19027571-0e03-4c2d-82d9-5d1bcc41320a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:48.292482 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c751a0f6-4955-4542-a2bc-fc00ac66cd87 req-19027571-0e03-4c2d-82d9-5d1bcc41320a service nova] Creating event network-changed:bb22f579-6de2-4001-be00-7032a7a05369 for instance 2008e28f-0828-4383-8ffd-ba7c69b01604 on n-h1-858238-3 Nov 02 14:37:48.301730 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c751a0f6-4955-4542-a2bc-fc00ac66cd87 req-19027571-0e03-4c2d-82d9-5d1bcc41320a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052393 Nov 02 14:37:48.302701 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4163/6367] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:49.101915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:49.102557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:49.109828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:49.110329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:49.110782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:49.111520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:49.111992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:49.112433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:49.246257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:49.254089 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41b037ca-d0f2-4ce0-9967-2802ba46fc14 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.156256 Nov 02 14:37:49.254683 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2205/6368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:49 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:50.278298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:50.279029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:50.286125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:50.286652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:50.287030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:50.287737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:50.288185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:50.288609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:50.419568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:50.427392 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ddef4959-f32e-42b1-9397-fab2dabefeaa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.153286 Nov 02 14:37:50.427977 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4164/6369] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:50 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:51.451257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:51.451878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:51.458818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:51.459341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:51.459785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:51.460481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:51.460946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:51.461382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:51.594741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:51.603112 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-21811082-7d85-4a64-a686-949ff85dc8d6 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.155822 Nov 02 14:37:51.603693 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2206/6370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:51 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:52.626836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:52.627509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:52.635002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:52.635512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:52.635946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:52.636681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:52.637190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:52.637616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:52.769602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:52.778056 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0bffdd02-8f9b-4812-8034-87e5d3b3b398 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.154987 Nov 02 14:37:52.778627 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4165/6371] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:52 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:37:53.801351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:53.801967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:53.808889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:53.809368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:53.809809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:53.810765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:53.811269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:53.811723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:53.952749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:53.960581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-64a63bf8-b02c-41b6-8e46-79abbdac0acf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.163524 Nov 02 14:37:53.961154 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2207/6372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:53 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:54.730903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-84f02bde-d92e-4f78-8301-c85eb3905791 req-ffd64060-c05c-4be2-bcb0-c856a9e26b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2008e28f-0828-4383-8ffd-ba7c69b01604", "name": "network-vif-plugged", "status": "completed", "tag": "bb22f579-6de2-4001-be00-7032a7a05369"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:54.741889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-84f02bde-d92e-4f78-8301-c85eb3905791 req-ffd64060-c05c-4be2-bcb0-c856a9e26b54 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:54.742397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-84f02bde-d92e-4f78-8301-c85eb3905791 req-ffd64060-c05c-4be2-bcb0-c856a9e26b54 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:54.743469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-84f02bde-d92e-4f78-8301-c85eb3905791 req-ffd64060-c05c-4be2-bcb0-c856a9e26b54 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:54.754998 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-84f02bde-d92e-4f78-8301-c85eb3905791 req-ffd64060-c05c-4be2-bcb0-c856a9e26b54 service nova] Creating event network-vif-plugged:bb22f579-6de2-4001-be00-7032a7a05369 for instance 2008e28f-0828-4383-8ffd-ba7c69b01604 on n-h1-858238-3 Nov 02 14:37:54.760601 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-84f02bde-d92e-4f78-8301-c85eb3905791 req-ffd64060-c05c-4be2-bcb0-c856a9e26b54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033527 Nov 02 14:37:54.761212 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4166/6373] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:54.983266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:54.983889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:54.990653 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:54.991172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:54.991619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:54.992316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:54.993307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:54.993742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:55.122941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:55.130784 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4eabd365-c160-4226-849e-ddad8e644372 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1317 microversion: 2.1 time: 0.151470 Nov 02 14:37:55.131394 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2208/6374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:54 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:56.152254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:56.153431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:56.159621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:56.160429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:56.169483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.169980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.170417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.171284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.171795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.172212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.306651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:56.314771 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b470f20e-3b3c-4269-9328-cdf25a81827d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1506 microversion: 2.1 time: 0.163612 Nov 02 14:37:56.315410 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4167/6375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:56 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:56.338907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:56.339498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:56.341406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:56.347818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.348311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.348756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.349454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.349916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.350354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.485158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:56.492907 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-db7d26e4-e8d8-4bfb-a582-3aaf65d8abad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1506 microversion: 2.1 time: 0.158436 Nov 02 14:37:56.493482 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2209/6376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:56 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:56.515228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:56.517650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:56.523638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.525004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.525214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.525904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.526355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.526779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.590175 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c47d9990-4e7b-4c0e-8b9a-7cd06a5bfa68 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "PUT /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1078 microversion: 2.1 time: 0.078665 Nov 02 14:37:56.594094 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4168/6377] 10.222.0.18 () {60 vars in 1256 bytes} [Wed Nov 2 14:37:56 2022] PUT /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1078 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:56.609200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:56.609828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:56.615875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.616367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.616811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.617503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.618003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.618441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.746708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:56.754544 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fe5bf6e4-7055-40f9-a495-0492e2031376 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1504 microversion: 2.1 time: 0.149202 Nov 02 14:37:56.755142 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2210/6378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:56 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:56.777417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:56.778030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:56.784020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.784498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.784969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.785651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.786102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.786522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.919016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:56.926815 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d4fccb7-1c6b-4f76-8b58-e84d2655ec48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1504 microversion: 2.1 time: 0.153931 Nov 02 14:37:56.927423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4169/6379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:56 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:56.950361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:56.952920 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:56.958960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.959481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.959941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.960611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:56.961205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:56.961618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:56.993713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:56.999750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Old instance type m1.heat2, new instance type m1.heat {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:37:57.006269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:37:57.006692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:37:57.007194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:37:57.007613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:37:57.008033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:37:57.070095 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56b9d8b2-f4ab-45ca-afec-6977d39d3f0b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604/action" status: 202 len: 0 microversion: 2.1 time: 0.124232 Nov 02 14:37:57.071600 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2211/6380] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:37:56 2022] POST /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:37:57.079691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:57.080308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:57.086316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:57.086803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:57.087266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:57.087969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:57.088423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:57.088844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:57.246261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:57.257077 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-708c4dac-a916-463e-afca-a5d2c898811e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1515 microversion: 2.1 time: 0.181259 Nov 02 14:37:57.257662 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4170/6381] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:57 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:58.283895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:58.284742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:58.286903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=38 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:58.294122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:58.295140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:58.295597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:58.296473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:58.296950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:58.297380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:58.431484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:58.439581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a000d751-24f5-4c85-a30f-6b598416b67e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1515 microversion: 2.1 time: 0.162354 Nov 02 14:37:58.440156 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2212/6382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:58 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:59.464043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:59.464661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:59.467352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:59.472835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:59.473318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:59.473757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:59.474450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:59.474908 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:59.475371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:59.479439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:59.612208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:59.619965 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10634a59-3535-4377-a1ec-0d2219f93221 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.160333 Nov 02 14:37:59.620544 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4171/6383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:37:59 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:00.643715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:00.644342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:00.651740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:00.652233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:00.652686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:00.653387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:00.653860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:00.654300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:00.782147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:00.790600 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b688f179-84bd-4b63-b7fb-557f26fe26c0 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.150870 Nov 02 14:38:00.791191 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2213/6384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:00 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:01.814330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:01.814939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:01.821946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:01.822422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:01.822865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:01.823569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:01.824018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:01.824435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:01.952341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:01.960103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49e11b90-5a8a-43c5-b891-fa3fe3a1eb12 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.150044 Nov 02 14:38:01.960669 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4172/6385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:01 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:02.983877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:02.984509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:02.991415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:02.991911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:02.992356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:02.993053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:02.993516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:02.993952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:03.125388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:03.133250 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e8bd2a49-d057-4818-b8f6-21e9a1728a9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.153262 Nov 02 14:38:03.133767 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2214/6386] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:02 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:04.156805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:04.157414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:04.164808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:04.165284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:04.165711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:04.166390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:04.166839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:04.167286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:04.297550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:04.305986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-47263f21-c5dc-4b38-b403-830b26dabd48 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.153102 Nov 02 14:38:04.306560 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4173/6387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:04 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:05.329472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:05.330006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:05.337053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:05.337542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:05.337991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:05.338690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:05.339181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:05.339622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:05.473415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:05.481130 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50c64c92-22bc-42f7-bfd3-72525d9dae65 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.155664 Nov 02 14:38:05.481697 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2215/6388] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:05 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:06.504378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:06.504992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:06.512181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:06.512661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:06.513119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:06.513782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:06.514231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:06.514652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:06.643557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:06.651952 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed2dd7c6-ba65-4a4f-bf66-0494b65d5f26 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.151476 Nov 02 14:38:06.652530 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4174/6389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:06 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:07.676038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:07.676599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:07.683694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:07.684193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:07.684639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:07.685609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:07.686075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:07.686514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:07.818109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:07.826288 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a1a31c87-cea3-4e4e-84ea-3a7744be2785 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.154409 Nov 02 14:38:07.826860 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2216/6390] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:07 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:08.849973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:08.850579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:08.858180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:08.858657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:08.859087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:08.859828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:08.860274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:08.860696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:08.991655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:08.999374 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3fc56dee-bd53-477a-a721-d0c6eb0132d4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.153222 Nov 02 14:38:08.999943 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4175/6391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:08 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:10.023287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:10.023806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:10.026391 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:38:10.026539 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 (ip 10.222.0.18) !!! Nov 02 14:38:10.032550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:10.033040 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:10.033488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:10.034190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:10.034658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:10.035113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:10.165111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:10.172807 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2b97f7fc-aa2f-485a-8ffa-2b46a4d4f818 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.153764 Nov 02 14:38:10.173377 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2217/6392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:10 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:11.197194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:11.197818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:11.204707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:11.205185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:11.205615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:11.206311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:11.206755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:11.207212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:11.345324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:11.353695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab0fe859-87a0-4c1e-9e77-53e4f9566d9a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.160080 Nov 02 14:38:11.354285 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4176/6393] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:11 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:12.377750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:12.378375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:12.385258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:12.385754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:12.386206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:12.387203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:12.387676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:12.388116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:12.515775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:12.523438 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-61d3e4da-b3b8-4394-8daf-19b0b491690d tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.149615 Nov 02 14:38:12.524020 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2218/6394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:12 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:13.546993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:13.547656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:13.554302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:13.554781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:13.555247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:13.555936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:13.557065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:13.557486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:13.689376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:13.697450 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c7be1c0-6f10-46a8-aaa1-5eb6de0d1de5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.154500 Nov 02 14:38:13.698019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4177/6395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:13 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:14.721263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:14.721790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:14.728682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:14.729181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:14.729629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:14.730521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:14.730947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:14.731420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:14.735436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:14.862479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:14.870749 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-16aa9717-32cd-402b-b041-3f428a4cdf3b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.153475 Nov 02 14:38:14.871346 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2219/6396] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:14 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:15.895338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:15.895944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:15.902465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:15.902937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:15.903390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:15.904073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:15.904518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:15.904934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:16.035234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:16.044304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e25b9961-80e9-4bef-a35d-85101588d2ad tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.152953 Nov 02 14:38:16.044820 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4178/6397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:15 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:17.067848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:17.068473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:17.075375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:17.075869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:17.076330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:17.077248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:17.077459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:17.077897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:17.210338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:17.218930 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3e70afed-2e55-43d6-8ce1-482aecd48a76 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.154957 Nov 02 14:38:17.219539 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2220/6398] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:17 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:18.241927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:18.242532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:18.250149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:18.250632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:18.251065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:18.251782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:18.252236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:18.252659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:18.382287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:18.390062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3fd64dbc-8af7-47b7-b90f-a08dd0cd9926 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.152191 Nov 02 14:38:18.390633 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4179/6399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:18 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:19.414022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:19.414642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:19.421842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:19.422333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:19.422778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:19.423521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:19.423985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:19.424413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:19.557238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:19.565226 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f6b913b9-ae7a-4deb-8f7a-1fcd7fce6e9f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.155109 Nov 02 14:38:19.565796 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2221/6400] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:19 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:20.589747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:20.590281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:20.597360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:20.597839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:20.598271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:20.598964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:20.599447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:20.599873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:20.732790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:20.740699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4eda4851-f593-4f51-bc10-8f5dda86fe2e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.155804 Nov 02 14:38:20.741275 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4180/6401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:20 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:21.764476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:21.765015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:21.771831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:21.772323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:21.772770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:21.773467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:21.773931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:21.774366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:21.905472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:21.913267 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a6057ddf-d454-441d-9dab-12e33e29e132 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.152714 Nov 02 14:38:21.913842 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2222/6402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:21 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:22.937330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:22.937941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:22.944805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:22.945285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:22.945717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:22.946441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:22.946894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:22.947363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:23.079612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:23.087289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df597abd-6311-46bb-986e-a1704eb497e1 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.154151 Nov 02 14:38:23.087865 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4181/6403] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:22 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:38:24.111791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:24.112485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:24.120176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:24.120670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:24.121109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:24.121809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:24.122272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:24.122708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:24.282918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:24.291983 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-defec98e-0911-41e9-b72d-1b2315cc05b2 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.184603 Nov 02 14:38:24.292577 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2223/6404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:24 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:25.315747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:25.316359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:25.323731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:25.324205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:25.324634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:25.325315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:25.325764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:25.326189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:25.461271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:25.469385 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1067058-b990-4328-9859-a0b06f5f453c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1520 microversion: 2.1 time: 0.157490 Nov 02 14:38:25.469969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4182/6405] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:25 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:26.492224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:26.492865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:26.500355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:26.500862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:26.501315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:26.502030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:26.502500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:26.502942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:26.525329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2008e28f-0828-4383-8ffd-ba7c69b01604", "name": "network-vif-unplugged", "status": "completed", "tag": "bb22f579-6de2-4001-be00-7032a7a05369"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:26.536993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:26.537481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:26.537905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:26.550172 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] Creating event network-vif-unplugged:bb22f579-6de2-4001-be00-7032a7a05369 for instance 2008e28f-0828-4383-8ffd-ba7c69b01604 on n-h2-858238-3 Nov 02 14:38:26.555775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:38:26.567299 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c7df088d-faa2-4ac7-9d29-54678c56c058 req-35253dec-5146-4677-9bab-28e24635b24d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046291 Nov 02 14:38:26.568243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4183/6406] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:26.650028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:26.657894 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b44ac1ab-0bc0-4f2c-b4c0-1863fc90f6db tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1519 microversion: 2.1 time: 0.169588 Nov 02 14:38:26.658476 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2224/6407] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:26 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:27.684128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:27.685085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:27.691745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:27.692263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:27.692697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:27.693422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:27.693871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:27.694321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:27.833621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:27.847762 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-97f38fc5-ad65-4fd2-86d6-80a628b06992 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1517 microversion: 2.1 time: 0.169215 Nov 02 14:38:27.848451 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4184/6408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:27 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:28.582269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2008e28f-0828-4383-8ffd-ba7c69b01604", "tag": "bb22f579-6de2-4001-be00-7032a7a05369"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:28.589254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=26 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:28.595951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:28.596448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:28.596894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:28.609887 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] Creating event network-changed:bb22f579-6de2-4001-be00-7032a7a05369 for instance 2008e28f-0828-4383-8ffd-ba7c69b01604 on n-h2-858238-3 Nov 02 14:38:28.615374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:38:28.626723 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8bf75ebc-1c9b-44b5-80d4-8f68e1e8e6e1 req-46d9cee2-9025-4dff-b2b1-d23fb766a0d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048089 Nov 02 14:38:28.627371 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2225/6409] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:28.872511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:28.873125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:28.881240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:28.881723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:28.882333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:28.883054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:28.884029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:28.884458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.027426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:29.035506 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9d33faaa-6adc-44f9-a0c0-45a38baaa230 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1514 microversion: 2.1 time: 0.167392 Nov 02 14:38:29.036092 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4185/6410] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:28 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:29.059042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:29.060196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:29.066460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:29.066956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:29.067456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.068162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:29.068656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:29.069066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.128579 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-18e1a364-e899-4574-9e26-c10a66f28cf9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604/action" status: 204 len: 0 microversion: 2.1 time: 0.073761 Nov 02 14:38:29.129420 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2226/6411] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:38:29 2022] POST /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:38:29.138862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:29.139512 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:29.145882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:29.146171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:29.146603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.147444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:29.147873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:29.148370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.374361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:29.383071 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9d02244-d90b-481c-8d1f-d4a23c64df7c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1514 microversion: 2.1 time: 0.249261 Nov 02 14:38:29.383872 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4186/6412] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:29 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:30.407211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:30.408518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:30.416451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:30.416954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:30.417593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:30.418466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:30.419088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:30.419710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:30.570324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:30.579789 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b8b2ec26-a082-4ebd-b39e-02d3ad425db5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1514 microversion: 2.1 time: 0.176648 Nov 02 14:38:30.580373 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2227/6413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:30 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:31.604711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:31.605466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:31.608666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=32 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:31.614165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:31.614650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:31.615083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:31.615802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:31.616249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:31.616672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:31.620894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=94 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:31.752061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:31.760308 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-570269dd-96cc-4487-ae6a-46e116d746b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1506 microversion: 2.1 time: 0.160647 Nov 02 14:38:31.760881 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4187/6414] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:31 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:31.782890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:31.783543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:31.790389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:31.790879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:31.791355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:31.792050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:31.792538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:31.793553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:31.921908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:31.929655 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae4b8b46-877d-4933-bc43-a51aeab5b2f5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1506 microversion: 2.1 time: 0.150615 Nov 02 14:38:31.930261 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2228/6415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:31 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:31.956345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-210df7bb-e649-45af-a985-ca6723e135c5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'create', calling method: .version_select at 0x7f6f80fd2ee0>, body: {"keypair": {"name": "tempest-keypair-1898969585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/5L6EbgMge3Ywa4zEed5PFRp+ni97ls0TDlrhfRkkdBZEyDFgIyWYnqHQl4fM7KQ3+7A4JROft2CccSrjZMiSrHVRQgCwBeGtL4Qb5vEF+EVEQH596jQaeIWPdum3DCA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:31.971689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-210df7bb-e649-45af-a985-ca6723e135c5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Getting quotas for project bd21e44bc4e1485589bbb4f8f67e00cf. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:38:31.976849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-210df7bb-e649-45af-a985-ca6723e135c5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Getting quotas for user 4c38044c7fa54c7eb578b9410e355968 and project bd21e44bc4e1485589bbb4f8f67e00cf. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:38:32.002378 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-210df7bb-e649-45af-a985-ca6723e135c5 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049776 Nov 02 14:38:32.003004 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4188/6416] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:38:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:32.507069 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e7bc298a-e5ab-4be1-b60f-c3d91b6d2380 req-59c27e2f-a075-4ea4-a477-388bb5944c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2008e28f-0828-4383-8ffd-ba7c69b01604", "name": "network-vif-plugged", "status": "completed", "tag": "bb22f579-6de2-4001-be00-7032a7a05369"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:32.518033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e7bc298a-e5ab-4be1-b60f-c3d91b6d2380 req-59c27e2f-a075-4ea4-a477-388bb5944c28 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:32.518752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e7bc298a-e5ab-4be1-b60f-c3d91b6d2380 req-59c27e2f-a075-4ea4-a477-388bb5944c28 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:32.519405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e7bc298a-e5ab-4be1-b60f-c3d91b6d2380 req-59c27e2f-a075-4ea4-a477-388bb5944c28 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:32.536474 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e7bc298a-e5ab-4be1-b60f-c3d91b6d2380 req-59c27e2f-a075-4ea4-a477-388bb5944c28 service nova] Creating event network-vif-plugged:bb22f579-6de2-4001-be00-7032a7a05369 for instance 2008e28f-0828-4383-8ffd-ba7c69b01604 on n-h2-858238-3 Nov 02 14:38:32.542349 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e7bc298a-e5ab-4be1-b60f-c3d91b6d2380 req-59c27e2f-a075-4ea4-a477-388bb5944c28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038859 Nov 02 14:38:32.543198 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2229/6417] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:33.185354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:33.185967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:33.192639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:33.193114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:33.193550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:33.194235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:33.194685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:33.195127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:33.326424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:33.334334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a41a8c67-22a9-48b2-88aa-34bbeb020d89 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 200 len: 1506 microversion: 2.1 time: 0.154160 Nov 02 14:38:33.334913 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4189/6418] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:33 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:33.358109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:33.358690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:33.364900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:33.365399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:33.365844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:33.366536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:33.366998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:33.367458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:33.393690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:38:33.470405 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-912d1bf0-e488-4164-8664-794c2448a367 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 204 len: 0 microversion: 2.1 time: 0.116360 Nov 02 14:38:33.471955 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2230/6419] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:38:33 2022] DELETE /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:38:33.531562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1904751076", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ecbe5c88-ff74-4166-9155-5cad43724f45"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:33.588836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] validate_networks() for [('ecbe5c88-ff74-4166-9155-5cad43724f45', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:38:33.990571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:38:33.991014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:38:33.991505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:38:33.991909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:38:33.992316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:38:34.002591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:34.003054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:34.003521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:34.004255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:34.004708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:34.005130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:34.023242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Getting quotas for project bd21e44bc4e1485589bbb4f8f67e00cf. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:38:34.028928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Getting quotas for user 4c38044c7fa54c7eb578b9410e355968 and project bd21e44bc4e1485589bbb4f8f67e00cf. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:38:34.042468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:38:34.044888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:38:34.090375 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93dc1115-a7e6-4e45-9d2c-3f9e63f61a47 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562660 Nov 02 14:38:34.091928 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4190/6420] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:38:34.107134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f1b4c8ff-3065-498e-a15a-6d891cf5bb92 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:34.107971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1b4c8ff-3065-498e-a15a-6d891cf5bb92 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:34.170304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f1b4c8ff-3065-498e-a15a-6d891cf5bb92 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:34.178607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f1b4c8ff-3065-498e-a15a-6d891cf5bb92 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1218 microversion: 2.1 time: 0.079946 Nov 02 14:38:34.179715 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2231/6421] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:34 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:35.206985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:35.207727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:35.217351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:35.217839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:35.218284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:35.218999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:35.219490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:35.219916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:35.284346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:35.292577 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-70954c0d-e5ab-41cb-803a-efdb1a639a22 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1270 microversion: 2.1 time: 0.090524 Nov 02 14:38:35.293482 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4191/6422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:35 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:35.581587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-025acf23-dd17-4517-8b24-13d311942e51 req-70e71486-3514-4cff-8f20-0eb99e56ec21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2008e28f-0828-4383-8ffd-ba7c69b01604", "name": "network-vif-deleted", "tag": "bb22f579-6de2-4001-be00-7032a7a05369"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:35.598615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-025acf23-dd17-4517-8b24-13d311942e51 req-70e71486-3514-4cff-8f20-0eb99e56ec21 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:35.599314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-025acf23-dd17-4517-8b24-13d311942e51 req-70e71486-3514-4cff-8f20-0eb99e56ec21 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:35.599913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-025acf23-dd17-4517-8b24-13d311942e51 req-70e71486-3514-4cff-8f20-0eb99e56ec21 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:35.614370 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-025acf23-dd17-4517-8b24-13d311942e51 req-70e71486-3514-4cff-8f20-0eb99e56ec21 service nova] Creating event network-vif-deleted:bb22f579-6de2-4001-be00-7032a7a05369 for instance 2008e28f-0828-4383-8ffd-ba7c69b01604 on n-h2-858238-3 Nov 02 14:38:35.621608 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-025acf23-dd17-4517-8b24-13d311942e51 req-70e71486-3514-4cff-8f20-0eb99e56ec21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043938 Nov 02 14:38:35.623006 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2232/6423] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:38:36.319023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:36.319703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:36.328634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:36.329421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:36.330075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:36.330948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:36.331584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:36.332006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:36.802689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:36.810809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1bb6878e-2f07-4810-896c-7036634c2401 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1318 microversion: 2.1 time: 0.496087 Nov 02 14:38:36.811358 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4192/6424] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:36 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:37.643631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a007f78a-9810-4376-af22-da4b3014fdb2 req-754785cc-69ba-4d02-abb2-4d4addad725f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0389bd9-5f67-45d0-b403-1a4564905cf0", "tag": "d636ca99-7e0f-4625-afe5-a13a7f91eead"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:37.653713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a007f78a-9810-4376-af22-da4b3014fdb2 req-754785cc-69ba-4d02-abb2-4d4addad725f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:37.654240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a007f78a-9810-4376-af22-da4b3014fdb2 req-754785cc-69ba-4d02-abb2-4d4addad725f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:37.654678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a007f78a-9810-4376-af22-da4b3014fdb2 req-754785cc-69ba-4d02-abb2-4d4addad725f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:37.666296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a007f78a-9810-4376-af22-da4b3014fdb2 req-754785cc-69ba-4d02-abb2-4d4addad725f service nova] Creating event network-changed:d636ca99-7e0f-4625-afe5-a13a7f91eead for instance d0389bd9-5f67-45d0-b403-1a4564905cf0 on n-h2-858238-3 Nov 02 14:38:37.671270 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a007f78a-9810-4376-af22-da4b3014fdb2 req-754785cc-69ba-4d02-abb2-4d4addad725f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Nov 02 14:38:37.671893 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2233/6425] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:37.834318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:37.834926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:37.842027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:37.842503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:37.842963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:37.843705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:37.844233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:37.844664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:37.978942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:37.987255 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9a7834fd-cb91-4c72-be48-5336e0518533 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1318 microversion: 2.1 time: 0.156862 Nov 02 14:38:37.987839 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4193/6426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:37 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:39.011875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:39.012603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:39.018953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:39.019498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:39.019955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:39.020669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:39.021141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:39.021593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:39.153133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:39.160806 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7e22679d-6660-467e-80ae-53f018fe8e0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1318 microversion: 2.1 time: 0.154724 Nov 02 14:38:39.161381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2234/6427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:39 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:38:40.184404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:40.185270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:40.192263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:40.192743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:40.193169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:40.193852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:40.194299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:40.194718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:40.322485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:40.330273 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1ce4c264-1627-4b2a-8bb5-29ffd64e7c11 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1318 microversion: 2.1 time: 0.150319 Nov 02 14:38:40.330843 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4194/6428] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:40 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:41.353490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:41.354116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:41.361285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:41.361801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:41.362245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:41.362940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:41.363440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:41.363894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:41.492055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:41.500376 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bca477ae-8d46-4b06-823b-2a94c7a3f7c3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1318 microversion: 2.1 time: 0.151395 Nov 02 14:38:41.500948 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2235/6429] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:41 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:42.518308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8e490668-145a-4204-9574-62d6e3d7bba2 req-4188a8da-347d-4ca3-8e52-bd08470bd519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0389bd9-5f67-45d0-b403-1a4564905cf0", "name": "network-vif-plugged", "status": "completed", "tag": "d636ca99-7e0f-4625-afe5-a13a7f91eead"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:42.524491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:42.525163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:42.530730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8e490668-145a-4204-9574-62d6e3d7bba2 req-4188a8da-347d-4ca3-8e52-bd08470bd519 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:42.531477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8e490668-145a-4204-9574-62d6e3d7bba2 req-4188a8da-347d-4ca3-8e52-bd08470bd519 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:42.531909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8e490668-145a-4204-9574-62d6e3d7bba2 req-4188a8da-347d-4ca3-8e52-bd08470bd519 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:42.534250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:42.534939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:42.535440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:42.536173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:42.536638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:42.537279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:42.543681 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8e490668-145a-4204-9574-62d6e3d7bba2 req-4188a8da-347d-4ca3-8e52-bd08470bd519 service nova] Creating event network-vif-plugged:d636ca99-7e0f-4625-afe5-a13a7f91eead for instance d0389bd9-5f67-45d0-b403-1a4564905cf0 on n-h2-858238-3 Nov 02 14:38:42.548806 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8e490668-145a-4204-9574-62d6e3d7bba2 req-4188a8da-347d-4ca3-8e52-bd08470bd519 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Nov 02 14:38:42.549751 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4195/6430] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:42.554557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:42.688252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:42.696855 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-976ae05f-e62e-4880-ba80-8c337e7206a4 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1318 microversion: 2.1 time: 0.177355 Nov 02 14:38:42.697441 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2236/6431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:42 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:38:43.721680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:43.722282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:43.729784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:43.730284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:43.730722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:43.731453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:43.731902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:43.732321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:43.863987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:43.871761 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d7e71df-438e-48d8-a900-95d44bd03ea3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1508 microversion: 2.1 time: 0.155535 Nov 02 14:38:43.872343 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4196/6432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:43 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:43.894336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:43.894934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:43.902678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:43.903241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:43.903703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:43.904453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:43.904955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:43.905399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:44.043533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:44.051376 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4f2f0c1-1463-4e8a-a318-6147fa9d93b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1508 microversion: 2.1 time: 0.160856 Nov 02 14:38:44.051958 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2237/6433] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:43 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:44.074721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:44.077074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:44.079026 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:44.079734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:44.085435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:44.085917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:44.086983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:44.087700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:44.088154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:44.088577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:44.119653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:44.125270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Old instance type m1.heat2, new instance type m1.heat {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:38:44.132349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:38:44.132776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:38:44.133782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:38:44.134190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:38:44.134614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:38:44.198942 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9adf5a02-cdae-4e35-92f8-028f6e5f61fa tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0/action" status: 202 len: 0 microversion: 2.1 time: 0.128255 Nov 02 14:38:44.199592 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4197/6434] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:38:44 2022] POST /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:38:44.207771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:44.208396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:44.210465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:44.216154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:44.216652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:44.217102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:44.217819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:44.218277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:44.218759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:44.372442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:44.380366 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c2e5a4f8-1241-469d-9f0a-6d21e11cde0e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1515 microversion: 2.1 time: 0.176512 Nov 02 14:38:44.380933 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2238/6435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:44 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:45.404180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:45.404825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:45.412839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:45.413367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:45.413805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:45.414515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:45.414970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:45.415427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:45.549028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:45.557201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-98e66f4a-9ded-404e-a220-9900cceb60e7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1515 microversion: 2.1 time: 0.156944 Nov 02 14:38:45.557790 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4198/6436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:45 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:46.581107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:46.581728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:46.589755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:46.590326 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:46.590744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:46.591527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:46.592018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:46.592598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:46.729024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:46.736878 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d2eee92f-7c3d-49ad-bbf2-3791efb9f7b7 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.159748 Nov 02 14:38:46.737452 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2239/6437] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:46 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:47.759903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:47.760421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:47.767426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:47.767910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:47.768343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:47.769032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:47.769483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:47.769904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:47.902520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:47.910307 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac8a00ad-a20e-413a-a65d-7c7c8a6bcbbe tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.154400 Nov 02 14:38:47.910883 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4199/6438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:47 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:48.934473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:48.935372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:48.941974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:48.942463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:48.942902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:48.943625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:48.944086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:48.944518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:49.075820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:49.083567 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e0a3413b-cd45-4089-8fb9-0e12e42818cf tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.153467 Nov 02 14:38:49.084143 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2240/6439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:48 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:50.107088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:50.107670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:50.114510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:50.114987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:50.115447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:50.116133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:50.116581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:50.117007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:50.249847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:50.257737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1351f4ee-632e-46e3-919f-da04ff7d7c66 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.154634 Nov 02 14:38:50.258523 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4200/6440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:50 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:51.281141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:51.281764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:51.288657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:51.289163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:51.289609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:51.290311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:51.290775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:51.291245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:51.420579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:51.428461 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-86e87f11-83f5-467a-810d-e38aa0d4717b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.151251 Nov 02 14:38:51.429029 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2241/6441] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:51 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:52.451858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:52.452498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:52.459587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:52.460070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:52.460505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:52.461704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:52.462185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:52.462633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:52.596394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:52.604268 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4382dcfb-de47-4fc7-a837-61fd40c91b3c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.156303 Nov 02 14:38:52.604845 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4201/6442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:52 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:53.627637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:53.628254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:53.635073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:53.635589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:53.636031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:53.636726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:53.637184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:53.637617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:53.766725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:53.775666 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e9e0c18c-5813-4cd1-bc3a-7941f3e37c2a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.151831 Nov 02 14:38:53.776297 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2242/6443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:53 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:54.800436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:54.801041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:54.808133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:54.808608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:54.809034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:54.809984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:54.810429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:54.810844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:54.961537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:54.969423 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a656895-cdd4-4250-93fa-11aa53c7cf31 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.172893 Nov 02 14:38:54.969995 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4202/6444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:54 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:55.993393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:55.994671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:56.002573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:56.003076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:56.003555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:56.004262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:56.004722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:56.005193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:56.158705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:56.167053 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d75ded91-2f78-40d1-b66a-7face43b2097 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.177967 Nov 02 14:38:56.167887 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2243/6445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:55 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:38:57.191227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:57.191842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:57.199414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:57.199897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:57.200333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:57.201035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:57.201490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:57.201915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:57.334827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:57.343783 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b1327603-087d-4236-bbfb-16f2185209b8 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.156497 Nov 02 14:38:57.344375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4203/6446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:57 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:58.367777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:58.368608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:58.375302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:58.375794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:58.376238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:58.376933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:58.377393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:58.377824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:58.590465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:58.598294 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05aad553-9425-4f46-8d26-d4e3b4390480 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.235154 Nov 02 14:38:58.598872 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2244/6447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:58 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:59.622703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:59.623265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:59.630102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:59.630588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:59.631022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:59.631747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:59.632201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:59.632666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:59.763818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:59.766143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:59.774171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2285a7cb-037c-4da0-a61e-b8a3a1bd3d0f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.155589 Nov 02 14:38:59.774759 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4204/6448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:38:59 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:00.798212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:00.798807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:00.801501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:00.807659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:00.808146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:00.808590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:00.809293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:00.810014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:00.810449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:00.942722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:00.950751 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d2a65057-037a-4114-845b-8de87fd935e9 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.156494 Nov 02 14:39:00.951366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2245/6449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:00 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:01.974104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:01.974725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:01.977928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:01.984881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:01.985359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:01.985801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:01.986501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:01.986934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:01.988077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:02.166247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:02.174074 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-976d9fb9-4f25-4e37-b1cd-ca001e20ac7e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.203871 Nov 02 14:39:02.174648 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4205/6450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:01 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:03.199779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:03.200369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:03.207423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:03.207916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:03.208365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:03.209066 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:03.209533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:03.209969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:03.341625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:03.349668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af847c46-1282-48f9-af14-b839a1c0373a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.155364 Nov 02 14:39:03.350243 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2246/6451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:03 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:04.374077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:04.374693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:04.381887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:04.382298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:04.383344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:04.384036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:04.384483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:04.384955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:04.604973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:04.612910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-56cf1566-d214-4786-831d-0bf315741962 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.242707 Nov 02 14:39:04.613497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4206/6452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:04 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:05.637495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:05.638146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:05.645335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:05.645835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:05.646288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:05.646998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:05.647496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:05.647936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:05.778839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:05.786799 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c616a3a2-0507-4a90-93ca-2d8694737686 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.153222 Nov 02 14:39:05.787470 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2247/6453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:05 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:06.811038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:06.811703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:06.819085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:06.819607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:06.820588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:06.821306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:06.821750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:06.822174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:06.962821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:06.970700 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6dc6af9-f509-46cb-a351-91bd40794764 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.164028 Nov 02 14:39:06.971309 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4207/6454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:06 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:07.993889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:07.994515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:08.001623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:08.002115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:08.002561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:08.003294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:08.003766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:08.004204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:08.136154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:08.143974 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-470233d8-90d2-4a7d-85f5-fdd7549d07f3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.154033 Nov 02 14:39:08.144543 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2248/6455] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:07 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:09.167846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:09.168458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:09.175360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:09.175839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:09.176270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:09.176964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:09.177412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:09.177831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:09.308835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:09.316916 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7c0ae8a-0432-4430-9461-06c4f6d76016 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.153501 Nov 02 14:39:09.317506 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4208/6456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:09 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:10.340592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:10.341242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:10.347815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:10.348320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:10.348762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:10.349462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:10.349925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:10.350354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:10.491442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:10.500221 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-93f1c2df-727c-411e-8d88-04ea79928548 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.163841 Nov 02 14:39:10.501557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2249/6457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:10 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:11.525655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:11.526249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:11.533148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:11.533623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:11.534050 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:11.534767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:11.535251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:11.535667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:11.677410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:11.685735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba720b70-c396-4fc4-9b7e-bc6985ffc842 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.163948 Nov 02 14:39:11.686333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4209/6458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:11 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:12.708748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:12.709407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:12.717170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:12.717672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:12.718147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:12.718861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:12.719356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:12.719799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:12.722517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=82 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:12.875672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:12.884607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-02d3608d-8353-4dc7-b932-aab9dc25735b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1520 microversion: 2.1 time: 0.179675 Nov 02 14:39:12.885171 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2250/6459] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:12 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:13.384714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0389bd9-5f67-45d0-b403-1a4564905cf0", "name": "network-vif-unplugged", "status": "completed", "tag": "d636ca99-7e0f-4625-afe5-a13a7f91eead"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:13.394800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:13.395329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:13.395760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:13.409014 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] Creating event network-vif-unplugged:d636ca99-7e0f-4625-afe5-a13a7f91eead for instance d0389bd9-5f67-45d0-b403-1a4564905cf0 on n-h1-858238-3 Nov 02 14:39:13.414812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:39:13.426552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-3dcdae89-eb98-4134-964b-d3ab19876db1 req-ccf7ff74-ec13-4965-aabb-5bd7fc082581 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046285 Nov 02 14:39:13.427206 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4210/6460] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:13.909532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:13.910165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:13.918596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:13.919130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:13.919579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:13.920296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:13.920768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:13.921206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:14.053894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:14.062269 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-68d64c3a-4879-4ebf-b4a6-db04cc5f726e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1519 microversion: 2.1 time: 0.156671 Nov 02 14:39:14.062952 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2251/6461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:13 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:15.088425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:15.089922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:15.095433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:15.095915 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:15.096347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:15.097037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:15.097488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:15.097912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:15.229011 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:15.236865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec99184f-f7fa-4782-9829-35b7a1848858 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1517 microversion: 2.1 time: 0.153651 Nov 02 14:39:15.237448 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4211/6462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:15 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:15.453710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0389bd9-5f67-45d0-b403-1a4564905cf0", "tag": "d636ca99-7e0f-4625-afe5-a13a7f91eead"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:15.464362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:15.464850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:15.465290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:15.477592 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] Creating event network-changed:d636ca99-7e0f-4625-afe5-a13a7f91eead for instance d0389bd9-5f67-45d0-b403-1a4564905cf0 on n-h1-858238-3 Nov 02 14:39:15.482928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:39:15.493480 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6dc3212a-5313-495b-b48b-d96b8f7bf619 req-57ee01eb-2a8c-439b-a27f-c237bb76230c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043500 Nov 02 14:39:15.494094 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2252/6463] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:16.261801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:16.262418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:16.269332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:16.269819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:16.270254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:16.270965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:16.271464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:16.271892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:16.409403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:16.418020 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b792aa94-00d8-4477-bb46-94312351909c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1514 microversion: 2.1 time: 0.160714 Nov 02 14:39:16.418864 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4212/6464] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:16 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:16.444626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:16.445781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:16.452082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:16.452581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:16.453031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:16.453736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:16.454291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:16.454626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:16.513804 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca115a83-6a27-4f9e-abe5-7eb56a6fbb05 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "POST /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0/action" status: 204 len: 0 microversion: 2.1 time: 0.073467 Nov 02 14:39:16.514868 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2253/6465] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:39:16 2022] POST /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:39:16.523224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:16.524118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:16.530348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:16.531322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:16.531705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:16.532417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:16.533029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:16.533567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:16.686268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:16.694289 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ddfb2fe-d781-4728-9cbd-11b0e4fbe41a tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1514 microversion: 2.1 time: 0.175163 Nov 02 14:39:16.694946 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4213/6466] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:16 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:17.718576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:17.719346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:17.726148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:17.726638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:17.727082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:17.727805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:17.728269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:17.728699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:17.870686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:17.879268 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-928f5ad9-4c1d-4770-9eb1-f3d1ad9b8f28 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1514 microversion: 2.1 time: 0.164941 Nov 02 14:39:17.879845 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2254/6467] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:17 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:18.905132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:18.905769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:18.912693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:18.913663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:18.914097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:18.914770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:18.915235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:18.915652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.044911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:19.053382 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d777ab56-7a5c-4e8b-b70c-daf599955c5b tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1506 microversion: 2.1 time: 0.152163 Nov 02 14:39:19.054702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4214/6468] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:18 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:19.077124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:19.077820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:19.084696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.085276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.085785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.086570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.087126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.087634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.141284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-81330ccb-1d1a-4360-b70e-4840d6c01c80 req-a8472084-8e45-41ea-9c38-1d3c3d2b36a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0389bd9-5f67-45d0-b403-1a4564905cf0", "name": "network-vif-plugged", "status": "completed", "tag": "d636ca99-7e0f-4625-afe5-a13a7f91eead"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:19.152624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-81330ccb-1d1a-4360-b70e-4840d6c01c80 req-a8472084-8e45-41ea-9c38-1d3c3d2b36a3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.153103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-81330ccb-1d1a-4360-b70e-4840d6c01c80 req-a8472084-8e45-41ea-9c38-1d3c3d2b36a3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.153577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-81330ccb-1d1a-4360-b70e-4840d6c01c80 req-a8472084-8e45-41ea-9c38-1d3c3d2b36a3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.166396 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-81330ccb-1d1a-4360-b70e-4840d6c01c80 req-a8472084-8e45-41ea-9c38-1d3c3d2b36a3 service nova] Creating event network-vif-plugged:d636ca99-7e0f-4625-afe5-a13a7f91eead for instance d0389bd9-5f67-45d0-b403-1a4564905cf0 on n-h1-858238-3 Nov 02 14:39:19.172469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-81330ccb-1d1a-4360-b70e-4840d6c01c80 req-a8472084-8e45-41ea-9c38-1d3c3d2b36a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Nov 02 14:39:19.173606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4215/6469] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:39:19.229411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:19.237793 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-27a11494-add7-45af-a886-efc61aaf43b3 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1506 microversion: 2.1 time: 0.164514 Nov 02 14:39:19.238366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2255/6470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:19 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:19.260578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:19.261363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:19.267573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.268052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.268490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.269172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.269623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.270046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.401480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:19.409375 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6f9e969-686d-4f82-bbcf-0f0c882fe311 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1506 microversion: 2.1 time: 0.152999 Nov 02 14:39:19.409955 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4216/6471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:19 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:19.432039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:19.432540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:19.438724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.439245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.439687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.440374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.440832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.441262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.466303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:39:19.544532 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8f37881f-321d-46bf-bcbb-5b9c0b512e23 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 204 len: 0 microversion: 2.1 time: 0.115568 Nov 02 14:39:19.544935 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2256/6472] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:39:19 2022] DELETE /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:39:19.561794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:19.562292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:19.568301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.568779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.569210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.570404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.570853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.571302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.596518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:39:19.639924 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.compute.api [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Instance is already in deleting state, ignoring this request Nov 02 14:39:19.640737 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8afd33d-14bd-4660-9776-73678140a45c tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 204 len: 0 microversion: 2.1 time: 0.083369 Nov 02 14:39:19.641300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4217/6473] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:39:19 2022] DELETE /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:39:19.650516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:19.651278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:19.657211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.657696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.658137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.658824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:19.659310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:19.659741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:19.787903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:19.795820 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b574243f-1e82-4128-95f2-555b2f46fc2f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1512 microversion: 2.1 time: 0.150134 Nov 02 14:39:19.796621 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2257/6474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:19 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:20.818707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:20.819376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:20.826203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:20.826677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:20.827113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:20.827942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:20.828389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:20.828804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:20.974647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c38044c7fa54c7eb578b9410e355968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd21e44bc4e1485589bbb4f8f67e00cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:20.983744 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5ac58c48-53fe-48a3-82a4-37a84572b99f tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 200 len: 1512 microversion: 2.1 time: 0.168914 Nov 02 14:39:20.985375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4218/6475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:20 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:21.339985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8f15a1d9-a679-4dc8-9084-7e1cecff2965 req-0371f51c-aec3-4323-bf34-ad1194372b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0389bd9-5f67-45d0-b403-1a4564905cf0", "name": "network-vif-deleted", "tag": "d636ca99-7e0f-4625-afe5-a13a7f91eead"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:21.352110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8f15a1d9-a679-4dc8-9084-7e1cecff2965 req-0371f51c-aec3-4323-bf34-ad1194372b6f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:21.352521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8f15a1d9-a679-4dc8-9084-7e1cecff2965 req-0371f51c-aec3-4323-bf34-ad1194372b6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:21.352965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8f15a1d9-a679-4dc8-9084-7e1cecff2965 req-0371f51c-aec3-4323-bf34-ad1194372b6f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:21.372926 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8f15a1d9-a679-4dc8-9084-7e1cecff2965 req-0371f51c-aec3-4323-bf34-ad1194372b6f service nova] Creating event network-vif-deleted:d636ca99-7e0f-4625-afe5-a13a7f91eead for instance d0389bd9-5f67-45d0-b403-1a4564905cf0 on n-h1-858238-3 Nov 02 14:39:21.378060 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8f15a1d9-a679-4dc8-9084-7e1cecff2965 req-0371f51c-aec3-4323-bf34-ad1194372b6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041704 Nov 02 14:39:21.378664 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2258/6476] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:22.009240 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:22.009853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: d0389bd9-5f67-45d0-b403-1a4564905cf0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:22.016775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:22.017256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:22.017691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:22.018412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:22.018868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:22.019326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:22.032762 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] HTTP exception thrown: Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 could not be found. Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Request method failure captured: Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 HTTP/1.1 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoC4lqVvLxGpgrGALY4uBFpc_Ew26wdHU3tf0HPoXkarpC7ymmvKuWvm7Th4ApY24qL5-THoReCuBEM0nV1aSUdzJ4VRUg-31f6_sPLBVguKFNxbsD6hed4eVdKhSfa7YvYbeCFrE-sAhV8EfDLm5yZabJze2eyHe9pn-G83waseW4s Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: bd21e44bc4e1485589bbb4f8f67e00cf Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd21e44bc4e1485589bbb4f8f67e00cf"}]}] Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: bd21e44bc4e1485589bbb4f8f67e00cf Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-1707657165-project Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 4c38044c7fa54c7eb578b9410e355968 Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-1707657165-project Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 could not be found. Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'd0389bd9-5f67-45d0-b403-1a4564905cf0'} Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 could not be found. Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 could not be found. Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:22.034416 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 could not be found. Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Returning 404 to user: Instance d0389bd9-5f67-45d0-b403-1a4564905cf0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc621ff1-988b-470d-95ca-f23244073675 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0" status: 404 len: 111 microversion: 2.1 time: 0.031255 Nov 02 14:39:22.038662 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4219/6477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:22 2022] GET /compute/v2.1/servers/d0389bd9-5f67-45d0-b403-1a4564905cf0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:39:22.045210 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-581d39e1-0195-49a5-874d-6301880324fd tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '.version_select at 0x7f6f85e99c10>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:22.068904 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-581d39e1-0195-49a5-874d-6301880324fd tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898969585" status: 202 len: 0 microversion: 2.1 time: 0.027862 Nov 02 14:39:22.070106 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2259/6478] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898969585 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:39:22.670211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:22.670636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:22.676664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:22.677139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:22.677567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:22.678246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:22.678722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:22.679160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:22.693247 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] HTTP exception thrown: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Request method failure captured: Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 HTTP/1.1 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoC4lqVvLxGpgrGALY4uBFpc_Ew26wdHU3tf0HPoXkarpC7ymmvKuWvm7Th4ApY24qL5-THoReCuBEM0nV1aSUdzJ4VRUg-31f6_sPLBVguKFNxbsD6hed4eVdKhSfa7YvYbeCFrE-sAhV8EfDLm5yZabJze2eyHe9pn-G83waseW4s Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: bd21e44bc4e1485589bbb4f8f67e00cf Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd21e44bc4e1485589bbb4f8f67e00cf"}]}] Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: bd21e44bc4e1485589bbb4f8f67e00cf Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerDiskConfigTestJSON-1707657165-project Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 4c38044c7fa54c7eb578b9410e355968 Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerDiskConfigTestJSON-1707657165-project Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2008e28f-0828-4383-8ffd-ba7c69b01604'} Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:39:22.695217 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Returning 404 to user: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ee5eac30-702b-4351-bb47-0a45ef065c6e tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 404 len: 111 microversion: 2.1 time: 0.030834 Nov 02 14:39:22.699509 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4220/6479] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:39:22 2022] DELETE /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:39:22.707141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:22.707889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] [instance: 2008e28f-0828-4383-8ffd-ba7c69b01604] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:22.715199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:22.715689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:22.716135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:22.716829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:22.717293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:22.717749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:22.731620 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] HTTP exception thrown: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Request method failure captured: Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 HTTP/1.1 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoC4lqVvLxGpgrGALY4uBFpc_Ew26wdHU3tf0HPoXkarpC7ymmvKuWvm7Th4ApY24qL5-THoReCuBEM0nV1aSUdzJ4VRUg-31f6_sPLBVguKFNxbsD6hed4eVdKhSfa7YvYbeCFrE-sAhV8EfDLm5yZabJze2eyHe9pn-G83waseW4s Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: bd21e44bc4e1485589bbb4f8f67e00cf Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd21e44bc4e1485589bbb4f8f67e00cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd21e44bc4e1485589bbb4f8f67e00cf"}]}] Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: bd21e44bc4e1485589bbb4f8f67e00cf Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1707657165 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerDiskConfigTestJSON-1707657165-project Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 4c38044c7fa54c7eb578b9410e355968 Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerDiskConfigTestJSON-1707657165-project Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '2008e28f-0828-4383-8ffd-ba7c69b01604'} Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:22.733249 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] Returning 404 to user: Instance 2008e28f-0828-4383-8ffd-ba7c69b01604 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cef782bf-a5a6-43bd-a9a9-feaf17ed0391 tempest-ServerDiskConfigTestJSON-1707657165 tempest-ServerDiskConfigTestJSON-1707657165-project] 10.222.0.18 "GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604" status: 404 len: 111 microversion: 2.1 time: 0.032370 Nov 02 14:39:22.737595 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2260/6480] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:22 2022] GET /compute/v2.1/servers/2008e28f-0828-4383-8ffd-ba7c69b01604 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:39:31.379760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46958d5b-6030-4029-9460-7bc81b5bb793 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'create', calling method: .version_select at 0x7f6f80e71160>, body: {"keypair": {"name": "tempest-keypair-2145718649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiruF3tbiDx9xB4VylJQgOS7PItdNprMi1JNSNDGRrCBqwrklhS9K/XHhuohpowDXdTmyjDJaQkUOn9bPHZ3bJPcbfFQzqwRuhi2zzrqyiBGjtbBNBndzUTqtPo0CEBTA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:31.395470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-46958d5b-6030-4029-9460-7bc81b5bb793 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:31.401379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-46958d5b-6030-4029-9460-7bc81b5bb793 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:31.427935 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46958d5b-6030-4029-9460-7bc81b5bb793 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206233 Nov 02 14:39:31.428633 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4221/6481] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:39:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:32.726828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1624441853", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e"}], "security_groups": [{"name": "tempest-securitygroup--1326539966"}], "key_name": "tempest-keypair-2145718649", "user_data": "}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:32.736412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:32.737087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:32.836802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] validate_networks() for [('ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:39:33.229239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:39:33.229679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:39:33.230161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:39:33.230575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:39:33.230994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:39:33.240303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:33.240795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:33.241907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:33.242854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:33.243351 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:33.243781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:33.261998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:39:33.267569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:39:33.280107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:39:33.282408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:39:33.332054 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-169a0518-43b5-4780-95fa-2470741286d9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.609456 Nov 02 14:39:33.333025 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2261/6482] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:39:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:39:33.342942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:33.347389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-04cb6546-6a3a-4d3f-a90d-93d9ccf236c3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:33.348137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-04cb6546-6a3a-4d3f-a90d-93d9ccf236c3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:33.350963 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:33.428925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-04cb6546-6a3a-4d3f-a90d-93d9ccf236c3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:33.438965 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-04cb6546-6a3a-4d3f-a90d-93d9ccf236c3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1239 microversion: 2.1 time: 0.097920 Nov 02 14:39:33.440127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4222/6483] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:33 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1239 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:39:34.464247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:34.465907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:34.473931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:34.474439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:34.474893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:34.477184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:34.477894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:34.478551 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:34.560303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:34.569711 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-607216bd-cd4b-40c1-930d-3de5317bed7f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1299 microversion: 2.1 time: 0.111221 Nov 02 14:39:34.570678 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2262/6484] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:34 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:35.596171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:35.596796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:35.605690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:35.605943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:35.606785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:35.607746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:35.608427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:35.609009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:35.744768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:35.753544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9ec7e9c2-5457-4407-9fc4-c446c0448b5f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.161399 Nov 02 14:39:35.754340 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4223/6485] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:35 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:36.319806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-61aca713-4600-4255-8c90-882d2000806c req-84f65de4-e1a6-4b95-98a8-23cbd930893f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:36.330204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-61aca713-4600-4255-8c90-882d2000806c req-84f65de4-e1a6-4b95-98a8-23cbd930893f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:36.330691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-61aca713-4600-4255-8c90-882d2000806c req-84f65de4-e1a6-4b95-98a8-23cbd930893f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:36.331153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-61aca713-4600-4255-8c90-882d2000806c req-84f65de4-e1a6-4b95-98a8-23cbd930893f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:36.343362 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-61aca713-4600-4255-8c90-882d2000806c req-84f65de4-e1a6-4b95-98a8-23cbd930893f service nova] Creating event network-changed:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h1-858238-3 Nov 02 14:39:36.348832 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-61aca713-4600-4255-8c90-882d2000806c req-84f65de4-e1a6-4b95-98a8-23cbd930893f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Nov 02 14:39:36.349673 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2263/6486] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:36.778384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:36.779136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:36.786448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:36.786935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:36.787404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:36.788637 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:36.789093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:36.789516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:36.926743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:36.935729 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fd85df22-d1f0-4ea3-8f43-90ecd8823578 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.162030 Nov 02 14:39:36.936447 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4224/6487] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:36 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:37.959961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:37.960672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:37.967178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:37.967643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:37.968093 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:37.968788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:37.969248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:37.969679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:38.107420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:38.116266 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-21ec5bd9-d17e-4335-8ba6-569255d6a8f1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.160722 Nov 02 14:39:38.116853 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2264/6488] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:37 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:39.139556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:39.140286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:39.147816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:39.148311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:39.148746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:39.149449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:39.149899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:39.150323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:39.282671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:39.290878 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60398884-868e-4c2b-9846-dae6a04debd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.155197 Nov 02 14:39:39.291759 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4225/6489] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:39 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:40.315486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:40.316047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:40.322709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.323201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.323688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.324362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.324824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.325259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.461973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:40.470031 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d07018d8-e069-43fe-b2e8-d5d1fb083020 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.158545 Nov 02 14:39:40.470619 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2265/6490] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:40 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:41.376355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-94a01307-1bbb-42b4-9606-279597831bcb req-62eaa7c2-2e1f-4f5e-b0a1-512b8b186133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "name": "network-vif-plugged", "status": "completed", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:41.385794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94a01307-1bbb-42b4-9606-279597831bcb req-62eaa7c2-2e1f-4f5e-b0a1-512b8b186133 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.386257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94a01307-1bbb-42b4-9606-279597831bcb req-62eaa7c2-2e1f-4f5e-b0a1-512b8b186133 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.386706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94a01307-1bbb-42b4-9606-279597831bcb req-62eaa7c2-2e1f-4f5e-b0a1-512b8b186133 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.397771 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-94a01307-1bbb-42b4-9606-279597831bcb req-62eaa7c2-2e1f-4f5e-b0a1-512b8b186133 service nova] Creating event network-vif-plugged:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h1-858238-3 Nov 02 14:39:41.403415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-94a01307-1bbb-42b4-9606-279597831bcb req-62eaa7c2-2e1f-4f5e-b0a1-512b8b186133 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082148 Nov 02 14:39:41.404013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4226/6491] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:41.494541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:41.495286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:41.502249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.502811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.503289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.503991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.504450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.504881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.634465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:41.642242 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e6bc63d0-9f0e-43c5-9e87-1772d487b2db tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.152393 Nov 02 14:39:41.642746 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2266/6492] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:41 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:42.666254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:42.667185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:42.674009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:42.674430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:42.674877 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:42.675600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:42.676053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:42.676475 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:42.815005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:42.823050 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5929d38e-9d2d-4d0a-ac46-c5926ee97a70 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1365 microversion: 2.1 time: 0.161280 Nov 02 14:39:42.823661 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4227/6493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:42 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:43.845858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:43.846606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:43.849436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:43.850208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:43.857472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.857972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.858411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.859137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.859602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.860031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.989048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:43.997362 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f54bd38d-b25b-42c2-aaab-631c3a2534b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1552 microversion: 2.1 time: 0.155441 Nov 02 14:39:43.997937 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2267/6494] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:39:43 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:44.020283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:44.020776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:44.022745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:44.029435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.029928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.030370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.031079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.031565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.031993 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.108520 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ed485c9e-69d1-446f-8d76-d283c165e6f4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092009 Nov 02 14:39:44.109163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4228/6495] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:39:44 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:45.482921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5208e4d5-857a-4892-a6ec-9fc7b7fdad23 req-d59a005d-9e0a-487d-acf2-13f79855f06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:45.493341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5208e4d5-857a-4892-a6ec-9fc7b7fdad23 req-d59a005d-9e0a-487d-acf2-13f79855f06f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.493834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5208e4d5-857a-4892-a6ec-9fc7b7fdad23 req-d59a005d-9e0a-487d-acf2-13f79855f06f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.494277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5208e4d5-857a-4892-a6ec-9fc7b7fdad23 req-d59a005d-9e0a-487d-acf2-13f79855f06f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.505382 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5208e4d5-857a-4892-a6ec-9fc7b7fdad23 req-d59a005d-9e0a-487d-acf2-13f79855f06f service nova] Creating event network-changed:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h1-858238-3 Nov 02 14:39:45.511170 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5208e4d5-857a-4892-a6ec-9fc7b7fdad23 req-d59a005d-9e0a-487d-acf2-13f79855f06f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087499 Nov 02 14:39:45.511969 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2268/6496] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:19.239785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=15 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:19.240788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=30 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:19.245434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.246033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.252999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.253473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.253897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.254574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.255021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.255469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.392442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.400672 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6b4dbca6-5878-4323-b0c4-17c2e493b181 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1670 microversion: 2.1 time: 0.162984 Nov 02 14:40:19.401256 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4229/6497] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:19.424581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.425298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.428359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:19.429017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:19.436584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.437076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.437519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.438214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.438675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.439142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.572170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.579904 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f9ca4489-10ad-434e-9f3f-a24558bdb423 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1670 microversion: 2.1 time: 0.159514 Nov 02 14:40:19.580476 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2269/6498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:19.602976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.603632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.609606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.610087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.610523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.611247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.611701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.612123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.746555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.754264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-598235e0-f46e-4c82-9c5b-dd104d961ecc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1670 microversion: 2.1 time: 0.155320 Nov 02 14:40:19.754835 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4230/6499] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:19.777524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:19.779750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.787881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.788431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.788876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.789572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.790031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.790469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.821352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.826933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Old instance type m1.heat2, new instance type m1.heat {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:40:19.833427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:40:19.833854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:40:19.834331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:40:19.834744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:40:19.835929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:40:19.902011 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e52c4ab-627e-4019-bab7-3ea64951e170 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.128321 Nov 02 14:40:19.903898 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2270/6500] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:40:19 2022] POST /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:40:19.912186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.913005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.923446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.923944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.924378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.925092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.925549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.925972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:20.104734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:20.112508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3543917-7e6b-4f78-b3cf-49bfc7a98168 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1679 microversion: 2.1 time: 0.205036 Nov 02 14:40:20.113306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4231/6501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:21.138428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:21.139058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:21.149155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.149655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.150101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.150811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.151308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.151952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.310731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:21.318932 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40175e85-fdb6-4c44-96bd-bef2a64b13ec tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1679 microversion: 2.1 time: 0.184613 Nov 02 14:40:21.320726 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2271/6502] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:21 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:22.344012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:22.344613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:22.351810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:22.352290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:22.352724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:22.353425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:22.353875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:22.354297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:22.485207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:22.493613 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c1cb712-49a2-4992-a8f6-5c41096aae2f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.153485 Nov 02 14:40:22.494194 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4232/6503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:22 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:23.517275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:23.517931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:23.524862 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:23.525349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:23.525794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:23.526491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:23.526957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:23.527429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:23.662249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:23.670811 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-14e010ef-861b-4455-ae72-5f35ca761677 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.157301 Nov 02 14:40:23.671373 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2272/6504] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:23 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:24.694917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:24.695501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:24.702411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:24.702884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:24.703342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:24.704024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:24.704471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:24.704888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:24.837807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:24.845759 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-60286830-4773-4494-9557-8355f340463e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.154759 Nov 02 14:40:24.846346 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4233/6505] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:24 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:25.870534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:25.871064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:25.877969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:25.878621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:25.878899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:25.879643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:25.880110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:25.880548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.013286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:26.021208 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d3df682b-2c33-48e5-a541-51c98832f3b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.155203 Nov 02 14:40:26.021778 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2273/6506] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:25 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:27.043938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:27.044488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:27.051267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:27.051747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:27.052175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:27.052852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:27.053303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:27.053720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:27.183335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:27.191316 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d8b4166-c95c-47f1-94dc-01699240f59c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.151287 Nov 02 14:40:27.191886 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4234/6507] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:27 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:28.215648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:28.216263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:28.222952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.223469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.223915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:28.224606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.225072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.226220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:28.356639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:28.364449 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-15b54ae2-7c07-4b87-8152-c3961a5bd615 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.152645 Nov 02 14:40:28.365024 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2274/6508] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:28 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:29.388063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:29.388676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:29.395515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:29.395988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:29.396414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:29.397101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:29.397547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:29.397966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:29.532538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:29.540957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1a0cbb10-9699-46cd-905c-02abf50cf6c5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.156754 Nov 02 14:40:29.541524 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4235/6509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:29 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:30.565346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:30.565967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:30.572993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:30.573482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:30.573925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:30.574615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:30.575076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:30.575536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:30.705584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:30.714028 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e864fccf-c034-4c3b-a639-00e3512c9cca tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.152388 Nov 02 14:40:30.714600 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2275/6510] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:30 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:31.738281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:31.738926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:31.745997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:31.746485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:31.746920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:31.747643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:31.748096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:31.748521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:31.883235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:31.891189 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ab7b8b19-b9e5-46c4-ae14-36e566386812 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.156836 Nov 02 14:40:31.891766 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4236/6511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:31 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:32.915009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:32.915677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:32.922487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:32.922978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:32.923531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:32.924231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:32.924693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:32.925127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:33.054491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:33.062480 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6d4d6f62-6f54-44a0-934b-7b0f921118f3 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.152016 Nov 02 14:40:33.063050 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2276/6512] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:32 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:34.086530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:34.087158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:34.094110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:34.094593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:34.095025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:34.095746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:34.096201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:34.096622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:34.226773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:34.235247 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5dd08dc9-7c23-4e83-b376-833e30000fdc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.153332 Nov 02 14:40:34.235822 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4237/6513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:34 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:35.259292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:35.259922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:35.266963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.267431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.267880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:35.268586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:35.269052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:35.269490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:35.400967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:35.409339 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-75c7813b-6dd6-4a09-87e4-00fbd8c75a7e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.154082 Nov 02 14:40:35.409912 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2277/6514] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:35 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:36.433481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:36.434098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:36.442110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:36.442602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:36.443039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:36.443899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:36.444830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:36.445257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:36.577370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:36.585220 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-22b58528-874c-442d-bb2a-0847f089cbc8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.155683 Nov 02 14:40:36.585807 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4238/6515] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:36 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:37.608685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:37.609290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:37.616261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.616758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.617205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.617939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:37.618407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:37.618847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:37.754620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:37.762946 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfd7fe02-cf0e-4039-a281-e509f974c4eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1684 microversion: 2.1 time: 0.158209 Nov 02 14:40:37.763564 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2278/6516] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:37 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:38.787433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:38.788110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:38.795618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.796230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.796670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.797406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:38.797825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:38.798280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:38.936089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:38.944335 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-59d53f23-12a5-4790-b5a6-d1bfcece0b63 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1683 microversion: 2.1 time: 0.161006 Nov 02 14:40:38.945209 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4239/6517] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:38 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:39.351560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "name": "network-vif-unplugged", "status": "completed", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:39.363008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:39.363635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:39.363961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:39.376957 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] Creating event network-vif-unplugged:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h2-858238-3 Nov 02 14:40:39.383837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] Instance e336d5da-430d-4826-a16c-76e48f446fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:40:39.395356 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5585a095-4ea9-421a-aab4-4233c57f983a req-bd4e4416-efa3-4a7b-b32a-3a1b5de40347 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103305 Nov 02 14:40:39.395986 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2279/6518] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:39.968923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:39.969538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:39.977600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:39.978089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:39.978523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:39.979258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:39.979715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:39.980137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:40.115435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:40.124193 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7d676a65-8852-4c91-b38f-cedd2bae9dde tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1683 microversion: 2.1 time: 0.159068 Nov 02 14:40:40.128674 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4240/6519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:39 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:41.149410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:41.150124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:41.156732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:41.157230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:41.157701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:41.158407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:41.158868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:41.159362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:41.297673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:41.306206 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-581c9958-b70b-4896-a3b2-17538db0774f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1681 microversion: 2.1 time: 0.162032 Nov 02 14:40:41.306794 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2280/6520] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:41 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:41.439673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:41.450480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:41.450949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:41.451399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:41.463574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] Creating event network-changed:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h2-858238-3 Nov 02 14:40:41.469211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] Instance e336d5da-430d-4826-a16c-76e48f446fd7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:40:41.480972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1a7cfe03-d979-4d78-826b-292901593c7f req-aef77f23-801a-4e18-9ed2-76c0469270a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044992 Nov 02 14:40:41.481632 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4241/6521] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:42.330104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:42.330638 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:42.338458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.338964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.339445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.340194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.340711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.341200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.478613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:42.486776 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-182ae283-ab48-4d38-9a74-090e5a3793c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1678 microversion: 2.1 time: 0.160620 Nov 02 14:40:42.487398 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2281/6522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:42 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:42.511258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:42.511966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:42.518996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.519532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.520176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.520870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.521325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.522258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.584960 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5042633d-b730-4130-b511-7a1a12918549 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7/action" status: 204 len: 0 microversion: 2.1 time: 0.077164 Nov 02 14:40:42.588719 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4242/6523] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:40:42 2022] POST /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:40:42.597097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:42.597971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:42.605721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.606245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.606677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.607422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:42.607889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:42.608318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:42.823570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:42.831589 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b2ac8060-1600-46b7-97ab-1524fc3fb10b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1678 microversion: 2.1 time: 0.241574 Nov 02 14:40:42.832163 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2282/6524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:42 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:43.860308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:43.861012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:43.868546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.869047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.869459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:43.870156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:43.870600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:43.871018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.014126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:44.022469 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61813e78-4028-4c7a-b37d-282ccf8c1969 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1670 microversion: 2.1 time: 0.168514 Nov 02 14:40:44.023171 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4243/6525] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:43 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:44.045621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:44.046240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:44.053413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.053905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.054346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.055039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.055530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.055967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.186903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:44.194968 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4e57686d-d9b4-4127-b251-ee4b41c9f3fd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1670 microversion: 2.1 time: 0.153200 Nov 02 14:40:44.195581 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2283/6526] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:44 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:44.217797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:44.218416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:44.224443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.225626 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.226116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.226812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.227297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.227724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.360097 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:44.362419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:44.369557 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e265754d-ddbf-468f-b69b-4ec7391b0b40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1670 microversion: 2.1 time: 0.155593 Nov 02 14:40:44.370131 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4244/6527] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:44 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:44.392297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:44.392814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:44.399733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.400231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.400679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.401385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.401852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.402295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.422564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:44.429861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:40:44.504671 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a53a1a8c-ab95-4209-b0e8-d0fe9fbd81a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 204 len: 0 microversion: 2.1 time: 0.115928 Nov 02 14:40:44.505283 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2284/6528] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:40:44 2022] DELETE /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:40:44.514465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:44.515073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:44.521935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.522956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.523419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.524112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:44.524559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:44.524976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:44.662020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:44.670079 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-913c9800-06e6-4c8b-aef4-49e1b7d0b179 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1676 microversion: 2.1 time: 0.159515 Nov 02 14:40:44.670657 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4245/6529] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:44 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:45.135975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b1e0487b-4e51-4009-8c64-9aae4f47fff3 req-0bab0722-6e7d-4d1f-b7ca-d6bd662aba61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "name": "network-vif-plugged", "status": "completed", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:45.150969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b1e0487b-4e51-4009-8c64-9aae4f47fff3 req-0bab0722-6e7d-4d1f-b7ca-d6bd662aba61 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:45.151585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b1e0487b-4e51-4009-8c64-9aae4f47fff3 req-0bab0722-6e7d-4d1f-b7ca-d6bd662aba61 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:45.152084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b1e0487b-4e51-4009-8c64-9aae4f47fff3 req-0bab0722-6e7d-4d1f-b7ca-d6bd662aba61 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:45.163980 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b1e0487b-4e51-4009-8c64-9aae4f47fff3 req-0bab0722-6e7d-4d1f-b7ca-d6bd662aba61 service nova] Creating event network-vif-plugged:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h2-858238-3 Nov 02 14:40:45.169036 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b1e0487b-4e51-4009-8c64-9aae4f47fff3 req-0bab0722-6e7d-4d1f-b7ca-d6bd662aba61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037373 Nov 02 14:40:45.169657 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2285/6530] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:45.694280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:45.694934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:45.701405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:45.701885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:45.702315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:45.703005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:45.703479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:45.703894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:45.838290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:45.846300 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cca6602-76ed-49a5-af6e-04621df092af tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1676 microversion: 2.1 time: 0.156196 Nov 02 14:40:45.846883 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4246/6531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:45 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:46.743907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-13a6252f-cc10-4365-9031-82f7c400b6c3 req-52671f62-9dca-466d-805c-814004b0a76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e336d5da-430d-4826-a16c-76e48f446fd7", "name": "network-vif-deleted", "tag": "1c6aa481-116f-4fbb-a7f1-74f18536b79d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:46.754010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-13a6252f-cc10-4365-9031-82f7c400b6c3 req-52671f62-9dca-466d-805c-814004b0a76f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:46.754956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-13a6252f-cc10-4365-9031-82f7c400b6c3 req-52671f62-9dca-466d-805c-814004b0a76f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:46.755117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-13a6252f-cc10-4365-9031-82f7c400b6c3 req-52671f62-9dca-466d-805c-814004b0a76f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:46.767991 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-13a6252f-cc10-4365-9031-82f7c400b6c3 req-52671f62-9dca-466d-805c-814004b0a76f service nova] Creating event network-vif-deleted:1c6aa481-116f-4fbb-a7f1-74f18536b79d for instance e336d5da-430d-4826-a16c-76e48f446fd7 on n-h2-858238-3 Nov 02 14:40:46.773780 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-13a6252f-cc10-4365-9031-82f7c400b6c3 req-52671f62-9dca-466d-805c-814004b0a76f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Nov 02 14:40:46.774382 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2286/6532] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:46.869724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:46.870279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:46.877480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:46.878002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:46.878794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:46.879402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:46.879931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:46.880367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:46.914486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:46.915267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:46.915709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:46.916147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lazy-loading 'fault' on Instance uuid e336d5da-430d-4826-a16c-76e48f446fd7 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:40:46.971002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:46.979666 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ce1d0153-65c5-40f7-9afa-0cb4ea105560 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 200 len: 1329 microversion: 2.1 time: 0.114284 Nov 02 14:40:46.980359 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4247/6533] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:46 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 1329 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:48.005258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:48.005896 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:48.012613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.013101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.013573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.014268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.014734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.015202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.029446 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 HTTP/1.1 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'e336d5da-430d-4826-a16c-76e48f446fd7'} Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:48.031108 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fba61a70-3d94-4078-9767-750bdc8ed1c6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 404 len: 111 microversion: 2.1 time: 0.032538 Nov 02 14:40:48.035997 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2287/6534] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:47 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:40:48.044516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:48.045135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:48.051970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.052448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.052880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.053698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.054100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.054526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.068115 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 HTTP/1.1 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e336d5da-430d-4826-a16c-76e48f446fd7'} Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:40:48.070334 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d340c7ea-4d25-4391-a406-fd5aede26739 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 404 len: 111 microversion: 2.1 time: 0.031117 Nov 02 14:40:48.074630 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4248/6535] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:48 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:40:48.120172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1056694570", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e"}], "security_groups": [{"name": "tempest-securitygroup--1326539966"}], "key_name": "tempest-keypair-2145718649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:48.223995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] validate_networks() for [('ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:40:48.665151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:40:48.665586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:40:48.666064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:40:48.666481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:40:48.666923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:40:48.678670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.679288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.679625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.680350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:48.680810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:48.681240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:48.700741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:40:48.706198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:40:48.718787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:40:48.721128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:40:48.768451 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-82590210-deb7-4635-8f11-9fb8159dec59 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.652036 Nov 02 14:40:48.769117 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2288/6536] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:40:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:40:48.780736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-13c94b93-dc5b-474e-a76f-9160ccf2ca5c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:48.781348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-13c94b93-dc5b-474e-a76f-9160ccf2ca5c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:48.836802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-13c94b93-dc5b-474e-a76f-9160ccf2ca5c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:48.846201 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-13c94b93-dc5b-474e-a76f-9160ccf2ca5c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1239 microversion: 2.1 time: 0.069484 Nov 02 14:40:48.846879 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4249/6537] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:48 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:49.872500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:49.873346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:49.879659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:49.882525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:49.883705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:49.883854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:49.884649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:49.885223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:49.885721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:49.955292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:49.963473 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-be4e2f81-02eb-4387-a9df-dc240206275d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1297 microversion: 2.1 time: 0.095796 Nov 02 14:40:49.964137 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2289/6538] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:49 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:50.987870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:50.988479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:50.992833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=47 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:50.998131 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:50.998608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:50.999038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:50.999758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:51.000207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:51.000632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:51.137653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:51.145986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e543f4aa-8b3a-487a-9c44-ad633479b194 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1365 microversion: 2.1 time: 0.161989 Nov 02 14:40:51.146629 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4250/6539] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:50 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:51.186658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-00082712-1d87-45eb-8442-9acd4f382243 req-2f56036d-7aa1-410c-a337-b1d0ba767a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:51.198993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-00082712-1d87-45eb-8442-9acd4f382243 req-2f56036d-7aa1-410c-a337-b1d0ba767a3d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:51.199544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-00082712-1d87-45eb-8442-9acd4f382243 req-2f56036d-7aa1-410c-a337-b1d0ba767a3d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:51.200057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-00082712-1d87-45eb-8442-9acd4f382243 req-2f56036d-7aa1-410c-a337-b1d0ba767a3d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:51.216857 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-00082712-1d87-45eb-8442-9acd4f382243 req-2f56036d-7aa1-410c-a337-b1d0ba767a3d service nova] Creating event network-changed:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h2-858238-3 Nov 02 14:40:51.222123 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-00082712-1d87-45eb-8442-9acd4f382243 req-2f56036d-7aa1-410c-a337-b1d0ba767a3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039439 Nov 02 14:40:51.222738 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2290/6540] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:52.170118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:52.170647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:52.177563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:52.178544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:52.178968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:52.179687 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:52.180133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:52.180547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:52.314309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:52.323360 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d6d09fc0-3176-4edd-9404-9fa6456da888 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1365 microversion: 2.1 time: 0.157154 Nov 02 14:40:52.323950 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4251/6541] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:52 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:53.348980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:53.350335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:53.356851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:53.357347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:53.357818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:53.358520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:53.358987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:53.359457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:53.499293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:53.507176 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bee20351-0314-48c0-be22-c080536cc85a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1365 microversion: 2.1 time: 0.163675 Nov 02 14:40:53.507786 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2291/6542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:53 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:54.529979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:54.530590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:54.537550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:54.538037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:54.538470 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:54.539196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:54.539650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:54.540072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:54.671068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:54.678946 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c0cf620a-f9e1-4ec6-ab30-f4102ca7d762 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1365 microversion: 2.1 time: 0.152745 Nov 02 14:40:54.679388 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4252/6543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:54 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:55.192787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a42e1cf4-41f2-4abf-b1ad-9b48394200da req-27c5556f-c440-4f9e-ae45-8029d1db59b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "name": "network-vif-plugged", "status": "completed", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:55.203396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a42e1cf4-41f2-4abf-b1ad-9b48394200da req-27c5556f-c440-4f9e-ae45-8029d1db59b4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:55.203891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a42e1cf4-41f2-4abf-b1ad-9b48394200da req-27c5556f-c440-4f9e-ae45-8029d1db59b4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:55.204325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a42e1cf4-41f2-4abf-b1ad-9b48394200da req-27c5556f-c440-4f9e-ae45-8029d1db59b4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:55.216385 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a42e1cf4-41f2-4abf-b1ad-9b48394200da req-27c5556f-c440-4f9e-ae45-8029d1db59b4 service nova] Creating event network-vif-plugged:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h2-858238-3 Nov 02 14:40:55.221332 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a42e1cf4-41f2-4abf-b1ad-9b48394200da req-27c5556f-c440-4f9e-ae45-8029d1db59b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032518 Nov 02 14:40:55.221942 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2292/6544] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:55.703517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:55.704125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:55.712100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:55.712595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:55.713036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:55.713745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:55.714205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:55.714632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:55.854133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:55.862559 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-25dca7dc-feb7-4fec-967b-d8d7939a234a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1365 microversion: 2.1 time: 0.162907 Nov 02 14:40:55.863163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4253/6545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:55 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:56.887541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:56.888260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:56.894501 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:56.894991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:56.895462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:56.896154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:56.896622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:56.897059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:57.101891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:57.109702 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb4184f4-ad2f-4c35-9e17-d8d688313ded tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1552 microversion: 2.1 time: 0.227248 Nov 02 14:40:57.110286 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2293/6546] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:40:56 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:57.132893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:57.133393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:57.140327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:57.140752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:57.141190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:57.141880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:57.142337 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:57.142761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:57.221887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4107e064-3edc-44d6-a4e6-23d2bd7dd495 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092887 Nov 02 14:40:57.222512 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4254/6547] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:40:57 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:58.477673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-7b74ca9b-ea7e-406b-adb7-13a2ce84d07d req-54a488d0-f679-4d70-aa9d-439b2d196739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:58.490190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7b74ca9b-ea7e-406b-adb7-13a2ce84d07d req-54a488d0-f679-4d70-aa9d-439b2d196739 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:58.491285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7b74ca9b-ea7e-406b-adb7-13a2ce84d07d req-54a488d0-f679-4d70-aa9d-439b2d196739 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:58.491722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-7b74ca9b-ea7e-406b-adb7-13a2ce84d07d req-54a488d0-f679-4d70-aa9d-439b2d196739 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:58.505098 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-7b74ca9b-ea7e-406b-adb7-13a2ce84d07d req-54a488d0-f679-4d70-aa9d-439b2d196739 service nova] Creating event network-changed:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h2-858238-3 Nov 02 14:40:58.510765 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-7b74ca9b-ea7e-406b-adb7-13a2ce84d07d req-54a488d0-f679-4d70-aa9d-439b2d196739 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037562 Nov 02 14:40:58.511435 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2294/6548] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:31.425753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.426705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.427645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=51 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.433007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6c1f1121-7df2-4133-a902-82afaea7b45f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:31.440771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c1f1121-7df2-4133-a902-82afaea7b45f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.441247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c1f1121-7df2-4133-a902-82afaea7b45f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.441682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6c1f1121-7df2-4133-a902-82afaea7b45f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.467640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6c1f1121-7df2-4133-a902-82afaea7b45f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:41:31.514707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6c1f1121-7df2-4133-a902-82afaea7b45f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.090377 Nov 02 14:41:31.515566 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4255/6549] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:41:31 2022] POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:31.521421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.522245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.524242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=11 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.524849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:31.529793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:31.530530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:31.539511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.540016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.541355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.541355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:31.541947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:31.542107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:31.690611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:31.699293 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bfe5a301-20ad-40ca-841b-1fe2e3483ac8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.178745 Nov 02 14:41:31.699895 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2295/6550] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:31 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:32.724718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:32.725414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:32.734430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:32.734906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:32.735357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.736042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:32.736492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:32.736905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:32.879328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:32.887287 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7b1eedb9-e4b3-46e9-98f3-6238e84226b4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.167718 Nov 02 14:41:32.887867 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4256/6551] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:32 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:33.911663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:33.912308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:33.921485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.921983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.922425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:33.923155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:33.923622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:33.924057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.056672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.064843 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e3e39339-5b03-4b75-b8ae-db2c2b013ec0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.157459 Nov 02 14:41:34.065418 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2296/6552] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:33 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:35.089395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:35.090038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:35.097015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.097632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.098067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.098755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.099297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.099717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.233506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:35.242315 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4d8d46f3-7e5d-425c-950c-3dd66d6f977f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.156778 Nov 02 14:41:35.242910 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4257/6553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:35 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:36.266465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:36.267037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:36.276540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:36.277028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:36.277474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:36.278168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:36.278629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:36.279064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:36.407538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:36.415963 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4a95e8b3-e919-46c6-b6d1-4775e275f9e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.153431 Nov 02 14:41:36.416535 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2297/6554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:36 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:37.441406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:37.442016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:37.451472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.451954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.452379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.453089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.453523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.453933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.586847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.594872 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a9bd1883-478b-4d89-ba26-41c1359b4361 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.157339 Nov 02 14:41:37.595506 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4258/6555] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:37 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:38.620888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:38.621510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:38.628056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.628543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.628984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.629678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.630140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.630573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.765003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:38.772757 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9ff9fd3e-7edb-449a-98a0-a8b093e5a285 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.156538 Nov 02 14:41:38.773338 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2298/6556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:38 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:39.796174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:39.796785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:39.804067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.804546 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.805363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.806201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.806705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.807332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.937082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:39.944900 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b4996c9-3f5a-4f2d-a920-98f4f4e3f453 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.152655 Nov 02 14:41:39.945476 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4259/6557] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:39 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:40.968318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:40.968990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:40.976490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.976984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.977428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.978132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.978591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.979023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.110729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.119145 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f122707f-a267-4b66-be85-7b9b2c78fa19 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.154729 Nov 02 14:41:41.119713 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2299/6558] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:40 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:42.142913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:42.143558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:42.151190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.151668 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.152096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.152777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.153228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.153643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.285211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.293605 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87880736-2cd2-41b8-9428-81e1f5c52d83 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1657 microversion: 2.1 time: 0.154629 Nov 02 14:41:42.294200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4260/6559] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:42 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:42.316850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:42.319197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:42.326678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.327223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.327681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.328406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.328861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.329303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.357459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.362857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Old instance type m1.heat2, new instance type m1.heat {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:41:42.369482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:41:42.369925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:41:42.370415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:41:42.370844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:41:42.371309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:41:42.437277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9a17cba8-cac2-424b-93c3-cb528b320f96 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.124244 Nov 02 14:41:42.437879 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2300/6560] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:41:42 2022] POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:42.446609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:42.447432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:42.453373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.453857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.454286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.454984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.455465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.455886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.622238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.633987 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f003eb11-cd8f-4829-bd41-c061dd49b151 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.191645 Nov 02 14:41:42.634578 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4261/6561] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:42 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:43.658497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:43.659151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:43.665783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.666280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.666724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.667449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.667916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.668348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.809363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:43.817984 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb50f232-44e6-4244-8138-a539d3a17d0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1680 microversion: 2.1 time: 0.164207 Nov 02 14:41:43.818575 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2301/6562] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:43 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:44.842524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:44.843066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:44.850180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.851225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.851658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.852357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:44.852815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:44.853244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:44.991876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:45.000127 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c448cefc-dc55-44b7-bbd9-55d06733a56d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1685 microversion: 2.1 time: 0.161520 Nov 02 14:41:45.000723 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4262/6563] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:44 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:46.029743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:46.029743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:46.034695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.035596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.036054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.036774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.037245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.037688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.177636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:46.185910 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-30a2734e-edc9-421c-ae4d-ae240b3925d8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1685 microversion: 2.1 time: 0.165046 Nov 02 14:41:46.186689 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2302/6564] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:46 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:46.579821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "name": "network-vif-unplugged", "status": "completed", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:46.591161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:46.591797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:46.592338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:46.605714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] Creating event network-vif-unplugged:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h1-858238-3 Nov 02 14:41:46.611348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:41:46.624089 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-861cbf6a-aa5d-4ef3-b5c1-a746a461d38a req-bf208173-004a-4290-9e24-cc0d887652ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047760 Nov 02 14:41:46.624920 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4263/6565] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:47.211315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:47.212133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:47.218798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.219334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.219787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.220490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:47.220953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:47.221388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:47.422856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:47.431072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e751523-f576-4072-9313-af3664a9d2e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1684 microversion: 2.1 time: 0.224878 Nov 02 14:41:47.431685 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2303/6566] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:47 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:48.455489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:48.456196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:48.463250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.463734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.464173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.464859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.465311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.465735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.596925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:48.605304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-be807155-fd47-4055-84fe-168f51c533c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1682 microversion: 2.1 time: 0.154064 Nov 02 14:41:48.605889 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4264/6567] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:48 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:48.657812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:48.667887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:48.668370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:48.668857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:48.681274 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] Creating event network-changed:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h1-858238-3 Nov 02 14:41:48.686798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:41:48.698445 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-19207d68-8ad7-4d51-9f84-240ff831bf59 req-e9424e64-cc04-4207-b494-d2b0c207151f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Nov 02 14:41:48.699124 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2304/6568] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:49.629839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:49.630448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:49.637616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.638124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.638557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.639290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.639739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.640159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.866854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:49.875071 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16308668-b258-4a27-876a-c60d231ea919 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1678 microversion: 2.1 time: 0.248911 Nov 02 14:41:49.891487 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4265/6569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:49 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:49.901137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:49.902357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:49.908877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.909391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.909855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.910577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.911058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.911528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.976311 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0cda305-4f0b-4d42-85e9-9b869b293229 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action" status: 204 len: 0 microversion: 2.1 time: 0.080618 Nov 02 14:41:49.977320 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2305/6570] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:41:49 2022] POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:41:49.985639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:49.986258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:49.992590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.993278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.993766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:49.994731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:49.995441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:49.996031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:50.141556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:50.151368 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a895646-ad13-4c3c-81fa-7809f39135ae tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1678 microversion: 2.1 time: 0.169509 Nov 02 14:41:50.152306 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4266/6571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:49 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:51.175667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:51.176419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:51.183482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.183982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.184428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.185434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.185900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.186337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.324009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:51.332156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c76d7320-a3fc-4c40-8b96-18238dff14f6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1678 microversion: 2.1 time: 0.160717 Nov 02 14:41:51.332735 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2306/6572] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:51 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:51.857397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-287a7e54-8904-4d08-a887-2c7ecdf2c018 req-82a4f9dd-a35a-4135-a769-155648645bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "name": "network-vif-plugged", "status": "completed", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:51.868822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-287a7e54-8904-4d08-a887-2c7ecdf2c018 req-82a4f9dd-a35a-4135-a769-155648645bfc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:51.869309 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-287a7e54-8904-4d08-a887-2c7ecdf2c018 req-82a4f9dd-a35a-4135-a769-155648645bfc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:51.869731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-287a7e54-8904-4d08-a887-2c7ecdf2c018 req-82a4f9dd-a35a-4135-a769-155648645bfc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:51.881441 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-287a7e54-8904-4d08-a887-2c7ecdf2c018 req-82a4f9dd-a35a-4135-a769-155648645bfc service nova] Creating event network-vif-plugged:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h1-858238-3 Nov 02 14:41:51.887053 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-287a7e54-8904-4d08-a887-2c7ecdf2c018 req-82a4f9dd-a35a-4135-a769-155648645bfc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Nov 02 14:41:51.887693 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4267/6573] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:41:52.356807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:52.357456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:52.364890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.365385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.365836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.367302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.367781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.368228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.502399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.510267 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-11324208-094b-4b07-83ba-24885bbac39a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1657 microversion: 2.1 time: 0.157394 Nov 02 14:41:52.510856 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2307/6574] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:52 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:52.533776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:52.534473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:52.541287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.541771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.542201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.542887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.543358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.543779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.677290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.685331 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7755d57a-9d3a-4b9c-9d56-90dcc6b84b50 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1657 microversion: 2.1 time: 0.155653 Nov 02 14:41:52.685904 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4268/6575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:52 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:52.708334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-034ddc23-23f8-44d1-96b1-c375b520c06a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:52.714849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-034ddc23-23f8-44d1-96b1-c375b520c06a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.715415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-034ddc23-23f8-44d1-96b1-c375b520c06a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.715877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-034ddc23-23f8-44d1-96b1-c375b520c06a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.738516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-034ddc23-23f8-44d1-96b1-c375b520c06a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Going to try to start instance {{(pid=137558) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:41:52.760974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:52.779286 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-034ddc23-23f8-44d1-96b1-c375b520c06a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.074730 Nov 02 14:41:52.779890 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2308/6576] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:41:52 2022] POST /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:52.788750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:52.789459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:52.795510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.795999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.796476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.797129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:52.797595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:52.798048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:52.990171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:52.998091 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a1d20457-2c9d-4cbe-8876-40eb719339e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1666 microversion: 2.1 time: 0.213873 Nov 02 14:41:52.998674 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4269/6577] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:52 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1666 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:54.023897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:54.025087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:54.030836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.031365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.031816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.032516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.032983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.033425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.163190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:54.171330 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f8c8409e-dd6e-4ffa-8044-cc0102f697d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1670 microversion: 2.1 time: 0.152790 Nov 02 14:41:54.171909 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2309/6578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:54 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:54.195023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:54.196122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:54.203082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.203598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.204012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.204690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.205138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.205557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.231480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:41:54.260179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:54.310581 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6add923d-d80b-4d32-b8df-7404bd0213e4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 204 len: 0 microversion: 2.1 time: 0.118945 Nov 02 14:41:54.311505 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4270/6579] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:41:54 2022] DELETE /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:41:54.319688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:54.320314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:54.326270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.326765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.327242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.327946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:54.328415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:54.328858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:54.461395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:54.469241 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e9fdf47-2f1e-44af-a324-54304d78255a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1676 microversion: 2.1 time: 0.153486 Nov 02 14:41:54.469798 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2310/6580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:54 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:55.494372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:55.495218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:55.502116 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:55.502600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:55.503044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:55.503767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:55.504225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:55.504651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:55.662977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:55.670848 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-878e155e-9c10-4693-aa9e-9ddd34190ab4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1676 microversion: 2.1 time: 0.181254 Nov 02 14:41:55.671472 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4271/6581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:55 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:56.696971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:56.697564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:56.706239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.707858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.707858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.708099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.708434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.708877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.799887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:56.810069 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ce4107fb-37e2-4dfc-99e5-6102b0a55f3d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 200 len: 1608 microversion: 2.1 time: 0.118142 Nov 02 14:41:56.810996 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2311/6582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:56 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 1608 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:56.882593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c8b2ae74-7fda-48fa-9525-c07d0d516738 req-e114df05-7bff-499c-a167-f755515998ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03649ef4-e9de-4264-b8fc-1403a8935cfb", "name": "network-vif-deleted", "tag": "6801630e-1e18-4103-9cf9-d48e4a598847"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:56.894921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c8b2ae74-7fda-48fa-9525-c07d0d516738 req-e114df05-7bff-499c-a167-f755515998ce service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.896662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c8b2ae74-7fda-48fa-9525-c07d0d516738 req-e114df05-7bff-499c-a167-f755515998ce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.896662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c8b2ae74-7fda-48fa-9525-c07d0d516738 req-e114df05-7bff-499c-a167-f755515998ce service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.908868 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c8b2ae74-7fda-48fa-9525-c07d0d516738 req-e114df05-7bff-499c-a167-f755515998ce service nova] Creating event network-vif-deleted:6801630e-1e18-4103-9cf9-d48e4a598847 for instance 03649ef4-e9de-4264-b8fc-1403a8935cfb on n-h1-858238-3 Nov 02 14:41:56.914957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c8b2ae74-7fda-48fa-9525-c07d0d516738 req-e114df05-7bff-499c-a167-f755515998ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035864 Nov 02 14:41:56.919000 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4272/6583] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:57.833893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:57.834519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:57.842202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.842981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.843460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.844246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.845272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.845272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.861284 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb HTTP/1.1 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '03649ef4-e9de-4264-b8fc-1403a8935cfb'} Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:57.863041 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-392033d2-a2d4-45be-bae3-cf5f2eca55a7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 404 len: 111 microversion: 2.1 time: 0.034537 Nov 02 14:41:57.867706 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2312/6584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:57 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:41:57.880781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:57.881480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:57.888112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.888711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.889076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.889783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.890235 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.890707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.906456 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb HTTP/1.1 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '03649ef4-e9de-4264-b8fc-1403a8935cfb'} Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:57.908127 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7325a822-d24d-4111-add1-311fac4de768 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 404 len: 111 microversion: 2.1 time: 0.033157 Nov 02 14:41:57.912695 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4273/6585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:57 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:41:57.959557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-252275703", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e"}], "security_groups": [{"name": "tempest-securitygroup--1326539966"}], "key_name": "tempest-keypair-2145718649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:58.062952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] validate_networks() for [('ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:41:58.429744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:41:58.430183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:41:58.430702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:41:58.431147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:41:58.431581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:41:58.440720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.441212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.441661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.442686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.442859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.443328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.459734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:58.465527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:58.478434 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:41:58.480762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:41:58.526011 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-286ad780-4214-4b6d-9dc1-88b7a96dd981 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.570311 Nov 02 14:41:58.526728 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2313/6586] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:41:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:41:58.537843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0551d536-cace-4f37-aa59-8ca220b6a3f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:58.538480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0551d536-cace-4f37-aa59-8ca220b6a3f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:58.594018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0551d536-cace-4f37-aa59-8ca220b6a3f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:58.600948 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0551d536-cace-4f37-aa59-8ca220b6a3f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1238 microversion: 2.1 time: 0.066875 Nov 02 14:41:58.601693 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4274/6587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:58 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:59.625296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:59.625986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:59.635915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:59.636430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:59.636880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:59.638233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:59.638886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:59.639362 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:59.709073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:59.718376 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a1faba01-2ba0-4388-9ff9-88288f5c86b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1298 microversion: 2.1 time: 0.097054 Nov 02 14:41:59.736332 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2314/6588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:41:59 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:00.745384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:00.745989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:00.750967 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:42:00.751146 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 (ip 10.222.0.18) !!! Nov 02 14:42:00.752988 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:42:00.753095 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 (ip 10.222.0.18) !!! Nov 02 14:42:00.768675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.769183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.769585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.770930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.770930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.771286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.910860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.921576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-625f7b4c-3d18-4582-91ac-e98842b00839 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1364 microversion: 2.1 time: 0.180437 Nov 02 14:42:00.922686 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4275/6589] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:00 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:01.047321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-66a58ea2-1512-4f3f-a766-3a762e670969 req-2e5886be-79c9-4572-b59a-485e03378cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:01.061240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-66a58ea2-1512-4f3f-a766-3a762e670969 req-2e5886be-79c9-4572-b59a-485e03378cf4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.062065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-66a58ea2-1512-4f3f-a766-3a762e670969 req-2e5886be-79c9-4572-b59a-485e03378cf4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.062863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-66a58ea2-1512-4f3f-a766-3a762e670969 req-2e5886be-79c9-4572-b59a-485e03378cf4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.083168 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-66a58ea2-1512-4f3f-a766-3a762e670969 req-2e5886be-79c9-4572-b59a-485e03378cf4 service nova] Creating event network-changed:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:42:01.088180 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-66a58ea2-1512-4f3f-a766-3a762e670969 req-2e5886be-79c9-4572-b59a-485e03378cf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044773 Nov 02 14:42:01.089017 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2315/6590] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:01.946817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:01.947548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:01.950185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:01.955583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.956065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.956496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.957190 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.957644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.958073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.095704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:02.104718 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8c3e3df-8ce3-415e-96d0-4e507b405d05 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1364 microversion: 2.1 time: 0.161833 Nov 02 14:42:02.105310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4276/6591] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:01 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:03.130856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:03.131658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:03.134258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:03.139881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.140378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.140827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.141529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.142007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.142439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.273485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:03.281349 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f33bed22-46ac-43f7-8256-fc9c06236017 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1364 microversion: 2.1 time: 0.155639 Nov 02 14:42:03.281964 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2316/6592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:03 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:04.305416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:04.305951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:04.313072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.313539 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.313964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.314640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.315089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.315529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.450157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.457954 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43195776-7771-417d-a568-c9122667ee41 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1364 microversion: 2.1 time: 0.156530 Nov 02 14:42:04.458520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4277/6593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:04 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:05.424909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9027a021-019b-4142-9b29-039a741a0837 req-8058814f-8e2f-4390-940c-c51a79f4df63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "name": "network-vif-plugged", "status": "completed", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:05.435936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9027a021-019b-4142-9b29-039a741a0837 req-8058814f-8e2f-4390-940c-c51a79f4df63 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.436426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9027a021-019b-4142-9b29-039a741a0837 req-8058814f-8e2f-4390-940c-c51a79f4df63 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.436861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9027a021-019b-4142-9b29-039a741a0837 req-8058814f-8e2f-4390-940c-c51a79f4df63 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.450244 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9027a021-019b-4142-9b29-039a741a0837 req-8058814f-8e2f-4390-940c-c51a79f4df63 service nova] Creating event network-vif-plugged:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:42:05.455029 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9027a021-019b-4142-9b29-039a741a0837 req-8058814f-8e2f-4390-940c-c51a79f4df63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034916 Nov 02 14:42:05.455673 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2317/6594] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:42:05.481383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:05.482079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:05.490029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.490693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.491221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.492035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.493245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.493670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.630438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:05.640409 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61941738-8f1b-4243-ae2e-c0fb3ebde432 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1364 microversion: 2.1 time: 0.162667 Nov 02 14:42:05.641008 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4278/6595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:05 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:06.665487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:06.666244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:06.672917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:06.673345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:06.673796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.674510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:06.674977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:06.675445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.824941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:06.834956 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-efdb30f6-b3b0-4a6b-9240-7b658a7107d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1364 microversion: 2.1 time: 0.173744 Nov 02 14:42:06.836098 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2318/6596] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:06 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:07.860473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:07.861039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:07.868533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.869015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.869453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.870147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.870599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.871020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.002533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.010366 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd357094-9ce8-4d4e-a530-15f2eb3f6f46 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1552 microversion: 2.1 time: 0.153888 Nov 02 14:42:08.010949 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4279/6597] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:07 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:08.033987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:08.034480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:08.041853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.042347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.042825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.043557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.044026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.044464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.121520 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-504a2339-e870-4b4e-8975-de6ce179729b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091353 Nov 02 14:42:08.122119 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2319/6598] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:42:08 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:09.068821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1564fcfd-6fec-413b-91f1-f6dddb94b4b3 req-ac04d789-63c7-45be-a35d-e92ed93c793d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:09.074256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:09.080759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1564fcfd-6fec-413b-91f1-f6dddb94b4b3 req-ac04d789-63c7-45be-a35d-e92ed93c793d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:09.081231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1564fcfd-6fec-413b-91f1-f6dddb94b4b3 req-ac04d789-63c7-45be-a35d-e92ed93c793d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:09.081653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1564fcfd-6fec-413b-91f1-f6dddb94b4b3 req-ac04d789-63c7-45be-a35d-e92ed93c793d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:09.094003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1564fcfd-6fec-413b-91f1-f6dddb94b4b3 req-ac04d789-63c7-45be-a35d-e92ed93c793d service nova] Creating event network-changed:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:42:09.099251 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1564fcfd-6fec-413b-91f1-f6dddb94b4b3 req-ac04d789-63c7-45be-a35d-e92ed93c793d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034029 Nov 02 14:42:09.100236 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4280/6599] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:41.962517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:41.963358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:41.965389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=7 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:41.966048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:41.970321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:41.972603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:41.981534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.982112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.982563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:41.983324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:41.983793 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:41.984231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.014929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:42.020755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Old instance type m1.heat2, new instance type m1.heat {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:42:42.027451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:42:42.027895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:42:42.028384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:42:42.028805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:42:42.029230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:42:42.093085 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e30d1bd9-9360-4b4e-a1b2-ed75b1bb2870 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6/action" status: 202 len: 0 microversion: 2.1 time: 0.131129 Nov 02 14:42:42.093739 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2320/6600] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:42:41 2022] POST /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:42:42.100392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=9 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:42.101260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:42.105849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:42.106215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:42.114170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:42.114737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:42.115258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.116003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:42.116500 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:42.116935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:42.290403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:42.298548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-673ae26e-62b0-43b3-bddf-f2fc7f149d6d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1679 microversion: 2.1 time: 0.200126 Nov 02 14:42:42.299071 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4281/6601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:42 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:43.322044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:43.322624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:43.330239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.330730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.331197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.332248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:43.332718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:43.333150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:43.474456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:43.483240 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5158c161-cdf4-4c96-9751-3a1460514956 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1679 microversion: 2.1 time: 0.165182 Nov 02 14:42:43.483824 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2321/6602] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:43 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:44.506431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:44.507034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:44.514290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:44.514767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:44.515218 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:44.515910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:44.516358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:44.516775 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:44.662374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:44.670742 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb59e6fd-af06-4811-b8f4-2e783a157566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.168308 Nov 02 14:42:44.671255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4282/6603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:44 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:45.695169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:45.696605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:45.703020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.703549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.703999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.704701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.705170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.705614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.835622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:45.843832 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-97272b6a-6f63-4881-b69c-df4f8a890ae4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.152689 Nov 02 14:42:45.844420 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2322/6604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:45 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:46.868961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:46.869571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:46.876208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:46.876682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:46.877110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.877926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:46.878474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:46.878898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:47.014083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:47.021950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9f5e83c8-e391-4e3c-b628-ddbf1d9bf165 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.157423 Nov 02 14:42:47.022533 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4283/6605] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:46 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:48.046490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:48.047128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:48.053593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.054086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.054534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.055280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:48.055748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:48.056182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:48.184375 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:48.192543 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fbab4857-efcc-422a-b62f-954dfad8084b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.150085 Nov 02 14:42:48.193107 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2323/6606] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:48 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:49.216397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:49.216988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:49.223885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.224357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.224783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.225462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:49.225914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:49.226330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:49.358926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:49.366808 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1759b504-a6ae-41b9-9aa3-43d20a3dc035 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.154358 Nov 02 14:42:49.368019 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4284/6607] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:49 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:50.391686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:50.392314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:50.399371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:50.399867 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:50.400312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:50.401015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:50.401514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:50.401958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:50.532944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:50.541326 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9514efda-1063-49a6-a438-e9ed78a554b0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.153613 Nov 02 14:42:50.541903 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2324/6608] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:50 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:51.565467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:51.566056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:51.573428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.573900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.574327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.575004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:51.575474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:51.575895 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:51.704579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:51.712338 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dff30648-052e-4a80-ac3b-17c75a1d8249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.150766 Nov 02 14:42:51.712913 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4285/6609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:51 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:52.735855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:52.736471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:52.743950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.744442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.744888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.745581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:52.746044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:52.746477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:52.880097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:52.888052 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b9ebecaa-2c73-470e-a41b-c5f82e650716 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.156040 Nov 02 14:42:52.888625 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2325/6610] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:52 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:53.911679 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:53.912294 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:53.919886 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:53.920361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:53.920792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:53.921498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:53.921954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:53.922378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:54.053306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:54.061293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0e29e88a-5c2f-4780-87cf-a038fd3aa4ab tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.153478 Nov 02 14:42:54.061875 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4286/6611] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:53 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:55.084780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:55.085428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:55.092461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:55.092965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:55.093412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:55.094117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:55.094584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:55.095024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:55.228001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:55.235750 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-02cea85d-46ea-4f81-86ba-8f694150147a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.154962 Nov 02 14:42:55.236319 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2326/6612] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:55 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:56.260183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:56.260794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:56.267706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:56.268183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:56.268609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:56.269286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:56.269733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:56.270180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:56.401505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:56.410420 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ba86a27e-83d1-482d-8afc-dbc7194daa14 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.154114 Nov 02 14:42:56.410990 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4287/6613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:56 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:57.433522 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:57.434149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:57.441207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:57.441692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:57.442134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:57.442828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:57.443323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:57.443755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:57.575695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:57.583629 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-642eb8f9-63c5-48b9-bfbd-cf01f00d2992 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.154041 Nov 02 14:42:57.584201 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2327/6614] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:57 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:58.608340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:58.608944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:58.615782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:58.616253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:58.616681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:58.617433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:58.617885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:58.618296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:58.748296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:58.756038 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c0c181a-2187-4b44-82a3-2c06e8e475c2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.151582 Nov 02 14:42:58.756611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4288/6615] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:58 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:59.780116 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:59.780748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:59.787933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:59.788431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:59.788877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:59.790095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:59.790568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:59.791007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:59.931585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:59.939803 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2acbbb92-7ffa-4756-bad0-29603dc2c95d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1684 microversion: 2.1 time: 0.163570 Nov 02 14:42:59.940387 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2328/6616] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:42:59 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:00.963910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:00.964703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:00.971597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:00.972112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:00.972532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:00.973280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:00.973702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:00.974629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.189541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:01.197809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f89537b9-4977-452e-a91f-671d70003d4c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1683 microversion: 2.1 time: 0.237635 Nov 02 14:43:01.198410 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4289/6617] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:00 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:01.474788 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "name": "network-vif-unplugged", "status": "completed", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:01.486495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:01.487246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:01.487878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:01.502829 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] Creating event network-vif-unplugged:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h1-858238-3 Nov 02 14:43:01.508436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:43:01.519571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e374c860-e707-4fc7-a11a-3438b0048b5e req-a86041c0-7609-4122-8a1c-85dfb46bebfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048779 Nov 02 14:43:01.520190 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2329/6618] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:02.221434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:02.222297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:02.229318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:02.229885 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:02.230318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:02.231013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:02.231527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:02.231972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:02.784100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:02.792049 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6473e628-e4ee-4383-8726-b664f7f345eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1683 microversion: 2.1 time: 0.574523 Nov 02 14:43:02.792634 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4290/6619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:02 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1683 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:03.563560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:03.573142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:03.573633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:03.574073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:03.586452 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] Creating event network-changed:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h1-858238-3 Nov 02 14:43:03.592361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:43:03.604146 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d2615fe3-7c6e-4b82-a2f1-c855b36f5ba0 req-d7cbb174-1287-48dc-adba-9a7c786fc5d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045860 Nov 02 14:43:03.604770 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2330/6620] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:03.815545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:03.816151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:03.823042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:03.823548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:03.823982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:03.824673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:03.825127 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:03.825549 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:03.963949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:03.971818 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50fd11e6-720d-499e-b6f3-36b27d08a6ee tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1681 microversion: 2.1 time: 0.160100 Nov 02 14:43:03.972620 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4291/6621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:03 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:04.997238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:04.997958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:05.004223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.004720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.005170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.005874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.006342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.006783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.136715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:05.144616 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f39130c1-6925-4d00-9483-2abf52b966e7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1678 microversion: 2.1 time: 0.152411 Nov 02 14:43:05.145188 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2331/6622] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:04 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:05.168314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:05.168832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:05.175643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.176124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.176565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.177298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.177735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.178248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.215873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.216346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.216779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.217494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.217991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.218417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.241046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:43:05.246746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:43:05.351829 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-681a9245-cbe8-4227-8c0a-6232b7d9beb0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6/action" status: 202 len: 0 microversion: 2.1 time: 0.187107 Nov 02 14:43:05.352926 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4292/6623] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:43:05 2022] POST /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:43:05.361073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:05.361691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:05.372396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.373142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.373697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.374517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:05.375121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:05.375671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:05.571745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:05.579804 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9a154f4-c5ec-4263-92bd-2a49e8f773fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1677 microversion: 2.1 time: 0.222568 Nov 02 14:43:05.580398 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2332/6624] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:05 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:06.604619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:06.605339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:06.613272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:06.613764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:06.614189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:06.614880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:06.615351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:06.615770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:06.754471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:06.762908 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-caa46492-9f99-4713-a931-510648506534 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1677 microversion: 2.1 time: 0.163324 Nov 02 14:43:06.763520 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4293/6625] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:06 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:07.786583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:07.787136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:07.795016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:07.795555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:07.796010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:07.796725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:07.797193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:07.797630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:07.944338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:07.954168 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ec91ab6c-86d2-4558-b1cc-78b7cec3bfce tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1677 microversion: 2.1 time: 0.171638 Nov 02 14:43:07.954751 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2333/6626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:07 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:08.257195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "name": "network-vif-plugged", "status": "completed", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:08.268488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:08.269196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:08.269734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:08.282609 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] Creating event network-vif-plugged:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:43:08.285277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:08.289040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:43:08.301480 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c088211d-8271-4340-a424-985d80ce2661 req-42598453-6aeb-419d-a65a-548cd9e16af4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047864 Nov 02 14:43:08.302096 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4294/6627] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:08.977998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:08.979030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:08.985708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:08.986220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:08.986673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:08.987485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:08.987960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:08.988404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:09.091486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "name": "network-vif-unplugged", "status": "completed", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:09.102591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:09.103239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:09.103870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:09.119841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] Creating event network-vif-unplugged:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:43:09.126557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:43:09.127605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:09.137140 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-df38c7d3-b742-4e5d-95bc-3f5f9cb8ed7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1677 microversion: 2.1 time: 0.163189 Nov 02 14:43:09.139181 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2334/6628] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:08 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:09.139353 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-08029a8a-aa8f-4628-bf31-f40074c7361f req-88d248c5-a835-4b8b-b5f0-bef33f77f42e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052940 Nov 02 14:43:09.139781 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4295/6629] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:10.161657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:10.162305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:10.169644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:10.170132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:10.170573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:10.171304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:10.171767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:10.172193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:10.309683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:10.313528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:10.318748 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3af5fcdd-a5de-407d-8b90-fcea7cbe3a81 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1677 microversion: 2.1 time: 0.160965 Nov 02 14:43:10.319370 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2335/6630] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:10 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:11.176589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:11.186569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.187074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.187524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.203011 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] Creating event network-changed:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:43:11.209352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:43:11.222417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-73480e4a-7077-4c67-a7e0-4886a871e97a req-727610ca-4bb5-4abb-bc85-00394de7a336 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050485 Nov 02 14:43:11.223055 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4296/6631] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:11.347913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:11.347913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:11.356648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.357775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.358543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.359836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:11.360451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:11.360899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:11.604787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:11.615727 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-17ec40e1-79cf-44bc-bb61-6bc79f9111f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1677 microversion: 2.1 time: 0.274895 Nov 02 14:43:11.619368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2336/6632] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:11 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:12.643122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:12.643829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:12.646259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:12.651890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.652365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.652794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.653480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.653932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.654350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.792105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:12.799982 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5f974ba8-6359-48b8-9fb9-98da51d546dc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1670 microversion: 2.1 time: 0.161350 Nov 02 14:43:12.800569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4297/6633] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:12 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:12.823711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:12.824329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:12.826977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=39 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:12.833039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.833532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.833981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.834724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:12.835224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:12.835667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:12.965229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:12.973022 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-728f3cba-33d6-4063-afa3-54dcaf25daa0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1670 microversion: 2.1 time: 0.153845 Nov 02 14:43:12.973588 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2337/6634] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:12 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:12.996743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:12.997346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:13.003411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.003900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.004323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.005014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.005463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.005882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.137401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:13.145130 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-872208cb-e232-41f0-95be-9c97fa1699eb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1670 microversion: 2.1 time: 0.152853 Nov 02 14:43:13.145698 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4298/6635] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:12 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:13.167742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:13.168257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:13.174168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.174660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.175126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.175838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.176304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.176741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.202064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:43:13.277092 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60e20148-938a-495f-9271-75a72b3be247 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 204 len: 0 microversion: 2.1 time: 0.113280 Nov 02 14:43:13.277610 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2338/6636] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:43:13 2022] DELETE /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:43:13.286194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:13.286809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:13.293928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.294402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.294835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.295572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.296030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.296456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.438161 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:13.446166 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-44213021-f12d-44b8-8c93-731015eb43fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1676 microversion: 2.1 time: 0.163956 Nov 02 14:43:13.446836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4299/6637] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:13 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:13.778432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-a9d788be-b1ef-4b9b-b5cf-7ea508590302 req-3de2da50-b9eb-4b30-a6a3-ce72d9e2ca00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "name": "network-vif-plugged", "status": "completed", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:13.789163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a9d788be-b1ef-4b9b-b5cf-7ea508590302 req-3de2da50-b9eb-4b30-a6a3-ce72d9e2ca00 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:13.789812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a9d788be-b1ef-4b9b-b5cf-7ea508590302 req-3de2da50-b9eb-4b30-a6a3-ce72d9e2ca00 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:13.790399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-a9d788be-b1ef-4b9b-b5cf-7ea508590302 req-3de2da50-b9eb-4b30-a6a3-ce72d9e2ca00 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:13.805713 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-a9d788be-b1ef-4b9b-b5cf-7ea508590302 req-3de2da50-b9eb-4b30-a6a3-ce72d9e2ca00 service nova] Creating event network-vif-plugged:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:43:13.811586 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-a9d788be-b1ef-4b9b-b5cf-7ea508590302 req-3de2da50-b9eb-4b30-a6a3-ce72d9e2ca00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037837 Nov 02 14:43:13.812200 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2339/6638] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:43:14.469991 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:14.470759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:14.477973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:14.478454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:14.479428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:14.480136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:14.480585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:14.481007 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:14.613938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:14.622523 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea437aa8-8d48-4ccb-99ce-a2de700de0d5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1676 microversion: 2.1 time: 0.156501 Nov 02 14:43:14.623138 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4300/6639] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:14 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:15.647755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:15.649173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:15.656411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.657236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.657889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.658708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.659315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.659857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.736907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:15.746616 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-da33b7fa-a866-41c4-9608-14f6f949297e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 200 len: 1608 microversion: 2.1 time: 0.103980 Nov 02 14:43:15.747590 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2340/6640] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:15 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 1608 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:15.783018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f9ddf4b9-d20b-4a30-a0ef-67b093f42f8c req-c47501df-11e2-42b7-8d3c-3d701f0b05cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6", "name": "network-vif-deleted", "tag": "6058aa8c-051f-4524-87b2-16a95b4b7240"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:15.789083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:15.799165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9ddf4b9-d20b-4a30-a0ef-67b093f42f8c req-c47501df-11e2-42b7-8d3c-3d701f0b05cd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:15.799940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9ddf4b9-d20b-4a30-a0ef-67b093f42f8c req-c47501df-11e2-42b7-8d3c-3d701f0b05cd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:15.800361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f9ddf4b9-d20b-4a30-a0ef-67b093f42f8c req-c47501df-11e2-42b7-8d3c-3d701f0b05cd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:15.814452 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f9ddf4b9-d20b-4a30-a0ef-67b093f42f8c req-c47501df-11e2-42b7-8d3c-3d701f0b05cd service nova] Creating event network-vif-deleted:6058aa8c-051f-4524-87b2-16a95b4b7240 for instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 on n-h2-858238-3 Nov 02 14:43:15.820858 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f9ddf4b9-d20b-4a30-a0ef-67b093f42f8c req-c47501df-11e2-42b7-8d3c-3d701f0b05cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041593 Nov 02 14:43:15.821540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4301/6641] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:16.770045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:16.770672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:16.781619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.782119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.783349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.784112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.784589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.785030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.799508 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 HTTP/1.1 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6'} Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:16.801194 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9d231f98-19cc-4fc5-951d-c6064814f9d4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 404 len: 111 microversion: 2.1 time: 0.036544 Nov 02 14:43:16.806365 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2341/6642] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:16 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:43:16.823683 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:16.824391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:16.832111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.833443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.833888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.834589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.835043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.835505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.849966 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 HTTP/1.1 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6'} Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:43:16.851644 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73e62669-a615-450e-a0a1-b4d4180c48fa tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 404 len: 111 microversion: 2.1 time: 0.034827 Nov 02 14:43:16.857498 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4302/6643] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:16 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:43:16.904542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2039063468", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e"}], "security_groups": [{"name": "tempest-securitygroup--1326539966"}], "key_name": "tempest-keypair-2145718649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:17.011646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] validate_networks() for [('ce3fcd1b-fb6f-4445-b1db-02e2601a0f5e', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:43:17.403966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:43:17.404403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:43:17.404888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:43:17.405311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:43:17.405735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:43:17.414806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:17.415336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:17.415785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.416609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:17.417083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:17.417526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.434831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:43:17.440748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:43:17.453968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:43:17.456344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:43:17.502791 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c6db93f1-8eaa-4111-9696-0763ef55704d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.602762 Nov 02 14:43:17.503502 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2342/6644] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:43:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:43:17.514819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-133ce73f-9a0a-4894-bb71-eb85f0554b8c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:17.515576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-133ce73f-9a0a-4894-bb71-eb85f0554b8c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:17.573274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-133ce73f-9a0a-4894-bb71-eb85f0554b8c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:17.580320 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-133ce73f-9a0a-4894-bb71-eb85f0554b8c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1239 microversion: 2.1 time: 0.069341 Nov 02 14:43:17.580919 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4303/6645] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:17 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:18.606381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:18.607018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:18.615649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:18.616398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:18.616851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:18.617602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:18.618076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:18.618518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:18.702956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:18.711139 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f89f568-c65d-4073-b8cc-b505ce8aeb60 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1297 microversion: 2.1 time: 0.110939 Nov 02 14:43:18.711730 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2343/6646] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:18 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:19.736142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:19.736753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:19.745274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.745761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.746195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.746900 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.747366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.747789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.956738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:19.965254 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b061f20b-aa0a-455e-a9bc-184bd0a49249 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1365 microversion: 2.1 time: 0.233304 Nov 02 14:43:19.966793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4304/6647] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:19 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:19.995113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-804a4a0b-fc5d-44d1-914b-896aeac0c972 req-d943e0af-f753-4366-a8e9-8d63dfa27633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:20.011012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-804a4a0b-fc5d-44d1-914b-896aeac0c972 req-d943e0af-f753-4366-a8e9-8d63dfa27633 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.011547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-804a4a0b-fc5d-44d1-914b-896aeac0c972 req-d943e0af-f753-4366-a8e9-8d63dfa27633 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.012004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-804a4a0b-fc5d-44d1-914b-896aeac0c972 req-d943e0af-f753-4366-a8e9-8d63dfa27633 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.028419 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-804a4a0b-fc5d-44d1-914b-896aeac0c972 req-d943e0af-f753-4366-a8e9-8d63dfa27633 service nova] Creating event network-changed:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:43:20.033208 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-804a4a0b-fc5d-44d1-914b-896aeac0c972 req-d943e0af-f753-4366-a8e9-8d63dfa27633 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042451 Nov 02 14:43:20.033843 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2344/6648] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:20.991132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:20.991876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:20.999486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.999975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.000412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.001112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.001569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.001994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.139979 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:21.148154 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62b27ab0-f701-497b-9090-5ec6b4584368 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1365 microversion: 2.1 time: 0.161067 Nov 02 14:43:21.148735 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4305/6649] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:20 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:22.174784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:22.175516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:22.181672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:22.182784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:22.183260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:22.183958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:22.184414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:22.184848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:22.318948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:22.326766 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c51f76cc-fe6a-485b-ab70-7af0f9e74e7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1365 microversion: 2.1 time: 0.157130 Nov 02 14:43:22.327368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2345/6650] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:22 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:23.350794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:23.351434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:23.358560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.359045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.359499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.360184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.360639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.361058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.497076 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:23.504950 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-701dda84-3c27-4fd9-a268-7dcc275623f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1365 microversion: 2.1 time: 0.158106 Nov 02 14:43:23.505531 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4306/6651] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:23 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:24.364687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5134bd24-113b-4b05-88ab-2d5eb87c86ce req-d765e81f-f484-41fb-8e91-d94d673b0a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "name": "network-vif-plugged", "status": "completed", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:24.376261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5134bd24-113b-4b05-88ab-2d5eb87c86ce req-d765e81f-f484-41fb-8e91-d94d673b0a22 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.376846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5134bd24-113b-4b05-88ab-2d5eb87c86ce req-d765e81f-f484-41fb-8e91-d94d673b0a22 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.377298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5134bd24-113b-4b05-88ab-2d5eb87c86ce req-d765e81f-f484-41fb-8e91-d94d673b0a22 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.389926 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5134bd24-113b-4b05-88ab-2d5eb87c86ce req-d765e81f-f484-41fb-8e91-d94d673b0a22 service nova] Creating event network-vif-plugged:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:43:24.395628 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5134bd24-113b-4b05-88ab-2d5eb87c86ce req-d765e81f-f484-41fb-8e91-d94d673b0a22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034224 Nov 02 14:43:24.396232 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2346/6652] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:24.528931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:24.529496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:24.536939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.537443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.538146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.539225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.539982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.541095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.667919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:24.675511 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e25b515-d91a-4537-a652-1d8f84270047 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1365 microversion: 2.1 time: 0.151258 Nov 02 14:43:24.676199 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4307/6653] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:24 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:25.700872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:25.701504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:25.708713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.709218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.709650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.710346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.710809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.711277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.839991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:25.847825 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ffa5d35c-e201-468e-a082-462557bb11f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1552 microversion: 2.1 time: 0.151915 Nov 02 14:43:25.848404 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2347/6654] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:43:25 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:25.872583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:25.873133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:25.879902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.880376 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.880803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.881483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:25.881923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:25.882338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.962754 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df6a96ad-7d3f-48a8-af9f-6b7fb25e02f9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095666 Nov 02 14:43:25.963455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4308/6655] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:43:25 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:43:27.217799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b59dde1a-3531-4346-bd89-ff44b275f6c2 req-3f7ae379-21d9-4749-904d-a40f45ed3cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:27.228167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b59dde1a-3531-4346-bd89-ff44b275f6c2 req-3f7ae379-21d9-4749-904d-a40f45ed3cf5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:27.229332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b59dde1a-3531-4346-bd89-ff44b275f6c2 req-3f7ae379-21d9-4749-904d-a40f45ed3cf5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:27.229777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b59dde1a-3531-4346-bd89-ff44b275f6c2 req-3f7ae379-21d9-4749-904d-a40f45ed3cf5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:27.241909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b59dde1a-3531-4346-bd89-ff44b275f6c2 req-3f7ae379-21d9-4749-904d-a40f45ed3cf5 service nova] Creating event network-changed:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:43:27.247830 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b59dde1a-3531-4346-bd89-ff44b275f6c2 req-3f7ae379-21d9-4749-904d-a40f45ed3cf5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033621 Nov 02 14:43:27.248448 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2348/6656] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:01.700922 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.701802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=25 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.702563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=64 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.707688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:01.708293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:01.716030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.716547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.716925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:01.717627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.718089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.718504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:01.852255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:01.860578 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8077f17c-6259-4ee3-9318-d8a42e0815fb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1670 microversion: 2.1 time: 0.161614 Nov 02 14:44:01.861159 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4309/6657] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:01 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:01.880396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.881192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.883060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.883739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:01.888895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1abd38d-fade-42dd-bc04-f2ec97e4d343"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:01.891316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:01.901705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.902204 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.902650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:01.903382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:01.903847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:01.904280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:02.139840 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5e590898-1397-4d4d-819f-4712d3324a29 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260104 Nov 02 14:44:02.140541 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2349/6658] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:44:01 2022] POST /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:13.932329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:13.935388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:13.938065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:13.938724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:13.944247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:13.944734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:13.945166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:13.945856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:13.946308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:13.946726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:13.974808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:13.980931 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Old instance type m1.heat2, new instance type m1.heat {{(pid=137559) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:44:13.987883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:44:13.988301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:44:13.988772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:44:13.989179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:44:13.989585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:44:14.053400 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4faa1f7-6bef-4b04-86df-553c282c1d3a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/action" status: 202 len: 0 microversion: 2.1 time: 0.125172 Nov 02 14:44:14.054012 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4310/6659] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:44:13 2022] POST /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:14.060334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:14.061381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:14.066051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:14.066759 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:14.074873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:14.075564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:14.076144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:14.077071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:14.077657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:14.078095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:14.242934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:14.252128 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-06d19f39-6bbc-4f57-b42a-eb581ecb3ce2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1725 microversion: 2.1 time: 0.193665 Nov 02 14:44:14.252860 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2350/6660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:14 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:15.277410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:15.278535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:15.286525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:15.287068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:15.287537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:15.288340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:15.289013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:15.289513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:15.580276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:15.588706 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49a998ad-97b2-4cb2-8986-74ab3232aa40 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1725 microversion: 2.1 time: 0.316324 Nov 02 14:44:15.589302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4311/6661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:15 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:16.613873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:16.614488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:16.622084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:16.622566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:16.623009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:16.623722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:16.624184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:16.624614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:16.756528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:16.765120 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9afcf4fc-6046-4367-934b-1b9dd2dcbc89 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.155198 Nov 02 14:44:16.765694 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2351/6662] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:16 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:17.790155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:17.790155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:17.797179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:17.797660 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:17.798092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:17.798789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:17.799290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:17.799710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:17.936421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:17.944724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa9778c4-64f1-4797-abfc-8bd236731566 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.159714 Nov 02 14:44:17.945313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4312/6663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:17 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:18.972178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:18.972843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:18.980041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:18.980538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:18.980987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:18.981685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:18.982152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:18.982590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:19.113405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:19.121891 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3abdd379-dfd1-468a-81ed-3df9dea5658a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.153749 Nov 02 14:44:19.122463 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2352/6664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:18 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:20.145681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:20.146296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:20.153889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:20.154363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:20.154791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:20.155532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:20.155981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:20.156398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:20.285592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:20.294739 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c98dcb76-5eb0-4a74-a66a-c977f56713a6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.152943 Nov 02 14:44:20.295342 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4313/6665] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:20 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:21.319778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:21.320866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:21.327945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:21.328440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:21.328887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:21.329596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:21.330103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:21.330497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:21.469269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:21.477777 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dca036f9-91be-44c2-81e2-191923db1fea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.163623 Nov 02 14:44:21.478353 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2353/6666] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:21 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:22.502330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:22.502939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:22.509812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:22.510287 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:22.510718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:22.511437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:22.511883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:22.513031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:22.645182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:22.653476 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d4214ccb-dee0-4840-affb-e4bd739f726a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.155099 Nov 02 14:44:22.654047 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4314/6667] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:22 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:23.677886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:23.678453 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:23.685199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.685950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.686394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.687086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:23.687572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:23.688001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:23.816280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:23.825102 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8846c571-228c-44bf-977e-da4aef1b0016 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.150954 Nov 02 14:44:23.825688 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2354/6668] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:23 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:24.849632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:24.850246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:24.857274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:24.858260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:24.858720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:24.859464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:24.859920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:24.860345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:24.990461 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:24.999419 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-059cbbb9-1046-4897-858a-2a4ca5e12e15 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.153775 Nov 02 14:44:25.000003 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4315/6669] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:24 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:26.023110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:26.023767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:26.031284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.031771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.032212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.032905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.033363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.033794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.164801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:26.173834 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5cd9380e-e727-413a-b1b7-46f4659a3eea tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.154620 Nov 02 14:44:26.174406 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2355/6670] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:26 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:27.197534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:27.198174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:27.205536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:27.206016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:27.206449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:27.207160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:27.207646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:27.208067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:27.335333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:27.344176 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d286aa6d-8e19-4d79-aa49-728eb6029c7b tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.150494 Nov 02 14:44:27.344753 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4316/6671] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:27 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:28.368350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:28.368942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:28.375740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.376224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.376667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.377356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.377816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.378246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.509972 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:28.518480 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54fc5fef-3a81-4090-a2e6-818a72412933 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.154126 Nov 02 14:44:28.519052 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2356/6672] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:28 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:29.542631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:29.543272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:29.550613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.551108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.551565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.552244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.552692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.553117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.684142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:29.693294 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4104c1ab-4798-4b79-a565-ed9520575180 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.154575 Nov 02 14:44:29.693883 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4317/6673] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:29 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:30.717555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:30.718104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:30.724959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:30.725452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:30.725902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:30.726600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:30.727070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:30.727532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:30.900739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:30.909372 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-534921d2-0c89-46d6-832b-2323bf1fdb51 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.196303 Nov 02 14:44:30.909956 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2357/6674] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:30 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:31.934029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:31.934641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:31.942380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:31.942857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:31.943325 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:31.944013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:31.944462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:31.944883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:32.074702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:32.083112 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82a81e0e-c5a2-4ce6-8cb7-d767ea3a0dff tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.152940 Nov 02 14:44:32.083699 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4318/6675] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:31 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:33.106307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:33.106933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:33.113758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:33.114261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:33.114709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:33.116561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:33.117393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:33.117843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:33.260908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:33.270413 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a83aab58-16d5-4792-8c2b-8a69b978abe2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.167956 Nov 02 14:44:33.271004 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2358/6676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:33 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:34.293962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:34.294578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:34.303782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:34.304264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:34.304693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:34.305400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:34.305842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:34.306260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:34.439322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:34.447697 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6224d636-46a4-4afb-920f-2af4ea7100b8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1730 microversion: 2.1 time: 0.157778 Nov 02 14:44:34.448293 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4319/6677] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:34 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:35.428861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "name": "network-vif-unplugged", "status": "completed", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:35.440552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:35.441122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:35.441550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:35.453571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] Creating event network-vif-unplugged:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h2-858238-3 Nov 02 14:44:35.459041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:44:35.470881 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d5c56378-d86b-4174-8729-35266bb147b4 req-a20a5707-0ab6-454a-a330-aeeaadae0991 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045310 Nov 02 14:44:35.471840 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2359/6678] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:35.473451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:35.474079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:35.481467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:35.482773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:35.483231 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:35.483943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:35.484392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:35.484815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:35.625399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:35.634038 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7c7a9748-5bb0-412d-9e45-d775fac84ddb tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1729 microversion: 2.1 time: 0.166168 Nov 02 14:44:35.634841 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4320/6679] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:35 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:36.660130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:36.660987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:36.668562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:36.669135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:36.670280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:36.671118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:36.671677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:36.672183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:36.808945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:36.817897 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5a36e1b8-71c6-4504-9157-d89d80bb56d0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.163722 Nov 02 14:44:36.818575 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2360/6680] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:36 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:37.512072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:37.522426 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:37.522899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:37.523351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:37.535481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] Creating event network-changed:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h2-858238-3 Nov 02 14:44:37.540770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:44:37.553101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e4c59521-fdf9-44e7-b5be-b8a477086061 req-78f54fc2-f660-4125-a199-0fc1882ecbe2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044677 Nov 02 14:44:37.554375 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4321/6681] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:37.843676 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:37.845821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:37.856317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:37.857721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:37.858559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:37.859833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:37.860643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:37.861299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:38.110995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:38.122492 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e77ce20e-de41-42e0-9505-28f2db72d555 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.284310 Nov 02 14:44:38.124433 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2361/6682] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:37 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:39.148006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:39.148718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:39.157814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:39.158353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:39.158742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:39.159471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:39.159930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:39.160355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:39.308395 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:39.317896 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fb66234a-9200-42c2-8642-83648b866d76 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.174104 Nov 02 14:44:39.318490 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4322/6683] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:39 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:40.342419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:40.343037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:40.349600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:40.350085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:40.350525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:40.351245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:40.351707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:40.352138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:40.489735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:40.498872 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-10777904-30de-4ce5-8032-3447b91ce895 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.160961 Nov 02 14:44:40.499510 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2362/6684] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:40 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:41.522058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:41.522676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:41.530472 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:41.530955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:41.531440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:41.532128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:41.532587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:41.533006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:41.672220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:41.680748 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e7311b9-ba15-4916-9bd0-f6b096baa851 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.162699 Nov 02 14:44:41.681336 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4323/6685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:41 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:42.705064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:42.705606 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:42.712381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:42.712868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:42.713314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:42.714001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:42.714460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:42.714889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:42.842675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:42.851266 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4611989a-de64-4423-8158-28084277abc1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.150644 Nov 02 14:44:42.851848 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2363/6686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:42 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:43.876391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:43.876980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:43.883223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.883681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.884105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.884786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.885228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.885646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:44.023054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:44.025417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:44.034697 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55e7ab81-0c84-4e72-b93f-1975e4fdf841 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.163533 Nov 02 14:44:44.035346 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4324/6687] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:43 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:45.059010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:45.059667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:45.063313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=29 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:45.068768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.069261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.069711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.070414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.070878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.071338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.073928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=83 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:45.201585 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:45.209929 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fbf54eea-0aaf-4c88-b988-59d52cf80d62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.154893 Nov 02 14:44:45.210502 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2364/6688] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:45 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:46.234284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:46.234917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:46.237794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=35 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:46.244047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:46.244528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:46.244954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:46.245631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:46.246077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:46.246489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:46.375533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:46.384220 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1807eda-8e35-423a-a83e-f92b13484e5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.154410 Nov 02 14:44:46.384793 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4325/6689] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:46 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:47.408374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:47.409229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:47.415616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:47.416109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:47.416562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:47.417255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:47.417714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:47.418145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:47.553778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:47.563560 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-802bfedc-2058-49ee-8a50-70efca9b8fc9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.159740 Nov 02 14:44:47.564146 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2365/6690] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:47 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:48.587943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:48.588568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:48.595972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:48.596456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:48.596890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:48.597588 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:48.598046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:48.598468 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:48.736522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:48.745480 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fa791e71-69b5-4345-86e5-ed6d0da8c391 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1727 microversion: 2.1 time: 0.161544 Nov 02 14:44:48.746064 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4326/6691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:48 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:49.770209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:49.770866 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:49.777893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.778401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.778855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.779670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.780825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.781332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.926850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:49.935410 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-306cddf2-7527-46ea-80aa-0366b3dc37f0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1724 microversion: 2.1 time: 0.169234 Nov 02 14:44:49.936814 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2366/6692] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:49 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:49.959792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:49.960362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:49.967215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.967794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.968296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.968923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.969370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.969953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.011891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.011995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.012391 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.013110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.013553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.013971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.037614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:44:50.043261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Getting quotas for user 8ba00b6c0b514e909c23e0146cfa153f and project 5c3c12bf7c9745b1ac0e3aebad4348af. Resources: {'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:44:50.151395 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b9253d3b-230a-4eea-8a63-4baada5c0918 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "POST /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/action" status: 202 len: 0 microversion: 2.1 time: 0.195337 Nov 02 14:44:50.152310 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4327/6693] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:44:49 2022] POST /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:50.160611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:50.161745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:50.168098 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.168833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.169450 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.170333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.171722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.172404 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.303364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "name": "network-vif-plugged", "status": "completed", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:50.318826 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.319693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.320289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.325491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:50.334565 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4fb41ff9-70d1-4533-a8a7-3fe97a9c572f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.178140 Nov 02 14:44:50.334765 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] Creating event network-vif-plugged:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h2-858238-3 Nov 02 14:44:50.335177 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2367/6694] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:50 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:50.346088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:44:50.359039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c94f0ef5-7928-46bc-a2e6-00a730ec5e7f req-2034d5ea-d96a-4970-bcd2-95acd57759a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120223 Nov 02 14:44:50.359723 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4328/6695] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:51.361221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:51.361871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:51.369022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:51.369530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:51.369978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:51.370707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:51.371211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:51.371655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:51.511372 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:51.520581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8b1ba1c1-44cf-4a71-b365-38f3da43a7a0 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.163753 Nov 02 14:44:51.521175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2368/6696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:51 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:52.545653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:52.546578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:52.552988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:52.553476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:52.553912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:52.554619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:52.555077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:52.555530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:52.695659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:52.705107 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2100a893-826f-4676-b896-2f125fac66c1 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.164625 Nov 02 14:44:52.705712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4329/6697] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:52 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:53.730033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:53.730563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:53.737412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:53.737905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:53.738353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:53.739108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:53.739581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:53.740020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:53.873391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:53.883055 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e765c1ff-9816-4a0f-a620-5496e21b648c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.157028 Nov 02 14:44:53.883660 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2369/6698] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:53 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:54.907506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:54.908143 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:54.915942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.916412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.916840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.917529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.918031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.918415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:55.119551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:55.128416 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c51e932c-543f-48c1-b5a3-da267e170106 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.225730 Nov 02 14:44:55.129002 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4330/6699] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:54 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:55.768929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "name": "network-vif-unplugged", "status": "completed", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:55.778257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:55.778741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:55.779202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:55.792052 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] Creating event network-vif-unplugged:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:44:55.798117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:44:55.810167 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c8ad9fb7-11ad-4bd9-bc29-bdc905c338e7 req-eaf996da-df9b-4aca-a971-4ddb00770a54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097085 Nov 02 14:44:55.811718 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2370/6700] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:56.152872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:56.153494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:56.161377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.161872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.162340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:56.163041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.163525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.163945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:56.405633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:56.414943 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d3158361-55a3-4087-8a41-47c47af63c5d tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.265882 Nov 02 14:44:56.415577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4331/6701] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:56 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:57.438769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:57.439635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:57.446880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:57.447403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:57.447848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:57.448677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:57.449146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:57.449578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:57.605887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:57.616160 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d8e096b9-8016-4fb8-b902-dcca0d0a1e62 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.181879 Nov 02 14:44:57.617263 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2371/6702] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:57 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:57.828324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:57.838868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:57.839371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:57.839791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:57.852145 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] Creating event network-changed:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:44:57.857918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137559) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:44:57.869111 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-147e92b3-b14a-458c-add4-fed62d5bc441 req-dcce8614-6cf7-42f4-b5f1-6787bc43f357 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045144 Nov 02 14:44:57.869973 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4332/6703] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:58.642438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:58.643354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:58.650153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:58.650643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:58.651088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:58.651814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:58.652274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:58.652954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:58.789824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:58.798277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1fa2993a-7019-4390-8d41-d1c3123f542c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.160450 Nov 02 14:44:58.798855 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2372/6704] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:58 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:59.823088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:59.823911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:59.832107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:59.832696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:59.833133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:59.833847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:59.834295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:59.834719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:59.969047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:59.977602 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-82c404d3-a07e-40c8-a9e2-cd9dbc2e78b7 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.158828 Nov 02 14:44:59.978177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4333/6705] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:44:59 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:01.002265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:01.002977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:01.010004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:01.010497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:01.010941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:01.011710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:01.012184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:01.012622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:01.143795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:01.152120 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fdfaeb07-2a3d-4302-81e5-bebac593eddd tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.154284 Nov 02 14:45:01.152696 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2373/6706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:00 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:02.177122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:02.177726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:02.180129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:02.186437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:02.187497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:02.187936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:02.188647 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:02.189095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:02.189515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:02.336597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:02.345697 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a74a24e3-6717-4f1e-81fc-dc2bde4207e6 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.172600 Nov 02 14:45:02.346284 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4334/6707] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:02 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:03.424560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:03.425190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:03.432179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.432674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.433125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.433825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:03.434294 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:03.434732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:03.563619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:03.571960 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-80fa0225-61bc-40c0-add1-fcb8044a9e8f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.151376 Nov 02 14:45:03.572757 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2374/6708] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:03 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:04.596556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:04.597169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:04.603913 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:04.604385 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:04.604813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:04.605489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:04.605932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:04.606354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:04.739781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:04.748075 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df397ac5-fd20-466e-8adf-bb32f6341eb4 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.156137 Nov 02 14:45:04.748645 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4335/6709] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:04 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:05.772311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:05.772929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:05.780051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:05.781176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:05.781615 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:05.782308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:05.782768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:05.783232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:05.916956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:05.925800 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f104fcf6-2331-4f97-bc78-fcd6d2f391e8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.157285 Nov 02 14:45:05.926380 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2375/6710] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:05 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:06.950028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:06.950636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:06.958107 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:06.958518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:06.958947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:06.959661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:06.960110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:06.960533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:07.089752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:07.098156 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49c1f93f-1f1d-418f-aa36-b156f5666378 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.152049 Nov 02 14:45:07.098744 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4336/6711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:06 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:08.122380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:08.123002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:08.130191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:08.130662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:08.131114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:08.131835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:08.132297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:08.132731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:08.272509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:08.281508 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ccfd7bc-c7bb-4f13-ae80-e7fe8709dd82 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1723 microversion: 2.1 time: 0.162428 Nov 02 14:45:08.282079 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2376/6712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:08 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:09.305459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.306071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.313664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.314139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.314570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.315292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.315741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.316160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.448850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.457112 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85ce851d-3a2e-45b6-bd32-3d4463f84a58 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1716 microversion: 2.1 time: 0.155590 Nov 02 14:45:09.457733 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4337/6713] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:09 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:09.480346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.480996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.488146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.488637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.489080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.489767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.490228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.490657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.621839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.630542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47edf567-cc80-4bd0-ab2a-c6f3c1c48a6c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1716 microversion: 2.1 time: 0.153999 Nov 02 14:45:09.631127 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2377/6714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:09 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:09.653576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.654113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.660676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.661153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.661583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.662266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.662715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.663156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.792140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:09.800536 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4398d8ae-84cb-4965-908a-de0d3554621f tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1716 microversion: 2.1 time: 0.150853 Nov 02 14:45:09.801111 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4338/6715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:09 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:09.823544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.824096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.831354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.831869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.832381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.833058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.833523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.834021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.859452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:45:09.934735 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-95b8a4e1-0e0a-4cbe-9f37-d9df35b6c412 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 204 len: 0 microversion: 2.1 time: 0.114882 Nov 02 14:45:09.935278 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2378/6716] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:09 2022] DELETE /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:45:09.945277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:09.945883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:09.951867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.952990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.953418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.954109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:09.954548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:09.954967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:09.957502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:10.088938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:10.097309 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-85709a08-8fa0-411e-b64f-c0c5a21ae56a tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1722 microversion: 2.1 time: 0.156116 Nov 02 14:45:10.097890 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4339/6717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:09 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:10.880554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e85c3a6d-cd44-4329-ba40-bb5ae9d88207 req-254e1fb3-0dfd-47d0-ae21-8ba35277127e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "name": "network-vif-plugged", "status": "completed", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:10.890989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e85c3a6d-cd44-4329-ba40-bb5ae9d88207 req-254e1fb3-0dfd-47d0-ae21-8ba35277127e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:10.891597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e85c3a6d-cd44-4329-ba40-bb5ae9d88207 req-254e1fb3-0dfd-47d0-ae21-8ba35277127e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:10.892039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e85c3a6d-cd44-4329-ba40-bb5ae9d88207 req-254e1fb3-0dfd-47d0-ae21-8ba35277127e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:10.902610 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e85c3a6d-cd44-4329-ba40-bb5ae9d88207 req-254e1fb3-0dfd-47d0-ae21-8ba35277127e service nova] Creating event network-vif-plugged:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:45:10.908504 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e85c3a6d-cd44-4329-ba40-bb5ae9d88207 req-254e1fb3-0dfd-47d0-ae21-8ba35277127e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033014 Nov 02 14:45:10.909298 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2379/6718] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:11.121199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:11.121715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:11.128783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.129291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.129723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.130498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:11.131049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:11.131564 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:11.261443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:11.270554 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c6efcba9-d777-4455-80cc-ee464d034287 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1722 microversion: 2.1 time: 0.153407 Nov 02 14:45:11.271154 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4340/6719] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:11 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:12.295238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:12.296183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:12.302419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.302918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.303395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.304095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.304560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.304998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.307692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:12.389611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:12.398732 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ffa657c4-6931-4e1d-a505-b013bcaf6082 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1654 microversion: 2.1 time: 0.108542 Nov 02 14:45:12.399339 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2380/6720] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:12 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1654 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:12.427912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c040d297-bdae-4def-a093-4ca15baba60a req-6c36ab67-8daa-4c3d-b2a3-c0212681dec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded87b1-fec6-494d-b9d8-34020a33ba89", "name": "network-vif-deleted", "tag": "e4865717-1814-4406-bb52-8d38390f81ba"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:12.439230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c040d297-bdae-4def-a093-4ca15baba60a req-6c36ab67-8daa-4c3d-b2a3-c0212681dec1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:12.439971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c040d297-bdae-4def-a093-4ca15baba60a req-6c36ab67-8daa-4c3d-b2a3-c0212681dec1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:12.440558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c040d297-bdae-4def-a093-4ca15baba60a req-6c36ab67-8daa-4c3d-b2a3-c0212681dec1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:12.453215 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c040d297-bdae-4def-a093-4ca15baba60a req-6c36ab67-8daa-4c3d-b2a3-c0212681dec1 service nova] Creating event network-vif-deleted:e4865717-1814-4406-bb52-8d38390f81ba for instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 on n-h1-858238-3 Nov 02 14:45:12.458371 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c040d297-bdae-4def-a093-4ca15baba60a req-6c36ab67-8daa-4c3d-b2a3-c0212681dec1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Nov 02 14:45:12.459012 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4341/6721] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:13.422583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:13.423821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:13.431151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:13.431942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:13.432666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:13.433582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:13.434254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:13.434930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:13.503468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:13.513748 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1f3bf703-8d14-493e-8a73-fc757e4af2f5 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1370 microversion: 2.1 time: 0.095650 Nov 02 14:45:13.514622 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2381/6722] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:13 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:14.539257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:14.540145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:14.553236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.553763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.554196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.554902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:14.555545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:14.555965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:14.621092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:14.630557 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01ab7d3a-33a5-41d0-847a-cfe94a52d724 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1370 microversion: 2.1 time: 0.096983 Nov 02 14:45:14.631361 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4342/6723] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:14 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:15.654666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:15.655333 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:15.658276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:15.664276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:15.664775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:15.665222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:15.665998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:15.666373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:15.666808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:15.738220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ba00b6c0b514e909c23e0146cfa153f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c12bf7c9745b1ac0e3aebad4348af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:15.746592 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-312336fa-8021-413e-9b5f-3b9485a7a8fc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 200 len: 1370 microversion: 2.1 time: 0.095916 Nov 02 14:45:15.747180 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2382/6724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:15 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:16.771270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:16.771814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:16.774700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:16.780313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.780855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.781316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.782057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.782504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.782921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.797634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 HTTP/1.1 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8ded87b1-fec6-494d-b9d8-34020a33ba89'} Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:16.799288 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b17d9983-ae16-4b8d-9591-ef6d0f8e5ae2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 404 len: 111 microversion: 2.1 time: 0.033482 Nov 02 14:45:16.804118 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4343/6725] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:16 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:16.863077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:16.865308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:16.872034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.872524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.872965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.873655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:16.874656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:16.875089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:16.888127 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-volume_attachments HTTP/1.1 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': '8ded87b1-fec6-494d-b9d8-34020a33ba89'} Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:16.889986 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8c501997-a0b2-4c0c-8987-2942ba1c93f2 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032362 Nov 02 14:45:16.893835 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2383/6726] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:45:16 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.233755 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.234315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.241792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.242285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.242723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.243471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.243954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.244384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.260340 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 HTTP/1.1 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8ded87b1-fec6-494d-b9d8-34020a33ba89'} Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.261923 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b44aad81-e451-415d-af38-0af12deb75cc tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 404 len: 111 microversion: 2.1 time: 0.033608 Nov 02 14:45:20.267311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4344/6727] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:20 2022] DELETE /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.272778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.273409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 8ded87b1-fec6-494d-b9d8-34020a33ba89] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.281463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.281850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.282301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.283032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.283532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.283971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.298969 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 HTTP/1.1 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '8ded87b1-fec6-494d-b9d8-34020a33ba89'} Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.300754 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 8ded87b1-fec6-494d-b9d8-34020a33ba89 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.305418 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99442042-427a-42cc-ab62-9df03bc60801 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89" status: 404 len: 111 microversion: 2.1 time: 0.033516 Nov 02 14:45:20.306675 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2384/6728] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:20 2022] GET /compute/v2.1/servers/8ded87b1-fec6-494d-b9d8-34020a33ba89 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.311028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.311849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.318068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.319778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.319778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.319778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.320293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.320545 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.335707 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 HTTP/1.1 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6'} Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.337267 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.341810 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b9d8e50-5e51-43b4-829f-ac1397819cd8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 404 len: 111 microversion: 2.1 time: 0.031613 Nov 02 14:45:20.343392 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4345/6729] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:20 2022] DELETE /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.348104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.348733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.355250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.355748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.356202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.356905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.357374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.357813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.371697 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 HTTP/1.1 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6'} Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.373345 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cf1b6433-dbbd-4938-9e6d-5f76cf5921a8 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6" status: 404 len: 111 microversion: 2.1 time: 0.031107 Nov 02 14:45:20.381876 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2385/6730] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:20 2022] GET /compute/v2.1/servers/21e16ee3-dcd5-4e4f-9c40-0c0dbc2dc8b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.384101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.384781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.391656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.392142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.392579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.393280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.393739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.394166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.408875 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb HTTP/1.1 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '03649ef4-e9de-4264-b8fc-1403a8935cfb'} Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.410452 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ca91dae4-76c3-495a-ace2-d40bbe9426e9 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 404 len: 111 microversion: 2.1 time: 0.031781 Nov 02 14:45:20.417651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4346/6731] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:20 2022] DELETE /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.424006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.424727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: 03649ef4-e9de-4264-b8fc-1403a8935cfb] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.430923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.431539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.432060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.432829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.433497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.434004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.448644 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb HTTP/1.1 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '03649ef4-e9de-4264-b8fc-1403a8935cfb'} Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.450273 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance 03649ef4-e9de-4264-b8fc-1403a8935cfb could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-667f272d-9342-4e60-a8e3-b942d3ec3c34 tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb" status: 404 len: 111 microversion: 2.1 time: 0.032360 Nov 02 14:45:20.454946 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2386/6732] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:20 2022] GET /compute/v2.1/servers/03649ef4-e9de-4264-b8fc-1403a8935cfb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.461399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.461901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.468084 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.468573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.469013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.469719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.470182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.470614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.486471 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 HTTP/1.1 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'e336d5da-430d-4826-a16c-76e48f446fd7'} Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.488068 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-145e78c8-020e-468d-8133-345069106b0c tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 404 len: 111 microversion: 2.1 time: 0.032060 Nov 02 14:45:20.492372 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4347/6733] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:20 2022] DELETE /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:20.497953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.498579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [instance: e336d5da-430d-4826-a16c-76e48f446fd7] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:20.505183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.505680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.506130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.506838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:20.507332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:20.507774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:20.522146 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] HTTP exception thrown: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Request method failure captured: Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 HTTP/1.1 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoEjNMayboPXLaRHADT2bktAmRIJHA4e-OBFEXl4ALgFHGPibDklO7QenhgeMTiToJB1ffjeDd_NmeWRMvy7J-rgQFz3U8y48CSW3krav3wmGW_eYUkZbSWSb-02AtFSvdc6Q_0XL9gI7zpTmxFrYsKyF_ycv53qoPwUTYZYmC0-VYw Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c3c12bf7c9745b1ac0e3aebad4348af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c3c12bf7c9745b1ac0e3aebad4348af"}]}] Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5c3c12bf7c9745b1ac0e3aebad4348af Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServerActionsTestJSON-1183037087 Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8ba00b6c0b514e909c23e0146cfa153f Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServerActionsTestJSON-1183037087-project Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'e336d5da-430d-4826-a16c-76e48f446fd7'} Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:20.523794 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Returning 404 to user: Instance e336d5da-430d-4826-a16c-76e48f446fd7 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7014547a-9e37-4562-89cf-b8e3c958655e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7" status: 404 len: 111 microversion: 2.1 time: 0.031122 Nov 02 14:45:20.528250 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2387/6734] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:20 2022] GET /compute/v2.1/servers/e336d5da-430d-4826-a16c-76e48f446fd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:45:20.534211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8648942-f77c-4817-817e-675bbf44a09e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] Calling method '.version_select at 0x7f6f80a5c310>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:20.538571 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a8648942-f77c-4817-817e-675bbf44a09e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [f8b49862-da96-4bc6-9eda-0742dace212f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:45:21.546474 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [None req-a8648942-f77c-4817-817e-675bbf44a09e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] [f8b49862-da96-4bc6-9eda-0742dace212f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52036. Nov 02 14:45:21.567961 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8648942-f77c-4817-817e-675bbf44a09e tempest-ServerActionsTestJSON-1183037087 tempest-ServerActionsTestJSON-1183037087-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145718649" status: 202 len: 0 microversion: 2.1 time: 1.037698 Nov 02 14:45:21.568577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4348/6735] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 14:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145718649 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:45:30.973596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=11 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:30.974839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=27 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:31.107578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-921153884", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "56bebd05-8c1e-456c-be6d-f0ccbfacd2c0"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:31.165211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] validate_networks() for [('56bebd05-8c1e-456c-be6d-f0ccbfacd2c0', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:45:31.580061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:45:31.580493 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:45:31.580971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:45:31.581387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:45:31.581836 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:45:31.591268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:31.591762 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:31.592202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:31.593494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:31.594153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:31.594381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:31.612073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Getting quotas for project fdb8cdf175134eab8847003934fda3ae. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:45:31.617480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Getting quotas for user e17c67159ae44343b2cd28b2bbf8818d and project fdb8cdf175134eab8847003934fda3ae. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:45:31.631277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:45:31.633580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:45:31.678140 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [96757c04-6a6b-4154-9c82-1e2a55b50ed1] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:45:32.686580 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [96757c04-6a6b-4154-9c82-1e2a55b50ed1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52118. Nov 02 14:45:32.690607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a072dd8a-0348-4c9e-b971-5c7a258fe3a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723187 Nov 02 14:45:32.691296 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2388/6736] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:45:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:45:32.700678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=29 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:32.701442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:32.707212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61869473-7a89-46b1-b029-347557c6602b tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:32.707917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61869473-7a89-46b1-b029-347557c6602b tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:32.768485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-61869473-7a89-46b1-b029-347557c6602b tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:32.775952 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61869473-7a89-46b1-b029-347557c6602b tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1216 microversion: 2.1 time: 0.077193 Nov 02 14:45:32.779497 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4349/6737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:32 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:33.803389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:33.804065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:33.814321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:33.815202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:33.816030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:33.817026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:33.817768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:33.818953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:33.910782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:33.920347 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1e3da450-29dc-482c-a7c4-4f2412aa0e68 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1286 microversion: 2.1 time: 0.123486 Nov 02 14:45:33.935120 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2389/6738] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:33 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:34.946012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:34.946646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:34.955210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.955692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.956118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:34.956804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:34.957251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:34.957669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:35.101710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:35.110992 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-df4c4e9f-8645-45c3-86eb-75c15d99d2a6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.168988 Nov 02 14:45:35.112238 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4350/6739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:34 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:35.251690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-0b399690-225e-44c0-a2a1-89362d521281 req-34363bf1-0865-409e-8c88-94d530af5ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e68013-49d4-4d44-93fb-3a224a77e4f8", "tag": "cc99fbcf-fbe2-4ce6-ad18-41d33342f62d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:35.272883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0b399690-225e-44c0-a2a1-89362d521281 req-34363bf1-0865-409e-8c88-94d530af5ff4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:35.273689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0b399690-225e-44c0-a2a1-89362d521281 req-34363bf1-0865-409e-8c88-94d530af5ff4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:35.274300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0b399690-225e-44c0-a2a1-89362d521281 req-34363bf1-0865-409e-8c88-94d530af5ff4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:35.287866 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-0b399690-225e-44c0-a2a1-89362d521281 req-34363bf1-0865-409e-8c88-94d530af5ff4 service nova] Creating event network-changed:cc99fbcf-fbe2-4ce6-ad18-41d33342f62d for instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 on n-h2-858238-3 Nov 02 14:45:35.293041 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-0b399690-225e-44c0-a2a1-89362d521281 req-34363bf1-0865-409e-8c88-94d530af5ff4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049371 Nov 02 14:45:35.294050 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2390/6740] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:36.136392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:36.136980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:36.149729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:36.150620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:36.151442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:36.152684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:36.153518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:36.154307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:36.321793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:36.329835 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03d3530d-1d1d-4045-831a-b0d8ae9a40c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.197314 Nov 02 14:45:36.330436 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4351/6741] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:36 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:37.354055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:37.354683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:37.362175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:37.362665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:37.363121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:37.363823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:37.364284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:37.364715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:37.502272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:37.510136 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-47982891-e8be-4a12-94f5-d6a19c914871 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.160391 Nov 02 14:45:37.510724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2391/6742] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:37 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:38.532568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:38.533185 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:38.540087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:38.540573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:38.541009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:38.541699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:38.542155 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:38.542583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:38.670524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:38.678196 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ddf2cc99-ece7-4eae-9282-bc13d7b84c77 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.149532 Nov 02 14:45:38.678771 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4352/6743] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:38 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:39.702348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:39.703053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:39.709639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:39.710111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:39.710554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:39.711274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:39.711739 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:39.712170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:39.845711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:39.853616 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e1c30c31-e23d-44b1-a006-aec7ccf66b87 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.155696 Nov 02 14:45:39.854190 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2392/6744] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:39 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:40.877227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:40.877957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:40.885215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:40.885700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:40.886136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:40.886844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:40.887320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:40.887746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:41.026562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:41.035549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4725fdd-5e75-4a0c-8cb9-ce5caab7c0c8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.162640 Nov 02 14:45:41.036181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4353/6745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:40 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:42.059366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:42.060000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:42.063165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:42.063852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:42.065139 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:45:42.065291 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 14:45:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 (ip 10.222.0.18) !!! Nov 02 14:45:42.078510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:42.079002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:42.079471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:42.080180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:42.080640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:42.081073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:42.210639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:42.218332 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-210ea449-3bdd-444f-9618-043220b4a7c5 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.163222 Nov 02 14:45:42.218913 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2393/6746] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:42 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:42.429012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8340a2c7-73c9-42d3-8311-b14284463955 req-dd8d59ed-9cfb-4af4-8b64-ce7eedd23ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e68013-49d4-4d44-93fb-3a224a77e4f8", "name": "network-vif-plugged", "status": "completed", "tag": "cc99fbcf-fbe2-4ce6-ad18-41d33342f62d"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:42.441263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8340a2c7-73c9-42d3-8311-b14284463955 req-dd8d59ed-9cfb-4af4-8b64-ce7eedd23ba5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:42.441864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8340a2c7-73c9-42d3-8311-b14284463955 req-dd8d59ed-9cfb-4af4-8b64-ce7eedd23ba5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:42.442328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8340a2c7-73c9-42d3-8311-b14284463955 req-dd8d59ed-9cfb-4af4-8b64-ce7eedd23ba5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:42.453608 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8340a2c7-73c9-42d3-8311-b14284463955 req-dd8d59ed-9cfb-4af4-8b64-ce7eedd23ba5 service nova] Creating event network-vif-plugged:cc99fbcf-fbe2-4ce6-ad18-41d33342f62d for instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 on n-h2-858238-3 Nov 02 14:45:42.458623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8340a2c7-73c9-42d3-8311-b14284463955 req-dd8d59ed-9cfb-4af4-8b64-ce7eedd23ba5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033286 Nov 02 14:45:42.459330 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4354/6747] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:43.241772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:43.242465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:43.251279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:43.251794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:43.252255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:43.252961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:43.253496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:43.253937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:43.405630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:43.418064 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e9fda87-243e-473e-82e0-7ac8120aa733 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1316 microversion: 2.1 time: 0.179772 Nov 02 14:45:43.419440 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2394/6748] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:43 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:44.441362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:44.446890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:44.447629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:44.454191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:44.454671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:44.455126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:44.455834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:44.456288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:44.456712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:44.588903 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:44.597319 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-974a3f54-7087-4cbe-9ae7-05dfe0379c9f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.157009 Nov 02 14:45:44.597917 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4355/6749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:44 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:44.659425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-988507956", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "56bebd05-8c1e-456c-be6d-f0ccbfacd2c0"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:44.712856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] validate_networks() for [('56bebd05-8c1e-456c-be6d-f0ccbfacd2c0', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:45:45.074706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:45:45.075182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:45:45.075675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:45:45.076102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:45:45.076533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:45:45.085706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:45.086202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:45.086655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:45.087440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:45.087909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:45.088363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:45.105582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Getting quotas for project fdb8cdf175134eab8847003934fda3ae. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:45:45.111694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Getting quotas for user e17c67159ae44343b2cd28b2bbf8818d and project fdb8cdf175134eab8847003934fda3ae. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:45:45.124705 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:45:45.126976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:45:45.173232 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-941b8487-2140-4285-8cc2-61c0467ee5d6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517680 Nov 02 14:45:45.174115 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2395/6750] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:45:45.185189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0b70342e-c9bd-4c16-99de-f362071c5534 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:45.185840 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0b70342e-c9bd-4c16-99de-f362071c5534 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:45.243891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0b70342e-c9bd-4c16-99de-f362071c5534 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:45.251743 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0b70342e-c9bd-4c16-99de-f362071c5534 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1216 microversion: 2.1 time: 0.070515 Nov 02 14:45:45.252374 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4356/6751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:45 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:46.276407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:46.277667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:46.284166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:46.284746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:46.285309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:46.286024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:46.286494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:46.286957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:46.383696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:46.392050 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-48133f77-3bb7-4157-a8c2-0727f1baf732 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1274 microversion: 2.1 time: 0.120661 Nov 02 14:45:46.392632 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2396/6752] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:46 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:47.416919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:47.417639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:47.425828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:47.426315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:47.426753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:47.427517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:47.428031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:47.428497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:47.626096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-62249354-1e1b-43f2-a0b0-4f51227775e2 req-0b4226c7-656e-4256-b5fa-bc6f49a0a2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3657f5f6-4c1a-47d4-b956-1ac907f6ca3d", "tag": "96b8ef32-7e0b-422b-bb0d-7e99e8fc5bfa"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:47.637011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-62249354-1e1b-43f2-a0b0-4f51227775e2 req-0b4226c7-656e-4256-b5fa-bc6f49a0a2cf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:47.637510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-62249354-1e1b-43f2-a0b0-4f51227775e2 req-0b4226c7-656e-4256-b5fa-bc6f49a0a2cf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:47.637957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-62249354-1e1b-43f2-a0b0-4f51227775e2 req-0b4226c7-656e-4256-b5fa-bc6f49a0a2cf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:47.650668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-62249354-1e1b-43f2-a0b0-4f51227775e2 req-0b4226c7-656e-4256-b5fa-bc6f49a0a2cf service nova] Creating event network-changed:96b8ef32-7e0b-422b-bb0d-7e99e8fc5bfa for instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d on n-h1-858238-3 Nov 02 14:45:47.653403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:47.657200 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-62249354-1e1b-43f2-a0b0-4f51227775e2 req-0b4226c7-656e-4256-b5fa-bc6f49a0a2cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035054 Nov 02 14:45:47.657721 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2397/6753] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:47.664520 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-573c6c58-bb82-4510-97cd-e2e1bee8056a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1316 microversion: 2.1 time: 0.251394 Nov 02 14:45:47.671478 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4357/6754] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:47 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:48.689818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:48.690445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:48.696709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:48.697202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:48.697655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:48.698347 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:48.698813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:48.699285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:48.870253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:48.878295 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7dde31ec-a3c5-4303-a3bd-7f6b80d5687f tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1316 microversion: 2.1 time: 0.194438 Nov 02 14:45:48.878876 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2398/6755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:48 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:49.901590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:49.902204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:49.912580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:49.913059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:49.913600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:49.914317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:49.914774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:49.915302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:50.064236 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:50.072173 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38437dc9-fd71-45fd-a825-b443a7980c44 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1316 microversion: 2.1 time: 0.174453 Nov 02 14:45:50.072751 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4358/6756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:49 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:51.096580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:51.097616 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:51.105216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:51.105722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:51.106183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:51.106973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:51.107477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:51.107956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:51.250179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:51.258116 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-54127118-a242-4457-a5f0-8f2ae4660551 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1316 microversion: 2.1 time: 0.166822 Nov 02 14:45:51.258698 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2399/6757] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:51 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:52.282484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:52.283153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:52.290061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:52.290542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:52.290976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:52.291704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:52.292165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:52.292593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:52.426173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:52.434060 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-084296d8-1945-4dd2-a524-07b61414655d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1316 microversion: 2.1 time: 0.156035 Nov 02 14:45:52.435197 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4359/6758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:52 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:53.067475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2d2acef2-5a20-4b15-ad27-3a9f9d582948 req-6204f623-987c-4d23-8eee-f80d323bfa85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3657f5f6-4c1a-47d4-b956-1ac907f6ca3d", "name": "network-vif-plugged", "status": "completed", "tag": "96b8ef32-7e0b-422b-bb0d-7e99e8fc5bfa"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:53.078959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2d2acef2-5a20-4b15-ad27-3a9f9d582948 req-6204f623-987c-4d23-8eee-f80d323bfa85 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:53.079609 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2d2acef2-5a20-4b15-ad27-3a9f9d582948 req-6204f623-987c-4d23-8eee-f80d323bfa85 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:53.080308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2d2acef2-5a20-4b15-ad27-3a9f9d582948 req-6204f623-987c-4d23-8eee-f80d323bfa85 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:53.091789 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2d2acef2-5a20-4b15-ad27-3a9f9d582948 req-6204f623-987c-4d23-8eee-f80d323bfa85 service nova] Creating event network-vif-plugged:96b8ef32-7e0b-422b-bb0d-7e99e8fc5bfa for instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d on n-h1-858238-3 Nov 02 14:45:53.097586 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2d2acef2-5a20-4b15-ad27-3a9f9d582948 req-6204f623-987c-4d23-8eee-f80d323bfa85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Nov 02 14:45:53.098191 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2400/6759] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:53.458621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:53.459204 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:53.466042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:53.466523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:53.466954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:53.467693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:53.468147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:53.468568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:53.602273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:53.610682 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8a0dc41f-5e94-4776-977f-05d41dbd6685 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1316 microversion: 2.1 time: 0.156020 Nov 02 14:45:53.611287 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4360/6760] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:53 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:54.634540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:54.635315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:54.643140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:54.643805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:54.644457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:54.645469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:54.646129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:54.646758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:54.792365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:54.800940 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-423aa54d-43af-405d-bceb-9edb21a95b31 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1504 microversion: 2.1 time: 0.171348 Nov 02 14:45:54.801557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2401/6761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:54 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:54.824467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:54.825032 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:54.832478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:54.832977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:54.833401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:54.834079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:54.834523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:54.834939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:54.860881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:45:54.937576 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8ad0905-b61e-4f9b-9165-6c400b26eac3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 204 len: 0 microversion: 2.1 time: 0.116694 Nov 02 14:45:54.938377 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4361/6762] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:54 2022] DELETE /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:45:54.947042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:54.947643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:54.954539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:54.955054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:54.955525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:54.956236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:54.956708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:54.957165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:55.096940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:55.099381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:55.106275 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5694edd0-ca38-4d6d-9d12-f9784fb2074a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1510 microversion: 2.1 time: 0.163212 Nov 02 14:45:55.106860 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2402/6763] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:54 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:56.130718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:56.131363 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:56.133318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:56.143025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:56.143535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:56.143971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:56.144667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:56.145148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:56.145568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:56.305555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:56.314181 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ea10ef9c-d0d7-4f87-a194-480fe29f03bf tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 200 len: 1510 microversion: 2.1 time: 0.187761 Nov 02 14:45:56.314790 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4362/6764] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:56 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:56.760813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2732fac8-d555-4773-9933-018a9fcedd25 req-c35d8ab8-fb4d-4680-bd7a-cfeec6d34e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3657f5f6-4c1a-47d4-b956-1ac907f6ca3d", "name": "network-vif-deleted", "tag": "96b8ef32-7e0b-422b-bb0d-7e99e8fc5bfa"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:56.768839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:56.775999 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2732fac8-d555-4773-9933-018a9fcedd25 req-c35d8ab8-fb4d-4680-bd7a-cfeec6d34e33 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:56.777370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2732fac8-d555-4773-9933-018a9fcedd25 req-c35d8ab8-fb4d-4680-bd7a-cfeec6d34e33 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:56.778176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2732fac8-d555-4773-9933-018a9fcedd25 req-c35d8ab8-fb4d-4680-bd7a-cfeec6d34e33 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:56.792005 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2732fac8-d555-4773-9933-018a9fcedd25 req-c35d8ab8-fb4d-4680-bd7a-cfeec6d34e33 service nova] Creating event network-vif-deleted:96b8ef32-7e0b-422b-bb0d-7e99e8fc5bfa for instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d on n-h1-858238-3 Nov 02 14:45:56.799497 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2732fac8-d555-4773-9933-018a9fcedd25 req-c35d8ab8-fb4d-4680-bd7a-cfeec6d34e33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046033 Nov 02 14:45:56.800436 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2403/6765] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:45:57.337894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:57.338503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:57.346172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.346648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.347077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.347794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.348247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.348672 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.362841 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] HTTP exception thrown: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d HTTP/1.1 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3657f5f6-4c1a-47d4-b956-1ac907f6ca3d'} Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:57.364542 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 404 to user: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6ffd024e-854e-4cec-ab55-80b15f1f0a57 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 404 len: 111 microversion: 2.1 time: 0.032015 Nov 02 14:45:57.369432 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4363/6766] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:57 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:57.376349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:57.377074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:57.383684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.384182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.384652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.385337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.385811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.386254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.574441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:57.582848 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d962c9b9-6ac5-41bb-a5a6-b9aed2ef0352 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.211123 Nov 02 14:45:57.583537 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2404/6767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:57 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:57.606920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cedd69b-0f76-4770-bfd2-c36b1e9d2739 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:57.609789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6cedd69b-0f76-4770-bfd2-c36b1e9d2739 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 8bc560ec-25be-412d-a8ca-aab1a0551170] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:57.615351 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6cedd69b-0f76-4770-bfd2-c36b1e9d2739 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] HTTP exception thrown: Instance 8bc560ec-25be-412d-a8ca-aab1a0551170 could not be found. Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cedd69b-0f76-4770-bfd2-c36b1e9d2739 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/8bc560ec-25be-412d-a8ca-aab1a0551170/action HTTP/1.1 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 32 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: {"resize": {"flavorRef": "452"}} Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 8bc560ec-25be-412d-a8ca-aab1a0551170 could not be found. Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '8bc560ec-25be-412d-a8ca-aab1a0551170', 'body': {'resize': {'flavorRef': '452'}}} Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc560ec-25be-412d-a8ca-aab1a0551170 could not be found. Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:57.616891 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc560ec-25be-412d-a8ca-aab1a0551170 could not be found. Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc560ec-25be-412d-a8ca-aab1a0551170 could not be found. Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cedd69b-0f76-4770-bfd2-c36b1e9d2739 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 404 to user: Instance 8bc560ec-25be-412d-a8ca-aab1a0551170 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6cedd69b-0f76-4770-bfd2-c36b1e9d2739 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "POST /compute/v2.1/servers/8bc560ec-25be-412d-a8ca-aab1a0551170/action" status: 404 len: 111 microversion: 2.1 time: 0.015337 Nov 02 14:45:57.621362 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4364/6768] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:45:57 2022] POST /compute/v2.1/servers/8bc560ec-25be-412d-a8ca-aab1a0551170/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:57.627623 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:57.628249 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:57.634170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.634662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.635133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.635835 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.636304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.636742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.771553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:57.780832 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-438cbe1e-52f5-4452-9720-2e1175fb6bf3 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.157649 Nov 02 14:45:57.781474 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2405/6769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:57 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:57.807746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:57.808359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:57.816741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.817224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.817662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.818366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:57.818818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:57.819300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:57.960914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:57.972233 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cd066bea-11f8-4335-a960-df6f22ea6fc9 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.168298 Nov 02 14:45:57.972740 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4365/6770] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:57 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:57.995002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "066ff309-35d7-4c36-ac86-fd51e12e5be0"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:57.997269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.004054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.004565 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.005021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.005768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.006240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.006683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.038060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:58.042885 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] HTTP exception thrown: Flavor 066ff309-35d7-4c36-ac86-fd51e12e5be0 could not be found. Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: request: POST /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8/action HTTP/1.1 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 65 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: {"resize": {"flavorRef": "066ff309-35d7-4c36-ac86-fd51e12e5be0"}} Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: exception: Flavor 066ff309-35d7-4c36-ac86-fd51e12e5be0 could not be found. Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '36e68013-49d4-4d44-93fb-3a224a77e4f8', 'body': {'resize': {'flavorRef': '066ff309-35d7-4c36-ac86-fd51e12e5be0'}}} Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:58.054214 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 066ff309-35d7-4c36-ac86-fd51e12e5be0 could not be found. Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 066ff309-35d7-4c36-ac86-fd51e12e5be0 could not be found. Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 066ff309-35d7-4c36-ac86-fd51e12e5be0 could not be found. Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 400 to user: Flavor 066ff309-35d7-4c36-ac86-fd51e12e5be0 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-41f6179f-73cd-48f3-855f-96420302e1f6 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "POST /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8/action" status: 400 len: 107 microversion: 2.1 time: 0.064849 Nov 02 14:45:58.059542 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2406/6771] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:45:57 2022] POST /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:45:58.066166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.066785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.074283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.074770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.075246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.075942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.076435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.077451 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.206381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:58.214324 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a64a44ef-bb36-4f75-bf76-8a45b90e4fd2 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.153514 Nov 02 14:45:58.214891 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4366/6772] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:58 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:58.238348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.238875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.244760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.245242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.245681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.246380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.246843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.247304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.382859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:58.391772 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-74ce09a3-4e43-4e0d-9ffc-169e360f814d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.157315 Nov 02 14:45:58.392345 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2407/6773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:58 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:45:58.419625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5eddec4-1783-42fa-b306-934636ca161d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5eddec4-1783-42fa-b306-934636ca161d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: request: POST /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8/action HTTP/1.1 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 29 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: {"resize": {"flavorRef": ""}} Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '36e68013-49d4-4d44-93fb-3a224a77e4f8', 'body': {'resize': {'flavorRef': ''}}} Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi '' Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.422849 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5eddec4-1783-42fa-b306-934636ca161d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5eddec4-1783-42fa-b306-934636ca161d tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "POST /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8/action" status: 400 len: 113 microversion: 2.1 time: 0.009719 Nov 02 14:45:58.427278 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4367/6774] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:45:58 2022] POST /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:45:58.432823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.433444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.439731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.440330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.440774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.441471 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.441930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.442363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.571271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:58.574809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=100 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:58.580662 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4f71fd10-7291-42f4-b757-96ee8745eb86 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1504 microversion: 2.1 time: 0.151639 Nov 02 14:45:58.581239 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2408/6775] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:58 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:58.606925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.607443 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.614506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.614977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.615436 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.616119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.616567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.616984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.630596 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] HTTP exception thrown: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d HTTP/1.1 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '3657f5f6-4c1a-47d4-b956-1ac907f6ca3d'} Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:58.632169 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 404 to user: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ac1010b-57ce-46f4-85c5-ec84d19df9b8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 404 len: 111 microversion: 2.1 time: 0.030390 Nov 02 14:45:58.636384 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4368/6776] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:58 2022] DELETE /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:58.643048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.643703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.649783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.650256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.650704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.651494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.651961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.652395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.666167 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] HTTP exception thrown: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d HTTP/1.1 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '3657f5f6-4c1a-47d4-b956-1ac907f6ca3d'} Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:45:58.667721 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 404 to user: Instance 3657f5f6-4c1a-47d4-b956-1ac907f6ca3d could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-de028583-7b78-43cc-bef9-361802c09da1 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d" status: 404 len: 111 microversion: 2.1 time: 0.030559 Nov 02 14:45:58.671923 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2409/6777] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:58 2022] GET /compute/v2.1/servers/3657f5f6-4c1a-47d4-b956-1ac907f6ca3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:45:58.677544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.678039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.684055 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.684538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.684964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.685646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.686853 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.687572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.713068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:45:58.715793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:58.789173 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-41e63d9a-386d-4df7-a347-86695201d02a tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "DELETE /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 204 len: 0 microversion: 2.1 time: 0.115011 Nov 02 14:45:58.789682 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4369/6778] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:45:58 2022] DELETE /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:45:58.798260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:58.799269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:58.805811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.806314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.806763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.807509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:58.807980 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:58.808421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:58.952088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:45:58.960033 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3549055e-0b7e-495b-b116-f058505e9537 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1510 microversion: 2.1 time: 0.166011 Nov 02 14:45:58.960610 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2410/6779] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:58 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:59.984099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:45:59.984802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:59.991836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:59.992273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:59.992704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:59.993400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:59.993847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:59.994267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:00.146115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:00.153920 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a16b0808-a4a0-42e0-9960-59560690e4e8 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1510 microversion: 2.1 time: 0.174536 Nov 02 14:46:00.155026 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4370/6780] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:45:59 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:00.749932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-270f4215-583e-4d04-9904-7a3e693151bb req-25b2e6ae-b8c8-47e6-95dd-db4eef4c3b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e68013-49d4-4d44-93fb-3a224a77e4f8", "name": "network-vif-deleted", "tag": "cc99fbcf-fbe2-4ce6-ad18-41d33342f62d"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:00.767721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-270f4215-583e-4d04-9904-7a3e693151bb req-25b2e6ae-b8c8-47e6-95dd-db4eef4c3b98 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:00.768652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-270f4215-583e-4d04-9904-7a3e693151bb req-25b2e6ae-b8c8-47e6-95dd-db4eef4c3b98 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:00.769237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-270f4215-583e-4d04-9904-7a3e693151bb req-25b2e6ae-b8c8-47e6-95dd-db4eef4c3b98 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:00.794683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-270f4215-583e-4d04-9904-7a3e693151bb req-25b2e6ae-b8c8-47e6-95dd-db4eef4c3b98 service nova] Creating event network-vif-deleted:cc99fbcf-fbe2-4ce6-ad18-41d33342f62d for instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 on n-h2-858238-3 Nov 02 14:46:00.799502 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-270f4215-583e-4d04-9904-7a3e693151bb req-25b2e6ae-b8c8-47e6-95dd-db4eef4c3b98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140043 Nov 02 14:46:00.800120 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2411/6781] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:01.178224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:01.178835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:01.186976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:01.187478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:01.187904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:01.188592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:01.189037 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:01.189460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:01.225607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:01.226085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:01.226514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:01.226961 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lazy-loading 'fault' on Instance uuid 36e68013-49d4-4d44-93fb-3a224a77e4f8 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:46:01.269114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17c67159ae44343b2cd28b2bbf8818d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb8cdf175134eab8847003934fda3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:01.276300 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-49b27d6c-1657-4dae-938e-642fb1ccafe7 tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 200 len: 1306 microversion: 2.1 time: 0.101983 Nov 02 14:46:01.276870 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4371/6782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:01 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:02.301400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:02.302029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] [instance: 36e68013-49d4-4d44-93fb-3a224a77e4f8] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:02.304013 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:02.309735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:02.310222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:02.310664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:02.311390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:02.312108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:02.312545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:02.327714 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] HTTP exception thrown: Instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 could not be found. Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Request method failure captured: Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 HTTP/1.1 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoKKm4o9NJvn4G7O7D7Ifx92chxwkCIHFAGoBpSqw3RHUDr3xPkyXb0R_eoYUt47qqZhV_FUnxvD7KFiIXvyoCNG6OZd3WCAjBPTog99OyaLEA3ZOusbRBifD-ncUW7YnmonhKZdINoLbGkob1EiJQYkLyg91PUpfWpMumeBBz-Ol7Q Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fdb8cdf175134eab8847003934fda3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fdb8cdf175134eab8847003934fda3ae"}]}] Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: fdb8cdf175134eab8847003934fda3ae Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2115747339 Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: e17c67159ae44343b2cd28b2bbf8818d Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-ServersNegativeTestJSON-2115747339-project Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 could not be found. Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '36e68013-49d4-4d44-93fb-3a224a77e4f8'} Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 could not be found. Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 could not be found. Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:46:02.329370 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 could not be found. Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] Returning 404 to user: Instance 36e68013-49d4-4d44-93fb-3a224a77e4f8 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-83cf5f78-e87a-4d3b-8042-aafbfbccfc9c tempest-ServersNegativeTestJSON-2115747339 tempest-ServersNegativeTestJSON-2115747339-project] 10.222.0.18 "GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8" status: 404 len: 111 microversion: 2.1 time: 0.034598 Nov 02 14:46:02.334211 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2412/6783] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:02 2022] GET /compute/v2.1/servers/36e68013-49d4-4d44-93fb-3a224a77e4f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:46:35.103423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:35.104746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:35.277893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1b4d10b7-6a9b-4724-bf16-535b22d78026 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: .version_select at 0x7f6f8224e550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-783571334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN99lXkKcrObUUgd8k4sAZxpgW0SHjzrpRWSeZaS5sMjY3KjLKtqwB8+odOZVZJaq7H+l71SGUx2GUbKM1aIRMy/uG6w9OWUzuZQlzXK73OfOT4PTFOeD2zo25Tk6RbJw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:35.295919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1b4d10b7-6a9b-4724-bf16-535b22d78026 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for project ebe43fd027c64c1abc93ef94397eb207. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:46:35.301193 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-1b4d10b7-6a9b-4724-bf16-535b22d78026 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for user 2cf51523283f4cb4b2d64cf9dc384822 and project ebe43fd027c64c1abc93ef94397eb207. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:46:35.329124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1b4d10b7-6a9b-4724-bf16-535b22d78026 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.231088 Nov 02 14:46:35.329812 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4372/6784] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:46:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:35.382254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1932295583", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-783571334", "networks": [{"uuid": "39f53bd0-f14b-44df-9554-2e40669c6183"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:35.392012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=12 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:35.392891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:35.443622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] validate_networks() for [('39f53bd0-f14b-44df-9554-2e40669c6183', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:46:35.917524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:46:35.917995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:46:35.918483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:46:35.918907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:46:35.919422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:46:35.928339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:35.928833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:35.929285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:35.930019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:35.930480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:35.930916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:35.947725 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for project ebe43fd027c64c1abc93ef94397eb207. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:46:35.953600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for user 2cf51523283f4cb4b2d64cf9dc384822 and project ebe43fd027c64c1abc93ef94397eb207. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:46:35.966160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:46:35.969084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:46:36.015334 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e848df92-66a0-4bd0-9557-573954e4c8a0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637127 Nov 02 14:46:36.016308 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2413/6785] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:46:36.027466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45faabda-f44e-4052-823c-10369eab4d50 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:36.028087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45faabda-f44e-4052-823c-10369eab4d50 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:36.097291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-45faabda-f44e-4052-823c-10369eab4d50 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:36.105525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45faabda-f44e-4052-823c-10369eab4d50 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1262 microversion: 2.1 time: 0.081931 Nov 02 14:46:36.124259 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4373/6786] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:36 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:37.131122 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:37.132416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:37.140288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:37.141161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:37.141777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:37.142663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:37.143426 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:37.144014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:37.236499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:37.246341 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c216f287-60df-41bf-9f8b-1cabf595553d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1322 microversion: 2.1 time: 0.120827 Nov 02 14:46:37.247175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2414/6787] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:37 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:38.270414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:38.272016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:38.281671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:38.282779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:38.283481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:38.284440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:38.285109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:38.285906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:38.581613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:38.600499 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f074c557-b628-40f6-8eeb-9d69a7609f92 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1362 microversion: 2.1 time: 0.324692 Nov 02 14:46:38.602335 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4374/6788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:38 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:38.751415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8e0e5393-4ae3-4743-b1d8-bb5579cc2a0c req-ab1a089e-8b5e-4b32-a469-6fb7bf3450c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a5f28f-23d1-4e24-9ff6-84cea75fe249", "tag": "ca0a6eea-36f1-4791-a5dc-9706b9295ffd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:38.762451 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8e0e5393-4ae3-4743-b1d8-bb5579cc2a0c req-ab1a089e-8b5e-4b32-a469-6fb7bf3450c0 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:38.763647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8e0e5393-4ae3-4743-b1d8-bb5579cc2a0c req-ab1a089e-8b5e-4b32-a469-6fb7bf3450c0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:38.764171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8e0e5393-4ae3-4743-b1d8-bb5579cc2a0c req-ab1a089e-8b5e-4b32-a469-6fb7bf3450c0 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:38.778880 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8e0e5393-4ae3-4743-b1d8-bb5579cc2a0c req-ab1a089e-8b5e-4b32-a469-6fb7bf3450c0 service nova] Creating event network-changed:ca0a6eea-36f1-4791-a5dc-9706b9295ffd for instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 on n-h1-858238-3 Nov 02 14:46:38.786250 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8e0e5393-4ae3-4743-b1d8-bb5579cc2a0c req-ab1a089e-8b5e-4b32-a469-6fb7bf3450c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039637 Nov 02 14:46:38.787780 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2415/6789] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:39.625537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:39.626151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:39.633288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:39.633771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:39.634208 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:39.634909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:39.635406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:39.635834 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:40.100312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:40.108303 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1373444e-6cc5-4022-b3c7-c9594fd1a4fd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1362 microversion: 2.1 time: 0.487299 Nov 02 14:46:40.110920 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4375/6790] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:39 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:41.134345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:41.135110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:41.141484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:41.142014 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:41.142463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:41.143399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:41.143868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:41.144310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:41.277886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:41.286571 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-16001eba-e2ff-4e35-9e63-262490adbcde tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1362 microversion: 2.1 time: 0.158304 Nov 02 14:46:41.287470 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2416/6791] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:41 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:42.309831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:42.310888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:42.318020 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:42.318496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:42.318923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:42.319641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:42.320086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:42.320502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:42.453836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:42.461551 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48380787-9931-4369-95f5-81cf415114eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1362 microversion: 2.1 time: 0.155684 Nov 02 14:46:42.462122 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4376/6792] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:42 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:43.279482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-cd2c2d4e-e5a3-4442-bc7c-4435be4cbd00 req-2fe06312-56f6-4c6d-a550-e1280845cfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a5f28f-23d1-4e24-9ff6-84cea75fe249", "name": "network-vif-plugged", "status": "completed", "tag": "ca0a6eea-36f1-4791-a5dc-9706b9295ffd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:43.300908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cd2c2d4e-e5a3-4442-bc7c-4435be4cbd00 req-2fe06312-56f6-4c6d-a550-e1280845cfbf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:43.301411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cd2c2d4e-e5a3-4442-bc7c-4435be4cbd00 req-2fe06312-56f6-4c6d-a550-e1280845cfbf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:43.301855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-cd2c2d4e-e5a3-4442-bc7c-4435be4cbd00 req-2fe06312-56f6-4c6d-a550-e1280845cfbf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:43.316221 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-cd2c2d4e-e5a3-4442-bc7c-4435be4cbd00 req-2fe06312-56f6-4c6d-a550-e1280845cfbf service nova] Creating event network-vif-plugged:ca0a6eea-36f1-4791-a5dc-9706b9295ffd for instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 on n-h1-858238-3 Nov 02 14:46:43.321376 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-cd2c2d4e-e5a3-4442-bc7c-4435be4cbd00 req-2fe06312-56f6-4c6d-a550-e1280845cfbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045558 Nov 02 14:46:43.321992 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2417/6793] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:43.484643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:43.485301 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:43.492035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:43.492551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:43.492983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:43.493691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:43.494149 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:43.494574 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:43.628407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:43.636103 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b7ebdfc8-a9a7-4987-b043-2059589f5ff6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1362 microversion: 2.1 time: 0.155555 Nov 02 14:46:43.636679 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4377/6794] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:43 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:44.661061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:44.661979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:44.670973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:44.671830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:44.672639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:44.673929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:44.674919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:44.675724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:44.838114 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:44.846181 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c375b18a-ce0e-4e1a-829c-7ddab3e3bdda tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1362 microversion: 2.1 time: 0.190150 Nov 02 14:46:44.846750 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2418/6795] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:44 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:45.869857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:45.870463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:45.877729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:45.878200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:45.878627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:45.879335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:45.879778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:45.880194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:46.012760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:46.021184 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-972abd5c-9560-4466-ae16-7f7fe17b0e63 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1553 microversion: 2.1 time: 0.155196 Nov 02 14:46:46.021759 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4378/6796] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:45 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:46.043940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:46.044566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:46.047400 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:46.048212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:46.053718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:46.054211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:46.054662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:46.055393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:46.055863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:46.056300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:46.193664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:46.201473 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50327965-2689-4868-b1d9-47e159733d65 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1553 microversion: 2.1 time: 0.161480 Nov 02 14:46:46.202056 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2419/6797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:46:46 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:47.882954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af6bed19-526c-49ff-954f-f8149bbe3fb0"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:47.885464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:47.887676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:47.894326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:47.894799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:47.895264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:47.895947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:47.896392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:47.896810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:48.140669 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e5179670-5259-478f-a8a4-dade4b79e7b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261340 Nov 02 14:46:48.141314 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4379/6798] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:46:47 2022] POST /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:58.856974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:58.857589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:58.860008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:58.860789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=30 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:58.866630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:58.867149 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:58.867603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:58.868310 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:58.868780 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:58.869224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:58.949642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lazy-loading 'services' on Instance uuid 01a5f28f-23d1-4e24-9ff6-84cea75fe249 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:46:59.022118 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5546e4ae-77f0-42c3-94ea-2ac69f39ffe8 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments/af6bed19-526c-49ff-954f-f8149bbe3fb0" status: 202 len: 0 microversion: 2.1 time: 0.169100 Nov 02 14:46:59.022787 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2420/6799] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:46:58 2022] DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments/af6bed19-526c-49ff-954f-f8149bbe3fb0 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:46:59.029135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:59.030543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:59.034729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:59.037165 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:59.045047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:59.045526 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:59.045966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:59.046662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:59.047135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:59.047569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:59.080740 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-dd58c593-d21a-40c0-ac69-5845d1613b81 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053432 Nov 02 14:46:59.081313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4380/6800] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:46:59 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:00.095945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:00.098208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:00.104519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:00.105037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:00.105461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:00.106699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:00.106699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:00.107044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:00.141005 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8dba39b9-176d-4c75-8445-785163225772 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051031 Nov 02 14:47:00.141586 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2421/6801] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:00 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:01.153169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:01.155962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:01.162830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:01.163341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:01.163774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:01.164489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:01.164937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:01.165354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:01.196755 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4a5f47ce-5c44-4744-9da6-7a9e538c5953 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047603 Nov 02 14:47:01.197336 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4381/6802] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:01 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:02.209942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:02.212217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:02.219304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:02.219800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:02.220246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:02.220952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:02.221410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:02.221843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:02.252741 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-18525fab-6205-431e-9d2e-b57d84f4b083 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046879 Nov 02 14:47:02.253307 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2422/6803] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:02 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:03.265174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:03.267295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:03.274509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:03.274994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:03.275495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:03.276191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:03.276643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:03.277064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:03.308687 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e0437a0-d052-4198-86fd-4e51b4eba0d6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047506 Nov 02 14:47:03.309250 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4382/6804] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:03 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:04.321389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:04.323629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:04.331209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:04.331700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:04.332148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:04.332845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:04.333307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:04.333737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:04.363543 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7c8f2962-bd1c-4f0e-8bff-075b53003308 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046066 Nov 02 14:47:04.364030 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2423/6805] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:04 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:47:04.374849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:04.375398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:04.382105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:04.382566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:04.383004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:04.383722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:04.384170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:04.384592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:04.463593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] HTTP exception thrown: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 is not attached to volume af6bed19-526c-49ff-954f-f8149bbe3fb0 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Request method failure captured: Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments/af6bed19-526c-49ff-954f-f8149bbe3fb0 HTTP/1.1 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoLFETqZ4nNpdFd3SmkdRdOUqJagtGYwfaGycnusQ4P2xd4S8FoQJM4xtZbGYQlrqwe9DHKAeVcNOKeFxnvdj5bpFejjEClc9UZr94KjlHUNJVsacYYjIungvwm1VHAZDf_cD3VftKwCntZKYXGTPdzKMh6iVU251bVuBdzaWaWoiEA Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ebe43fd027c64c1abc93ef94397eb207"}]}] Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 2cf51523283f4cb4b2d64cf9dc384822 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 is not attached to volume af6bed19-526c-49ff-954f-f8149bbe3fb0 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': '01a5f28f-23d1-4e24-9ff6-84cea75fe249', 'id': 'af6bed19-526c-49ff-954f-f8149bbe3fb0'} Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id af6bed19-526c-49ff-954f-f8149bbe3fb0. Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 is not attached to volume af6bed19-526c-49ff-954f-f8149bbe3fb0 Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:04.476896 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 is not attached to volume af6bed19-526c-49ff-954f-f8149bbe3fb0 Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Returning 404 to user: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 is not attached to volume af6bed19-526c-49ff-954f-f8149bbe3fb0 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73c15ef7-b7db-499f-b89c-03b5ee64b8d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments/af6bed19-526c-49ff-954f-f8149bbe3fb0" status: 404 len: 154 microversion: 2.1 time: 0.107708 Nov 02 14:47:04.481339 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4383/6806] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:47:04 2022] DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249/os-volume_attachments/af6bed19-526c-49ff-954f-f8149bbe3fb0 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:47:07.830119 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:07.830748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:07.838064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:07.838657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:07.839265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:07.840071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:07.840634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:07.841146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:07.868065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:47:07.947765 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cee88265-13f9-4f87-99e8-3555fa11d5af tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 204 len: 0 microversion: 2.1 time: 0.122233 Nov 02 14:47:07.948368 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2424/6807] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:47:07 2022] DELETE /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:47:07.957431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:07.958214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:07.966036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:07.966517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:07.967004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:07.967723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:07.968180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:07.968600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:08.101650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:08.110858 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d643c9de-97c9-4e8d-aa67-b1f58e8b4973 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1559 microversion: 2.1 time: 0.157323 Nov 02 14:47:08.124510 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4384/6808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:07 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:09.136140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:09.136852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:09.143925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:09.144422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:09.144869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:09.145569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:09.146034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:09.146470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:09.276282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:09.284628 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-73b7d5a6-13e2-4778-8a13-c496dd6ff81d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1559 microversion: 2.1 time: 0.152763 Nov 02 14:47:09.285196 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2425/6809] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:09 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:10.018521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-fdb83b38-794d-4f74-9ac4-54961911dad1 req-43b331db-64ea-4fb9-ae1b-d1a70b55095f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a5f28f-23d1-4e24-9ff6-84cea75fe249", "name": "network-vif-deleted", "tag": "ca0a6eea-36f1-4791-a5dc-9706b9295ffd"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:10.030197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fdb83b38-794d-4f74-9ac4-54961911dad1 req-43b331db-64ea-4fb9-ae1b-d1a70b55095f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:10.031016 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fdb83b38-794d-4f74-9ac4-54961911dad1 req-43b331db-64ea-4fb9-ae1b-d1a70b55095f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:10.031540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-fdb83b38-794d-4f74-9ac4-54961911dad1 req-43b331db-64ea-4fb9-ae1b-d1a70b55095f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:10.045952 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-fdb83b38-794d-4f74-9ac4-54961911dad1 req-43b331db-64ea-4fb9-ae1b-d1a70b55095f service nova] Creating event network-vif-deleted:ca0a6eea-36f1-4791-a5dc-9706b9295ffd for instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 on n-h1-858238-3 Nov 02 14:47:10.052159 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-fdb83b38-794d-4f74-9ac4-54961911dad1 req-43b331db-64ea-4fb9-ae1b-d1a70b55095f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Nov 02 14:47:10.053030 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4385/6810] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:10.308489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:10.308976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:10.316727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:10.317226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:10.317677 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:10.318386 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:10.318854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:10.319332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:10.353595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:10.354092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:10.354541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:10.355003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lazy-loading 'fault' on Instance uuid 01a5f28f-23d1-4e24-9ff6-84cea75fe249 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:47:10.396855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:10.405241 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3de6e292-ce2e-4f4b-b526-bfeb8283e045 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 200 len: 1352 microversion: 2.1 time: 0.100952 Nov 02 14:47:10.405811 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2426/6811] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:10 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:11.429975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:11.430666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 01a5f28f-23d1-4e24-9ff6-84cea75fe249] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:11.437655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:11.438125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:11.438552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:11.439261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:11.439707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:11.440124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:11.454193 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] HTTP exception thrown: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 could not be found. Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Request method failure captured: Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 HTTP/1.1 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoLFETqZ4nNpdFd3SmkdRdOUqJagtGYwfaGycnusQ4P2xd4S8FoQJM4xtZbGYQlrqwe9DHKAeVcNOKeFxnvdj5bpFejjEClc9UZr94KjlHUNJVsacYYjIungvwm1VHAZDf_cD3VftKwCntZKYXGTPdzKMh6iVU251bVuBdzaWaWoiEA Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ebe43fd027c64c1abc93ef94397eb207"}]}] Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 2cf51523283f4cb4b2d64cf9dc384822 Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 could not be found. Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '01a5f28f-23d1-4e24-9ff6-84cea75fe249'} Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 could not be found. Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 could not be found. Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:11.455817 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 could not be found. Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Returning 404 to user: Instance 01a5f28f-23d1-4e24-9ff6-84cea75fe249 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c63ca459-237b-433c-b6ac-c8d0bb15d5dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249" status: 404 len: 111 microversion: 2.1 time: 0.032274 Nov 02 14:47:11.460714 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4386/6812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:11 2022] GET /compute/v2.1/servers/01a5f28f-23d1-4e24-9ff6-84cea75fe249 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:47:11.465850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9d723551-0bf7-42a4-ab82-294abaaa294a tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '.version_select at 0x7f6f811150d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:11.489335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9d723551-0bf7-42a4-ab82-294abaaa294a tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-783571334" status: 202 len: 0 microversion: 2.1 time: 0.027212 Nov 02 14:47:11.489903 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2427/6813] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 14:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-783571334 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:47:11.507246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cc606c1-b5bb-4be1-9014-e633e1294caa tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: .version_select at 0x7f6f80b97670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1028089814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9M3nS2ke3tDuLVBpKaiLTa6rpeLYgHjM3eJpjZq4jEXuEyHFHTHNXbVvelVp4BYQI7UiOBniNs1SDGE+m47rg62EsubpUw4x6iwHqzJRP5+LD8tAbsqVh1/ETz8teveA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:11.523305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6cc606c1-b5bb-4be1-9014-e633e1294caa tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for project ebe43fd027c64c1abc93ef94397eb207. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:11.528534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-6cc606c1-b5bb-4be1-9014-e633e1294caa tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for user 2cf51523283f4cb4b2d64cf9dc384822 and project ebe43fd027c64c1abc93ef94397eb207. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:11.551837 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6cc606c1-b5bb-4be1-9014-e633e1294caa tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048496 Nov 02 14:47:11.552430 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4387/6814] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:47:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:11.603540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1899204675", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1028089814", "networks": [{"uuid": "39f53bd0-f14b-44df-9554-2e40669c6183"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:11.659398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] validate_networks() for [('39f53bd0-f14b-44df-9554-2e40669c6183', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:47:12.030821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:47:12.031305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:47:12.031800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:47:12.032231 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:47:12.032660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:47:12.041598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.042095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.042546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.043332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.043805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.044244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.063452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for project ebe43fd027c64c1abc93ef94397eb207. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:12.068662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for user 2cf51523283f4cb4b2d64cf9dc384822 and project ebe43fd027c64c1abc93ef94397eb207. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:12.081176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:47:12.083511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:47:12.131243 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9de0f8eb-90f7-4728-a136-1e03569f5cd5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531623 Nov 02 14:47:12.131902 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2428/6815] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:47:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:47:12.143418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bc637571-eb14-47ca-a744-14f4fa1157dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:12.144168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bc637571-eb14-47ca-a744-14f4fa1157dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:12.206169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-bc637571-eb14-47ca-a744-14f4fa1157dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:12.214283 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bc637571-eb14-47ca-a744-14f4fa1157dd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1263 microversion: 2.1 time: 0.074670 Nov 02 14:47:12.214846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4388/6816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:12 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:13.239473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:13.240106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:13.247543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:13.248714 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:13.249232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:13.249971 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:13.250438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:13.251053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:13.358671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:13.367046 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f3f288e8-1cf0-4997-8017-bf16ceafa505 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1333 microversion: 2.1 time: 0.132601 Nov 02 14:47:13.368354 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2429/6817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:13 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1333 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:14.392021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:14.392887 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:14.400184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.400670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.401111 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:14.401813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.402271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.402752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:14.560077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5ac8e7bc-faec-4a54-a51d-301fe33c7b92 req-d668fb11-a66c-49a1-8e86-6291d49e9d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0387a514-5f20-4d92-b9d8-919bc12f3436", "tag": "b14720d5-c889-448f-bc8c-5f1d8c11876f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:14.571684 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5ac8e7bc-faec-4a54-a51d-301fe33c7b92 req-d668fb11-a66c-49a1-8e86-6291d49e9d5f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.572445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5ac8e7bc-faec-4a54-a51d-301fe33c7b92 req-d668fb11-a66c-49a1-8e86-6291d49e9d5f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.572914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5ac8e7bc-faec-4a54-a51d-301fe33c7b92 req-d668fb11-a66c-49a1-8e86-6291d49e9d5f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:14.584655 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5ac8e7bc-faec-4a54-a51d-301fe33c7b92 req-d668fb11-a66c-49a1-8e86-6291d49e9d5f service nova] Creating event network-changed:b14720d5-c889-448f-bc8c-5f1d8c11876f for instance 0387a514-5f20-4d92-b9d8-919bc12f3436 on n-h1-858238-3 Nov 02 14:47:14.589395 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5ac8e7bc-faec-4a54-a51d-301fe33c7b92 req-d668fb11-a66c-49a1-8e86-6291d49e9d5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Nov 02 14:47:14.589993 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2430/6818] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:47:14.651576 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:14.659987 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8949752c-5c9d-4ac3-bfc7-e1804c05a6b6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1363 microversion: 2.1 time: 0.271896 Nov 02 14:47:14.660611 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4389/6819] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:14 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:15.685864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:15.686455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:15.692930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:15.693422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:15.693872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.694571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:15.695037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:15.695498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.858314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:15.866170 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6d5bb037-6620-4cc8-9659-1fa182f2d7d7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1363 microversion: 2.1 time: 0.186024 Nov 02 14:47:15.866840 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2431/6820] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:15 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:16.890242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:16.890836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:16.897710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:16.898183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:16.898608 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:16.899333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:16.899783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:16.900202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:17.027941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:17.035797 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-03e03b65-3b36-4717-84a7-63655a272d73 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1363 microversion: 2.1 time: 0.150661 Nov 02 14:47:17.036373 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4390/6821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:16 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:18.059263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:18.059895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:18.067528 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:18.067975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:18.068429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:18.069135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:18.069604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:18.070045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:18.201843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:18.209839 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e7b108cd-a1cd-4bd6-86d5-31375a504de5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1363 microversion: 2.1 time: 0.154703 Nov 02 14:47:18.210412 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2432/6822] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:18 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:19.233327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:19.233954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:19.240781 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:19.241252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:19.241677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:19.242354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:19.242799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:19.243249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:19.379510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:19.387171 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c925bf5-6a1c-4a4f-bea8-2e32a2c8dec2 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1363 microversion: 2.1 time: 0.158212 Nov 02 14:47:19.387755 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4391/6823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:19 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:19.466130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9a4f6358-91a0-4285-ac4a-5641d3414fa4 req-3529fea4-f28b-4beb-a72d-d8d05836d890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0387a514-5f20-4d92-b9d8-919bc12f3436", "name": "network-vif-plugged", "status": "completed", "tag": "b14720d5-c889-448f-bc8c-5f1d8c11876f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:19.477860 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9a4f6358-91a0-4285-ac4a-5641d3414fa4 req-3529fea4-f28b-4beb-a72d-d8d05836d890 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:19.478358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9a4f6358-91a0-4285-ac4a-5641d3414fa4 req-3529fea4-f28b-4beb-a72d-d8d05836d890 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:19.478893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9a4f6358-91a0-4285-ac4a-5641d3414fa4 req-3529fea4-f28b-4beb-a72d-d8d05836d890 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:19.492509 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9a4f6358-91a0-4285-ac4a-5641d3414fa4 req-3529fea4-f28b-4beb-a72d-d8d05836d890 service nova] Creating event network-vif-plugged:b14720d5-c889-448f-bc8c-5f1d8c11876f for instance 0387a514-5f20-4d92-b9d8-919bc12f3436 on n-h1-858238-3 Nov 02 14:47:19.497515 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9a4f6358-91a0-4285-ac4a-5641d3414fa4 req-3529fea4-f28b-4beb-a72d-d8d05836d890 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Nov 02 14:47:19.498797 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2433/6824] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:20.409975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:20.410591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:20.419722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:20.420210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:20.420643 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:20.421350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:20.421796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:20.422214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:20.556946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:20.565692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-543cfb62-3317-4010-b24e-58b031e34ede tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1363 microversion: 2.1 time: 0.159573 Nov 02 14:47:20.566270 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4392/6825] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:20 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:21.590042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:21.590750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:21.598491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:21.598986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:21.599455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:21.600156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:21.600618 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:21.601051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:21.729433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:21.737483 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f451122d-310a-46a2-b078-1b7616dfd89f tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1554 microversion: 2.1 time: 0.151600 Nov 02 14:47:21.738056 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2434/6826] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:21 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:21.760141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:21.760746 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:21.768040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:21.768532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:21.768942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:21.769616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:21.770064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:21.770476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:21.904981 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:21.912814 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa84c116-b162-450f-a23c-1fafe9705645 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1554 microversion: 2.1 time: 0.156577 Nov 02 14:47:21.913386 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4393/6827] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:21 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:23.413199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af7a3ef-da74-4d6f-b52f-fc82daf189e0"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:23.415495 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:23.417553 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:23.418721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:23.426538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:23.427046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:23.427519 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:23.428216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:23.428675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:23.429106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:23.650903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:23.670220 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7deb6aea-b773-48d5-a468-852c7bfbdbe5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260547 Nov 02 14:47:23.670972 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2435/6828] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:47:23 2022] POST /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:34.382258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:34.382737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:34.384669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:34.385658 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:47:34.385827 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:47:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments/1af7a3ef-da74-4d6f-b52f-fc82daf189e0 (ip 10.222.0.18) !!! Nov 02 14:47:34.389194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:34.389849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=64 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:34.399702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.400179 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.400614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.401316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.401762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.402178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.485463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lazy-loading 'services' on Instance uuid 0387a514-5f20-4d92-b9d8-919bc12f3436 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:47:34.556609 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66c0a7f2-7730-4359-a558-d16966bce9c4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments/1af7a3ef-da74-4d6f-b52f-fc82daf189e0" status: 202 len: 0 microversion: 2.1 time: 0.178001 Nov 02 14:47:34.557200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4394/6829] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:47:34 2022] DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments/1af7a3ef-da74-4d6f-b52f-fc82daf189e0 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:47:34.567117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:34.569504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:34.572354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:34.573274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:34.581414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.581941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.582395 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.583133 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.583608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.584053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.617950 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-39e57840-c6e8-47dd-85e1-dfe5f8933bd9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055982 Nov 02 14:47:34.618646 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2436/6830] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:34 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:35.631865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:35.634244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:35.641884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.642360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.642789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:35.643504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.643953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.644372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:35.675227 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8cbd1450-7a92-49c9-94cf-653fd5dfc62d tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 Nov 02 14:47:35.675780 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4395/6831] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:35 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:36.688132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:36.690283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:36.696820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:36.697487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:36.697827 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:36.698926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:36.699582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:36.700143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:36.730916 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e9b07aac-bbba-416a-bbd3-347f97c09843 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Nov 02 14:47:36.731524 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2437/6832] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:36 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:37.744249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:37.746416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:37.753636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.754110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.754538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.755254 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.755708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.756121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.785889 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2b55e52-6294-440c-83ad-eaa0c483e2b1 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Nov 02 14:47:37.786454 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4396/6833] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:37 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:38.799079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:38.801248 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:38.808446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:38.808936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:38.809382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:38.810088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:38.810547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:38.810983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:38.841982 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-04898234-d894-4900-89f5-09dd22eb2cb5 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047490 Nov 02 14:47:38.842548 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2438/6834] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:38 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:39.854286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:39.856405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:39.863625 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.864099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.864524 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.865219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.865665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.866101 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.896075 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a8cee546-312d-4f88-8013-9e7c2d55cce6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045876 Nov 02 14:47:39.896651 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4397/6835] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:47:39 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:47:39.907849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:39.908367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:39.915010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.915535 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.915979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.916671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.917136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.917568 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.995846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] HTTP exception thrown: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 is not attached to volume 1af7a3ef-da74-4d6f-b52f-fc82daf189e0 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Request method failure captured: Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments/1af7a3ef-da74-4d6f-b52f-fc82daf189e0 HTTP/1.1 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoLFETqZ4nNpdFd3SmkdRdOUqJagtGYwfaGycnusQ4P2xd4S8FoQJM4xtZbGYQlrqwe9DHKAeVcNOKeFxnvdj5bpFejjEClc9UZr94KjlHUNJVsacYYjIungvwm1VHAZDf_cD3VftKwCntZKYXGTPdzKMh6iVU251bVuBdzaWaWoiEA Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ebe43fd027c64c1abc93ef94397eb207"}]}] Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 2cf51523283f4cb4b2d64cf9dc384822 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 is not attached to volume 1af7a3ef-da74-4d6f-b52f-fc82daf189e0 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': '0387a514-5f20-4d92-b9d8-919bc12f3436', 'id': '1af7a3ef-da74-4d6f-b52f-fc82daf189e0'} Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1af7a3ef-da74-4d6f-b52f-fc82daf189e0. Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 is not attached to volume 1af7a3ef-da74-4d6f-b52f-fc82daf189e0 Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:39.997927 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 is not attached to volume 1af7a3ef-da74-4d6f-b52f-fc82daf189e0 Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Returning 404 to user: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 is not attached to volume 1af7a3ef-da74-4d6f-b52f-fc82daf189e0 {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5e845827-cdc2-48fc-a802-551f043fcb85 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments/1af7a3ef-da74-4d6f-b52f-fc82daf189e0" status: 404 len: 154 microversion: 2.1 time: 0.096051 Nov 02 14:47:40.002608 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2439/6836] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:47:39 2022] DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436/os-volume_attachments/1af7a3ef-da74-4d6f-b52f-fc82daf189e0 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:47:43.354400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:43.357219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:43.364778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:43.365300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:43.365737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:43.366448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:43.366905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:43.367540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:43.395808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:47:43.480544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-77df8026-6164-4519-9f62-35e1fd197557 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 204 len: 0 microversion: 2.1 time: 0.130605 Nov 02 14:47:43.483132 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4398/6837] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:47:43 2022] DELETE /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:47:43.489873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:43.490507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:43.500455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:43.501028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:43.502214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:43.503020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:43.503605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:43.504101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:43.645968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:43.653974 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6d736724-9ac8-4e88-80ee-ce86cfb9fedb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1560 microversion: 2.1 time: 0.168073 Nov 02 14:47:43.654549 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2440/6838] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:43 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:44.677333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:44.677964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:44.684925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:44.685484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:44.685819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:44.686494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:44.686942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:44.687402 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:44.819191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:44.826923 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ae9ee56-dc64-4344-8a0c-e830b9726014 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1560 microversion: 2.1 time: 0.153925 Nov 02 14:47:44.827555 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4399/6839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:44 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:45.479298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-e24b775c-2b70-4454-b7a6-8e399ecf8f28 req-c2408b32-d163-4f65-838f-80d954d82c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0387a514-5f20-4d92-b9d8-919bc12f3436", "name": "network-vif-deleted", "tag": "b14720d5-c889-448f-bc8c-5f1d8c11876f"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:45.490931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e24b775c-2b70-4454-b7a6-8e399ecf8f28 req-c2408b32-d163-4f65-838f-80d954d82c03 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:45.491538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e24b775c-2b70-4454-b7a6-8e399ecf8f28 req-c2408b32-d163-4f65-838f-80d954d82c03 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:45.492057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-e24b775c-2b70-4454-b7a6-8e399ecf8f28 req-c2408b32-d163-4f65-838f-80d954d82c03 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:45.506957 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-e24b775c-2b70-4454-b7a6-8e399ecf8f28 req-c2408b32-d163-4f65-838f-80d954d82c03 service nova] Creating event network-vif-deleted:b14720d5-c889-448f-bc8c-5f1d8c11876f for instance 0387a514-5f20-4d92-b9d8-919bc12f3436 on n-h1-858238-3 Nov 02 14:47:45.511866 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-e24b775c-2b70-4454-b7a6-8e399ecf8f28 req-c2408b32-d163-4f65-838f-80d954d82c03 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036424 Nov 02 14:47:45.512506 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2441/6840] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:45.850369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:45.851633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:45.859645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:45.860137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:45.861119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:45.862022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:45.863133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:45.863553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:45.898486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:45.899003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:45.899453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:45.899902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lazy-loading 'fault' on Instance uuid 0387a514-5f20-4d92-b9d8-919bc12f3436 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:47:45.943792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:45.951839 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4a8c000d-65fc-4fe0-ba76-6f733ed8f8b9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 200 len: 1353 microversion: 2.1 time: 0.105284 Nov 02 14:47:45.952423 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4400/6841] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:45 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:46.977509 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:46.978141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: 0387a514-5f20-4d92-b9d8-919bc12f3436] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:46.984418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:46.984914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:46.985358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:46.986053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:46.986517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:46.986952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:47.000296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] HTTP exception thrown: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 could not be found. Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Request method failure captured: Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 HTTP/1.1 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoLFETqZ4nNpdFd3SmkdRdOUqJagtGYwfaGycnusQ4P2xd4S8FoQJM4xtZbGYQlrqwe9DHKAeVcNOKeFxnvdj5bpFejjEClc9UZr94KjlHUNJVsacYYjIungvwm1VHAZDf_cD3VftKwCntZKYXGTPdzKMh6iVU251bVuBdzaWaWoiEA Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ebe43fd027c64c1abc93ef94397eb207"}]}] Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 2cf51523283f4cb4b2d64cf9dc384822 Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 could not be found. Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '0387a514-5f20-4d92-b9d8-919bc12f3436'} Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 could not be found. Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 could not be found. Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:47.001903 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 could not be found. Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Returning 404 to user: Instance 0387a514-5f20-4d92-b9d8-919bc12f3436 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-adf1b768-797b-4512-91a7-1fb974881c44 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436" status: 404 len: 111 microversion: 2.1 time: 0.031035 Nov 02 14:47:47.006529 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2442/6842] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:46 2022] GET /compute/v2.1/servers/0387a514-5f20-4d92-b9d8-919bc12f3436 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:47:47.012267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ad3a388-ab69-491f-9590-f0e808fbc19b tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '.version_select at 0x7f6f8096f040>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:47.032986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ad3a388-ab69-491f-9590-f0e808fbc19b tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1028089814" status: 202 len: 0 microversion: 2.1 time: 0.023881 Nov 02 14:47:47.033556 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4401/6843] 10.222.0.18 () {58 vars in 1278 bytes} [Wed Nov 2 14:47:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1028089814 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:47:47.050121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50adf1cf-59d0-4bcb-bf45-98f4b420989a tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: .version_select at 0x7f6f827da3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1236285071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8RvcB+nHa62xmjyUgfPZa89GckZgtc3Yaef+I9clcn8APxZNw2GQi3eU+YYE9taGDHzqiwjoegkG3IEUXd9U9qNTm590tSFE8ItvCMN+N+q/D5v7OOJpL3uZMPqTrqxA=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:47.065730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-50adf1cf-59d0-4bcb-bf45-98f4b420989a tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for project ebe43fd027c64c1abc93ef94397eb207. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:47.071022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-50adf1cf-59d0-4bcb-bf45-98f4b420989a tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for user 2cf51523283f4cb4b2d64cf9dc384822 and project ebe43fd027c64c1abc93ef94397eb207. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:47.094382 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50adf1cf-59d0-4bcb-bf45-98f4b420989a tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048078 Nov 02 14:47:47.095610 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2443/6844] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:47:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:47.145808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2114523336", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1236285071", "networks": [{"uuid": "39f53bd0-f14b-44df-9554-2e40669c6183"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:47.198964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] validate_networks() for [('39f53bd0-f14b-44df-9554-2e40669c6183', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:47:47.660453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:47:47.660916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:47:47.661389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:47:47.661799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:47:47.662212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:47:47.671201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:47.671675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:47.672103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:47.672823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:47.673771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:47.674191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:47.692095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for project ebe43fd027c64c1abc93ef94397eb207. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:47.697314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Getting quotas for user 2cf51523283f4cb4b2d64cf9dc384822 and project ebe43fd027c64c1abc93ef94397eb207. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:47.709809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:47:47.712117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:47:47.759102 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4798ff90-a0ac-4021-b72c-6a591cb14d4e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617786 Nov 02 14:47:47.759775 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4402/6845] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:47:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:47:47.771128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40d43b91-5d05-4dee-a8ad-47606410e236 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:47.771755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40d43b91-5d05-4dee-a8ad-47606410e236 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:47.831802 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40d43b91-5d05-4dee-a8ad-47606410e236 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:47.840233 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40d43b91-5d05-4dee-a8ad-47606410e236 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1263 microversion: 2.1 time: 0.073092 Nov 02 14:47:47.840798 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2444/6846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:47 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:48.863305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:48.864134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:48.872169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:48.872808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:48.873335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:48.874135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:48.874681 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:48.875230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:48.978607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:48.986568 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-64d24a4a-cf30-4a9c-b3dd-1d6bd405d2e4 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1333 microversion: 2.1 time: 0.127206 Nov 02 14:47:48.987234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4403/6847] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:48 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:50.010117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:50.010916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:50.020184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.021075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.021768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.022539 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.023016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.023529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.212572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:50.221605 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ca9d3961-eb88-4b6e-9868-24d10b7db913 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1363 microversion: 2.1 time: 0.215441 Nov 02 14:47:50.222334 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2445/6848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:50 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:50.523129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c1e5c1a7-eacb-4ea5-9af0-030f4ff5569b req-942bae08-a3e8-4abb-89ea-53017979e8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea3d71c-440a-42ce-9faf-e6aedc652584", "tag": "33c59109-20e1-4cf1-a7a4-1dc30c46e779"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:50.541159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1e5c1a7-eacb-4ea5-9af0-030f4ff5569b req-942bae08-a3e8-4abb-89ea-53017979e8f9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:50.541644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1e5c1a7-eacb-4ea5-9af0-030f4ff5569b req-942bae08-a3e8-4abb-89ea-53017979e8f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:50.542408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1e5c1a7-eacb-4ea5-9af0-030f4ff5569b req-942bae08-a3e8-4abb-89ea-53017979e8f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:50.555440 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c1e5c1a7-eacb-4ea5-9af0-030f4ff5569b req-942bae08-a3e8-4abb-89ea-53017979e8f9 service nova] Creating event network-changed:33c59109-20e1-4cf1-a7a4-1dc30c46e779 for instance aea3d71c-440a-42ce-9faf-e6aedc652584 on n-h1-858238-3 Nov 02 14:47:50.560296 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c1e5c1a7-eacb-4ea5-9af0-030f4ff5569b req-942bae08-a3e8-4abb-89ea-53017979e8f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041385 Nov 02 14:47:50.561496 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4404/6849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:51.245107 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:51.245732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:51.253207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:51.253695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:51.254142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:51.254837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:51.255337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:51.255773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:51.383597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:51.391381 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-954cc2da-07db-4a9d-970b-5f452c7a28eb tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1363 microversion: 2.1 time: 0.150148 Nov 02 14:47:51.392012 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2446/6850] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:51 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:52.415280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:52.415982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:52.422297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:52.422776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:52.423733 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:52.424427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:52.424878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:52.425302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:52.558692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:52.566603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ffd7b2a5-bd55-496d-9984-050d3777b0c9 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1363 microversion: 2.1 time: 0.156458 Nov 02 14:47:52.567200 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4405/6851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:52 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:53.589521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:53.590153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:53.596974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:53.597473 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:53.597931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:53.598650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:53.599140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:53.599591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:53.732880 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:53.741160 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d0a92f2e-cc9f-45ae-aeda-266767d7545e tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1363 microversion: 2.1 time: 0.155597 Nov 02 14:47:53.741724 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2447/6852] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:53 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:54.765083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:54.765645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:54.773279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:54.773763 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:54.774196 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:54.774883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:54.775368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:54.775789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:54.908721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:54.916641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55d4c99c-a6e8-4c96-9468-2a6be7c3275c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1363 microversion: 2.1 time: 0.155684 Nov 02 14:47:54.917240 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4406/6853] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:54 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:55.622308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2d19b20a-c768-4c94-8fba-0713b7e0ea68 req-153f7adb-e1df-4615-9ac8-85c588dcdb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea3d71c-440a-42ce-9faf-e6aedc652584", "name": "network-vif-plugged", "status": "completed", "tag": "33c59109-20e1-4cf1-a7a4-1dc30c46e779"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:55.634086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2d19b20a-c768-4c94-8fba-0713b7e0ea68 req-153f7adb-e1df-4615-9ac8-85c588dcdb93 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:55.634582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2d19b20a-c768-4c94-8fba-0713b7e0ea68 req-153f7adb-e1df-4615-9ac8-85c588dcdb93 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:55.635008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2d19b20a-c768-4c94-8fba-0713b7e0ea68 req-153f7adb-e1df-4615-9ac8-85c588dcdb93 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:55.647402 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2d19b20a-c768-4c94-8fba-0713b7e0ea68 req-153f7adb-e1df-4615-9ac8-85c588dcdb93 service nova] Creating event network-vif-plugged:33c59109-20e1-4cf1-a7a4-1dc30c46e779 for instance aea3d71c-440a-42ce-9faf-e6aedc652584 on n-h1-858238-3 Nov 02 14:47:55.652345 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2d19b20a-c768-4c94-8fba-0713b7e0ea68 req-153f7adb-e1df-4615-9ac8-85c588dcdb93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Nov 02 14:47:55.652998 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2448/6854] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:55.940379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:55.941056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:55.947921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:55.948397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:55.948827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:55.949515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:55.949964 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:55.950394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:56.078770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:56.086623 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0bedfc39-1df8-4455-8f07-357309569650 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1363 microversion: 2.1 time: 0.151000 Nov 02 14:47:56.087229 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4407/6855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:55 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:57.112168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:57.112737 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:57.118841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.119369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.119826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.120531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.121002 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.121442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.255355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:57.263068 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ead211a4-bb73-484f-85dd-cf086f324dd6 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1555 microversion: 2.1 time: 0.157105 Nov 02 14:47:57.263660 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2449/6856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:57 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:47:57.286477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:57.287129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:57.294238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.294480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.294920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.295658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:57.296115 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:57.296542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:57.425866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:57.433794 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e1118677-8400-48bc-8979-e46d43315756 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1555 microversion: 2.1 time: 0.151284 Nov 02 14:47:57.434371 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4408/6857] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:47:57 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:58.927049 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6858aa4c-f792-46ea-b14c-91fa3964dae1"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:58.929343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:58.931319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:58.937313 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.938063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.939168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:58.939869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:58.940339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:58.940772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:59.177279 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6df710c7-9b12-4f95-98f0-c573e9316d11 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "POST /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254308 Nov 02 14:47:59.178040 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2450/6858] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:47:58 2022] POST /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:09.895909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:09.896476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:09.898392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:09.899117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:09.900989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:09.901665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:09.909680 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:09.910167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:09.910607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:09.911341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:09.911831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:09.912259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:09.997629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lazy-loading 'services' on Instance uuid aea3d71c-440a-42ce-9faf-e6aedc652584 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:48:10.070084 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f4ee14e-96e5-4895-8146-f1bc49924b7c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments/6858aa4c-f792-46ea-b14c-91fa3964dae1" status: 202 len: 0 microversion: 2.1 time: 0.178537 Nov 02 14:48:10.070678 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4409/6859] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:48:09 2022] DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments/6858aa4c-f792-46ea-b14c-91fa3964dae1 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:48:10.079853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:10.082814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:10.086369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:10.087168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:10.094182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:10.094688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:10.095171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:10.095895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:10.096960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:10.097403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:10.130565 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-56ec5e72-26d0-4797-b7ee-03209a31d441 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055109 Nov 02 14:48:10.131250 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2451/6860] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:10 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:11.144065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:11.146466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:11.153839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:11.154333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:11.154771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:11.155511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:11.156047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:11.156471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:11.187694 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bb9f87cf-1a1b-4677-af18-0ff0281f6c95 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Nov 02 14:48:11.188529 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4410/6861] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:11 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:12.201496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:12.203702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:12.211300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:12.211804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:12.212260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:12.212967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:12.213437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:12.213884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:12.244229 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0bf9c5bf-43d5-46e5-9460-1e764656fb94 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Nov 02 14:48:12.245043 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2452/6862] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:12 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:13.256065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:13.258397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:13.264845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:13.265323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:13.265758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:13.266448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:13.266937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:13.267388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:13.297856 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-89e39200-7ae5-41c5-8802-d226c3a86997 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Nov 02 14:48:13.298439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4411/6863] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:13 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:14.310005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:14.312264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:14.322095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:14.322598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:14.323055 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:14.323798 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:14.324266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:14.324708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:14.356140 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-afdd7339-6f0f-4467-aaa6-aae1cce786c0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050096 Nov 02 14:48:14.356741 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2453/6864] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:14 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:48:15.368827 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:15.370970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:15.377530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:15.378006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:15.378438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:15.379150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:15.379602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:15.380023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:15.409998 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4c8d8cd0-a4cb-4ac1-b48a-12c39f323208 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045310 Nov 02 14:48:15.410567 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4412/6865] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:48:15 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 14:48:15.421183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:15.421691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:15.428573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:15.429072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:15.429583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:15.430417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:15.430969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:15.431483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:15.506524 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] HTTP exception thrown: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 is not attached to volume 6858aa4c-f792-46ea-b14c-91fa3964dae1 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Request method failure captured: Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments/6858aa4c-f792-46ea-b14c-91fa3964dae1 HTTP/1.1 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoLFETqZ4nNpdFd3SmkdRdOUqJagtGYwfaGycnusQ4P2xd4S8FoQJM4xtZbGYQlrqwe9DHKAeVcNOKeFxnvdj5bpFejjEClc9UZr94KjlHUNJVsacYYjIungvwm1VHAZDf_cD3VftKwCntZKYXGTPdzKMh6iVU251bVuBdzaWaWoiEA Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ebe43fd027c64c1abc93ef94397eb207"}]}] Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 2cf51523283f4cb4b2d64cf9dc384822 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 is not attached to volume 6858aa4c-f792-46ea-b14c-91fa3964dae1 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': 'aea3d71c-440a-42ce-9faf-e6aedc652584', 'id': '6858aa4c-f792-46ea-b14c-91fa3964dae1'} Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6858aa4c-f792-46ea-b14c-91fa3964dae1. Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 is not attached to volume 6858aa4c-f792-46ea-b14c-91fa3964dae1 Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:15.508144 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 is not attached to volume 6858aa4c-f792-46ea-b14c-91fa3964dae1 Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Returning 404 to user: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 is not attached to volume 6858aa4c-f792-46ea-b14c-91fa3964dae1 {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a5a9af51-30f3-4dc9-920d-64e1d597c753 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments/6858aa4c-f792-46ea-b14c-91fa3964dae1" status: 404 len: 154 microversion: 2.1 time: 0.092401 Nov 02 14:48:15.512465 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2454/6866] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:48:15 2022] DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584/os-volume_attachments/6858aa4c-f792-46ea-b14c-91fa3964dae1 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:48:18.857066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:18.857604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:18.865425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:18.865971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:18.866412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:18.867124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:18.867586 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:18.868010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:18.897616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:48:18.976800 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa09eb29-8883-42ed-a19a-56d0fdc0b1d0 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 204 len: 0 microversion: 2.1 time: 0.123380 Nov 02 14:48:18.977684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4413/6867] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:48:18 2022] DELETE /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:48:18.986317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:18.986975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:18.994229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:18.994819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:18.995390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:18.996159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:18.996698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:18.997212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:19.133781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:19.141605 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f51523c3-04be-4513-b7e5-0a257e511e93 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1561 microversion: 2.1 time: 0.159388 Nov 02 14:48:19.142182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2455/6868] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:18 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:20.166371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:20.167075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:20.174086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:20.174566 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:20.175532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:20.176221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:20.176675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:20.177098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:20.308148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:20.316453 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f3dee1c-62c5-4cf4-ac95-74f93ab913bf tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1561 microversion: 2.1 time: 0.154428 Nov 02 14:48:20.317060 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4414/6869] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:20 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:21.015263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-87df0f18-1cc6-4360-b863-9fdbe3432882 req-02490e2d-e525-4051-9253-2345bf7ea8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea3d71c-440a-42ce-9faf-e6aedc652584", "name": "network-vif-deleted", "tag": "33c59109-20e1-4cf1-a7a4-1dc30c46e779"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:21.032152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-87df0f18-1cc6-4360-b863-9fdbe3432882 req-02490e2d-e525-4051-9253-2345bf7ea8c5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:21.032944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-87df0f18-1cc6-4360-b863-9fdbe3432882 req-02490e2d-e525-4051-9253-2345bf7ea8c5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:21.033556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-87df0f18-1cc6-4360-b863-9fdbe3432882 req-02490e2d-e525-4051-9253-2345bf7ea8c5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:21.053567 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-87df0f18-1cc6-4360-b863-9fdbe3432882 req-02490e2d-e525-4051-9253-2345bf7ea8c5 service nova] Creating event network-vif-deleted:33c59109-20e1-4cf1-a7a4-1dc30c46e779 for instance aea3d71c-440a-42ce-9faf-e6aedc652584 on n-h1-858238-3 Nov 02 14:48:21.058856 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-87df0f18-1cc6-4360-b863-9fdbe3432882 req-02490e2d-e525-4051-9253-2345bf7ea8c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047343 Nov 02 14:48:21.060142 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2456/6870] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:21.340134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:21.340866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:21.348057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:21.348544 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:21.348982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:21.349675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:21.350132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:21.350557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:21.382709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:21.383223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:21.383665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:21.384110 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lazy-loading 'fault' on Instance uuid aea3d71c-440a-42ce-9faf-e6aedc652584 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:48:21.427940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf51523283f4cb4b2d64cf9dc384822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe43fd027c64c1abc93ef94397eb207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:21.436058 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9943ea98-75e6-4fc6-9ab9-42e7f8d75a3c tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 200 len: 1353 microversion: 2.1 time: 0.099827 Nov 02 14:48:21.436641 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4415/6871] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:21 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:22.462600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:22.463342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] [instance: aea3d71c-440a-42ce-9faf-e6aedc652584] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:22.469562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:22.470054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:22.470502 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:22.471229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:22.472198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:22.472635 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:22.485803 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] HTTP exception thrown: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 could not be found. Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Request method failure captured: Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 HTTP/1.1 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoLFETqZ4nNpdFd3SmkdRdOUqJagtGYwfaGycnusQ4P2xd4S8FoQJM4xtZbGYQlrqwe9DHKAeVcNOKeFxnvdj5bpFejjEClc9UZr94KjlHUNJVsacYYjIungvwm1VHAZDf_cD3VftKwCntZKYXGTPdzKMh6iVU251bVuBdzaWaWoiEA Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ebe43fd027c64c1abc93ef94397eb207"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ebe43fd027c64c1abc93ef94397eb207"}]}] Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: ebe43fd027c64c1abc93ef94397eb207 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1698054006 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 2cf51523283f4cb4b2d64cf9dc384822 Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestEncryptedCinderVolumes-1698054006-project Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 could not be found. Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'aea3d71c-440a-42ce-9faf-e6aedc652584'} Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 could not be found. Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 could not be found. Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:22.488094 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 could not be found. Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Returning 404 to user: Instance aea3d71c-440a-42ce-9faf-e6aedc652584 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5de01573-4fae-4d2d-ab21-f1003e2e6dfd tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584" status: 404 len: 111 microversion: 2.1 time: 0.031928 Nov 02 14:48:22.492445 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2457/6872] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:22 2022] GET /compute/v2.1/servers/aea3d71c-440a-42ce-9faf-e6aedc652584 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:48:22.498205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7356e41-2473-40c9-b13e-4e4d750bfdb7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] Calling method '.version_select at 0x7f6f80b93af0>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:22.517822 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7356e41-2473-40c9-b13e-4e4d750bfdb7 tempest-TestEncryptedCinderVolumes-1698054006 tempest-TestEncryptedCinderVolumes-1698054006-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1236285071" status: 202 len: 0 microversion: 2.1 time: 0.023397 Nov 02 14:48:22.518406 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4416/6873] 10.222.0.18 () {58 vars in 1278 bytes} [Wed Nov 2 14:48:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1236285071 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:48:50.200384 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c25e325c-30e6-4a58-ba52-1d613ecafbc8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'create', calling method: .version_select at 0x7f6f8351fdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-698485212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsmZbSCJG/JUp1rsKUjI58bISfo1FGruqfY4JBQMNiCxhOHpiv5ay52nryFA+VcCusFkKhSC8zMMCgVYN3pTZGQQ3lzPvZu/euw+l8t9SEv+sbZtjnyUs2mIB+bJwfC6w=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:50.206286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:50.207067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=34 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:50.219432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c25e325c-30e6-4a58-ba52-1d613ecafbc8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:48:50.225019 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-c25e325c-30e6-4a58-ba52-1d613ecafbc8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for user ddffc0d1e4054e66ae331d58d44b244f and project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:48:50.248623 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c25e325c-30e6-4a58-ba52-1d613ecafbc8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052626 Nov 02 14:48:50.249328 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2458/6874] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:48:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:48:50.298203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:50.298977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:50.303698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1500287207", "imageRef": "a4647dd4-9b96-4e5c-87ee-c1cba384d5c9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-698485212", "networks": [{"uuid": "aa5ac7d0-24a5-463d-bc0f-848c77d93a85"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:50.356861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] validate_networks() for [('aa5ac7d0-24a5-463d-bc0f-848c77d93a85', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:48:50.729795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:48:50.730223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:48:50.730710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:48:50.731142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:48:50.731563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:48:50.740353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:50.740837 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:50.741271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:50.742005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:50.742459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:50.742882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:50.760520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:48:50.765759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for user ddffc0d1e4054e66ae331d58d44b244f and project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:48:50.778510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:48:50.780776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4647dd4-9b96-4e5c-87ee-c1cba384d5c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:48:50.826585 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f51426c-36eb-4b3e-804a-3e11d8864f02 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530365 Nov 02 14:48:50.827260 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4417/6875] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:48:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:48:50.838887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-86fb931c-0c87-4f33-bc29-bac6047a72d3 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:50.839586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-86fb931c-0c87-4f33-bc29-bac6047a72d3 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:50.894964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-86fb931c-0c87-4f33-bc29-bac6047a72d3 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:50.902343 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-86fb931c-0c87-4f33-bc29-bac6047a72d3 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1258 microversion: 2.1 time: 0.067393 Nov 02 14:48:50.903419 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2459/6876] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:50 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:51.926457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:51.927264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:51.934912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:51.935423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:51.935847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:51.936543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:51.936989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:51.937404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:52.025800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:52.035393 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-521dc11b-f3bb-47bd-ad8e-948b38a0675f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1316 microversion: 2.1 time: 0.114671 Nov 02 14:48:52.036255 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4418/6877] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:51 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1316 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:48:53.060203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:53.060955 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:53.069912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:53.070424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:53.070879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:53.071767 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:53.072244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:53.072688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:53.214091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:53.226067 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-364ba72d-0c95-4e47-93b3-d5ed7fd4a52e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.169832 Nov 02 14:48:53.233555 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2460/6878] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:53 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:54.251562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:54.253600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:54.263620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:54.264640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:54.265384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:54.266286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:54.266975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:54.267600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:54.432671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:54.442125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-87b76099-7e2c-42b7-a01f-7e7f7996bc62 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.196097 Nov 02 14:48:54.458329 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4419/6879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:54 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:55.467723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:55.469257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:55.479073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:55.480099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:55.480895 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:55.481905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:55.482437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:55.483021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:55.626017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:55.634685 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9477f50c-e32c-4118-8287-e98f695a201a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.172852 Nov 02 14:48:55.635433 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2461/6880] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:55 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:56.659238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:56.659923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:56.667264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:56.667894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:56.668396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:56.669100 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:56.669645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:56.670009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:56.818735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:56.827137 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d9b3b482-ae38-4322-8f1b-285473f65457 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.171687 Nov 02 14:48:56.828398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4420/6881] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:56 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:57.852560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:57.853158 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:57.860154 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:57.860654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:57.861105 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:57.861838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:57.862308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:57.862750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:58.020042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:58.028555 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9c602222-6612-467d-9e7c-f4b422d7995f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.179968 Nov 02 14:48:58.029139 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2462/6882] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:57 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:59.052397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:59.053010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:59.060056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.060540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.060972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.061724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.062167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.062764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.207025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:59.215537 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f555249c-15d4-4aa7-bd7f-131ad2d2d527 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.167457 Nov 02 14:48:59.216398 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4421/6883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:48:59 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:00.239467 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:00.240086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:00.247142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.247644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.248083 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.248785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.249244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.249675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.479477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:00.487739 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef63f98f-2251-48c9-8831-0db50f70c490 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.252828 Nov 02 14:49:00.488338 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2463/6884] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:00 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:00.797386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-03109885-d083-4393-8dcc-3a46fa3a4cdb req-0b94aacd-5c97-43dd-babf-2d07119d6acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:00.804332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:00.805093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:00.812043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-03109885-d083-4393-8dcc-3a46fa3a4cdb req-0b94aacd-5c97-43dd-babf-2d07119d6acb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.812522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-03109885-d083-4393-8dcc-3a46fa3a4cdb req-0b94aacd-5c97-43dd-babf-2d07119d6acb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.812948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-03109885-d083-4393-8dcc-3a46fa3a4cdb req-0b94aacd-5c97-43dd-babf-2d07119d6acb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.825066 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-03109885-d083-4393-8dcc-3a46fa3a4cdb req-0b94aacd-5c97-43dd-babf-2d07119d6acb service nova] Creating event network-changed:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:49:00.830095 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-03109885-d083-4393-8dcc-3a46fa3a4cdb req-0b94aacd-5c97-43dd-babf-2d07119d6acb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037294 Nov 02 14:49:00.830707 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4422/6885] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:01.511636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:01.512205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:01.514222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:01.520354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:01.520853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:01.521297 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:01.522413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:01.522628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:01.523671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:01.655268 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:01.663248 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8189d30c-637b-410f-8aeb-e6a6fb4f9c7c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.155509 Nov 02 14:49:01.663819 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2464/6886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:01 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:02.687480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:02.688198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:02.695872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:02.696353 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:02.696803 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:02.697493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:02.697927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:02.698345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:02.832641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:02.840502 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9df0d1a1-0a3e-4b26-ac7e-bd242c4d9d33 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.158384 Nov 02 14:49:02.841080 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4423/6887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:02 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:03.864852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:03.865324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:03.873103 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:03.873583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:03.874031 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:03.874742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:03.875233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:03.875686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.009346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:04.017195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-42bb8fa2-465b-40d2-82ce-59af02070135 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.157171 Nov 02 14:49:04.018409 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2465/6888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:03 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:05.041649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:05.042260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:05.049243 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.049724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.050151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.050838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.051320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.051736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.182048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:05.190809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-742de7f0-c01d-4a7d-bb80-f78936972d88 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.153969 Nov 02 14:49:05.191425 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4424/6889] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:05 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:05.893997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-34509e80-9962-4dad-b3a7-b2b779b3ead7 req-1da4c5c9-6820-44c8-83c4-3d5c5e8cb276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "name": "network-vif-plugged", "status": "completed", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:05.907630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-34509e80-9962-4dad-b3a7-b2b779b3ead7 req-1da4c5c9-6820-44c8-83c4-3d5c5e8cb276 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.908120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-34509e80-9962-4dad-b3a7-b2b779b3ead7 req-1da4c5c9-6820-44c8-83c4-3d5c5e8cb276 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.908572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-34509e80-9962-4dad-b3a7-b2b779b3ead7 req-1da4c5c9-6820-44c8-83c4-3d5c5e8cb276 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.919931 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-34509e80-9962-4dad-b3a7-b2b779b3ead7 req-1da4c5c9-6820-44c8-83c4-3d5c5e8cb276 service nova] Creating event network-vif-plugged:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:49:05.925855 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-34509e80-9962-4dad-b3a7-b2b779b3ead7 req-1da4c5c9-6820-44c8-83c4-3d5c5e8cb276 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035990 Nov 02 14:49:05.926707 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2466/6890] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:06.214211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:06.215195 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:06.222355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:06.222832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:06.223302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:06.223988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:06.224437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:06.224856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:06.354027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:06.362264 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-01a12237-df4d-4e82-8b0e-f9e10ce3159f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1358 microversion: 2.1 time: 0.151366 Nov 02 14:49:06.362837 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4425/6891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:06 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:07.386387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:07.387164 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:07.394818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.395344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.395799 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.396500 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.396969 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.397411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.530768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:07.538528 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-50520c4b-eabb-4269-af67-a22510f50515 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1548 microversion: 2.1 time: 0.156458 Nov 02 14:49:07.539118 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2467/6892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:07 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:07.560593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:07.561202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:07.568794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.569281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.569714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.570396 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.570852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.571302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.703970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:07.712448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ee559c6-bfab-4c78-8dab-5e93b438e048 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1548 microversion: 2.1 time: 0.155651 Nov 02 14:49:07.713031 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4426/6893] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:07 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:07.734322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:07.739108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:07.739956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Searching by: {'deleted': False, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:49:07.745303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.745790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.746233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.746954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.747442 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.747873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.772656 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:49:07.798388 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1c484193-f585-4c88-8a7f-4357da2a26fe tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067872 Nov 02 14:49:07.799491 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2468/6894] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 14:49:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:07.811068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:07.811699 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:07.818458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.818937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.819408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.820093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:07.820540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:07.820966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:07.951728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:07.959548 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-251c086d-2609-493a-afd7-41edbff73886 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1548 microversion: 2.1 time: 0.152329 Nov 02 14:49:07.960106 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4427/6895] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:07 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:09.507053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b66df26-94fa-4f12-8da4-8dbf573f4fd2"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:09.509413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:09.516062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.516544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.517142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.518341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:09.518803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:09.519278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:09.757072 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-72943dd1-ec55-4717-b59e-970e5e7d67ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253667 Nov 02 14:49:09.757718 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2469/6896] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:49:09 2022] POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:49:22.817462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:22.818112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:22.820962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:22.821611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=58 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:22.828306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:22.828780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:22.829210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:22.829893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:22.830336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:22.830753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:23.108118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:23.116903 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8524085e-01a0-4a1c-963b-30ed82f130af tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1594 microversion: 2.1 time: 0.304455 Nov 02 14:49:23.117477 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4428/6897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:22 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1594 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:25.137213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9804442d-7a91-4436-9fb2-8f62a077c324 req-61edd1be-768d-4815-9c6d-a96f291a0e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:25.143128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:25.143817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:25.145018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:25.152851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9804442d-7a91-4436-9fb2-8f62a077c324 req-61edd1be-768d-4815-9c6d-a96f291a0e85 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:25.153349 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9804442d-7a91-4436-9fb2-8f62a077c324 req-61edd1be-768d-4815-9c6d-a96f291a0e85 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:25.153796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9804442d-7a91-4436-9fb2-8f62a077c324 req-61edd1be-768d-4815-9c6d-a96f291a0e85 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:25.168548 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9804442d-7a91-4436-9fb2-8f62a077c324 req-61edd1be-768d-4815-9c6d-a96f291a0e85 service nova] Creating event network-changed:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:49:25.174101 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9804442d-7a91-4436-9fb2-8f62a077c324 req-61edd1be-768d-4815-9c6d-a96f291a0e85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040460 Nov 02 14:49:25.174289 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2470/6898] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:49:26.149667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1520055764"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:26.150207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:26.157331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:26.157820 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:26.158255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:26.158962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:26.159444 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:26.159867 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:26.294655 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Adding security group e6106eb6-c5f5-45bf-abd3-7aa8616255b5 to port 618dc23e-649c-429b-ae0d-e5506b18e619 Nov 02 14:49:26.609568 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3700dd71-f2c8-4dcb-9a5b-dd9ccfb40a03 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/action" status: 202 len: 0 microversion: 2.1 time: 0.463798 Nov 02 14:49:26.610551 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4429/6899] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:49:26 2022] POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:49:26.620748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:26.621457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:26.628108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:26.628530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:26.629039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:26.630254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:26.630886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:26.631526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:26.802082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:26.811067 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1987f6c7-c408-4a33-8858-3eed32d9462f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1759 microversion: 2.1 time: 0.195843 Nov 02 14:49:26.823115 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2471/6900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:49:26 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:27.192172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-61b52f30-88cc-4b03-878c-f7153493bef1 req-6ae50630-e0c5-433b-aaff-367cfb14ec56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:27.203926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-61b52f30-88cc-4b03-878c-f7153493bef1 req-6ae50630-e0c5-433b-aaff-367cfb14ec56 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:27.204658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-61b52f30-88cc-4b03-878c-f7153493bef1 req-6ae50630-e0c5-433b-aaff-367cfb14ec56 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:27.205180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-61b52f30-88cc-4b03-878c-f7153493bef1 req-6ae50630-e0c5-433b-aaff-367cfb14ec56 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:27.218167 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-61b52f30-88cc-4b03-878c-f7153493bef1 req-6ae50630-e0c5-433b-aaff-367cfb14ec56 service nova] Creating event network-changed:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:49:27.223882 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-61b52f30-88cc-4b03-878c-f7153493bef1 req-6ae50630-e0c5-433b-aaff-367cfb14ec56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038559 Nov 02 14:49:27.225395 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4430/6901] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:04.757876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:04.758640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:04.760247 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 14:51:04.767366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:04.769564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:04.776121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:04.776619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:04.777070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:04.777760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:04.778224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:04.778661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:04.851519 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d897ad75-3a27-4f06-87c6-dc932f06ca7b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/action" status: 202 len: 0 microversion: 2.1 time: 0.095308 Nov 02 14:51:04.852185 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2472/6902] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:51:04 2022] POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:51:04.858583 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:04.859354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:04.864967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:04.865671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:04.873248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:04.873732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:04.874167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:04.874861 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:04.875354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:04.875778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:05.114339 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:05.123728 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b95646b3-adc6-4458-8b68-9193b4df7113 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1761 microversion: 2.1 time: 0.267177 Nov 02 14:51:05.124331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4431/6903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:04 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1761 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:06.149325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:06.150048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:06.156318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:06.156815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:06.157270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:06.157970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:06.158441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:06.158881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:06.404430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:06.412816 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9059021-d5fc-42fd-8a23-d715d2d9b653 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1759 microversion: 2.1 time: 0.269362 Nov 02 14:51:06.413381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2473/6904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:51:06 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1759 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:19.165860 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:52:19.166877 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:52:19.167362 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:19.168096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:19.172350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1520055764"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:19.172876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:19.180119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:19.180641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:19.181064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:19.181738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:19.182201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:19.182598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:19.316025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Removing security group e6106eb6-c5f5-45bf-abd3-7aa8616255b5 from port 618dc23e-649c-429b-ae0d-e5506b18e619 Nov 02 14:52:19.948477 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-46623c04-c2c0-409c-af11-d9af2212a1e7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/action" status: 202 len: 0 microversion: 2.1 time: 0.784209 Nov 02 14:52:19.953618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4432/6905] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:52:19 2022] POST /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:52:19.957431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:19.958203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:20.032027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-070520e3-6412-4203-ac51-135bf3a1bdcd req-54b8147f-7a10-4a2a-9033-b339f2615691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:20.047580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-070520e3-6412-4203-ac51-135bf3a1bdcd req-54b8147f-7a10-4a2a-9033-b339f2615691 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:20.047580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-070520e3-6412-4203-ac51-135bf3a1bdcd req-54b8147f-7a10-4a2a-9033-b339f2615691 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:20.048028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-070520e3-6412-4203-ac51-135bf3a1bdcd req-54b8147f-7a10-4a2a-9033-b339f2615691 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:20.060339 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-070520e3-6412-4203-ac51-135bf3a1bdcd req-54b8147f-7a10-4a2a-9033-b339f2615691 service nova] Creating event network-changed:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:52:20.065380 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-070520e3-6412-4203-ac51-135bf3a1bdcd req-54b8147f-7a10-4a2a-9033-b339f2615691 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109852 Nov 02 14:52:20.066159 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2474/6906] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:21.084555 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53364. Nov 02 14:52:21.085375 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53366. Nov 02 14:52:21.133538 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:21.134150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:21.141245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:21.141663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:21.142113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:21.142823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:21.143324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:21.143763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:21.188315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-64ca4081-6f8f-4bb7-9e1b-284d260246c0 req-bc97e92a-f550-4051-990b-8c8e613a79fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:21.201253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-64ca4081-6f8f-4bb7-9e1b-284d260246c0 req-bc97e92a-f550-4051-990b-8c8e613a79fe service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:21.201974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-64ca4081-6f8f-4bb7-9e1b-284d260246c0 req-bc97e92a-f550-4051-990b-8c8e613a79fe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:21.202650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-64ca4081-6f8f-4bb7-9e1b-284d260246c0 req-bc97e92a-f550-4051-990b-8c8e613a79fe service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:21.216376 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-64ca4081-6f8f-4bb7-9e1b-284d260246c0 req-bc97e92a-f550-4051-990b-8c8e613a79fe service nova] Creating event network-changed:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:52:21.221574 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-64ca4081-6f8f-4bb7-9e1b-284d260246c0 req-bc97e92a-f550-4051-990b-8c8e613a79fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148026 Nov 02 14:52:21.222416 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4433/6907] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:21.267716 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lazy-loading 'services' on Instance uuid f359b758-c3e0-4aba-83a2-b31039b12628 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:52:21.367441 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-90fca163-6463-4a53-ba9c-d05c61f61389 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments/0b66df26-94fa-4f12-8da4-8dbf573f4fd2" status: 202 len: 0 microversion: 2.1 time: 0.237323 Nov 02 14:52:21.368200 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2475/6908] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:52:21 2022] DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments/0b66df26-94fa-4f12-8da4-8dbf573f4fd2 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:52:21.383507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:21.386351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:21.394628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:21.395531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:21.396121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:21.397670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:21.398874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:21.399486 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:21.449545 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91bfc452-a48a-4365-890f-37ef2a8336e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076447 Nov 02 14:52:21.450702 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4434/6909] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:52:21 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:22.463432 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:22.465727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:22.471983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:22.472476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:22.472919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:22.473611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:22.474071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:22.474498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:22.505147 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef1c6e20-1e57-4302-b0e0-9b305e632491 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Nov 02 14:52:22.505712 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2476/6910] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:52:22 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:23.518051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:23.520313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:23.527229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:23.527714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:23.528146 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:23.528836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:23.529291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:23.529720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:23.559318 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-866b9046-501a-460c-b8d0-382abfb4321f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Nov 02 14:52:23.559895 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4435/6911] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:52:23 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:24.572930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:24.575178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:24.582382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:24.582878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:24.583355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:24.584057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:24.584515 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:24.584944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:24.617195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f1bcd304-627f-4ed1-a08e-64fbb7dae3bc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Nov 02 14:52:24.617749 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2477/6912] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:52:24 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:25.629829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:25.632073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:25.639069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:25.639592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:25.640028 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:25.640723 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:25.641175 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:25.641595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:25.672588 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-712a8058-0734-4b3c-8299-eafd6f32621a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Nov 02 14:52:25.673082 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4436/6913] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:52:25 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:26.685672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:26.687881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:26.695597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:26.696090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:26.696545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:26.697241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:26.697696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:26.698126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:26.727683 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8845e477-7813-41ab-ac54-8961452321e1 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045946 Nov 02 14:52:26.728246 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2478/6914] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:52:26 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:52:26.743555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:26.744072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:26.751006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:26.751812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:26.752033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:26.752872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:26.753180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:26.753594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:26.832859 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] HTTP exception thrown: Instance f359b758-c3e0-4aba-83a2-b31039b12628 is not attached to volume 0b66df26-94fa-4f12-8da4-8dbf573f4fd2 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Request method failure captured: Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: request: DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments/0b66df26-94fa-4f12-8da4-8dbf573f4fd2 HTTP/1.1 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoND0-5gYvCrlQb2ifOVoZfQHAIbOTv-qh2iW1wWcfukGWkxgvDyD4fQBNnQX5x5YPaLV950jTFJk-WV9X9NimoHiv1tFdhfxLoDuOGqzxT5IfksVVpc5Ex_fw48_2ebOySotPhPVn27eF5e__qDU1_5pqK7tAmT4ZciSiY_E4QeScw Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f45ee49e89a149b9a68cca6dd8c32ea3"}]}] Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ddffc0d1e4054e66ae331d58d44b244f Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f359b758-c3e0-4aba-83a2-b31039b12628 is not attached to volume 0b66df26-94fa-4f12-8da4-8dbf573f4fd2 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'server_id': 'f359b758-c3e0-4aba-83a2-b31039b12628', 'id': '0b66df26-94fa-4f12-8da4-8dbf573f4fd2'} Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0b66df26-94fa-4f12-8da4-8dbf573f4fd2. Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f359b758-c3e0-4aba-83a2-b31039b12628 is not attached to volume 0b66df26-94fa-4f12-8da4-8dbf573f4fd2 Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:26.834465 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f359b758-c3e0-4aba-83a2-b31039b12628 is not attached to volume 0b66df26-94fa-4f12-8da4-8dbf573f4fd2 Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Returning 404 to user: Instance f359b758-c3e0-4aba-83a2-b31039b12628 is not attached to volume 0b66df26-94fa-4f12-8da4-8dbf573f4fd2 {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ddca4f17-f424-4d96-bed8-2858dddbf958 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments/0b66df26-94fa-4f12-8da4-8dbf573f4fd2" status: 404 len: 154 microversion: 2.1 time: 0.097224 Nov 02 14:52:26.839090 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4437/6915] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:52:26 2022] DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628/os-volume_attachments/0b66df26-94fa-4f12-8da4-8dbf573f4fd2 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:52:30.099829 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:30.100336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:30.107185 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:30.107675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:30.108118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:30.108808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:30.109285 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:30.109702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:30.135222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:52:30.217254 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7142a2c6-8868-4e3e-96b4-b5019bcfb88f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 204 len: 0 microversion: 2.1 time: 0.120737 Nov 02 14:52:30.218557 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2479/6916] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:52:30 2022] DELETE /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:52:30.231590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:30.233611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:30.240999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:30.241484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:30.242498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:30.243335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:30.243790 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:30.244211 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:30.381878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:30.390292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f588d70-71d2-4167-8aa1-0d5419b90129 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1554 microversion: 2.1 time: 0.167117 Nov 02 14:52:30.390871 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4438/6917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:30 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:31.414112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:31.414886 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:31.422390 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:31.422888 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:31.423357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:31.424064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:31.424526 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:31.424961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:31.559637 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:31.567773 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d88fb53-4ad9-4a39-af66-43ae2ec6c13e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1554 microversion: 2.1 time: 0.158007 Nov 02 14:52:31.568348 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2480/6918] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:31 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:32.240059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-96029a68-63ea-4639-83c5-65c4c9a78de1 req-45005615-d3c6-4f8d-8ab3-292329098f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f359b758-c3e0-4aba-83a2-b31039b12628", "name": "network-vif-deleted", "tag": "618dc23e-649c-429b-ae0d-e5506b18e619"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:32.252429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-96029a68-63ea-4639-83c5-65c4c9a78de1 req-45005615-d3c6-4f8d-8ab3-292329098f9d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:32.252904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-96029a68-63ea-4639-83c5-65c4c9a78de1 req-45005615-d3c6-4f8d-8ab3-292329098f9d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:32.253328 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-96029a68-63ea-4639-83c5-65c4c9a78de1 req-45005615-d3c6-4f8d-8ab3-292329098f9d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:32.265448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-96029a68-63ea-4639-83c5-65c4c9a78de1 req-45005615-d3c6-4f8d-8ab3-292329098f9d service nova] Creating event network-vif-deleted:618dc23e-649c-429b-ae0d-e5506b18e619 for instance f359b758-c3e0-4aba-83a2-b31039b12628 on n-h1-858238-3 Nov 02 14:52:32.270261 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-96029a68-63ea-4639-83c5-65c4c9a78de1 req-45005615-d3c6-4f8d-8ab3-292329098f9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Nov 02 14:52:32.270882 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4439/6919] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:32.592104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:32.592722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:32.599763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:32.600257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:32.600697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:32.601483 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:32.601947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:32.602376 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:32.635872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:32.636374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:32.636823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:32.637288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lazy-loading 'fault' on Instance uuid f359b758-c3e0-4aba-83a2-b31039b12628 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:52:32.680563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:32.688308 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae5b707b-f5a7-491e-9230-ca5ba356a73a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 200 len: 1348 microversion: 2.1 time: 0.100466 Nov 02 14:52:32.688876 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2481/6920] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:32 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:33.714210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:33.714923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: f359b758-c3e0-4aba-83a2-b31039b12628] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:33.721219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:33.721707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:33.722144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:33.722835 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:33.723332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:33.723762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:33.737678 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] HTTP exception thrown: Instance f359b758-c3e0-4aba-83a2-b31039b12628 could not be found. Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Request method failure captured: Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 HTTP/1.1 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoND0-5gYvCrlQb2ifOVoZfQHAIbOTv-qh2iW1wWcfukGWkxgvDyD4fQBNnQX5x5YPaLV950jTFJk-WV9X9NimoHiv1tFdhfxLoDuOGqzxT5IfksVVpc5Ex_fw48_2ebOySotPhPVn27eF5e__qDU1_5pqK7tAmT4ZciSiY_E4QeScw Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f45ee49e89a149b9a68cca6dd8c32ea3"}]}] Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ddffc0d1e4054e66ae331d58d44b244f Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance f359b758-c3e0-4aba-83a2-b31039b12628 could not be found. Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'f359b758-c3e0-4aba-83a2-b31039b12628'} Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f359b758-c3e0-4aba-83a2-b31039b12628 could not be found. Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f359b758-c3e0-4aba-83a2-b31039b12628 could not be found. Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:52:33.739335 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f359b758-c3e0-4aba-83a2-b31039b12628 could not be found. Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Returning 404 to user: Instance f359b758-c3e0-4aba-83a2-b31039b12628 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ec49870a-5f7d-4f2d-8869-c53e99e00024 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628" status: 404 len: 111 microversion: 2.1 time: 0.032373 Nov 02 14:52:33.745062 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4440/6921] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:33 2022] GET /compute/v2.1/servers/f359b758-c3e0-4aba-83a2-b31039b12628 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:52:33.750319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8a687b1c-e2f5-417a-b8ce-b7f3b3da2638 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '.version_select at 0x7f6f82210f70>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:33.773608 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8a687b1c-e2f5-417a-b8ce-b7f3b3da2638 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-698485212" status: 202 len: 0 microversion: 2.1 time: 0.027074 Nov 02 14:52:33.774261 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2482/6922] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 14:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-698485212 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:52:42.786631 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-faf7517f-23ca-4096-9f70-f8948b148b42 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'create', calling method: .version_select at 0x7f6f80315b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-860239655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfhG9aU0xheKDbGuAcI7YGdisFHNylLVQr39BwPZX77qS/yiYHrg6OJa4cxk9BDLE6mYK9NtcBcIfAAK/bNx83vpqsoXN7AcSaDYBnwLQsPW1WhULfs8jG3J0ajyVxmfQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:42.804804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-faf7517f-23ca-4096-9f70-f8948b148b42 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:52:42.811669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-faf7517f-23ca-4096-9f70-f8948b148b42 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for user ddffc0d1e4054e66ae331d58d44b244f and project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:52:42.835232 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-faf7517f-23ca-4096-9f70-f8948b148b42 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052726 Nov 02 14:52:42.835823 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4441/6923] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:52:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:42.886065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:42.890173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-29214720", "imageRef": "614c104b-8c65-4705-a6e0-2360461ccda8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-860239655", "networks": [{"uuid": "aa5ac7d0-24a5-463d-bc0f-848c77d93a85"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:42.947190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] validate_networks() for [('aa5ac7d0-24a5-463d-bc0f-848c77d93a85', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:52:43.372316 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:52:43.372761 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:52:43.373253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:52:43.373706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:52:43.374167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:52:43.383644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:43.384529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:43.385276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:43.386543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:43.387034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:43.387513 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:43.408058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:52:43.413479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Getting quotas for user ddffc0d1e4054e66ae331d58d44b244f and project f45ee49e89a149b9a68cca6dd8c32ea3. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:52:43.425950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:52:43.428223 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='614c104b-8c65-4705-a6e0-2360461ccda8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:52:43.472056 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [96757c04-6a6b-4154-9c82-1e2a55b50ed1] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:52:44.479819 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [96757c04-6a6b-4154-9c82-1e2a55b50ed1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53520. Nov 02 14:52:44.484085 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3af0ba08-0826-44d9-a47b-f7af711339b5 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599958 Nov 02 14:52:44.484773 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2483/6924] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:52:44.492711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=40 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:44.497751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c2ea0934-0dbb-4686-b2d2-a11d21727853 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:44.498623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c2ea0934-0dbb-4686-b2d2-a11d21727853 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:44.553645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c2ea0934-0dbb-4686-b2d2-a11d21727853 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:44.560738 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c2ea0934-0dbb-4686-b2d2-a11d21727853 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1256 microversion: 2.1 time: 0.068816 Nov 02 14:52:44.561317 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4442/6925] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:44 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:45.586970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:45.588343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:45.595075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:45.595594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:45.596221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:45.596925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:45.597387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:45.597919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:45.671394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:45.679465 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2329e81b-5025-4d25-94c9-88528ac26f50 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1326 microversion: 2.1 time: 0.099025 Nov 02 14:52:45.680961 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2484/6926] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:45 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:46.711644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:46.712297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:46.719863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:46.720356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:46.720799 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:46.721510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:46.721968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:46.722403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:46.911006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:46.919706 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3342e76a-0984-4728-b6ae-b85b2e734f2b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.213928 Nov 02 14:52:46.920548 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4443/6927] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:46 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:47.944162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:47.944770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:47.952108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:47.952887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:47.953334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:47.954048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:47.954682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:47.955132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:48.104873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:48.112668 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-12474bab-729a-48fc-b747-ba10983c4697 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.172871 Nov 02 14:52:48.113240 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2485/6928] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:47 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:49.136848 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:49.138596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:49.146013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:49.146606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:49.147157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:49.148104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:49.149298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:49.149786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:49.296141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:49.308656 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-da51533b-0699-4a3d-a9bf-bb880effcd00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.176208 Nov 02 14:52:49.309606 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4444/6929] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:49 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:50.337843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:50.339607 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:50.343320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:50.353084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:50.353928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:50.354782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:50.356021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:50.356830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:50.357581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:50.533146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:50.543331 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-53db2011-dca4-46d4-a4e7-15c5c3f6189e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.213006 Nov 02 14:52:50.559166 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2486/6930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:50 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:51.569696 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:51.570321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:51.572519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:51.579541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:51.580043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:51.580562 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:51.581293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:51.581747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:51.582217 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:51.729387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:51.737802 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e9d94b1-0661-4d75-8743-618a7faad560 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.174068 Nov 02 14:52:51.749921 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4445/6931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:51 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:52.767412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:52.768092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:52.776309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:52.776819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:52.777303 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:52.778153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:52.778669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:52.779232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:52.929689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:52.939442 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7207fca3-6859-4b69-8f7c-acaaf03aaa4a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.178050 Nov 02 14:52:52.940040 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2487/6932] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:52 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:53.969555 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:53.970174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:53.978369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:53.978860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:53.979330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:53.980043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:53.980507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:53.980919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:54.137823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:54.149404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-791e8ca4-c321-4eb0-ba37-3327330859ce tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.183123 Nov 02 14:52:54.150112 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4446/6933] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:53 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:52:54.448464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b7c0dd2a-3cb6-4695-8487-a0011023504e req-6e28ec48-f6d6-437b-a6b2-6ad591923afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:54.453504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:54.454388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:54.466902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b7c0dd2a-3cb6-4695-8487-a0011023504e req-6e28ec48-f6d6-437b-a6b2-6ad591923afd service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:54.467474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b7c0dd2a-3cb6-4695-8487-a0011023504e req-6e28ec48-f6d6-437b-a6b2-6ad591923afd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:54.467911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b7c0dd2a-3cb6-4695-8487-a0011023504e req-6e28ec48-f6d6-437b-a6b2-6ad591923afd service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:54.482459 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b7c0dd2a-3cb6-4695-8487-a0011023504e req-6e28ec48-f6d6-437b-a6b2-6ad591923afd service nova] Creating event network-changed:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:52:54.488232 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b7c0dd2a-3cb6-4695-8487-a0011023504e req-6e28ec48-f6d6-437b-a6b2-6ad591923afd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047480 Nov 02 14:52:54.488849 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2488/6934] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:55.173722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:55.174535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:55.176302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:55.182334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:55.182810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:55.183291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:55.183984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:55.184431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:55.184849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:55.323606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:55.331415 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fbf6afc2-b1ff-42f0-b839-c5464311df5c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.161531 Nov 02 14:52:55.332008 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4447/6935] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:55 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:56.355226 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:56.355936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:56.362959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:56.363485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:56.363938 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:56.364631 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:56.365097 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:56.365530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:56.496006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:56.503598 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6874a4c4-1ca2-4b69-b32f-92d1ac4f0303 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.152637 Nov 02 14:52:56.504187 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2489/6936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:56 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:57.527654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:57.528261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:57.534985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:57.535491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:57.535918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:57.536594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:57.537040 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:57.537457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:57.669570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:57.677341 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-db4627a4-c26d-4443-8c17-c5be7bdca228 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.154530 Nov 02 14:52:57.677937 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4448/6937] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:57 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:58.702086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:58.702718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:58.709564 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:58.710063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:58.710510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:58.711336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:58.711809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:58.712246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:58.849583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:58.857519 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-07da60d9-0689-4228-86d3-201d83663609 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.160001 Nov 02 14:52:58.858093 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2490/6938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:58 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:59.881769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:59.882369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:59.889645 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:59.890121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:59.890547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:59.891262 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:59.891709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:59.892124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:00.023194 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:00.031595 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-53d578b2-364f-44bf-be23-c8dca4138193 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.154371 Nov 02 14:53:00.032179 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4449/6939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:52:59 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:00.615577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9aac9cdb-9ff2-4a47-85f4-c04826727b9a req-061e4a26-cb7b-4125-89f9-8251f7835dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "name": "network-vif-plugged", "status": "completed", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:00.626939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9aac9cdb-9ff2-4a47-85f4-c04826727b9a req-061e4a26-cb7b-4125-89f9-8251f7835dca service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:00.627472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9aac9cdb-9ff2-4a47-85f4-c04826727b9a req-061e4a26-cb7b-4125-89f9-8251f7835dca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:00.627906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9aac9cdb-9ff2-4a47-85f4-c04826727b9a req-061e4a26-cb7b-4125-89f9-8251f7835dca service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:00.638672 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9aac9cdb-9ff2-4a47-85f4-c04826727b9a req-061e4a26-cb7b-4125-89f9-8251f7835dca service nova] Creating event network-vif-plugged:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:53:00.644073 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9aac9cdb-9ff2-4a47-85f4-c04826727b9a req-061e4a26-cb7b-4125-89f9-8251f7835dca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087709 Nov 02 14:53:00.645093 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2491/6940] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:01.054794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:01.055433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:01.062389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:01.062875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:01.063346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:01.064048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:01.064499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:01.064921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:01.202214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:01.210127 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3e06de56-2406-4a37-b4dc-c3cbcf7fb866 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1356 microversion: 2.1 time: 0.159293 Nov 02 14:53:01.210703 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4450/6941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:01 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:02.234275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:02.234997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:02.242027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.243089 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.243569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.244258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.244724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.245161 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.379406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:02.387269 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-364076b3-0bf1-45c2-ac5f-a7ed260fded4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1545 microversion: 2.1 time: 0.157233 Nov 02 14:53:02.387851 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2492/6942] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:02 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:53:02.410091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:02.410697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:02.418166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.418657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.419113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.420283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.420995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.421473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.551875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:02.559634 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f4f14fc-c74d-4b06-8665-d42dc0a5c4aa tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1545 microversion: 2.1 time: 0.153473 Nov 02 14:53:02.560210 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4451/6943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:02 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:02.581809 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:02.587157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:02.587940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Searching by: {'deleted': False, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3'} {{(pid=137558) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:53:02.593339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.593826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.594269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.594994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.595491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.595929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.620359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.multi_cell_list [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:53:02.646966 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-092d2a95-b2aa-4cc6-8414-bd81fe55ca19 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.068958 Nov 02 14:53:02.647583 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2493/6944] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 14:53:02 2022] GET /compute/v2.1/servers => generated 341 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:02.659813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:02.660463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:02.667041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.667559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.667997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.668690 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:02.669147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:02.669573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:02.799845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:02.807910 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-aa27283f-8b08-4457-a1c8-4c8c4cc72375 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1545 microversion: 2.1 time: 0.151930 Nov 02 14:53:02.808495 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4452/6945] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:02 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:04.330729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10c6cfce-4f4a-4705-ae76-a440bd4d48e1"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:04.333136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:04.339893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:04.340391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:04.340834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:04.341529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:04.341992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:04.342422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:04.583542 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f643334b-037f-4e19-860d-08710f4b333b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256610 Nov 02 14:53:04.584722 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2494/6946] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 14:53:04 2022] POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:15.377751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:15.378348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:15.381223 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=15 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:15.381880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=60 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:15.388086 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:15.388567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:15.388997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:15.389685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:15.390137 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:15.390557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:15.528323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:15.536659 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75803a71-4441-4e84-81b9-45a2eeaf128f tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1591 microversion: 2.1 time: 0.162865 Nov 02 14:53:15.537239 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4453/6947] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:15 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1591 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:17.458745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-05920b3d-fe0e-40b1-b72c-696a8c291754 req-85e14794-81e2-4030-81cf-ddf795f240ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:17.465463 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] AMQP server on 10.222.0.18:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 02 14:53:17.465901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:17.467212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=17 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:17.468206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:17.474516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-05920b3d-fe0e-40b1-b72c-696a8c291754 req-85e14794-81e2-4030-81cf-ddf795f240ff service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:17.475213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-05920b3d-fe0e-40b1-b72c-696a8c291754 req-85e14794-81e2-4030-81cf-ddf795f240ff service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:17.475669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-05920b3d-fe0e-40b1-b72c-696a8c291754 req-85e14794-81e2-4030-81cf-ddf795f240ff service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:17.489101 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-05920b3d-fe0e-40b1-b72c-696a8c291754 req-85e14794-81e2-4030-81cf-ddf795f240ff service nova] Creating event network-changed:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:53:17.494966 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-05920b3d-fe0e-40b1-b72c-696a8c291754 req-85e14794-81e2-4030-81cf-ddf795f240ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040315 Nov 02 14:53:17.495576 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2495/6948] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:18.724278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-361112496"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:18.724817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:18.732220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:18.732710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:18.733148 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:18.733845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:18.734299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:18.734719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:18.866112 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.network.security_group_api [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Adding security group e8801e3b-036a-4919-9510-d4b4413a46ce to port 771ef11f-bede-46e9-8996-5d440629bc26 Nov 02 14:53:19.184752 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-878251aa-a21b-4620-a5fe-2f6d6a20d565 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/action" status: 202 len: 0 microversion: 2.1 time: 0.463299 Nov 02 14:53:19.185605 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4454/6949] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:53:18 2022] POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:53:19.195921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:19.196929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:19.201662 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8943c27c-2b93-4963-8259-5b078c84b385 req-652af9e1-ad2a-496e-95c2-a16a39098fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:19.204708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:19.205478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:19.206132 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:19.207083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:19.207824 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:19.208469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:19.220374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8943c27c-2b93-4963-8259-5b078c84b385 req-652af9e1-ad2a-496e-95c2-a16a39098fc5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:19.221067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8943c27c-2b93-4963-8259-5b078c84b385 req-652af9e1-ad2a-496e-95c2-a16a39098fc5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:19.221839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8943c27c-2b93-4963-8259-5b078c84b385 req-652af9e1-ad2a-496e-95c2-a16a39098fc5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:19.245201 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8943c27c-2b93-4963-8259-5b078c84b385 req-652af9e1-ad2a-496e-95c2-a16a39098fc5 service nova] Creating event network-changed:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:53:19.252587 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8943c27c-2b93-4963-8259-5b078c84b385 req-652af9e1-ad2a-496e-95c2-a16a39098fc5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061681 Nov 02 14:53:19.254094 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2496/6950] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:53:19.392482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:19.403336 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-37a47628-a0b9-472e-bbef-881a56a39c00 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1755 microversion: 2.1 time: 0.212426 Nov 02 14:53:19.419894 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4455/6951] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:19 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:35.424095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:53:35.426491 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:35.429655 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:53:35.430686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:35.431338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:35.437505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:35.438063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:35.438435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:35.439170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:35.439636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:35.440071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:35.514573 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-182a189d-0010-4fae-96af-37e3d9195a8c tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/action" status: 202 len: 0 microversion: 2.1 time: 0.094483 Nov 02 14:53:35.515326 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2497/6952] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:53:35 2022] POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:53:35.524859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:35.525573 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:35.527663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:35.528322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:53:35.535422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:35.536496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:35.536950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:35.537859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:35.538320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:35.538753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:35.698358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:35.707039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-75113909-0028-4e3d-bb8a-828f47217ec6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1747 microversion: 2.1 time: 0.186559 Nov 02 14:53:35.707747 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4456/6953] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:35 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1747 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:36.734652 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:36.735448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:36.745299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:36.745789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:36.746233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:36.746937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:36.747431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:36.747868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:36.751679 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53694. Nov 02 14:53:36.906293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:36.915335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1f176c20-727f-4e59-9217-1233c065a5b2 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.186349 Nov 02 14:53:36.916175 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2498/6954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:36 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:37.939896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:37.940511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:37.949176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:37.949659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:37.950094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:37.950792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:37.951278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:37.951707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:38.093397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:38.101695 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2f014de2-d9d2-44b7-ab13-ce12f18e0e24 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.165807 Nov 02 14:53:38.102840 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4457/6955] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:37 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:39.127978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:39.128594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:39.136323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:39.136820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:39.137264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:39.138001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:39.138463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:39.138899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:39.286512 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:39.295156 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99e36a5c-088f-4387-87c4-3b38ce4be6fc tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.171020 Nov 02 14:53:39.295739 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2499/6956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:39 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:40.371285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:40.371926 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:40.377975 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:40.378445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:40.378871 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:40.379653 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:40.380105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:40.380521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:40.531697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:40.540055 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-43fbc4ce-a9d3-4eb6-92c5-683048d68027 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.224337 Nov 02 14:53:40.540640 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4458/6957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:40 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:41.564806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:41.565433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:41.573314 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:41.573807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:41.574254 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:41.574959 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:41.575455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:41.575893 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:41.729152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:41.737502 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0311782-3691-4c7f-9696-20c64ef411b7 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.176678 Nov 02 14:53:41.738081 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2500/6958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:41 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:42.762336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:42.762974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:42.769805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:42.770286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:42.770716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:42.771429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:42.771878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:42.772296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:42.911386 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:42.920641 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-793d2035-cf67-4f8d-b015-c92388140f4d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.162742 Nov 02 14:53:42.921261 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4459/6959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:42 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:43.945393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:43.946109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:43.953042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:43.953532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:43.953984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:43.954682 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:43.955183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:43.955621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:44.096950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:44.105887 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-82c8ebc6-3f7a-4e24-a84d-b1ae0222388e tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.164668 Nov 02 14:53:44.106456 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2501/6960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:43 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:45.130389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:45.131031 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:45.138476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:45.138956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:45.139433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:45.140123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:45.140575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:45.140997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:45.287403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:45.295783 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1766ddf5-7205-405e-921b-54b643dc091a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.169296 Nov 02 14:53:45.296378 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4460/6961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:45 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:46.319059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:46.319696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:46.327287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:46.327785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:46.328240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:46.328952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:46.329427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:46.329873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:46.481018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:46.490933 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ee2e1a08-0c78-4a18-9309-9d0f9699ad6a tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1752 microversion: 2.1 time: 0.176003 Nov 02 14:53:46.491556 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2502/6962] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:46 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:53:47.515295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:53:47.515905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:53:47.522772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:47.523285 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:47.523719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:47.524401 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:53:47.524852 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:53:47.525274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:53:47.674389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:53:47.683432 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c81571cf-bba5-4c7f-91f9-9f63efe52796 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1755 microversion: 2.1 time: 0.172030 Nov 02 14:53:47.684013 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4461/6963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:53:47 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:19.967556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-361112496"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:19.968191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:19.970329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=12 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:19.971032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:19.976755 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:19.977251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:19.977698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:19.978399 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:19.978861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:19.979322 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:20.107968 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.network.security_group_api [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Removing security group e8801e3b-036a-4919-9510-d4b4413a46ce from port 771ef11f-bede-46e9-8996-5d440629bc26 Nov 02 14:54:20.441383 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-49a09bfe-d027-4244-b8c9-931298c6bb60 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/action" status: 202 len: 0 microversion: 2.1 time: 0.477716 Nov 02 14:54:20.445101 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2503/6964] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:54:19 2022] POST /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:54:20.445329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-ce32e013-edf0-499c-9ff5-259aebfac258 req-7bf95489-51dd-461f-b24d-bd41daf26adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:20.450467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=12 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:20.454657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=36 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:20.467992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ce32e013-edf0-499c-9ff5-259aebfac258 req-7bf95489-51dd-461f-b24d-bd41daf26adb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:20.471786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ce32e013-edf0-499c-9ff5-259aebfac258 req-7bf95489-51dd-461f-b24d-bd41daf26adb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:20.472459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-ce32e013-edf0-499c-9ff5-259aebfac258 req-7bf95489-51dd-461f-b24d-bd41daf26adb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:20.499321 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-ce32e013-edf0-499c-9ff5-259aebfac258 req-7bf95489-51dd-461f-b24d-bd41daf26adb service nova] Creating event network-changed:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:54:20.508901 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-ce32e013-edf0-499c-9ff5-259aebfac258 req-7bf95489-51dd-461f-b24d-bd41daf26adb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067722 Nov 02 14:54:20.511807 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4462/6965] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:54:21.738530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:21.739123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:21.745108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:21.745594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:21.746041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:21.746731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:21.747221 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:21.747655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:21.830990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lazy-loading 'services' on Instance uuid 2aa57e2f-0e61-495c-8a22-5635311a455e {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:54:21.906612 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfb31bdb-d528-4d0b-a8cd-f76a23b417ad tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments/10c6cfce-4f4a-4705-ae76-a440bd4d48e1" status: 202 len: 0 microversion: 2.1 time: 0.172744 Nov 02 14:54:21.907646 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2504/6966] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:54:21 2022] DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments/10c6cfce-4f4a-4705-ae76-a440bd4d48e1 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:54:21.917503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:21.921080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:21.932729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:21.933278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:21.933716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:21.934428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:21.934944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:21.935598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:21.971069 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-51440b02-15d5-4882-996b-72f6d510d370 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058509 Nov 02 14:54:21.971796 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4463/6967] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:54:21 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:22.529360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5cb01d81-ef22-4445-b46c-e7946aff2c3f req-aee49e5c-35d9-4f49-8ecb-706562c832f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:22.540690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5cb01d81-ef22-4445-b46c-e7946aff2c3f req-aee49e5c-35d9-4f49-8ecb-706562c832f3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:22.541216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5cb01d81-ef22-4445-b46c-e7946aff2c3f req-aee49e5c-35d9-4f49-8ecb-706562c832f3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:22.541661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5cb01d81-ef22-4445-b46c-e7946aff2c3f req-aee49e5c-35d9-4f49-8ecb-706562c832f3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:22.556550 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5cb01d81-ef22-4445-b46c-e7946aff2c3f req-aee49e5c-35d9-4f49-8ecb-706562c832f3 service nova] Creating event network-changed:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:54:22.562142 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5cb01d81-ef22-4445-b46c-e7946aff2c3f req-aee49e5c-35d9-4f49-8ecb-706562c832f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Nov 02 14:54:22.562951 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2505/6968] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:22.984604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:22.986901 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:22.995239 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:22.995978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:22.996511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:22.997302 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:22.998416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:22.998952 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:23.031280 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-179af5aa-574c-4664-9d20-e82003c70578 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051100 Nov 02 14:54:23.036806 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4464/6969] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:54:22 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:24.045840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:24.048232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:24.054481 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:24.054970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:24.055448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:24.056148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:24.056612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:24.057050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:24.087411 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3d437a4f-f277-4e4a-bae4-2ea3f8b71669 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046649 Nov 02 14:54:24.087981 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2506/6970] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:54:24 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:25.100221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:25.102308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:25.109585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:25.110063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:25.110502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:25.111225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:25.111677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:25.112099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:25.141817 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8ff63291-12c2-4c21-bab5-324c05b814d4 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045750 Nov 02 14:54:25.142737 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4465/6971] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:54:25 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:26.155267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:26.157789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:26.165722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:26.166368 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:26.166816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:26.167555 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:26.168007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:26.168437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:26.198824 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-829ddf8e-7e98-4ff0-8990-476b2f3575b8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048105 Nov 02 14:54:26.199426 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2507/6972] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:54:26 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:27.212174 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:27.214344 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:27.218319 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:54:27.218472 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 14:54:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments (ip 10.222.0.18) !!! Nov 02 14:54:27.226448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:27.226949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:27.227405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:27.228092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:27.228534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:27.228950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:27.258871 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6ac2330-a06a-4b45-8114-94a4ff400470 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050681 Nov 02 14:54:27.259469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4466/6973] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 14:54:27 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:54:27.270412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:27.270961 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:27.277768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:27.278263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:27.279246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:27.279945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:27.280414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:27.280853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:27.355229 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] HTTP exception thrown: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e is not attached to volume 10c6cfce-4f4a-4705-ae76-a440bd4d48e1 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Request method failure captured: Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: request: DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments/10c6cfce-4f4a-4705-ae76-a440bd4d48e1 HTTP/1.1 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoND0-5gYvCrlQb2ifOVoZfQHAIbOTv-qh2iW1wWcfukGWkxgvDyD4fQBNnQX5x5YPaLV950jTFJk-WV9X9NimoHiv1tFdhfxLoDuOGqzxT5IfksVVpc5Ex_fw48_2ebOySotPhPVn27eF5e__qDU1_5pqK7tAmT4ZciSiY_E4QeScw Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f45ee49e89a149b9a68cca6dd8c32ea3"}]}] Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: ddffc0d1e4054e66ae331d58d44b244f Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e is not attached to volume 10c6cfce-4f4a-4705-ae76-a440bd4d48e1 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'server_id': '2aa57e2f-0e61-495c-8a22-5635311a455e', 'id': '10c6cfce-4f4a-4705-ae76-a440bd4d48e1'} Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 10c6cfce-4f4a-4705-ae76-a440bd4d48e1. Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e is not attached to volume 10c6cfce-4f4a-4705-ae76-a440bd4d48e1 Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:54:27.356845 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e is not attached to volume 10c6cfce-4f4a-4705-ae76-a440bd4d48e1 Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Returning 404 to user: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e is not attached to volume 10c6cfce-4f4a-4705-ae76-a440bd4d48e1 {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d3568139-ebb1-4e68-9ae8-91bacaed41b6 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments/10c6cfce-4f4a-4705-ae76-a440bd4d48e1" status: 404 len: 154 microversion: 2.1 time: 0.092007 Nov 02 14:54:27.361745 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2508/6974] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 14:54:27 2022] DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e/os-volume_attachments/10c6cfce-4f4a-4705-ae76-a440bd4d48e1 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:54:30.618638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:30.619247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:30.626731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:30.627248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:30.627677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:30.628365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:30.628811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:30.629226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:30.653666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:54:30.738301 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e20f2ee1-d0c1-459d-aad5-46cfdadb1624 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 204 len: 0 microversion: 2.1 time: 0.123141 Nov 02 14:54:30.739894 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4467/6975] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:54:30 2022] DELETE /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:54:30.748421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:30.749163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:30.757370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:30.757873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:30.758427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:30.759257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:30.759733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:30.760173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:30.898769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:30.907455 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79efcd7c-5e84-4cbf-a116-d6ec1bb78cbb tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1551 microversion: 2.1 time: 0.163111 Nov 02 14:54:30.908032 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2509/6976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:30 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:31.933615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:31.934321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:31.941911 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:31.942400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:31.942836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:31.943831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:31.944296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:31.944724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:32.474770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddffc0d1e4054e66ae331d58d44b244f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45ee49e89a149b9a68cca6dd8c32ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:32.483898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fc77a938-e2ce-4372-9f9d-f384c816c21b tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 200 len: 1551 microversion: 2.1 time: 0.554744 Nov 02 14:54:32.484493 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4468/6977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:31 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 1551 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:32.942659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-64ec2932-218c-4bb0-9b72-aecdddad3108 req-f1a901d7-b856-4a03-a070-6e9ccf8ee5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa57e2f-0e61-495c-8a22-5635311a455e", "name": "network-vif-deleted", "tag": "771ef11f-bede-46e9-8996-5d440629bc26"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:32.953991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-64ec2932-218c-4bb0-9b72-aecdddad3108 req-f1a901d7-b856-4a03-a070-6e9ccf8ee5bf service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:32.954641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-64ec2932-218c-4bb0-9b72-aecdddad3108 req-f1a901d7-b856-4a03-a070-6e9ccf8ee5bf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:32.955079 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-64ec2932-218c-4bb0-9b72-aecdddad3108 req-f1a901d7-b856-4a03-a070-6e9ccf8ee5bf service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:32.967326 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-64ec2932-218c-4bb0-9b72-aecdddad3108 req-f1a901d7-b856-4a03-a070-6e9ccf8ee5bf service nova] Creating event network-vif-deleted:771ef11f-bede-46e9-8996-5d440629bc26 for instance 2aa57e2f-0e61-495c-8a22-5635311a455e on n-h2-858238-3 Nov 02 14:54:32.972415 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-64ec2932-218c-4bb0-9b72-aecdddad3108 req-f1a901d7-b856-4a03-a070-6e9ccf8ee5bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033413 Nov 02 14:54:32.973019 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2510/6978] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:33.508136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:33.508674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] [instance: 2aa57e2f-0e61-495c-8a22-5635311a455e] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:33.515960 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:33.516439 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:33.516874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:33.517557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:33.518008 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:33.518431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:33.532735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] HTTP exception thrown: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e could not be found. Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Request method failure captured: Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e HTTP/1.1 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoND0-5gYvCrlQb2ifOVoZfQHAIbOTv-qh2iW1wWcfukGWkxgvDyD4fQBNnQX5x5YPaLV950jTFJk-WV9X9NimoHiv1tFdhfxLoDuOGqzxT5IfksVVpc5Ex_fw48_2ebOySotPhPVn27eF5e__qDU1_5pqK7tAmT4ZciSiY_E4QeScw Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f45ee49e89a149b9a68cca6dd8c32ea3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f45ee49e89a149b9a68cca6dd8c32ea3"}]}] Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: f45ee49e89a149b9a68cca6dd8c32ea3 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestMinimumBasicScenario-255114236 Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: ddffc0d1e4054e66ae331d58d44b244f Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestMinimumBasicScenario-255114236-project Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e could not be found. Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2aa57e2f-0e61-495c-8a22-5635311a455e'} Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e could not be found. Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e could not be found. Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:54:33.534369 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e could not be found. Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Returning 404 to user: Instance 2aa57e2f-0e61-495c-8a22-5635311a455e could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45d92351-3d7e-46d3-8f30-0d8d72e8696d tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e" status: 404 len: 111 microversion: 2.1 time: 0.031723 Nov 02 14:54:33.542250 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4469/6979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:33 2022] GET /compute/v2.1/servers/2aa57e2f-0e61-495c-8a22-5635311a455e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:54:33.545328 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0992de8a-2e07-4bfb-b5b1-e04e8fb746c8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] Calling method '.version_select at 0x7f6f825fc0d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:33.564983 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0992de8a-2e07-4bfb-b5b1-e04e8fb746c8 tempest-TestMinimumBasicScenario-255114236 tempest-TestMinimumBasicScenario-255114236-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-860239655" status: 202 len: 0 microversion: 2.1 time: 0.023749 Nov 02 14:54:33.565559 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2511/6980] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 14:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-860239655 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:54:42.615569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3faa1a57-4944-4903-8248-119d3877e421 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: .version_select at 0x7f6f80d9b820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2105920062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApvP+RKUQdRJj/3Lm8+P4ohlp10mfTb1LQngfP3XZQquURp3b7bzUrph2WZ9kOTcXMglIGQQP36jfSLmUqQh80pMaQDUKGI7qq7ofoSVnMLKqxUuqt5PXvBMH+K6+STQA=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:42.631875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3faa1a57-4944-4903-8248-119d3877e421 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:54:42.637684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-3faa1a57-4944-4903-8248-119d3877e421 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:54:42.662327 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3faa1a57-4944-4903-8248-119d3877e421 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.209100 Nov 02 14:54:42.662925 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4470/6981] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:54:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:48.243797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:48.244667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:48.249199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-773961202", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "7daa9f10-0477-4e54-9ff9-3ccf6c6dcd8d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2105920062", "security_groups": [{"name": "tempest-secgroup-smoke-2115333080"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:48.406011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] validate_networks() for [('7daa9f10-0477-4e54-9ff9-3ccf6c6dcd8d', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:54:48.842644 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:54:48.843250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:54:48.843750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:54:48.844177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:54:48.844613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:54:48.853777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:48.854275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:48.854726 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:48.855507 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:48.855981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:48.856423 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:48.875550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:54:48.880853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:54:48.894220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:54:48.896673 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:54:48.948119 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a33451b4-9213-4fa4-9142-fbd802fb661c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706584 Nov 02 14:54:48.949092 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2512/6982] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:54:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:54:48.958774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:48.962823 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9376a681-c193-486f-8b5b-1d153ff59ae7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:48.963685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9376a681-c193-486f-8b5b-1d153ff59ae7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:49.032559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9376a681-c193-486f-8b5b-1d153ff59ae7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:49.040269 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9376a681-c193-486f-8b5b-1d153ff59ae7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1266 microversion: 2.1 time: 0.083028 Nov 02 14:54:49.041022 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4471/6983] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:48 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:50.065764 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:50.067110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:50.074821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:50.075433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:50.076216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:50.077030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:50.077578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:50.078099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:50.174687 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:50.184195 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9528463d-2c62-4a70-a25e-e71bdf5482a2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1318 microversion: 2.1 time: 0.123909 Nov 02 14:54:50.185124 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2513/6984] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:50 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:51.217597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:51.218785 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:51.222307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:51.236459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:51.237438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:51.238038 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:51.238937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:51.239698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:51.240360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:51.461457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:51.472178 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-55fa3bc3-fe89-4fef-9fc0-0aafecd11ebd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.266024 Nov 02 14:54:51.473114 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4472/6985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:51 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:52.145778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3d3b5ffd-c2ab-400b-9863-e357a149ee32 req-2c16136b-7084-4d51-a89c-7d07f759fd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0496e1-3744-4ae0-a7f1-fa7f8685e137", "tag": "936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:52.160669 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3d3b5ffd-c2ab-400b-9863-e357a149ee32 req-2c16136b-7084-4d51-a89c-7d07f759fd10 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:52.161482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3d3b5ffd-c2ab-400b-9863-e357a149ee32 req-2c16136b-7084-4d51-a89c-7d07f759fd10 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:52.162163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3d3b5ffd-c2ab-400b-9863-e357a149ee32 req-2c16136b-7084-4d51-a89c-7d07f759fd10 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:52.174060 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3d3b5ffd-c2ab-400b-9863-e357a149ee32 req-2c16136b-7084-4d51-a89c-7d07f759fd10 service nova] Creating event network-changed:936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd for instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 on n-h1-858238-3 Nov 02 14:54:52.179514 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3d3b5ffd-c2ab-400b-9863-e357a149ee32 req-2c16136b-7084-4d51-a89c-7d07f759fd10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037387 Nov 02 14:54:52.180366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2514/6986] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:52.498857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:52.499496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:52.506894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:52.507688 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:52.508384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:52.509177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:52.509707 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:52.510338 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:52.664378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:52.672884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0bac8192-896e-41ea-a880-902e2e969280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.177947 Nov 02 14:54:52.673469 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4473/6987] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:52 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:54:53.697046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:53.697963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:53.704740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:53.705246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:53.705695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:53.706406 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:53.706876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:53.707350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:53.959016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:53.966761 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b08919a9-d97a-4bb0-941f-7a567f6178ee tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.275085 Nov 02 14:54:53.967366 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2515/6988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:53 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:54.990228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:54.990783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:54.997615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:54.998089 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:54.998521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:54.999219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:54.999666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:55.000081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:55.129808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:55.137575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-af5cc725-0c4a-4710-864e-471c74081986 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.151320 Nov 02 14:54:55.138158 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4474/6989] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:54 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:56.161838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:56.162448 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:56.169289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:56.169786 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:56.170237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:56.171571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:56.172043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:56.172486 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:56.306748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:56.314568 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3180d4ce-78b2-46e0-82ec-e23b00e4077a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.156828 Nov 02 14:54:56.315162 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2516/6990] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:56 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:57.337776 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:57.338384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:57.346427 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:57.346937 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:57.347397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:57.348120 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:57.348570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:57.348986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:57.398594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b52d466a-6b9d-4ed1-8093-cd7205f542f4 req-70d98d3c-db18-44ea-aabe-77bc6b87671b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0496e1-3744-4ae0-a7f1-fa7f8685e137", "name": "network-vif-plugged", "status": "completed", "tag": "936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:57.413497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b52d466a-6b9d-4ed1-8093-cd7205f542f4 req-70d98d3c-db18-44ea-aabe-77bc6b87671b service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:57.414315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b52d466a-6b9d-4ed1-8093-cd7205f542f4 req-70d98d3c-db18-44ea-aabe-77bc6b87671b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:57.414942 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b52d466a-6b9d-4ed1-8093-cd7205f542f4 req-70d98d3c-db18-44ea-aabe-77bc6b87671b service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:57.429504 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b52d466a-6b9d-4ed1-8093-cd7205f542f4 req-70d98d3c-db18-44ea-aabe-77bc6b87671b service nova] Creating event network-vif-plugged:936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd for instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 on n-h1-858238-3 Nov 02 14:54:57.434641 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b52d466a-6b9d-4ed1-8093-cd7205f542f4 req-70d98d3c-db18-44ea-aabe-77bc6b87671b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040493 Nov 02 14:54:57.435435 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2517/6991] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:57.502390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:57.510516 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9bd467a-9130-4fad-829d-6762247e3a70 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.176573 Nov 02 14:54:57.511174 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4475/6992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:57 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:58.535678 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:58.536321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:58.542731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:58.543263 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:58.543713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:58.544422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:58.544894 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:58.545359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:58.689163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:58.697222 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-074166cb-bd47-4ccf-801a-d5ba4b04f653 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1392 microversion: 2.1 time: 0.167218 Nov 02 14:54:58.697792 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2518/6993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:58 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:54:59.720238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:59.720787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:59.723404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:59.728948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:59.729418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:59.729846 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:59.730518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:59.730959 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:59.731393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:59.864474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:59.872690 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7dc4c9d3-9704-45e0-8093-5c6b34d51cc7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1563 microversion: 2.1 time: 0.157174 Nov 02 14:54:59.873268 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4476/6994] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:59 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:59.897358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:59.897991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:59.900026 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:59.900824 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:59.908657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:59.909169 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:59.909617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:59.910331 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:59.910800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:59.911283 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:00.057340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:00.067498 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-26904813-b0a9-4a21-86a2-67a6e3620ad8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1563 microversion: 2.1 time: 0.174400 Nov 02 14:55:00.068091 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2519/6995] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:54:59 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:01.679114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:01.679850 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:01.680641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5a7ec83e-3467-4d52-bae8-2feb4aeb1b42 req-1228809b-3dbe-4420-9197-64dbe112a65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0496e1-3744-4ae0-a7f1-fa7f8685e137", "tag": "936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:01.687112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:01.687698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:01.688203 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:01.688978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:01.689507 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:01.690029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:01.691415 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5a7ec83e-3467-4d52-bae8-2feb4aeb1b42 req-1228809b-3dbe-4420-9197-64dbe112a65c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:01.691902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5a7ec83e-3467-4d52-bae8-2feb4aeb1b42 req-1228809b-3dbe-4420-9197-64dbe112a65c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:01.692342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5a7ec83e-3467-4d52-bae8-2feb4aeb1b42 req-1228809b-3dbe-4420-9197-64dbe112a65c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:01.705073 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5a7ec83e-3467-4d52-bae8-2feb4aeb1b42 req-1228809b-3dbe-4420-9197-64dbe112a65c service nova] Creating event network-changed:936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd for instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 on n-h1-858238-3 Nov 02 14:55:01.710334 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5a7ec83e-3467-4d52-bae8-2feb4aeb1b42 req-1228809b-3dbe-4420-9197-64dbe112a65c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033237 Nov 02 14:55:01.711415 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2520/6996] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:01.901858 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:01.910088 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-52bda14d-2434-4f31-86be-300bc3608817 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1563 microversion: 2.1 time: 0.235660 Nov 02 14:55:01.910887 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4477/6997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:01 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1563 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:23.161383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:23.162237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=38 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:23.166743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:23.169056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:23.177044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:23.177547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:23.178000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:23.178702 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:23.179218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:23.179658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:23.235027 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4c70b261-02c3-4730-a84f-0bad48e0a010 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action" status: 200 len: 24575 microversion: 2.1 time: 0.075430 Nov 02 14:55:23.235716 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2521/6998] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:55:23 2022] POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action => generated 24575 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:55:29.698874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:29.699517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:29.701412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=11 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:29.702052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=36 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:29.708693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.709168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.709599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.710603 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.710734 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.711224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.779693 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f4436c3f-4800-4d2c-a783-7048bdda00fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action" status: 202 len: 0 microversion: 2.1 time: 0.085253 Nov 02 14:55:29.780597 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4478/6999] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:55:29 2022] POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:55:29.789923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:29.790760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:29.798385 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.798876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.799343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.800076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.800878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.801325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.957003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:29.966168 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ef7e84ab-2da1-4eb2-9d77-0bdcf5c76a1d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1687 microversion: 2.1 time: 0.180317 Nov 02 14:55:29.966756 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2522/7000] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:29 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:30.992520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:30.993219 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:30.999410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:30.999875 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:31.000313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:31.001000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:31.001453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:31.001881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:31.134739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:31.143025 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d3c0530-9b67-4fd7-bcff-442485507db2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1667 microversion: 2.1 time: 0.155648 Nov 02 14:55:31.143634 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4479/7001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:30 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:32.240429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:32.242625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:32.250160 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.250650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.251199 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.251803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.252261 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.252692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.301636 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9aafd4ef-0d5e-4c86-853d-ad41af60834f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action" status: 200 len: 32648 microversion: 2.1 time: 0.064860 Nov 02 14:55:32.302269 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2523/7002] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:55:32 2022] POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action => generated 32648 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:55:32.314087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:32.314621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:32.322969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.323520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.323955 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.324644 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.325095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.325514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.390500 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e8d2e5fd-8de2-4c06-9093-06ae9029c161 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action" status: 202 len: 0 microversion: 2.1 time: 0.080144 Nov 02 14:55:32.391333 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4480/7003] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:55:32 2022] POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:55:32.399815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:32.400527 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:32.408147 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.408690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.409090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.410017 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.410474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.410907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.545843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:32.555188 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-15bc96f3-699b-4d6d-81ac-5b3d23a0ab24 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1674 microversion: 2.1 time: 0.159460 Nov 02 14:55:32.555956 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2524/7004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:32 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:33.580029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:33.580772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:33.588360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:33.588844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:33.589277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:33.589971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:33.590422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:33.590845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:33.729413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:33.737278 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7eed31ab-a46f-4fc5-a743-191d823e1c05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1682 microversion: 2.1 time: 0.161565 Nov 02 14:55:33.737858 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4481/7005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:33 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:33.842110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:33.844419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:33.852419 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:33.852916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:33.853391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:33.854108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:33.854574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:33.855009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:33.906274 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9e5476aa-1bd3-4cf6-aaf4-693ffea62998 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action" status: 200 len: 35056 microversion: 2.1 time: 0.067934 Nov 02 14:55:33.906958 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2525/7006] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:55:33 2022] POST /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137/action => generated 35056 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:55:34.919307 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:34.919807 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:34.921613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5952e4d7-09a9-4031-9783-1373235be1c5 req-d56d5aa3-3e3c-4e5a-9d5e-5e3a6561a029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0496e1-3744-4ae0-a7f1-fa7f8685e137", "tag": "936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:34.928503 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:34.929322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:34.930027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:34.931079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:34.931894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:34.932534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:34.933753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5952e4d7-09a9-4031-9783-1373235be1c5 req-d56d5aa3-3e3c-4e5a-9d5e-5e3a6561a029 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:34.934251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5952e4d7-09a9-4031-9783-1373235be1c5 req-d56d5aa3-3e3c-4e5a-9d5e-5e3a6561a029 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:34.934691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5952e4d7-09a9-4031-9783-1373235be1c5 req-d56d5aa3-3e3c-4e5a-9d5e-5e3a6561a029 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:34.946783 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5952e4d7-09a9-4031-9783-1373235be1c5 req-d56d5aa3-3e3c-4e5a-9d5e-5e3a6561a029 service nova] Creating event network-changed:936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd for instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 on n-h1-858238-3 Nov 02 14:55:34.952166 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5952e4d7-09a9-4031-9783-1373235be1c5 req-d56d5aa3-3e3c-4e5a-9d5e-5e3a6561a029 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034442 Nov 02 14:55:34.953443 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2526/7007] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:55:34.962884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:55:35.048116 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3df7f400-df96-4f6d-b6ea-d015b0005aff tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 204 len: 0 microversion: 2.1 time: 0.132665 Nov 02 14:55:35.052047 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4482/7008] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:55:34 2022] DELETE /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:55:35.059051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:35.059811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:35.067749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:35.068257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:35.068715 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:35.069708 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:35.070274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:35.070977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:35.225781 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:35.234094 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b91e8e51-d6e6-47c5-b3bb-349d2c56ad7c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1688 microversion: 2.1 time: 0.180546 Nov 02 14:55:35.234682 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2527/7009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:35 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:36.260640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:36.261329 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:36.268559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:36.269033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:36.269462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:36.270159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:36.270589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:36.271004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:36.470481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:36.478389 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-16f84f65-9194-4e13-bb01-e95e3a45c8cd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1688 microversion: 2.1 time: 0.221955 Nov 02 14:55:36.478962 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4483/7010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:36 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:37.441330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-dd3e5811-24df-483d-9fbe-45b149901511 req-225b62e2-b4e0-4427-a12c-c9594113232a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0496e1-3744-4ae0-a7f1-fa7f8685e137", "name": "network-vif-deleted", "tag": "936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:37.451865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-dd3e5811-24df-483d-9fbe-45b149901511 req-225b62e2-b4e0-4427-a12c-c9594113232a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:37.452356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-dd3e5811-24df-483d-9fbe-45b149901511 req-225b62e2-b4e0-4427-a12c-c9594113232a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:37.452852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-dd3e5811-24df-483d-9fbe-45b149901511 req-225b62e2-b4e0-4427-a12c-c9594113232a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:37.467040 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-dd3e5811-24df-483d-9fbe-45b149901511 req-225b62e2-b4e0-4427-a12c-c9594113232a service nova] Creating event network-vif-deleted:936f5dd3-c0e0-4d4e-ad6d-98bf24ec77dd for instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 on n-h1-858238-3 Nov 02 14:55:37.472406 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-dd3e5811-24df-483d-9fbe-45b149901511 req-225b62e2-b4e0-4427-a12c-c9594113232a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035074 Nov 02 14:55:37.473354 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2528/7011] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:37.501946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:37.502572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:37.509516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:37.509995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:37.510418 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:37.511138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:37.511590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:37.512006 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:37.543811 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:37.544291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:37.544719 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:37.545159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lazy-loading 'fault' on Instance uuid 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:55:37.589552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:37.598063 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-521a7357-cbeb-40c7-af1c-8c07697cfae0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 200 len: 1356 microversion: 2.1 time: 0.100022 Nov 02 14:55:37.598628 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4484/7012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:37 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:38.623335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:38.623966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 4e0496e1-3744-4ae0-a7f1-fa7f8685e137] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:38.630137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:38.630626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:38.631076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:38.631795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:38.632266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:38.632703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:38.646406 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] HTTP exception thrown: Instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 could not be found. Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Request method failure captured: Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 HTTP/1.1 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoSxPosju-essxv8T8heQnjnwrtQoou1TPPD8IYQd9rrwCncELbeY-UmuAePM5C7a5vLlSNHLgXiaqqUnISix-TPId3LHSfPZwjnqrwfME-ecLFgrT-iUlYsLgTWw5pYBmX8HLnR_HPX2GXP-y-0ZmNuJ6ST3NfSp_P6pYndMwfE65k Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5afde707d5484ac0b34ab9f76c99f857"}]}] Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 74dca63bcbdf44d884868eb9474e11f6 Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 could not be found. Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': '4e0496e1-3744-4ae0-a7f1-fa7f8685e137'} Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 could not be found. Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 could not be found. Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:55:38.648056 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 could not be found. Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Returning 404 to user: Instance 4e0496e1-3744-4ae0-a7f1-fa7f8685e137 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b54d8d56-0587-48e5-ac23-00cda77a7cb9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137" status: 404 len: 111 microversion: 2.1 time: 0.031310 Nov 02 14:55:38.653293 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2529/7013] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:38 2022] GET /compute/v2.1/servers/4e0496e1-3744-4ae0-a7f1-fa7f8685e137 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:55:42.010873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e2ace5d1-16d7-4fe2-ae82-8577a8ba9dc1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '.version_select at 0x7f6f803f0d30>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:42.035133 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e2ace5d1-16d7-4fe2-ae82-8577a8ba9dc1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2105920062" status: 202 len: 0 microversion: 2.1 time: 0.028455 Nov 02 14:55:42.036350 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4485/7014] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 14:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2105920062 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:55:42.063508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5e8c6112-f82f-4e57-90c4-7a2927b4c6af tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: .version_select at 0x7f6f8351f550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1435267869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDZyimfbWxIX5usxeB/AFOuslcH5e9huBKGVy9Kh/tTRNUur9srywv5dr7lCDdD2QHilvnAxsm0Q1x+NjJCohJp9R4YX/34P58pASKeR3msVn+q5LYozIlHg3deSjJ+Cw=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:42.080693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-5e8c6112-f82f-4e57-90c4-7a2927b4c6af tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:55:42.086791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-5e8c6112-f82f-4e57-90c4-7a2927b4c6af tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:55:42.110638 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5e8c6112-f82f-4e57-90c4-7a2927b4c6af tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051526 Nov 02 14:55:42.111279 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2530/7015] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:55:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:47.971380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-253026485", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "157db0b9-0f26-40cc-89bf-c78eae4a3e2a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1435267869", "security_groups": [{"name": "tempest-secgroup-smoke-102595076"}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:47.986234 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:48.097478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] validate_networks() for [('157db0b9-0f26-40cc-89bf-c78eae4a3e2a', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:55:48.670870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:55:48.672017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:55:48.672749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:55:48.673226 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:55:48.674432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:55:48.685368 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:48.686105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:48.687045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:48.688167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:48.688712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:48.689357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:48.709595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:55:48.715553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:55:48.730104 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:55:48.732810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:55:48.790825 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2d65542a-2f6f-4c93-b248-ab5217cf6db6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823267 Nov 02 14:55:48.792782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4486/7016] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:55:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:55:48.806806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-088bce1b-3796-4a84-b096-08cc20872212 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:48.808201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-088bce1b-3796-4a84-b096-08cc20872212 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:48.819076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:48.885636 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-088bce1b-3796-4a84-b096-08cc20872212 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:48.895340 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-088bce1b-3796-4a84-b096-08cc20872212 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1266 microversion: 2.1 time: 0.094282 Nov 02 14:55:48.896490 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2531/7017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:48 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:49.918466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8de4d7aa-7b43-4376-b265-e52aaf352b83 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:49.919085 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8de4d7aa-7b43-4376-b265-e52aaf352b83 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:49.980774 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8de4d7aa-7b43-4376-b265-e52aaf352b83 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:49.988597 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8de4d7aa-7b43-4376-b265-e52aaf352b83 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1266 microversion: 2.1 time: 0.074098 Nov 02 14:55:49.989325 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4487/7018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:49 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:51.013707 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ccec7cc-1ddb-456e-af57-58f5a679aa2e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:51.014643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ccec7cc-1ddb-456e-af57-58f5a679aa2e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:51.078146 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ccec7cc-1ddb-456e-af57-58f5a679aa2e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:51.085465 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ccec7cc-1ddb-456e-af57-58f5a679aa2e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1266 microversion: 2.1 time: 0.076643 Nov 02 14:55:51.086035 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2532/7019] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:51 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:52.109275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1d454a24-e76a-48d9-bec5-3be3e77b64b4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:52.109869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1d454a24-e76a-48d9-bec5-3be3e77b64b4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:52.162073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1d454a24-e76a-48d9-bec5-3be3e77b64b4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:52.169098 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1d454a24-e76a-48d9-bec5-3be3e77b64b4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1266 microversion: 2.1 time: 0.064319 Nov 02 14:55:52.169685 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4488/7020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:52 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1266 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:53.193211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:53.193965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:53.197010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:53.203757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:53.204260 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:53.204711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:53.205424 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:53.205892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:53.206336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:53.271045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:53.278803 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ff5b61ce-2bcc-44ac-b023-8a76bca9bd3a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1324 microversion: 2.1 time: 0.089543 Nov 02 14:55:53.279616 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2533/7021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:53 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1324 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:54.303794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:54.304445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:54.307924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d7b852dc-08c6-46eb-b079-eb07fdad7515 req-68a65c37-3300-42b1-909b-297f944917f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b51e87f-1125-4bc5-94bc-6ca3b0479fe4", "tag": "f488a692-7b2c-4df5-85ea-d93265856d6c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:54.312056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:54.312648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:54.313179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:54.313978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:54.314517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:54.315337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:54.322994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d7b852dc-08c6-46eb-b079-eb07fdad7515 req-68a65c37-3300-42b1-909b-297f944917f9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:54.323745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d7b852dc-08c6-46eb-b079-eb07fdad7515 req-68a65c37-3300-42b1-909b-297f944917f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:54.324369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d7b852dc-08c6-46eb-b079-eb07fdad7515 req-68a65c37-3300-42b1-909b-297f944917f9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:54.335944 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d7b852dc-08c6-46eb-b079-eb07fdad7515 req-68a65c37-3300-42b1-909b-297f944917f9 service nova] Creating event network-changed:f488a692-7b2c-4df5-85ea-d93265856d6c for instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 on n-h1-858238-3 Nov 02 14:55:54.341413 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d7b852dc-08c6-46eb-b079-eb07fdad7515 req-68a65c37-3300-42b1-909b-297f944917f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042806 Nov 02 14:55:54.347781 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4489/7022] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:54.463087 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:54.471982 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-99de0601-dba9-4113-87d1-aeb74addca86 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1391 microversion: 2.1 time: 0.172918 Nov 02 14:55:54.472570 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2534/7023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:54 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:55.497403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:55.498052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:55.504589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:55.505078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:55.505518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:55.506253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:55.506705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:55.507152 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:55.647374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:55.655165 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-93b68e42-67d5-4425-bd1f-2954492f0fe4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1391 microversion: 2.1 time: 0.163078 Nov 02 14:55:55.656269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4490/7024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:55 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:56.678731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:56.679381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:56.686162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:56.686658 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:56.687121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:56.687823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:56.688288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:56.688724 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:56.824009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:56.832216 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0fc29491-216f-4262-b349-7fccfa584333 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1391 microversion: 2.1 time: 0.157345 Nov 02 14:55:56.832784 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2535/7025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:56 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:57.856000 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:57.856641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:57.863411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:57.863893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:57.864327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:57.865023 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:57.865538 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:57.865962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:58.004592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:58.012362 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-02eacfaa-41ed-47c6-b7cc-2ee411b7b966 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1391 microversion: 2.1 time: 0.160280 Nov 02 14:55:58.012945 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4491/7026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:57 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:59.036482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:59.037102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:59.043983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:59.044474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:59.044919 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:59.045619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:59.046591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:59.047022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:59.176474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:59.184180 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d0f1e417-881e-49fe-891c-f6bb46a66cac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1391 microversion: 2.1 time: 0.151644 Nov 02 14:55:59.184750 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2536/7027] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:55:59 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:59.632213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-c1db0f24-dbc9-4f9e-b96a-9901bc6b981b req-25cbc95d-f831-40fb-94e7-56796282afde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b51e87f-1125-4bc5-94bc-6ca3b0479fe4", "name": "network-vif-plugged", "status": "completed", "tag": "f488a692-7b2c-4df5-85ea-d93265856d6c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:59.637351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:59.644768 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1db0f24-dbc9-4f9e-b96a-9901bc6b981b req-25cbc95d-f831-40fb-94e7-56796282afde service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:59.645251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1db0f24-dbc9-4f9e-b96a-9901bc6b981b req-25cbc95d-f831-40fb-94e7-56796282afde service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:59.645698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-c1db0f24-dbc9-4f9e-b96a-9901bc6b981b req-25cbc95d-f831-40fb-94e7-56796282afde service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:59.657864 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-c1db0f24-dbc9-4f9e-b96a-9901bc6b981b req-25cbc95d-f831-40fb-94e7-56796282afde service nova] Creating event network-vif-plugged:f488a692-7b2c-4df5-85ea-d93265856d6c for instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 on n-h1-858238-3 Nov 02 14:55:59.662786 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-c1db0f24-dbc9-4f9e-b96a-9901bc6b981b req-25cbc95d-f831-40fb-94e7-56796282afde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Nov 02 14:55:59.663427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4492/7028] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:56:00.208508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:00.209074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:00.215875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:00.216364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:00.216804 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:00.217494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:00.218033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:00.218466 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:00.363865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:00.371737 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e6d45180-dac7-422b-b570-7de9fce42111 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1391 microversion: 2.1 time: 0.167245 Nov 02 14:56:00.372324 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2537/7029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:00 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:01.397452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:01.398154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:01.400123 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:01.405783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:01.406273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:01.406709 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:01.407438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:01.407890 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:01.408316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:01.543770 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:01.552258 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8c34ef89-a131-40d7-a66c-0bb4bce07d3f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1562 microversion: 2.1 time: 0.159930 Nov 02 14:56:01.552847 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4493/7030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:01 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:01.575250 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:01.575900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:01.577735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=8 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:01.585127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:01.585611 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:01.586054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:01.586743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:01.587259 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:01.587693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:01.720561 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:01.728291 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-05e7a95c-f9bc-4e47-8033-5d36f11dc4fc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1562 microversion: 2.1 time: 0.156881 Nov 02 14:56:01.728861 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2538/7031] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:01 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:03.306807 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-ed760c0e-bef5-40a1-bc1d-35c389368780 req-340bb37e-5aa8-4419-a02f-5698b70da7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b51e87f-1125-4bc5-94bc-6ca3b0479fe4", "tag": "f488a692-7b2c-4df5-85ea-d93265856d6c"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:56:03.310303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:03.310998 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:03.313951 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:03.320774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ed760c0e-bef5-40a1-bc1d-35c389368780 req-340bb37e-5aa8-4419-a02f-5698b70da7c9 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:03.321321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:03.321566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ed760c0e-bef5-40a1-bc1d-35c389368780 req-340bb37e-5aa8-4419-a02f-5698b70da7c9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:03.321808 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:03.322056 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-ed760c0e-bef5-40a1-bc1d-35c389368780 req-340bb37e-5aa8-4419-a02f-5698b70da7c9 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:03.322232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:03.323157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:03.323791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:03.324213 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:03.335479 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-ed760c0e-bef5-40a1-bc1d-35c389368780 req-340bb37e-5aa8-4419-a02f-5698b70da7c9 service nova] Creating event network-changed:f488a692-7b2c-4df5-85ea-d93265856d6c for instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 on n-h1-858238-3 Nov 02 14:56:03.340613 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-ed760c0e-bef5-40a1-bc1d-35c389368780 req-340bb37e-5aa8-4419-a02f-5698b70da7c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037464 Nov 02 14:56:03.341702 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2539/7032] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:56:03.470139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:03.478183 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-33cbf7b7-722d-4f8b-9f54-5a2aeade53dc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1562 microversion: 2.1 time: 0.177977 Nov 02 14:56:03.479050 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4494/7033] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:03 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:24.749357 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=13 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:24.750717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=38 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:24.754931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:56:24.757211 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:24.764543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:24.765036 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:24.766072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:24.766775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:24.767284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:24.767722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:24.817139 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dc179f4e-bef9-4c81-9a66-8db2cddc4c3e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4/action" status: 200 len: 24570 microversion: 2.1 time: 0.070125 Nov 02 14:56:24.817774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2540/7034] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:56:24 2022] POST /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:56:35.827330 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:56:35.829501 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:35.832616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:35.833354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=30 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:35.839491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:35.839971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:35.840433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:35.841122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:35.841568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:35.841983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:35.914304 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76ec053f-f502-424a-b92c-5abaafd9ac4b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4/action" status: 202 len: 0 microversion: 2.1 time: 0.091171 Nov 02 14:56:35.915196 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4495/7035] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:56:35 2022] POST /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:56:35.923838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:35.924549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:35.928560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:35.929219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:56:35.933562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:35.934053 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:35.934499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:35.935783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:35.935783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:35.936118 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:36.139068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:36.146911 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7f99eb69-016a-4376-9fab-917bfd1c8fe8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1672 microversion: 2.1 time: 0.227276 Nov 02 14:56:36.147514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2541/7036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:35 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:37.172849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:37.173567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:37.180992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:37.181490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:37.181918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:37.182594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:37.183036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:37.183474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:37.318446 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:37.326603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-967a1a48-1084-424f-b3cf-289cf77636fd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.158163 Nov 02 14:56:37.327194 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4496/7037] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:37 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:38.350398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:38.351022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:38.357514 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:38.358007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:38.358454 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:38.359180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:38.359649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:38.360086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:38.495580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:38.504176 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7d87c125-f3f4-411a-814d-b824fb9bb3e8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.157932 Nov 02 14:56:38.504744 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2542/7038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:38 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:39.527678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:39.528281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:39.535047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:39.535547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:39.535973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:39.536986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:39.537112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:39.537492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:39.667480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:39.675299 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c1e6440-4b1e-41ab-bed9-278cfc395be9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.151355 Nov 02 14:56:39.675798 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4497/7039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:39 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:40.699518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:40.700059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:40.706776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:40.707307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:40.707751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:40.708518 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:40.709062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:40.709498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:40.840990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:40.848758 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-81852e11-b094-45a8-8d4a-7423f8e154e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.153446 Nov 02 14:56:40.849327 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2543/7040] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:40 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:41.872935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:41.873494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:41.880797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:41.881271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:41.881704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:41.882383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:41.882828 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:41.883343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:42.016375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:42.025981 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c9f69ad5-6da2-416e-a546-0d800fe2601f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.157007 Nov 02 14:56:42.026573 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4498/7041] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:41 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:43.049671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:43.050885 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:43.057642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:43.058129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:43.058573 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:43.059289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:43.059751 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:43.060184 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:43.189182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:43.197846 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f3007a0f-5d6b-47d4-af2e-a9180b7a2280 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.152065 Nov 02 14:56:43.198411 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2544/7042] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:43 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:44.221944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:44.222557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:44.229364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:44.229860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:44.230279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:44.230965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:44.231450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:44.231884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:44.370498 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:44.378223 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d576f2da-58ac-492c-8861-898a41ac89a1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.160259 Nov 02 14:56:44.379127 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4499/7043] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:44 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:45.402525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:45.403197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:45.410071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:45.410597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:45.411043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:45.411773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:45.412236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:45.412680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:45.545072 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:45.553572 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1853e6b8-f25b-4ad2-a642-f0079cc02287 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.154904 Nov 02 14:56:45.554250 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2545/7044] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:45 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:46.577467 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:46.578079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:46.585669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:46.586156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:46.586590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:46.587312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:46.587766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:46.588189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:46.716266 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:46.723972 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4e22f95-9ece-4d7c-8f62-f13c0a1f0087 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.150441 Nov 02 14:56:46.724550 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4500/7045] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:46 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:47.748278 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:47.748831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:47.756257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:47.756746 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:47.757190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:47.757887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:47.758345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:47.758776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:47.891859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:47.900322 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3320fea0-e041-49bf-aa68-de92af2b7af4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.156095 Nov 02 14:56:47.900894 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2546/7046] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:47 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:48.926356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:48.926990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:48.934134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:48.934612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:48.935043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:48.935766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:48.936216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:48.936640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:49.066375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:49.074531 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f042afc2-577a-458a-bedb-edf376cde7d2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.153927 Nov 02 14:56:49.075135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4501/7047] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:48 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:50.097825 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:50.098475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:50.106469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:50.106973 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:50.107525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:50.108238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:50.108741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:50.109233 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:50.248574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:50.256535 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c49f4893-5a16-4195-943e-05f181eb56f7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.162601 Nov 02 14:56:50.257093 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2547/7048] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:50 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:51.280027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:51.280621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:51.286816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:51.287322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:51.287756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:51.288447 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:51.288897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:51.289319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:51.421906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:51.430335 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5d215e73-a085-4b1e-9eab-2c1e2dbe1385 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1677 microversion: 2.1 time: 0.154322 Nov 02 14:56:51.430906 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4502/7049] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:51 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:56:52.454479 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:56:52.455126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:56:52.463437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:52.463945 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:52.464393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:52.465095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:56:52.465560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:56:52.465997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:56:52.599991 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:56:52.607706 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b5804d58-33fd-4a33-af36-153e05908c3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1680 microversion: 2.1 time: 0.157085 Nov 02 14:56:52.608275 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2548/7050] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:56:52 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:16.813283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:16.815421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:16.818842 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:16.819592 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:16.826609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:16.827088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:16.827569 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:16.828263 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:16.828715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:16.829138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:16.886161 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6aab75c3-25ae-4480-9691-0b2a7cbc817d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4/action" status: 200 len: 68870 microversion: 2.1 time: 0.076703 Nov 02 14:57:16.886822 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4503/7051] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:57:16 2022] POST /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4/action => generated 68870 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:57:24.228784 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:24.229299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:24.231701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=16 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:24.232377 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=48 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:24.247541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:24.248498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:24.248498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:24.249220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:24.249765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:24.250271 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:24.278710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:57:24.281249 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b6eb539d-1f4e-4863-b70c-856e8622475c req-6e0cfd8c-dee5-4763-8682-a2bb453f8e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b51e87f-1125-4bc5-94bc-6ca3b0479fe4", "tag": "f488a692-7b2c-4df5-85ea-d93265856d6c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:24.293300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6eb539d-1f4e-4863-b70c-856e8622475c req-6e0cfd8c-dee5-4763-8682-a2bb453f8e86 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:24.294108 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6eb539d-1f4e-4863-b70c-856e8622475c req-6e0cfd8c-dee5-4763-8682-a2bb453f8e86 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:24.294604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b6eb539d-1f4e-4863-b70c-856e8622475c req-6e0cfd8c-dee5-4763-8682-a2bb453f8e86 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:24.306588 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b6eb539d-1f4e-4863-b70c-856e8622475c req-6e0cfd8c-dee5-4763-8682-a2bb453f8e86 service nova] Creating event network-changed:f488a692-7b2c-4df5-85ea-d93265856d6c for instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 on n-h1-858238-3 Nov 02 14:57:24.312166 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b6eb539d-1f4e-4863-b70c-856e8622475c req-6e0cfd8c-dee5-4763-8682-a2bb453f8e86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091094 Nov 02 14:57:24.313201 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4504/7052] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:24.370840 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-17c0e185-01b6-41db-8da7-d01446f3af36 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 204 len: 0 microversion: 2.1 time: 0.152478 Nov 02 14:57:24.375268 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2549/7053] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:57:24 2022] DELETE /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:57:24.381497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:24.382987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:24.392455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:24.392940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:24.393370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:24.394091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:24.394715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:24.395159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:24.530052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:24.538080 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3fcfa3a9-1ccb-4e7a-b55d-a5a2b90ee055 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1686 microversion: 2.1 time: 0.161252 Nov 02 14:57:24.539569 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4505/7054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:24 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:25.564224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:25.564941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:25.572963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:25.573463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:25.573912 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:25.574619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:25.575086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:25.575547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:25.708101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:25.715860 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-38a776a5-716c-4d50-8266-2dba4c249386 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1686 microversion: 2.1 time: 0.155968 Nov 02 14:57:25.716432 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2550/7055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:25 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:26.692276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-bbf0769f-a94a-4a17-bb9b-021ba5ea6688 req-148e415c-b539-4f09-99f5-9cc7e2c31ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b51e87f-1125-4bc5-94bc-6ca3b0479fe4", "name": "network-vif-deleted", "tag": "f488a692-7b2c-4df5-85ea-d93265856d6c"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:26.702587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bbf0769f-a94a-4a17-bb9b-021ba5ea6688 req-148e415c-b539-4f09-99f5-9cc7e2c31ea1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:26.703119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bbf0769f-a94a-4a17-bb9b-021ba5ea6688 req-148e415c-b539-4f09-99f5-9cc7e2c31ea1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:26.703602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-bbf0769f-a94a-4a17-bb9b-021ba5ea6688 req-148e415c-b539-4f09-99f5-9cc7e2c31ea1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:26.715404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-bbf0769f-a94a-4a17-bb9b-021ba5ea6688 req-148e415c-b539-4f09-99f5-9cc7e2c31ea1 service nova] Creating event network-vif-deleted:f488a692-7b2c-4df5-85ea-d93265856d6c for instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 on n-h1-858238-3 Nov 02 14:57:26.720354 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-bbf0769f-a94a-4a17-bb9b-021ba5ea6688 req-148e415c-b539-4f09-99f5-9cc7e2c31ea1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091144 Nov 02 14:57:26.721543 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4506/7056] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:26.739332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:26.740057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:26.747795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:26.748364 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:26.748979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:26.749701 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:26.750177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:26.750626 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:26.784344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:26.784848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:26.785307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:26.785771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lazy-loading 'fault' on Instance uuid 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:57:26.829634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:26.838167 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0e02789-3057-40d1-808d-6a66f7cc273a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 200 len: 1356 microversion: 2.1 time: 0.102814 Nov 02 14:57:26.838741 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2551/7057] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:26 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:27.863241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:27.863866 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:27.870550 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:27.871048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:27.871496 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:27.872186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:27.872639 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:27.873059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:27.887005 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] HTTP exception thrown: Instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 could not be found. Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Request method failure captured: Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 HTTP/1.1 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoSxPosju-essxv8T8heQnjnwrtQoou1TPPD8IYQd9rrwCncELbeY-UmuAePM5C7a5vLlSNHLgXiaqqUnISix-TPId3LHSfPZwjnqrwfME-ecLFgrT-iUlYsLgTWw5pYBmX8HLnR_HPX2GXP-y-0ZmNuJ6ST3NfSp_P6pYndMwfE65k Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5afde707d5484ac0b34ab9f76c99f857"}]}] Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 74dca63bcbdf44d884868eb9474e11f6 Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 could not be found. Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '2b51e87f-1125-4bc5-94bc-6ca3b0479fe4'} Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 could not be found. Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 could not be found. Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:57:27.888741 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 could not be found. Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Returning 404 to user: Instance 2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d53afae2-7ef5-43c4-b7b2-1d07168f56b9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4" status: 404 len: 111 microversion: 2.1 time: 0.032293 Nov 02 14:57:27.893675 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4507/7058] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:27 2022] GET /compute/v2.1/servers/2b51e87f-1125-4bc5-94bc-6ca3b0479fe4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:57:30.931341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6d62129c-7a03-476d-a04a-94511e7829cb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '.version_select at 0x7f6f80523b80>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:30.954967 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6d62129c-7a03-476d-a04a-94511e7829cb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1435267869" status: 202 len: 0 microversion: 2.1 time: 0.027964 Nov 02 14:57:30.956773 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2552/7059] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 14:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1435267869 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:57:30.986943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-50309bf9-c55c-44e7-aa97-a16b31af3121 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: .version_select at 0x7f6f80163430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1929734237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA6vGXivp0hp4rs5rhofBq9gOpAehaUXshJk8pmSp2BYv62lOzPlhS6C0YPbrGhivZOUFo6nSgmN0OhmSa5FVZx7tu8CiwIoRgCs/+pPyeeRpnFSqRSOoiX2TBV6k2PAw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:31.005982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-50309bf9-c55c-44e7-aa97-a16b31af3121 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:57:31.011944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-50309bf9-c55c-44e7-aa97-a16b31af3121 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:57:31.034773 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-50309bf9-c55c-44e7-aa97-a16b31af3121 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051874 Nov 02 14:57:31.035424 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4508/7060] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:57:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:36.739916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1616492867", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "157402c3-32e8-46f4-af3a-977df44132ff"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1929734237", "security_groups": [{"name": "tempest-secgroup-smoke-92977919"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:36.834382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:36.866930 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] validate_networks() for [('157402c3-32e8-46f4-af3a-977df44132ff', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:57:37.326280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:57:37.327111 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:57:37.327610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:57:37.328045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:57:37.328935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:57:37.340292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:37.340796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:37.341239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:37.341970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:37.342484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:37.342914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:37.361425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:57:37.367586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:57:37.379859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:57:37.384130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:57:37.438248 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1acbf35f-7f10-4ea9-a6c0-c2618485bba9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.701988 Nov 02 14:57:37.439047 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2553/7061] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:57:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:57:37.450742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0c2890a1-d133-448a-821f-f575aa4041eb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:37.451374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0c2890a1-d133-448a-821f-f575aa4041eb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:37.510914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0c2890a1-d133-448a-821f-f575aa4041eb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:37.518275 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0c2890a1-d133-448a-821f-f575aa4041eb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1267 microversion: 2.1 time: 0.071590 Nov 02 14:57:37.518853 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4509/7062] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:37 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:38.543307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b4d09747-4143-4472-a6d6-6c79fb13c6a6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:38.543950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b4d09747-4143-4472-a6d6-6c79fb13c6a6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:38.609124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b4d09747-4143-4472-a6d6-6c79fb13c6a6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:38.616333 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b4d09747-4143-4472-a6d6-6c79fb13c6a6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1267 microversion: 2.1 time: 0.078472 Nov 02 14:57:38.616915 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2554/7063] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:38 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:39.640360 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f1a56cf1-b1d1-4637-98e7-dea90063e30c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:39.642756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f1a56cf1-b1d1-4637-98e7-dea90063e30c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:39.656664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:39.710406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f1a56cf1-b1d1-4637-98e7-dea90063e30c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:39.718903 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f1a56cf1-b1d1-4637-98e7-dea90063e30c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1267 microversion: 2.1 time: 0.082301 Nov 02 14:57:39.719538 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4510/7064] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:39 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:40.744042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e6de2609-f710-4496-b061-f2de41f63b5a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:40.744660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e6de2609-f710-4496-b061-f2de41f63b5a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:40.797891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e6de2609-f710-4496-b061-f2de41f63b5a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:40.806095 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e6de2609-f710-4496-b061-f2de41f63b5a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1267 microversion: 2.1 time: 0.066512 Nov 02 14:57:40.806904 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2555/7065] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:40 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:41.831942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:41.832499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:41.840019 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:41.840495 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:41.840919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:41.841597 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:41.842042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:41.842457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:41.902967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:41.910593 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eb4e9368-c139-47f6-a85a-847c8d9e5596 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1271 microversion: 2.1 time: 0.082647 Nov 02 14:57:41.911177 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4511/7066] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:41 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:57:42.934059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:42.934694 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:42.942858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:42.943392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:42.943853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:42.944581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:42.945054 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:42.945498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:43.148123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:43.156032 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e4ee4e8d-b937-4e42-8729-e0ac03e2c089 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1325 microversion: 2.1 time: 0.225947 Nov 02 14:57:43.156605 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2556/7067] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:42 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:44.179533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:44.180135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:44.186869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:44.187375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:44.187802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:44.188491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:44.188935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:44.189352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:44.343952 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5336f66e-c143-4b74-ad50-23b624852173 req-402cf117-62c4-48bb-96d1-6888db9da5dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:44.360302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5336f66e-c143-4b74-ad50-23b624852173 req-402cf117-62c4-48bb-96d1-6888db9da5dc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:44.360791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5336f66e-c143-4b74-ad50-23b624852173 req-402cf117-62c4-48bb-96d1-6888db9da5dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:44.361222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5336f66e-c143-4b74-ad50-23b624852173 req-402cf117-62c4-48bb-96d1-6888db9da5dc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:44.373006 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5336f66e-c143-4b74-ad50-23b624852173 req-402cf117-62c4-48bb-96d1-6888db9da5dc service nova] Creating event network-changed:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h1-858238-3 Nov 02 14:57:44.377889 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5336f66e-c143-4b74-ad50-23b624852173 req-402cf117-62c4-48bb-96d1-6888db9da5dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037696 Nov 02 14:57:44.378485 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2557/7068] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:57:44.441818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:44.451421 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d56c9d6a-4011-4cc4-b0c7-61bbd1359f9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1391 microversion: 2.1 time: 0.275598 Nov 02 14:57:44.452033 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4512/7069] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:44 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:45.477590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:45.478300 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:45.484497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:45.484989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:45.485437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:45.486130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:45.486594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:45.487030 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:45.680131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:45.688111 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a19fe66c-bffa-4ce4-a4d4-4682697d102d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1391 microversion: 2.1 time: 0.215506 Nov 02 14:57:45.688702 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2558/7070] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:45 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:46.712505 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:46.713118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:46.719985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:46.720466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:46.720897 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:46.721580 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:46.722029 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:46.722450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:46.854671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:46.862507 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e7e82558-fe4c-4871-b3c8-dbbe85704288 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1391 microversion: 2.1 time: 0.153879 Nov 02 14:57:46.863085 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4513/7071] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:46 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:47.886413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:47.888193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:47.890123 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:47.895614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:47.896101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:47.896543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:47.897962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:47.898433 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:47.898884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:48.036344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:48.044204 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bb1e69b7-52f7-48b3-b776-ca709abface7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1391 microversion: 2.1 time: 0.161645 Nov 02 14:57:48.044776 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2559/7072] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:47 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:49.068817 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:49.069421 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:49.072494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:49.077878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:49.078358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:49.078792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:49.079510 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:49.079965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:49.080387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:49.213065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:49.220787 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1683721e-915c-4def-975c-3eee19f213a5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1391 microversion: 2.1 time: 0.155843 Nov 02 14:57:49.221360 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4514/7073] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:49 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:50.114533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-48fbc90c-e272-40da-b6eb-a8e59fd3eb3e req-b323b3f4-f7d6-4d10-9022-b13988e1f04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "name": "network-vif-plugged", "status": "completed", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:50.129517 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-48fbc90c-e272-40da-b6eb-a8e59fd3eb3e req-b323b3f4-f7d6-4d10-9022-b13988e1f04a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.130024 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-48fbc90c-e272-40da-b6eb-a8e59fd3eb3e req-b323b3f4-f7d6-4d10-9022-b13988e1f04a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.130461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-48fbc90c-e272-40da-b6eb-a8e59fd3eb3e req-b323b3f4-f7d6-4d10-9022-b13988e1f04a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.142673 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-48fbc90c-e272-40da-b6eb-a8e59fd3eb3e req-b323b3f4-f7d6-4d10-9022-b13988e1f04a service nova] Creating event network-vif-plugged:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h1-858238-3 Nov 02 14:57:50.148036 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-48fbc90c-e272-40da-b6eb-a8e59fd3eb3e req-b323b3f4-f7d6-4d10-9022-b13988e1f04a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037354 Nov 02 14:57:50.148893 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2560/7074] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:50.244739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:50.245410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:50.247441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=8 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:50.253949 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.254430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.254864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.255593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.256044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.256511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.392295 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:50.403827 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7cc5227b-c317-418e-a594-267604f40d52 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1391 microversion: 2.1 time: 0.162812 Nov 02 14:57:50.404445 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4515/7075] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:50 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:51.430350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:51.431064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:51.434099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=10 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:51.441102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.441598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.442043 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.442745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.443236 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.443713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.579192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:51.587240 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-40ea320a-518f-4b0f-bece-a19ebd429aac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1563 microversion: 2.1 time: 0.162675 Nov 02 14:57:51.587830 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2561/7076] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:51 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:51.610099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:51.610704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:51.617455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.617940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.618364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.619053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.619552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.619968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.755536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:51.763247 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-76c8c6db-33ca-4085-8eb9-85e073169183 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1563 microversion: 2.1 time: 0.157107 Nov 02 14:57:51.763816 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4516/7077] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:51 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:53.332850 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:53.333847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:53.335345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9ab2434c-edbe-4048-8f7c-89e6ee96f75a req-66c46a38-1f1a-42ac-ba23-66169d813acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:53.341601 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.342213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.342763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:53.343768 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.344338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.344884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:53.346456 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9ab2434c-edbe-4048-8f7c-89e6ee96f75a req-66c46a38-1f1a-42ac-ba23-66169d813acb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.346929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9ab2434c-edbe-4048-8f7c-89e6ee96f75a req-66c46a38-1f1a-42ac-ba23-66169d813acb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.347400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9ab2434c-edbe-4048-8f7c-89e6ee96f75a req-66c46a38-1f1a-42ac-ba23-66169d813acb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:53.360118 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9ab2434c-edbe-4048-8f7c-89e6ee96f75a req-66c46a38-1f1a-42ac-ba23-66169d813acb service nova] Creating event network-changed:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h1-858238-3 Nov 02 14:57:53.365210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9ab2434c-edbe-4048-8f7c-89e6ee96f75a req-66c46a38-1f1a-42ac-ba23-66169d813acb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 Nov 02 14:57:53.365852 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4517/7078] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:53.575546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:53.583864 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-dee0d560-4896-44e2-9505-5e3628ec0a31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1563 microversion: 2.1 time: 0.255321 Nov 02 14:57:53.584461 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2562/7079] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:57:53 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:16.875805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=7 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:58:16.876463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=38 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:58:16.882462 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:16.884705 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:16.891624 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:16.892096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:16.892520 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:16.893271 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:16.893642 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:16.894059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:16.948210 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7bec5b91-ef17-4406-821f-28bc556cdc98 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action" status: 200 len: 24570 microversion: 2.1 time: 0.074158 Nov 02 14:58:16.948877 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4518/7080] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:58:16 2022] POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:58:23.411543 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:23.413806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:23.416021 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:58:23.416916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:58:23.424335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:23.424830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:23.425273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:23.425974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:23.426437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:23.426865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:23.511630 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:23.517957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Old instance type m1.heat2, new instance type m1.heat {{(pid=137558) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 14:58:23.524640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:58:23.525075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:58:23.525556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:58:23.525977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:58:23.526408 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:58:23.590158 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8c8943e4-57d6-46bb-97d2-70c11c5738a0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action" status: 202 len: 0 microversion: 2.1 time: 0.182665 Nov 02 14:58:23.590921 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2563/7081] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:58:23 2022] POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:58:23.599944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:23.600636 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:23.608093 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:23.608568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:23.608996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:23.609684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:23.610128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:23.610579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:23.756656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:23.764661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-19d962b8-9f3d-4fdb-82f5-3181964b9182 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1690 microversion: 2.1 time: 0.169055 Nov 02 14:58:23.765439 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4519/7082] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:23 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:24.790869 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:24.791534 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:24.802651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:24.803086 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:24.803545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:24.804773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:24.805241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:24.805680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:24.940663 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:24.949736 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8ba18d66-b4cd-4add-ba85-a700291bd11e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1690 microversion: 2.1 time: 0.162716 Nov 02 14:58:24.950346 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2564/7083] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:24 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:25.973521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:25.974324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:25.981114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:25.981595 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:25.982030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:25.982713 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:25.983186 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:25.983606 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:26.119004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:26.126665 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0ea8d3e8-f661-4ffd-8395-0730b2c4f9d4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.157041 Nov 02 14:58:26.127254 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4520/7084] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:25 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:27.151302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:27.151950 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:27.158983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:27.159506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:27.159949 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:27.160639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:27.161113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:27.161530 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:27.291812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:27.299614 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7bd2bba9-6443-419e-951c-b69e3794d880 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.152498 Nov 02 14:58:27.300182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2565/7085] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:27 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:28.324442 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:28.325046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:28.332667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:28.333141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:28.333568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:28.334248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:28.334693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:28.335757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:28.466133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:28.474204 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-1e218017-1922-47c9-9c4f-c75daa98c3e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.153870 Nov 02 14:58:28.474767 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4521/7086] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:28 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:29.498603 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:29.499327 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:29.506153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:29.506650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:29.507741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:29.508441 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:29.508909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:29.509346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:29.645267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:29.653129 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c48f748d-05be-4d6d-a3da-74943b662035 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.158498 Nov 02 14:58:29.653705 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2566/7087] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:29 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:30.677508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:30.678136 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:30.685593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:30.686074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:30.686502 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:30.687212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:30.687674 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:30.688095 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:30.819154 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:30.827042 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efddab67-a5d2-49fc-985d-1cfc76fdb2c2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.153498 Nov 02 14:58:30.827636 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4522/7088] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:30 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:31.851922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:31.852480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:31.859348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:31.859844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:31.860293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:31.860988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:31.861455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:31.861891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:31.996202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:32.003996 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4eec368b-d500-4092-bc27-1dea6eeeb7e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.156673 Nov 02 14:58:32.004567 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2567/7089] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:31 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:33.027791 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:33.028400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:33.035252 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:33.035739 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:33.036172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:33.036873 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:33.037348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:33.037777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:33.168812 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:33.176847 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f6413678-ba27-4c7a-962e-65f64bcee21f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.153008 Nov 02 14:58:33.177427 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4523/7090] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:33 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:34.202192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:34.202815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:34.210734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:34.211282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:34.211734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:34.212445 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:34.212915 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:34.213392 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:34.350671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:34.358435 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6ea6630e-b22b-4cf4-86cd-7f8636bc1eb0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.160263 Nov 02 14:58:34.359008 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2568/7091] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:34 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:35.382514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:35.383078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:35.389805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:35.390278 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:35.390704 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:35.391417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:35.391865 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:35.392282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:35.524359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:35.532065 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ecea7a9b-4dda-4b45-b266-c8a3b9e463c3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.154144 Nov 02 14:58:35.532635 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4524/7092] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:35 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:36.555757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:36.556547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:36.563544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:36.564039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:36.564484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:36.565181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:36.565643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:36.566077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:36.696371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:36.704263 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-77e472cc-a3fc-4884-8469-b94dd125289b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1695 microversion: 2.1 time: 0.153071 Nov 02 14:58:36.704940 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2569/7093] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:36 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:37.728833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:37.729378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:37.736216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:37.736702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:37.737142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:37.737831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:37.738282 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:37.738702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:37.877202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "name": "network-vif-unplugged", "status": "completed", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:37.881657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:37.894782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e036ee5-97e3-4e6c-9715-ea4897d54ce5 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1694 microversion: 2.1 time: 0.169915 Nov 02 14:58:37.895435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4525/7094] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:37 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:37.900238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:37.900738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:37.901178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:37.917353 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] Creating event network-vif-unplugged:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h2-858238-3 Nov 02 14:58:37.922905 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:58:37.934429 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3d181ba6-e90b-407d-b2b4-7088c7ddd9ed req-9c811299-50da-4760-b00e-ddacef54da82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061739 Nov 02 14:58:37.935041 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2570/7095] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:58:38.918469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:38.919087 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:38.926041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:38.926459 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:38.926843 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:38.927560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:38.928004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:38.928423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:39.062980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:39.071684 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2e6ede5b-af33-4969-ab79-f8377f5254de tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1692 microversion: 2.1 time: 0.157123 Nov 02 14:58:39.072359 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4526/7096] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:38 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:39.958957 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:39.969085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:39.969572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:39.970009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:39.982717 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] Creating event network-changed:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h2-858238-3 Nov 02 14:58:39.988215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858238-3', 'n-h2-858238-3'} {{(pid=137558) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 14:58:39.999427 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-979d89d4-9248-464a-a0e1-aba925d55295 req-692da843-050c-4d79-87d1-7fd66b702cf8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045340 Nov 02 14:58:40.000038 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2571/7097] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:58:40.096380 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:40.097230 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:40.105450 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:40.105947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:40.106387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:40.107139 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:40.107882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:40.108105 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:40.343167 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:40.351809 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-cc046454-76d5-4ac9-8528-64b35cf41552 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1692 microversion: 2.1 time: 0.259933 Nov 02 14:58:40.353405 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4527/7098] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:40 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1692 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:41.381042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:41.381871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:41.388267 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.388756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.389203 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.389889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.390388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.390822 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.524255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:41.532677 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2b13f33e-9095-429a-a896-c91552e52aea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1689 microversion: 2.1 time: 0.156732 Nov 02 14:58:41.533593 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2572/7099] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:41 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:41.556324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:41.556936 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:41.563878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.564361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.564798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.565491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.565954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.566377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.622899 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a894efa7-f436-4527-a1fe-bf56480de41b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action" status: 204 len: 0 microversion: 2.1 time: 0.070348 Nov 02 14:58:41.623580 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4528/7100] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:58:41 2022] POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:58:41.632808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:41.633545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:41.639745 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.640235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.640683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.641382 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.641848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.642280 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.857090 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:41.864961 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0a12f62-1619-4123-8f26-246ee59de91a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1689 microversion: 2.1 time: 0.237143 Nov 02 14:58:41.865573 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2573/7101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:41 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:41.889002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:41.889706 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:41.895966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.896458 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.896896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:41.898158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:41.898629 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:41.899191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:42.113272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:42.122169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f8854a6c-b9df-4dbd-a1c7-720f2cb7081d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1689 microversion: 2.1 time: 0.237326 Nov 02 14:58:42.122718 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4529/7102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:41 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:43.146629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:43.147901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:43.155921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:43.156414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:43.156859 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:43.157560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:43.158025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:43.159252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:43.296818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:43.304908 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-46e055cd-3254-4a68-ae43-e52a9979e9ac tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1681 microversion: 2.1 time: 0.162133 Nov 02 14:58:43.305474 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2574/7103] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:58:43 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:44.376613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-d3c41485-111d-400a-8ce3-136fe6de5e9e req-fd99a779-deea-4657-ace7-72fd59185810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "name": "network-vif-plugged", "status": "completed", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:44.386813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d3c41485-111d-400a-8ce3-136fe6de5e9e req-fd99a779-deea-4657-ace7-72fd59185810 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:44.387321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d3c41485-111d-400a-8ce3-136fe6de5e9e req-fd99a779-deea-4657-ace7-72fd59185810 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:44.387749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-d3c41485-111d-400a-8ce3-136fe6de5e9e req-fd99a779-deea-4657-ace7-72fd59185810 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:44.399292 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-d3c41485-111d-400a-8ce3-136fe6de5e9e req-fd99a779-deea-4657-ace7-72fd59185810 service nova] Creating event network-vif-plugged:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h2-858238-3 Nov 02 14:58:44.408495 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-d3c41485-111d-400a-8ce3-136fe6de5e9e req-fd99a779-deea-4657-ace7-72fd59185810 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089684 Nov 02 14:58:44.409133 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4530/7104] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:59:05.489342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:05.492232 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:05.495286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=28 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:05.495966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:05.501911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:05.502407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:05.502857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:05.503595 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:05.504065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:05.504503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:05.561578 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e9ef8b13-2187-4a9d-a505-768d9c62fcb7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action" status: 200 len: 24574 microversion: 2.1 time: 0.076060 Nov 02 14:59:05.562534 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2575/7105] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:59:05 2022] POST /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:59:12.580596 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=26 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:12.582098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:12.586275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-6025a856-8e54-40a6-a525-e2a01123b5cf req-24fff62c-d43e-4fd4-872a-33f3d892e53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:12.587075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:12.587740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:12.596431 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.596914 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.597347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:12.598041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.598488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.598905 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:12.599065 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6025a856-8e54-40a6-a525-e2a01123b5cf req-24fff62c-d43e-4fd4-872a-33f3d892e53c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.599821 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6025a856-8e54-40a6-a525-e2a01123b5cf req-24fff62c-d43e-4fd4-872a-33f3d892e53c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.601155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-6025a856-8e54-40a6-a525-e2a01123b5cf req-24fff62c-d43e-4fd4-872a-33f3d892e53c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:12.613945 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-6025a856-8e54-40a6-a525-e2a01123b5cf req-24fff62c-d43e-4fd4-872a-33f3d892e53c service nova] Creating event network-changed:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h2-858238-3 Nov 02 14:59:12.620384 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-6025a856-8e54-40a6-a525-e2a01123b5cf req-24fff62c-d43e-4fd4-872a-33f3d892e53c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038491 Nov 02 14:59:12.621573 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2576/7106] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:59:12.630992 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:59:12.726746 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4603c08d-003d-4f36-826c-b9f695e64c88 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 204 len: 0 microversion: 2.1 time: 0.146552 Nov 02 14:59:12.728435 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4531/7107] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 14:59:12 2022] DELETE /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:59:12.743461 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:12.744900 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:12.753388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.754009 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.754548 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:12.755776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:12.756494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:12.757015 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:12.908239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:12.916898 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-084dc631-6889-4082-a468-5d4690834345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1687 microversion: 2.1 time: 0.182801 Nov 02 14:59:12.917490 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2577/7108] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:12 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:59:13.942628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:13.943476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:13.951121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:13.951621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:13.952053 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:13.952962 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:13.953408 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:13.953825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:14.094916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:14.103434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-66290df2-abcb-4d13-862e-973bd86e5071 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 200 len: 1687 microversion: 2.1 time: 0.165259 Nov 02 14:59:14.104027 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4532/7109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:13 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:14.636170 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-53cd9036-190e-4423-8b39-e97115821a7e req-ac4880cb-398a-471c-ba4c-2c56c1ceb260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d44d30c-f110-4df5-bc24-bbdc75f8ee93", "name": "network-vif-deleted", "tag": "05ce86ef-5b78-4800-9e6c-070f47450a94"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:14.650177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-53cd9036-190e-4423-8b39-e97115821a7e req-ac4880cb-398a-471c-ba4c-2c56c1ceb260 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:14.650596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-53cd9036-190e-4423-8b39-e97115821a7e req-ac4880cb-398a-471c-ba4c-2c56c1ceb260 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:14.651042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-53cd9036-190e-4423-8b39-e97115821a7e req-ac4880cb-398a-471c-ba4c-2c56c1ceb260 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:14.662611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-53cd9036-190e-4423-8b39-e97115821a7e req-ac4880cb-398a-471c-ba4c-2c56c1ceb260 service nova] Creating event network-vif-deleted:05ce86ef-5b78-4800-9e6c-070f47450a94 for instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 on n-h2-858238-3 Nov 02 14:59:14.667267 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-53cd9036-190e-4423-8b39-e97115821a7e req-ac4880cb-398a-471c-ba4c-2c56c1ceb260 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Nov 02 14:59:14.667881 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2578/7110] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:59:15.130667 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:15.133527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 5d44d30c-f110-4df5-bc24-bbdc75f8ee93] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:15.141225 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:15.141921 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:15.142358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:15.143068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:15.143547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:15.143972 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:15.159583 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] HTTP exception thrown: Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 could not be found. Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Request method failure captured: Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 HTTP/1.1 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoSxPosju-essxv8T8heQnjnwrtQoou1TPPD8IYQd9rrwCncELbeY-UmuAePM5C7a5vLlSNHLgXiaqqUnISix-TPId3LHSfPZwjnqrwfME-ecLFgrT-iUlYsLgTWw5pYBmX8HLnR_HPX2GXP-y-0ZmNuJ6ST3NfSp_P6pYndMwfE65k Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5afde707d5484ac0b34ab9f76c99f857"}]}] Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 74dca63bcbdf44d884868eb9474e11f6 Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 could not be found. Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '5d44d30c-f110-4df5-bc24-bbdc75f8ee93'} Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 could not be found. Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 could not be found. Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.161150 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 could not be found. Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Returning 404 to user: Instance 5d44d30c-f110-4df5-bc24-bbdc75f8ee93 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e88d0464-dfee-4dbf-91f3-2154d8281b89 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93" status: 404 len: 111 microversion: 2.1 time: 0.036603 Nov 02 14:59:15.166540 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4533/7111] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:15 2022] GET /compute/v2.1/servers/5d44d30c-f110-4df5-bc24-bbdc75f8ee93 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:59:18.512230 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-afe18640-aad7-4720-a831-f5db2f4a8c31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '.version_select at 0x7f6f81807790>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:18.534676 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-afe18640-aad7-4720-a831-f5db2f4a8c31 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1929734237" status: 202 len: 0 microversion: 2.1 time: 0.027947 Nov 02 14:59:18.535212 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2579/7112] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 14:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1929734237 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:59:18.561481 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-054ff925-c6d1-4619-9509-66a617a44bca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: .version_select at 0x7f6f85e58160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1747487052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVZs3bnILIafLhYSNRi7Xnixqwfm0vyR3yxaj+04NpMn40tOjzChQNDb7E+lZTOcTMYt9eT3ReC+mstCz5cmBDgYJLCxTfspGeumTZ4/5dJE5GkWP1adhi5/E7IidBsMw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:18.578752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-054ff925-c6d1-4619-9509-66a617a44bca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:59:18.585359 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-054ff925-c6d1-4619-9509-66a617a44bca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:59:18.613724 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-054ff925-c6d1-4619-9509-66a617a44bca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056079 Nov 02 14:59:18.620226 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4534/7113] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 14:59:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:59:24.272237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1142665959", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "febaa4b4-04d0-434a-9809-f079ebced14e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1747487052", "security_groups": [{"name": "tempest-secgroup-smoke-709666094"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:24.395931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] validate_networks() for [('febaa4b4-04d0-434a-9809-f079ebced14e', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:59:24.656172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=14 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:24.869814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:59:24.870191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:59:24.870671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:59:24.871319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:59:24.871554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:59:24.881494 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:24.882032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:24.882485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:24.883242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:24.883717 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:24.884142 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:25.172047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:59:25.177321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:59:25.190355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:59:25.192803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:59:25.256801 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d7cff7ab-ccb5-4c0a-ab7b-6e5ba2b36fbd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988585 Nov 02 14:59:25.264221 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2580/7114] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 14:59:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 14:59:25.270365 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7d7ac520-925e-4fc4-8c6c-b625eb5441e1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:25.271177 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7d7ac520-925e-4fc4-8c6c-b625eb5441e1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:25.276613 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:25.362725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7d7ac520-925e-4fc4-8c6c-b625eb5441e1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:25.371434 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7d7ac520-925e-4fc4-8c6c-b625eb5441e1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1267 microversion: 2.1 time: 0.105875 Nov 02 14:59:25.372969 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4535/7115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:25 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:26.401986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:26.403299 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:26.412215 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:26.412989 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:26.413704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:26.414444 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:26.414918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:26.415387 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:26.507057 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:26.532672 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-46b66580-9c80-46b1-a16e-f4450fba6cf3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1337 microversion: 2.1 time: 0.136641 Nov 02 14:59:26.540341 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2581/7116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:26 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1337 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:27.556983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:27.557851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:27.565398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:27.565888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:27.566321 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:27.567014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:27.567497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:27.567920 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:27.788051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:27.795898 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-455078a4-300e-4d9f-8385-f1c9b1a49d99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1392 microversion: 2.1 time: 0.242839 Nov 02 14:59:27.796472 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4536/7117] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:27 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:27.934182 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-9aaa9fcd-8129-40d9-9520-f30d33e36b5d req-7a96351b-55e2-42e9-be0d-e0f6d8b00523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de612fcf-6876-4a88-8854-d47caf456612", "tag": "1973ae73-e3fc-44ef-86a9-4fdb45a70c98"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:27.950944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9aaa9fcd-8129-40d9-9520-f30d33e36b5d req-7a96351b-55e2-42e9-be0d-e0f6d8b00523 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:27.951563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9aaa9fcd-8129-40d9-9520-f30d33e36b5d req-7a96351b-55e2-42e9-be0d-e0f6d8b00523 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:27.952523 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-9aaa9fcd-8129-40d9-9520-f30d33e36b5d req-7a96351b-55e2-42e9-be0d-e0f6d8b00523 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:27.965329 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-9aaa9fcd-8129-40d9-9520-f30d33e36b5d req-7a96351b-55e2-42e9-be0d-e0f6d8b00523 service nova] Creating event network-changed:1973ae73-e3fc-44ef-86a9-4fdb45a70c98 for instance de612fcf-6876-4a88-8854-d47caf456612 on n-h1-858238-3 Nov 02 14:59:27.971981 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-9aaa9fcd-8129-40d9-9520-f30d33e36b5d req-7a96351b-55e2-42e9-be0d-e0f6d8b00523 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041565 Nov 02 14:59:27.972580 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2582/7118] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:59:28.820899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:28.821494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:28.828424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:28.828907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:28.829387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:28.830080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:28.830532 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:28.830954 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:28.966556 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:28.974528 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2ca5e1df-6b24-4e3f-92ab-436c8ff5b5c4 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1392 microversion: 2.1 time: 0.158290 Nov 02 14:59:28.975116 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4537/7119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:28 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:29.998597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:29.999345 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:30.006556 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:30.007048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:30.007524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:30.008229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:30.008696 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:30.009135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:30.147846 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:30.155660 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76359d0a-03cc-4c04-adde-681dcdad8f7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1392 microversion: 2.1 time: 0.161301 Nov 02 14:59:30.156190 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2583/7120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:29 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:59:31.179400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:31.180013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:31.187276 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:31.187753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:31.188188 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:31.188872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:31.189323 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:31.189742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:31.320319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:31.328109 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9e42b0fd-0fb9-4924-be7b-02153e1b1d42 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1392 microversion: 2.1 time: 0.152588 Nov 02 14:59:31.328684 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4538/7121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:31 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:32.351269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:32.351908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:32.358675 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:32.359206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:32.359660 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:32.360371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:32.360840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:32.361282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:32.496994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:32.508421 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6b8fc231-26af-4aaa-b1a6-75099fc32db8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1392 microversion: 2.1 time: 0.161075 Nov 02 14:59:32.509098 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2584/7122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:32 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:32.614630 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2a076f14-4d7d-45f4-a7ac-7c6a83cdf768 req-682177e1-05ed-4ffb-bf71-75fdd8dad609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de612fcf-6876-4a88-8854-d47caf456612", "name": "network-vif-plugged", "status": "completed", "tag": "1973ae73-e3fc-44ef-86a9-4fdb45a70c98"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:32.626477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2a076f14-4d7d-45f4-a7ac-7c6a83cdf768 req-682177e1-05ed-4ffb-bf71-75fdd8dad609 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:32.626971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2a076f14-4d7d-45f4-a7ac-7c6a83cdf768 req-682177e1-05ed-4ffb-bf71-75fdd8dad609 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:32.627445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2a076f14-4d7d-45f4-a7ac-7c6a83cdf768 req-682177e1-05ed-4ffb-bf71-75fdd8dad609 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:32.639496 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2a076f14-4d7d-45f4-a7ac-7c6a83cdf768 req-682177e1-05ed-4ffb-bf71-75fdd8dad609 service nova] Creating event network-vif-plugged:1973ae73-e3fc-44ef-86a9-4fdb45a70c98 for instance de612fcf-6876-4a88-8854-d47caf456612 on n-h1-858238-3 Nov 02 14:59:32.645070 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2a076f14-4d7d-45f4-a7ac-7c6a83cdf768 req-682177e1-05ed-4ffb-bf71-75fdd8dad609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034509 Nov 02 14:59:32.645660 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4539/7123] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:59:33.533640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:33.534289 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:33.541610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:33.542102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:33.542546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:33.543276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:33.543742 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:33.544198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:33.680003 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:33.687754 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-252bc231-f5d8-4e25-b061-7c79b08fdd8a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1392 microversion: 2.1 time: 0.158099 Nov 02 14:59:33.688316 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2585/7124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:33 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:34.712869 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:34.713492 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:34.719833 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:34.720317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:34.720783 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:34.721473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:34.721930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:34.722355 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:34.909732 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:34.918020 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e772b3f5-d9ca-42c5-854e-d45e2ee39fdd tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1564 microversion: 2.1 time: 0.210341 Nov 02 14:59:34.918614 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4540/7125] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:34 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1564 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:34.941430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:34.942058 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:34.949578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:34.950068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:34.950524 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:34.951410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:34.951884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:34.952397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:35.085148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:35.092840 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f5ba0d54-7ebd-44bd-b2e7-1d1be8040e2f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1564 microversion: 2.1 time: 0.155296 Nov 02 14:59:35.093420 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2586/7126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:34 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:36.727789 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:59:36.728404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:36.730245 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-5e7b6aca-e929-4d3a-92d8-dc77c64bba17 req-bd7da3bd-0a20-49c3-84b9-5a4cf5d5c3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de612fcf-6876-4a88-8854-d47caf456612", "tag": "1973ae73-e3fc-44ef-86a9-4fdb45a70c98"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:36.731009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:36.737597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:36.737796 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:36.738255 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:36.738685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:36.739919 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:36.740187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:36.740517 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:36.740948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:36.743051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:36.750832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5e7b6aca-e929-4d3a-92d8-dc77c64bba17 req-bd7da3bd-0a20-49c3-84b9-5a4cf5d5c3ec service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:36.751318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5e7b6aca-e929-4d3a-92d8-dc77c64bba17 req-bd7da3bd-0a20-49c3-84b9-5a4cf5d5c3ec service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:36.751871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-5e7b6aca-e929-4d3a-92d8-dc77c64bba17 req-bd7da3bd-0a20-49c3-84b9-5a4cf5d5c3ec service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:36.767548 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-5e7b6aca-e929-4d3a-92d8-dc77c64bba17 req-bd7da3bd-0a20-49c3-84b9-5a4cf5d5c3ec service nova] Creating event network-changed:1973ae73-e3fc-44ef-86a9-4fdb45a70c98 for instance de612fcf-6876-4a88-8854-d47caf456612 on n-h1-858238-3 Nov 02 14:59:36.773292 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-5e7b6aca-e929-4d3a-92d8-dc77c64bba17 req-bd7da3bd-0a20-49c3-84b9-5a4cf5d5c3ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047312 Nov 02 14:59:36.774255 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2587/7127] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 14:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:59:36.998377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:59:37.008399 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e59eba14-706c-4058-9a52-6d995ecf532a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1564 microversion: 2.1 time: 0.285013 Nov 02 14:59:37.009243 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4541/7128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 14:59:36 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1564 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:59:58.247981 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:58.248738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:59:58.303810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:59:58.306144 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:59:58.312302 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:58.312797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:58.313242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:58.313935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:59:58.314397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:59:58.314830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:59:58.367570 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-90d92be2-33d2-45a2-b892-8168d0438c7b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action" status: 200 len: 24571 microversion: 2.1 time: 0.121322 Nov 02 14:59:58.368176 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2588/7129] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 14:59:58 2022] POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action => generated 24571 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 15:00:09.357760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-905eef03-95f6-4eb2-8cc9-b0b1fa97a54b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:09.359983 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.360815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=32 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.369522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-905eef03-95f6-4eb2-8cc9-b0b1fa97a54b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.369999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-905eef03-95f6-4eb2-8cc9-b0b1fa97a54b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.370433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-905eef03-95f6-4eb2-8cc9-b0b1fa97a54b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.393689 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-905eef03-95f6-4eb2-8cc9-b0b1fa97a54b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Going to try to stop instance {{(pid=137559) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 15:00:09.439309 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-905eef03-95f6-4eb2-8cc9-b0b1fa97a54b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action" status: 202 len: 0 microversion: 2.1 time: 0.085316 Nov 02 15:00:09.440055 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4542/7130] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:00:09 2022] POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:00:09.449418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:09.450126 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:09.453352 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.454410 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.461489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.462336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.462853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.463870 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.464401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.464908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.600841 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:09.609148 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-bf0e6b6c-561f-4de1-a81d-79c7324d411d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.164107 Nov 02 15:00:09.609844 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2589/7131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:09 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:00:10.635742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:10.636432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:10.643312 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:10.643788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:10.644214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:10.644889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:10.645849 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:10.646265 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:10.780798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:10.788521 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-323a5eea-2536-40b9-9451-2429500c6dca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.157805 Nov 02 15:00:10.789087 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4543/7132] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:10 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:11.812346 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:11.812899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:11.820094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:11.820604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:11.821063 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:11.821775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:11.822252 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:11.822700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:11.952018 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:11.960308 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e19aa0cf-8e7a-4e29-ae82-f45c531c7503 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.152023 Nov 02 15:00:11.960882 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2590/7133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:11 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:12.984352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:12.984944 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:12.992731 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:12.993215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:12.993649 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:12.994340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:12.994798 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:12.995251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:13.128393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:13.136067 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f49b5ca-9217-4fbc-9ca3-1dc4a3db61c6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.155620 Nov 02 15:00:13.136639 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4544/7134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:12 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:14.159648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:14.160273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:14.167978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:14.168474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:14.168921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:14.169650 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:14.170112 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:14.170550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:14.300306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:14.308439 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-de0eeefc-0a32-41b8-af47-3bd8e1304075 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.152740 Nov 02 15:00:14.309018 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2591/7135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:14 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:15.332464 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:15.333062 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:15.339590 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:15.340065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:15.340494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:15.341170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:15.341622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:15.342043 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:15.471947 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:15.479552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3b4a560-f94d-4ae2-9183-714c6ecb9cd1 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.151725 Nov 02 15:00:15.480126 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4545/7136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:15 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:16.502988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:16.503641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:16.511034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:16.511560 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:16.512010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:16.512719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:16.513239 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:16.513681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:16.647908 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:16.656246 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-874974da-4876-4764-9174-1b48039db23a tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.157120 Nov 02 15:00:16.656821 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2592/7137] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:16 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:17.679767 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:17.680372 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:17.687114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:17.687600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:17.688024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:17.688701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:17.689145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:17.689559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:18.103627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:18.111369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-958f1ccc-c982-437d-8d0b-3098053343ae tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.435413 Nov 02 15:00:18.111953 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4546/7138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:17 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:19.135257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:19.135883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:19.142756 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:19.143288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:19.143743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:19.144446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:19.144916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:19.145356 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:19.279797 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:19.288065 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-846505e8-f929-49df-bf51-34ff1bab87a8 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.156734 Nov 02 15:00:19.288649 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2593/7139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:19 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:00:20.312685 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:20.313398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:20.321379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:20.321933 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:20.322430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:20.323216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:20.323819 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:20.324279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:20.456747 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:20.464801 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-32d775c5-87cd-4804-b32c-1ca45f0dc961 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.155993 Nov 02 15:00:20.465379 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4547/7140] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:20 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:21.491397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:21.492027 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:21.499229 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:21.499727 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:21.500173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:21.500876 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:21.501348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:21.501783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:21.633138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:21.640932 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-915128cc-6405-4d69-8b73-01aad40b077e tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.155452 Nov 02 15:00:21.641497 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2594/7141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:21 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:22.665274 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:22.665889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:22.672233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:22.672640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:22.673068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:22.673809 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:22.674256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:22.674673 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:22.808968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:22.816884 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4680c35c-a971-4884-a4a9-7a88bf6a0eca tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.156292 Nov 02 15:00:22.817467 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4548/7142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:22 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:23.843088 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:23.843703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:23.851140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:23.851651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:23.852109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:23.852828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:23.853307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:23.853757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:23.985554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:23.993335 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-66c1e950-03cc-48af-864d-27e37bb63e5d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1692 microversion: 2.1 time: 0.154806 Nov 02 15:00:23.993906 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2595/7143] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:23 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:25.015934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:25.016572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:25.024081 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:25.024558 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:25.024988 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:25.025669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:25.026113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:25.026541 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:25.157379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:25.165078 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d875c1c3-70f0-450c-b699-d8199241be58 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1669 microversion: 2.1 time: 0.153054 Nov 02 15:00:25.165647 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4549/7144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:25 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:26.257659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:26.259979 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:26.267138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.267634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.268080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.268775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.269235 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.269679 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.321554 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-69e042e5-8595-4359-b9b0-e2b41aae6efa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action" status: 200 len: 38394 microversion: 2.1 time: 0.068140 Nov 02 15:00:26.322234 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2596/7145] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:00:26 2022] POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action => generated 38394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 15:00:26.333943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2f831ac-35d9-4e7f-8acf-d8a767dc1ad2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:26.341098 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f831ac-35d9-4e7f-8acf-d8a767dc1ad2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.341587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f831ac-35d9-4e7f-8acf-d8a767dc1ad2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.342027 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2f831ac-35d9-4e7f-8acf-d8a767dc1ad2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.364953 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2f831ac-35d9-4e7f-8acf-d8a767dc1ad2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Going to try to start instance {{(pid=137559) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 15:00:26.406460 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2f831ac-35d9-4e7f-8acf-d8a767dc1ad2 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action" status: 202 len: 0 microversion: 2.1 time: 0.076234 Nov 02 15:00:26.407135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4550/7146] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:00:26 2022] POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:00:26.416020 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:26.416752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:26.424358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.424873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.425332 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.426192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.426814 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.427826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.658819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:26.667115 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-24ab4d6f-aaed-4c65-aa11-fb952b54fa06 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1678 microversion: 2.1 time: 0.255354 Nov 02 15:00:26.667711 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2597/7147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:26 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:27.694096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:27.694792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:27.700930 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:27.701410 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:27.701923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:27.702522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:27.702969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:27.703415 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:27.848557 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:27.856424 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-946c14c3-7d10-485d-b2fc-4825ff3632e6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1678 microversion: 2.1 time: 0.168272 Nov 02 15:00:27.857007 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4551/7148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:27 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:28.882287 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:28.882838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:28.890475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:28.890970 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:28.891516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:28.892218 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:28.892686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:28.893129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:29.030838 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:29.038644 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6fa11bdf-dad6-4027-b470-61752167fa62 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1682 microversion: 2.1 time: 0.160944 Nov 02 15:00:29.039237 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2598/7149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:00:28 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:53.228946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:53.231286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:53.233628 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=20 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:53.234406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:53.240160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:53.240646 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:53.241078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:53.241777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:53.242313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:53.242703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:53.300661 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-376e387a-055a-44f5-950e-cfaa3b7a80cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action" status: 200 len: 62948 microversion: 2.1 time: 0.076250 Nov 02 15:00:53.301331 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4552/7150] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:00:53 2022] POST /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612/action => generated 62948 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 15:01:00.360898 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:00.361422 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:00.363352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-de4e6342-09a0-4791-a126-de5594528545 req-805930e3-eb0f-436c-b4f2-8cff993172d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de612fcf-6876-4a88-8854-d47caf456612", "tag": "1973ae73-e3fc-44ef-86a9-4fdb45a70c98"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:00.367693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=20 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:00.368720 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=58 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:00.370489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:00.370992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:00.371634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:00.372499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:00.373168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:00.373847 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:00.375516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-de4e6342-09a0-4791-a126-de5594528545 req-805930e3-eb0f-436c-b4f2-8cff993172d1 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:00.376004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-de4e6342-09a0-4791-a126-de5594528545 req-805930e3-eb0f-436c-b4f2-8cff993172d1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:00.376413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-de4e6342-09a0-4791-a126-de5594528545 req-805930e3-eb0f-436c-b4f2-8cff993172d1 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:00.389003 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-de4e6342-09a0-4791-a126-de5594528545 req-805930e3-eb0f-436c-b4f2-8cff993172d1 service nova] Creating event network-changed:1973ae73-e3fc-44ef-86a9-4fdb45a70c98 for instance de612fcf-6876-4a88-8854-d47caf456612 on n-h1-858238-3 Nov 02 15:01:00.394124 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-de4e6342-09a0-4791-a126-de5594528545 req-805930e3-eb0f-436c-b4f2-8cff993172d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034834 Nov 02 15:01:00.395055 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4553/7151] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:01:00.405317 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:01:00.493272 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f0636ebf-bf2a-4484-be71-f1a1842f12cf tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 204 len: 0 microversion: 2.1 time: 0.136106 Nov 02 15:01:00.494167 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2599/7152] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 15:01:00 2022] DELETE /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:01:00.503970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:00.504925 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:00.512917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:00.513416 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:00.513860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:00.514584 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:00.515045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:00.515511 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:00.673990 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:00.682617 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ef6f9f57-8ee0-45ad-8f63-966fa98fcf02 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1688 microversion: 2.1 time: 0.183260 Nov 02 15:01:00.683300 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4554/7153] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:00 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:01.708552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:01.709872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:01.716843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:01.717339 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:01.717791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:01.718496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:01.718963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:01.719430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:01.925298 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:01.933202 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-07dc909f-1533-4e40-8e87-c759d3cb4824 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1688 microversion: 2.1 time: 0.228914 Nov 02 15:01:01.933794 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2600/7154] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:01 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:02.565392 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-da6e3222-10d6-4d5c-94c6-906433d69737 req-3964e797-9570-45e3-80f2-4e5b53dd8350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de612fcf-6876-4a88-8854-d47caf456612", "name": "network-vif-deleted", "tag": "1973ae73-e3fc-44ef-86a9-4fdb45a70c98"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:02.577929 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-da6e3222-10d6-4d5c-94c6-906433d69737 req-3964e797-9570-45e3-80f2-4e5b53dd8350 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:02.578409 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-da6e3222-10d6-4d5c-94c6-906433d69737 req-3964e797-9570-45e3-80f2-4e5b53dd8350 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:02.578836 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-da6e3222-10d6-4d5c-94c6-906433d69737 req-3964e797-9570-45e3-80f2-4e5b53dd8350 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:02.590583 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-da6e3222-10d6-4d5c-94c6-906433d69737 req-3964e797-9570-45e3-80f2-4e5b53dd8350 service nova] Creating event network-vif-deleted:1973ae73-e3fc-44ef-86a9-4fdb45a70c98 for instance de612fcf-6876-4a88-8854-d47caf456612 on n-h1-858238-3 Nov 02 15:01:02.595403 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-da6e3222-10d6-4d5c-94c6-906433d69737 req-3964e797-9570-45e3-80f2-4e5b53dd8350 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033767 Nov 02 15:01:02.596389 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4555/7155] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:01:02.966985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:02.968374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:02.976576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:02.977078 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:02.977533 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:02.978420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:02.978810 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:02.979282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:03.012672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:03.013163 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:03.013619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:03.014094 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lazy-loading 'fault' on Instance uuid de612fcf-6876-4a88-8854-d47caf456612 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:01:03.056657 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:03.064607 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-66af0047-cc67-429c-98ac-6e90ea45f31b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 200 len: 1357 microversion: 2.1 time: 0.108824 Nov 02 15:01:03.065216 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2601/7156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:02 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:04.090348 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:04.091044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: de612fcf-6876-4a88-8854-d47caf456612] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:04.097202 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:04.097676 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:04.098103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:04.098788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:04.099272 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:04.099692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:04.113039 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] HTTP exception thrown: Instance de612fcf-6876-4a88-8854-d47caf456612 could not be found. Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Request method failure captured: Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 HTTP/1.1 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoSxPosju-essxv8T8heQnjnwrtQoou1TPPD8IYQd9rrwCncELbeY-UmuAePM5C7a5vLlSNHLgXiaqqUnISix-TPId3LHSfPZwjnqrwfME-ecLFgrT-iUlYsLgTWw5pYBmX8HLnR_HPX2GXP-y-0ZmNuJ6ST3NfSp_P6pYndMwfE65k Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5afde707d5484ac0b34ab9f76c99f857"}]}] Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 74dca63bcbdf44d884868eb9474e11f6 Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance de612fcf-6876-4a88-8854-d47caf456612 could not be found. Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'de612fcf-6876-4a88-8854-d47caf456612'} Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de612fcf-6876-4a88-8854-d47caf456612 could not be found. Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de612fcf-6876-4a88-8854-d47caf456612 could not be found. Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:01:04.114620 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de612fcf-6876-4a88-8854-d47caf456612 could not be found. Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Returning 404 to user: Instance de612fcf-6876-4a88-8854-d47caf456612 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-62fab4df-8c80-412f-b541-2af53f2b9432 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612" status: 404 len: 111 microversion: 2.1 time: 0.030893 Nov 02 15:01:04.119906 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4556/7157] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:04 2022] GET /compute/v2.1/servers/de612fcf-6876-4a88-8854-d47caf456612 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:01:07.488796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fcf28d66-818a-4249-bef2-ae25875387e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '.version_select at 0x7f6f823390d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:07.511644 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fcf28d66-818a-4249-bef2-ae25875387e9 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1747487052" status: 202 len: 0 microversion: 2.1 time: 0.026772 Nov 02 15:01:07.512511 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2602/7158] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 15:01:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1747487052 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:01:07.546322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1a93743-f33d-49f5-b954-0c385785ad72 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: .version_select at 0x7f6f801b6820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1715728028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKoYmqRMkR6qgK4T0BB8Py89QEqCm3HOCSdN2Hn7H5XvvhfU+FpNRvwoRNOdxGZeXJ/itCydkFwYmJeTscfPmO+iA7MhuaT/HkdKsofhg3XE4L4y9ETR3fIRVGm7UGDpQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:07.563552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d1a93743-f33d-49f5-b954-0c385785ad72 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:01:07.568984 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-d1a93743-f33d-49f5-b954-0c385785ad72 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:01:07.592858 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1a93743-f33d-49f5-b954-0c385785ad72 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050453 Nov 02 15:01:07.593465 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4557/7159] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 15:01:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:01:13.248816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1489663707", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "networks": [{"uuid": "3d083ca7-bcec-45ae-8494-3c9cd0924b54"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1715728028", "security_groups": [{"name": "tempest-secgroup-smoke-294880710"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:13.260213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:13.390241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] validate_networks() for [('3d083ca7-bcec-45ae-8494-3c9cd0924b54', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:01:13.821939 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:01:13.822301 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:01:13.822795 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:01:13.823253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:01:13.823907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:01:13.846854 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:13.847383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:13.847833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:13.848574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:13.849080 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:13.849521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:13.873816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:01:13.880550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Getting quotas for user 74dca63bcbdf44d884868eb9474e11f6 and project 5afde707d5484ac0b34ab9f76c99f857. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:01:13.894916 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:01:13.897844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:01:13.948223 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-af5dbd3a-78e1-44ee-8151-230d37e06cbb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704918 Nov 02 15:01:13.949598 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2603/7160] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 15:01:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:01:13.962233 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-08c68bc6-aeee-4a8c-a482-195d40130aa6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:13.962924 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-08c68bc6-aeee-4a8c-a482-195d40130aa6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:14.025568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-08c68bc6-aeee-4a8c-a482-195d40130aa6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:14.033349 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-08c68bc6-aeee-4a8c-a482-195d40130aa6 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1267 microversion: 2.1 time: 0.075652 Nov 02 15:01:14.034097 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4558/7161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:13 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:15.059566 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:15.060940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:15.068558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:15.069413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:15.070100 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:15.071269 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:15.071997 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:15.072667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:15.151487 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:15.164182 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6e2720ea-008b-4598-945b-691801ca1ff3 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1327 microversion: 2.1 time: 0.109855 Nov 02 15:01:15.171529 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2604/7162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:15 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:01:16.190248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:16.190862 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:16.193805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=16 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:16.201012 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:16.201579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:16.202015 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:16.202721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:16.203212 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:16.203640 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:16.354005 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:16.362729 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-48b907c6-d8c8-4e95-97a3-0605d29782e0 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1392 microversion: 2.1 time: 0.176572 Nov 02 15:01:16.363665 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4559/7163] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:16 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:16.561216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-c12df4e1-62e3-4012-a9cc-c87419c1c6d5 req-e543487b-808a-4d99-9665-e9ce53a2aefa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f015c46-ef94-4879-8a24-29f122939cb0", "tag": "06436718-cfc7-4d16-9e55-dac6b5874f67"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:16.578744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c12df4e1-62e3-4012-a9cc-c87419c1c6d5 req-e543487b-808a-4d99-9665-e9ce53a2aefa service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:16.579394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c12df4e1-62e3-4012-a9cc-c87419c1c6d5 req-e543487b-808a-4d99-9665-e9ce53a2aefa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:16.579951 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-c12df4e1-62e3-4012-a9cc-c87419c1c6d5 req-e543487b-808a-4d99-9665-e9ce53a2aefa service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:16.594611 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-c12df4e1-62e3-4012-a9cc-c87419c1c6d5 req-e543487b-808a-4d99-9665-e9ce53a2aefa service nova] Creating event network-changed:06436718-cfc7-4d16-9e55-dac6b5874f67 for instance 0f015c46-ef94-4879-8a24-29f122939cb0 on n-h1-858238-3 Nov 02 15:01:16.602355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-c12df4e1-62e3-4012-a9cc-c87419c1c6d5 req-e543487b-808a-4d99-9665-e9ce53a2aefa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049308 Nov 02 15:01:16.603503 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2605/7164] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:01:17.389221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:17.389841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:17.396716 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:17.397197 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:17.397632 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:17.398315 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:17.398766 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:17.399224 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:17.531327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:17.539647 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3a337369-54c9-4da8-b818-ea15015c7d9f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1392 microversion: 2.1 time: 0.154372 Nov 02 15:01:17.540234 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4560/7165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:17 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:18.564621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:18.565183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:18.572906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:18.573411 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:18.573863 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:18.574581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:18.575048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:18.575525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:18.715075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:18.722961 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-addf4216-d2dc-48df-813e-354b9d36e66f tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1392 microversion: 2.1 time: 0.162865 Nov 02 15:01:18.723581 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2606/7166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:18 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:19.746551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:19.747198 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:19.754060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:19.754547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:19.754986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:19.755708 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:19.756168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:19.756598 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:19.892126 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:19.900552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-69445d4a-0c3f-44da-a182-26ecb26de532 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1392 microversion: 2.1 time: 0.157940 Nov 02 15:01:19.901136 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4561/7167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:19 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:20.923840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:20.924497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:20.931430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:20.931954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:20.932403 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:20.933104 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:20.933571 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:20.934007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:21.086371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:21.094279 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ae87e910-5609-401c-81bc-38efbb351f05 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1392 microversion: 2.1 time: 0.174375 Nov 02 15:01:21.095053 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2607/7168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:20 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:21.131292 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-2286dbbd-8609-4a82-bae1-11e62a054c4d req-09a7299b-cad1-4dc1-81d2-c7ec77ce7d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f015c46-ef94-4879-8a24-29f122939cb0", "name": "network-vif-plugged", "status": "completed", "tag": "06436718-cfc7-4d16-9e55-dac6b5874f67"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:21.142764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2286dbbd-8609-4a82-bae1-11e62a054c4d req-09a7299b-cad1-4dc1-81d2-c7ec77ce7d34 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:21.143317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2286dbbd-8609-4a82-bae1-11e62a054c4d req-09a7299b-cad1-4dc1-81d2-c7ec77ce7d34 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:21.143753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-2286dbbd-8609-4a82-bae1-11e62a054c4d req-09a7299b-cad1-4dc1-81d2-c7ec77ce7d34 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:21.155544 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-2286dbbd-8609-4a82-bae1-11e62a054c4d req-09a7299b-cad1-4dc1-81d2-c7ec77ce7d34 service nova] Creating event network-vif-plugged:06436718-cfc7-4d16-9e55-dac6b5874f67 for instance 0f015c46-ef94-4879-8a24-29f122939cb0 on n-h1-858238-3 Nov 02 15:01:21.160608 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-2286dbbd-8609-4a82-bae1-11e62a054c4d req-09a7299b-cad1-4dc1-81d2-c7ec77ce7d34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034626 Nov 02 15:01:21.161957 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4562/7169] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:01:22.117816 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:22.118452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:22.125459 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:22.125958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:22.126414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:22.127137 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:22.127617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:22.128064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:22.263070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:22.272017 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4ace55a7-fc09-4822-a30f-0fa21d85475d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1392 microversion: 2.1 time: 0.158070 Nov 02 15:01:22.273042 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2608/7170] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:22 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:23.297788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:23.298489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:23.300487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:23.306331 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:23.306813 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:23.307290 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:23.307986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:23.308435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:23.308855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:23.443559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:23.451357 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9b82ddf2-a4de-475e-a7f8-300b5e04c856 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1565 microversion: 2.1 time: 0.158588 Nov 02 15:01:23.451930 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4563/7171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:23 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:23.475665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:23.476222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:23.483172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:23.483672 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:23.484128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:23.484833 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:23.485307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:23.485749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:23.619592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:23.627355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c70f6098-9227-49b6-862a-590934856b90 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1565 microversion: 2.1 time: 0.155669 Nov 02 15:01:23.627930 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2609/7172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:23 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:25.213851 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:25.214634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:25.216518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:25.218592 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2614777a-8b7a-4880-846a-9b32c24d0943 req-1cdefd6b-b21d-46b9-9178-337a1cbe1224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f015c46-ef94-4879-8a24-29f122939cb0", "tag": "06436718-cfc7-4d16-9e55-dac6b5874f67"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:25.223130 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:25.223738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:25.224169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:25.225117 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:25.225570 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:25.226173 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:25.226327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:25.227492 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:25.234570 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2614777a-8b7a-4880-846a-9b32c24d0943 req-1cdefd6b-b21d-46b9-9178-337a1cbe1224 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:25.235172 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2614777a-8b7a-4880-846a-9b32c24d0943 req-1cdefd6b-b21d-46b9-9178-337a1cbe1224 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:25.235683 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2614777a-8b7a-4880-846a-9b32c24d0943 req-1cdefd6b-b21d-46b9-9178-337a1cbe1224 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:25.248927 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2614777a-8b7a-4880-846a-9b32c24d0943 req-1cdefd6b-b21d-46b9-9178-337a1cbe1224 service nova] Creating event network-changed:06436718-cfc7-4d16-9e55-dac6b5874f67 for instance 0f015c46-ef94-4879-8a24-29f122939cb0 on n-h1-858238-3 Nov 02 15:01:25.256012 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2614777a-8b7a-4880-846a-9b32c24d0943 req-1cdefd6b-b21d-46b9-9178-337a1cbe1224 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042598 Nov 02 15:01:25.257079 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2610/7173] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:01:25.373855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:25.382832 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f015d532-92b2-4274-ad08-6d33be05f0ea tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1565 microversion: 2.1 time: 0.173695 Nov 02 15:01:25.383794 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4564/7174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:25 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:46.623272 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:46.625583 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:46.628396 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:46.629165 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=36 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:46.636964 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:46.637469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:46.637925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:46.638639 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:46.639166 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:46.639621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:46.695935 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-82cb140e-587e-4c52-b651-eb6b69f960bc tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action" status: 200 len: 24567 microversion: 2.1 time: 0.076586 Nov 02 15:01:46.696626 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2611/7175] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:01:46 2022] POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action => generated 24567 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 15:01:53.155652 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:53.156250 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:53.158273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:53.158968 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=32 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:01:53.160391 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:01:53.160535 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action (ip 10.222.0.18) !!! Nov 02 15:01:53.168863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:53.169345 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:53.169772 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:53.170454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:53.170898 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:53.171342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:53.196543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lazy-loading 'flavor' on Instance uuid 0f015c46-ef94-4879-8a24-29f122939cb0 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:01:53.269034 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7fe50be2-24ed-43e1-8693-739fa9dbd95b tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action" status: 202 len: 0 microversion: 2.1 time: 0.116843 Nov 02 15:01:53.270183 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4565/7176] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:01:53 2022] POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:01:53.281634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:53.282379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:53.291070 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:53.291588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:53.292042 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:53.292765 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:53.293238 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:53.293681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:53.488168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:53.496714 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5f31b2a6-ccc2-49a6-b6e5-349babe22b3c tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1691 microversion: 2.1 time: 0.221745 Nov 02 15:01:53.497279 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2612/7177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:53 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:54.522519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:54.523267 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:54.531150 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:54.531634 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:54.532068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:54.532758 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:54.533210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:54.533627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:54.670074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:54.681343 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fdc18d2d-c4d8-4e6f-bd65-4c5cf355f1fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1674 microversion: 2.1 time: 0.163300 Nov 02 15:01:54.681952 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4566/7178] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:54 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:56.104776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:56.106974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:56.114640 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:56.115181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:56.115671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:56.116883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:56.117353 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:56.117796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:56.169287 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-465b1553-488f-4f68-b43b-42b2bd83bbf7 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action" status: 200 len: 35229 microversion: 2.1 time: 0.068252 Nov 02 15:01:56.169981 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2613/7179] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:01:56 2022] POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action => generated 35229 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 15:01:56.182210 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:56.182726 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:56.189593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:56.190074 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:56.190528 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:56.191244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:56.191693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:56.192109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:56.262277 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4957ec97-2cb7-4eff-a793-25a4f6e73e99 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action" status: 202 len: 0 microversion: 2.1 time: 0.084270 Nov 02 15:01:56.263674 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4567/7180] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:01:56 2022] POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:01:56.272498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:56.273222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:56.281010 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:56.281645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:56.282925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:56.283681 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:56.284729 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:56.285176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:56.433815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:56.441642 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7687b9ac-2d44-4142-b75f-0fa71e694751 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1680 microversion: 2.1 time: 0.173464 Nov 02 15:01:56.443342 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2614/7181] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:56 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:57.468589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:57.469291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:57.476326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:57.476804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:57.477242 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:57.477923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:57.478375 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:57.478795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:57.615417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:57.627203 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0610a2a8-94b7-4f5c-8ba3-5e7386e31d43 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1680 microversion: 2.1 time: 0.162779 Nov 02 15:01:57.627917 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4568/7182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:57 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:58.651787 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:01:58.652418 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:58.659425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:58.659925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:58.660383 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:58.661085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:58.661557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:58.662006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:58.796275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:01:58.804741 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e5479df9-f908-4a33-8913-f9580e3ea243 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1683 microversion: 2.1 time: 0.156844 Nov 02 15:01:58.805313 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2615/7183] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:01:58 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:01:58.904658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:01:58.906847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:01:58.914237 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:58.914720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:58.915200 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:58.915899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:01:58.916343 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:01:58.916764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:01:58.958242 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-61124f42-14b8-432d-b4c7-5ad074e86345 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action" status: 200 len: 35229 microversion: 2.1 time: 0.057362 Nov 02 15:01:58.959220 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4569/7184] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:01:58 2022] POST /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0/action => generated 35229 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 15:02:00.297956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:00.298482 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:00.300508 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-1f11c04c-3816-44a3-895b-c627d5279c9c req-e0625cdb-124b-4252-88a7-729217f03a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f015c46-ef94-4879-8a24-29f122939cb0", "tag": "06436718-cfc7-4d16-9e55-dac6b5874f67"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:00.305659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:00.306171 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:00.306625 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:00.307378 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:00.307849 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:00.308477 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:00.312387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1f11c04c-3816-44a3-895b-c627d5279c9c req-e0625cdb-124b-4252-88a7-729217f03a97 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:00.312974 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1f11c04c-3816-44a3-895b-c627d5279c9c req-e0625cdb-124b-4252-88a7-729217f03a97 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:00.313497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-1f11c04c-3816-44a3-895b-c627d5279c9c req-e0625cdb-124b-4252-88a7-729217f03a97 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:00.326401 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-1f11c04c-3816-44a3-895b-c627d5279c9c req-e0625cdb-124b-4252-88a7-729217f03a97 service nova] Creating event network-changed:06436718-cfc7-4d16-9e55-dac6b5874f67 for instance 0f015c46-ef94-4879-8a24-29f122939cb0 on n-h1-858238-3 Nov 02 15:02:00.331821 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-1f11c04c-3816-44a3-895b-c627d5279c9c req-e0625cdb-124b-4252-88a7-729217f03a97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035678 Nov 02 15:02:00.332927 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4570/7185] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:00.338004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:02:00.428848 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ded01713-d4a1-491c-9646-f959ca2ee76d tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 204 len: 0 microversion: 2.1 time: 0.134473 Nov 02 15:02:00.429639 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2616/7186] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 15:02:00 2022] DELETE /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:02:00.439284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:00.440296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:00.451917 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:00.452730 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:00.453370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:00.454750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:00.455474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:00.456090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:00.603030 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:00.611169 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5b266618-a01e-44ab-83e4-d5d1ba062c14 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1689 microversion: 2.1 time: 0.176491 Nov 02 15:02:00.611836 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4571/7187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:00 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:01.637569 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:01.638281 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:01.645414 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:01.645911 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:01.646363 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:01.647735 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:01.648206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:01.648646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:01.790225 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:01.797799 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a0c9bcd7-c7c1-4f4a-ba60-a6514efa73fb tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1689 microversion: 2.1 time: 0.164524 Nov 02 15:02:01.798393 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2617/7188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:01 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:02.518088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-812778bf-dbf6-4f49-ad5e-fc43033a79c7 req-781157f5-0ff4-46cd-acf6-087d425e09a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f015c46-ef94-4879-8a24-29f122939cb0", "name": "network-vif-deleted", "tag": "06436718-cfc7-4d16-9e55-dac6b5874f67"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:02.531677 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-812778bf-dbf6-4f49-ad5e-fc43033a79c7 req-781157f5-0ff4-46cd-acf6-087d425e09a4 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:02.532160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-812778bf-dbf6-4f49-ad5e-fc43033a79c7 req-781157f5-0ff4-46cd-acf6-087d425e09a4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:02.532589 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-812778bf-dbf6-4f49-ad5e-fc43033a79c7 req-781157f5-0ff4-46cd-acf6-087d425e09a4 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:02.545186 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-812778bf-dbf6-4f49-ad5e-fc43033a79c7 req-781157f5-0ff4-46cd-acf6-087d425e09a4 service nova] Creating event network-vif-deleted:06436718-cfc7-4d16-9e55-dac6b5874f67 for instance 0f015c46-ef94-4879-8a24-29f122939cb0 on n-h1-858238-3 Nov 02 15:02:02.550009 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-812778bf-dbf6-4f49-ad5e-fc43033a79c7 req-781157f5-0ff4-46cd-acf6-087d425e09a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035788 Nov 02 15:02:02.550613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4572/7189] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:02.821152 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:02.821789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:02.828956 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:02.829457 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:02.829906 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:02.830655 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:02.831143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:02.831614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:02.865340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:02.865883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:02.866341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:02.866815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lazy-loading 'fault' on Instance uuid 0f015c46-ef94-4879-8a24-29f122939cb0 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:02:02.916050 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74dca63bcbdf44d884868eb9474e11f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afde707d5484ac0b34ab9f76c99f857', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:02.924415 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c3b380d3-9ef5-4754-9e3f-590e607d3e01 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 200 len: 1357 microversion: 2.1 time: 0.107368 Nov 02 15:02:02.925221 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2618/7190] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:02 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:03.950977 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:03.951724 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] [instance: 0f015c46-ef94-4879-8a24-29f122939cb0] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:03.959079 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:03.959633 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:03.960077 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:03.960782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:03.961264 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:03.961670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:03.975735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] HTTP exception thrown: Instance 0f015c46-ef94-4879-8a24-29f122939cb0 could not be found. Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Request method failure captured: Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 HTTP/1.1 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoSxPosju-essxv8T8heQnjnwrtQoou1TPPD8IYQd9rrwCncELbeY-UmuAePM5C7a5vLlSNHLgXiaqqUnISix-TPId3LHSfPZwjnqrwfME-ecLFgrT-iUlYsLgTWw5pYBmX8HLnR_HPX2GXP-y-0ZmNuJ6ST3NfSp_P6pYndMwfE65k Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5afde707d5484ac0b34ab9f76c99f857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5afde707d5484ac0b34ab9f76c99f857"}]}] Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: 5afde707d5484ac0b34ab9f76c99f857 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1908308610 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 74dca63bcbdf44d884868eb9474e11f6 Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1908308610-project Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 0f015c46-ef94-4879-8a24-29f122939cb0 could not be found. Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '0f015c46-ef94-4879-8a24-29f122939cb0'} Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f015c46-ef94-4879-8a24-29f122939cb0 could not be found. Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f015c46-ef94-4879-8a24-29f122939cb0 could not be found. Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:02:03.977383 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f015c46-ef94-4879-8a24-29f122939cb0 could not be found. Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Returning 404 to user: Instance 0f015c46-ef94-4879-8a24-29f122939cb0 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b8d644ba-120a-4921-bb3d-b461d35b9096 tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0" status: 404 len: 111 microversion: 2.1 time: 0.032168 Nov 02 15:02:03.982293 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4573/7191] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:03 2022] GET /compute/v2.1/servers/0f015c46-ef94-4879-8a24-29f122939cb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:02:07.047813 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-42b3cf2f-827b-4c89-be6a-ed684aa750fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] Calling method '.version_select at 0x7f6f81c739d0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:07.069380 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-42b3cf2f-827b-4c89-be6a-ed684aa750fa tempest-TestNetworkAdvancedServerOps-1908308610 tempest-TestNetworkAdvancedServerOps-1908308610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1715728028" status: 202 len: 0 microversion: 2.1 time: 0.024552 Nov 02 15:02:07.070254 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2619/7192] 10.222.0.18 () {58 vars in 1284 bytes} [Wed Nov 2 15:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1715728028 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:02:18.336189 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=18 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:18.337238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:18.523021 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-91b49fc4-a86e-4b60-b2f6-280b68f23a43 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'create', calling method: .version_select at 0x7f6f801b6820>, body: {"keypair": {"name": "tempest-TestShelveInstance-258393326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBso+ygmx2fbfIkHi3fuq1rduWd90n3gzOV0Bn/qt2hWqdHf6dS9qDKelIYiDWbjfwAxaGp3nApL0DTqWx7lu3Nn0vjlfF99SSa76wZXSRTdv2F8pent7DZqz9D8uza8Uw=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:18.542902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-91b49fc4-a86e-4b60-b2f6-280b68f23a43 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:02:18.548994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-91b49fc4-a86e-4b60-b2f6-280b68f23a43 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for user 8389005a0ddf4529aa9c79f7da0652bd and project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:02:18.588251 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-91b49fc4-a86e-4b60-b2f6-280b68f23a43 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.258420 Nov 02 15:02:18.589827 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4574/7193] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 15:02:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:19.683634 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-984517401", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-258393326", "security_groups": [{"name": "tempest-secgroup-smoke-514255767"}], "networks": [{"uuid": "f18f2526-8fba-408a-8ee0-a2251105c4d9"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:19.706698 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:19.707557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:19.799413 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] validate_networks() for [('f18f2526-8fba-408a-8ee0-a2251105c4d9', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:02:20.198256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:02:20.198704 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:02:20.199209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:02:20.199775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:02:20.200197 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:02:20.209628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:20.210132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:20.210580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:20.211359 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:20.211832 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:20.212288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:20.234251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:02:20.239602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for user 8389005a0ddf4529aa9c79f7da0652bd and project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:02:20.252747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:02:20.255064 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:02:20.305376 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-acff5f53-7b11-4614-966e-b87fbafdad4d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.627727 Nov 02 15:02:20.306289 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2620/7194] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 15:02:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:02:20.319838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-57ccfc4b-b17f-4384-80ea-eb3b7a1ecc26 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:20.320881 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-57ccfc4b-b17f-4384-80ea-eb3b7a1ecc26 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:20.384939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-57ccfc4b-b17f-4384-80ea-eb3b7a1ecc26 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:20.394674 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-57ccfc4b-b17f-4384-80ea-eb3b7a1ecc26 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1245 microversion: 2.1 time: 0.080320 Nov 02 15:02:20.399174 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4575/7195] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:20 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:21.422485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:21.423703 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:21.431899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:21.432647 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:21.433264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:21.433987 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:21.434604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:21.435046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:21.509075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:21.518495 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f1bb8205-e2d0-479f-ac96-62b52e376a82 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1297 microversion: 2.1 time: 0.100570 Nov 02 15:02:21.519086 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2621/7196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:21 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:22.542745 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:22.543657 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:22.552258 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:22.552786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:22.553238 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:22.553943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:22.554400 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:22.554859 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:22.792280 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:22.800614 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a6e8b5d7-ef3d-4379-85b9-e61574c11720 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.261899 Nov 02 15:02:22.801218 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4576/7197] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:22 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:23.216011 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-d22e4d21-9fd1-47ff-9ade-b5f1512cb3af req-b0c80c91-75aa-4bfa-8625-183726191a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:23.227750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d22e4d21-9fd1-47ff-9ade-b5f1512cb3af req-b0c80c91-75aa-4bfa-8625-183726191a71 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:23.228525 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d22e4d21-9fd1-47ff-9ade-b5f1512cb3af req-b0c80c91-75aa-4bfa-8625-183726191a71 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:23.229177 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-d22e4d21-9fd1-47ff-9ade-b5f1512cb3af req-b0c80c91-75aa-4bfa-8625-183726191a71 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:23.241301 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-d22e4d21-9fd1-47ff-9ade-b5f1512cb3af req-b0c80c91-75aa-4bfa-8625-183726191a71 service nova] Creating event network-changed:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:02:23.246909 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-d22e4d21-9fd1-47ff-9ade-b5f1512cb3af req-b0c80c91-75aa-4bfa-8625-183726191a71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034778 Nov 02 15:02:23.247634 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2622/7198] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:23.824216 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:23.824829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:23.831884 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:23.832366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:23.832802 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:23.834069 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:23.834471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:23.834896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:24.043259 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:24.051565 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7ba74d1-9d72-40d5-8b4e-2f8577fce337 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.231268 Nov 02 15:02:24.052142 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4577/7199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:23 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:25.075719 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:25.076545 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:25.082865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:25.083391 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:25.083884 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:25.084590 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:25.085060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:25.085497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:25.302257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:25.310280 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-71b802e6-7c95-418d-b77d-f8f3447e6d10 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.239753 Nov 02 15:02:25.310861 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2623/7200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:25 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:26.333878 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:26.334489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:26.341354 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:26.341831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:26.342260 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:26.342941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:26.343425 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:26.343841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:26.479318 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:26.487132 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-184069fa-960c-4a85-9500-3f0bd66eb0e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.157214 Nov 02 15:02:26.487712 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4578/7201] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:26 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:27.511504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:27.512162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:27.518937 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:27.519475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:27.519936 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:27.520649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:27.521156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:27.521594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:27.658882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:27.666587 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c0208eb0-8786-4c4f-af8c-6e8692325750 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.159352 Nov 02 15:02:27.667172 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2624/7202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:27 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:28.689856 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:28.690371 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:28.698054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:28.698529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:28.698957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:28.699737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:28.700182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:28.700600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:28.830091 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:28.838603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c1147dc6-1626-4316-bdae-e2072efe90e6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.152684 Nov 02 15:02:28.839209 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4579/7203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:28 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:29.481831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b683af26-2e38-4424-9b04-cdae16458a7c req-4ac83f1b-74a3-46dc-a915-555a706a62bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "name": "network-vif-plugged", "status": "completed", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:29.494092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b683af26-2e38-4424-9b04-cdae16458a7c req-4ac83f1b-74a3-46dc-a915-555a706a62bb service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:29.494588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b683af26-2e38-4424-9b04-cdae16458a7c req-4ac83f1b-74a3-46dc-a915-555a706a62bb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:29.495037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b683af26-2e38-4424-9b04-cdae16458a7c req-4ac83f1b-74a3-46dc-a915-555a706a62bb service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:29.506323 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b683af26-2e38-4424-9b04-cdae16458a7c req-4ac83f1b-74a3-46dc-a915-555a706a62bb service nova] Creating event network-vif-plugged:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:02:29.511387 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b683af26-2e38-4424-9b04-cdae16458a7c req-4ac83f1b-74a3-46dc-a915-555a706a62bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Nov 02 15:02:29.511994 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2625/7204] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:29.861814 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:29.862424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:29.869257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:29.869738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:29.870171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:29.870880 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:29.871356 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:29.871777 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:30.004762 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:30.012733 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c4ef2ca7-ebce-47b6-889b-28bb52e838aa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1370 microversion: 2.1 time: 0.154802 Nov 02 15:02:30.013313 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4580/7205] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:29 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:31.032476 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:31.033275 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:31.038929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:31.039695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:31.046740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:31.047265 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:31.047723 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:31.048431 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:31.048899 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:31.049341 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:31.181106 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:31.188885 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e70e3a07-9778-4b09-9430-e765359c9983 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1553 microversion: 2.1 time: 0.157420 Nov 02 15:02:31.189466 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2626/7206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:31 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:31.213428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:31.214034 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:31.215892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:31.222314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:31.222788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:31.223246 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:31.223932 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:31.224382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:31.224804 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:31.359844 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:31.368125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-80357ce3-a298-42be-a022-9c66ba9b07ea tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1553 microversion: 2.1 time: 0.158556 Nov 02 15:02:31.368690 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4581/7207] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:02:31 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:33.094373 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-2945bd2b-98f5-4bc1-8cb5-05923569f589 req-d1459e80-5fb5-49a2-9e79-2e21d2997ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:33.104458 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2945bd2b-98f5-4bc1-8cb5-05923569f589 req-d1459e80-5fb5-49a2-9e79-2e21d2997ff3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:33.104958 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2945bd2b-98f5-4bc1-8cb5-05923569f589 req-d1459e80-5fb5-49a2-9e79-2e21d2997ff3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:33.105416 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-2945bd2b-98f5-4bc1-8cb5-05923569f589 req-d1459e80-5fb5-49a2-9e79-2e21d2997ff3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:33.117174 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-2945bd2b-98f5-4bc1-8cb5-05923569f589 req-d1459e80-5fb5-49a2-9e79-2e21d2997ff3 service nova] Creating event network-changed:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:02:33.122249 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-2945bd2b-98f5-4bc1-8cb5-05923569f589 req-d1459e80-5fb5-49a2-9e79-2e21d2997ff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092194 Nov 02 15:02:33.122869 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2627/7208] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:04:28.298610 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:04:28.299714 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:04:28.300482 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:28.301476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=36 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:28.302718 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:04:28.302895 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:04:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648/action (ip 10.222.0.18) !!! Nov 02 15:04:28.304317 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:04:28.304447 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:04:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648/action (ip 10.222.0.18) !!! Nov 02 15:04:28.310845 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:04:28.311403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:28.324927 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:28.325407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:28.325839 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:28.326521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:28.326965 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:28.327407 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:28.353251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lazy-loading 'flavor' on Instance uuid f620604c-41be-4394-8a89-364de6ef5648 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:04:28.540539 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4fed68a0-80d4-4a53-95c4-fa1f1aaf95da tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648/action" status: 202 len: 0 microversion: 2.1 time: 0.243466 Nov 02 15:04:28.541163 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4582/7209] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:04:28 2022] POST /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:04:28.548260 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 15:04:28.549320 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e82819bf-8a21-4687-82cd-782450aa05a3] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 15:04:28.549889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:28.550873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=32 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:28.556198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:28.556924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:28.564706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:28.565208 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:28.565661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:28.566587 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:28.567059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:28.567800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:28.802674 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:28.810523 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-60c38ff6-2b88-4697-835e-b9d822dac339 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.264534 Nov 02 15:04:28.811115 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2628/7210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:28 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:29.834422 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:29.835048 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:29.851489 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:29.852222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:29.852656 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:29.853366 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:29.853855 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:29.854284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:29.858325 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55106. Nov 02 15:04:29.861424 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55104. Nov 02 15:04:29.989484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:29.998049 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e96eda21-b824-4b87-bcf4-0378edb3659e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.167969 Nov 02 15:04:29.998622 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4583/7211] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:29 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:31.021186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:31.021817 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:31.031004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:31.031531 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:31.031982 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:31.032690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:31.033157 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:31.033597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:31.040699 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [e82819bf-8a21-4687-82cd-782450aa05a3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55112. Nov 02 15:04:31.041432 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55110. Nov 02 15:04:31.170861 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:31.178769 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-45e5aeb6-7cbb-4cb5-939c-3f2be14b2988 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.161628 Nov 02 15:04:31.179383 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2629/7212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:31 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:32.203340 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:32.203946 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:32.210662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:32.211166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:32.211599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:32.212279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:32.212740 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:32.213141 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:32.342327 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:32.350089 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8fadefaf-0729-472f-b8f7-426f6cbed59d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.150650 Nov 02 15:04:32.350655 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4584/7213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:32 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:33.374101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:33.374685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:33.381721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:33.382216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:33.382666 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:33.383405 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:33.383873 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:33.384311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:33.515360 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:33.523324 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1262fa2e-d232-44dc-9829-6524b3775819 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.153758 Nov 02 15:04:33.523897 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2630/7214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:33 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:34.547367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:34.548244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:34.555142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:34.555623 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:34.556051 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:34.556736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:34.557184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:34.557718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:34.755109 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:34.763010 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-31fa4751-b009-45c3-92cd-326b43f76615 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.219549 Nov 02 15:04:34.763838 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4585/7215] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:34 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:35.787282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:35.787834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:35.794608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:35.795115 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:35.795605 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:35.796304 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:35.796774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:35.797212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:35.928879 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:35.937306 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31535b9c-f49a-4605-9288-ed8955e903a1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.154124 Nov 02 15:04:35.937876 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2631/7216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:35 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:36.960916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:36.961537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:36.969159 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:36.969697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:36.970119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:36.970815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:36.971299 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:36.971910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:37.106191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:37.113986 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-c04aaf06-9af2-4bb4-93f6-99d555e94565 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.157165 Nov 02 15:04:37.114565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4586/7217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:36 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:38.139412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:38.140117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:38.147121 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:38.147629 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:38.148075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:38.148775 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:38.149237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:38.149671 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:38.280738 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:38.288581 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4d205fcb-4b05-4fe6-9800-56b7e8f78ab3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.153738 Nov 02 15:04:38.289165 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2632/7218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:38 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:39.313257 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:39.313945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:39.321229 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:39.321711 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:39.322144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:39.322838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:39.323388 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:39.323815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:39.455381 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:39.463354 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f3c39792-42db-4828-acc2-37659a233b66 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1697 microversion: 2.1 time: 0.154472 Nov 02 15:04:39.463932 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4587/7219] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:39 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:40.488060 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:40.488753 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:40.495865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:40.496366 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:40.497273 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:40.498247 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:40.498868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:40.499343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:40.638546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:40.646403 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b807fbde-bd73-48bb-b0e9-0a412dcb3f23 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.162379 Nov 02 15:04:40.646971 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2633/7220] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:40 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:41.670591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:41.671352 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:41.679045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:41.679654 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:41.680090 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:41.680794 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:41.681247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:41.681669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:41.828494 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:41.840148 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-455ebbc3-fe23-429c-b4a2-eaffc64e4a97 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.174061 Nov 02 15:04:41.841317 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4588/7221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:41 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:42.132537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-40620f07-3ea0-4cf5-a193-3b83defb5911 req-62f0e755-1572-41fa-96d0-2ce48697fa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "name": "network-vif-plugged", "status": "completed", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:04:42.143976 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-40620f07-3ea0-4cf5-a193-3b83defb5911 req-62f0e755-1572-41fa-96d0-2ce48697fa7a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:42.144602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-40620f07-3ea0-4cf5-a193-3b83defb5911 req-62f0e755-1572-41fa-96d0-2ce48697fa7a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:42.145051 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-40620f07-3ea0-4cf5-a193-3b83defb5911 req-62f0e755-1572-41fa-96d0-2ce48697fa7a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:42.160175 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-40620f07-3ea0-4cf5-a193-3b83defb5911 req-62f0e755-1572-41fa-96d0-2ce48697fa7a service nova] Creating event network-vif-plugged:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:04:42.165926 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-40620f07-3ea0-4cf5-a193-3b83defb5911 req-62f0e755-1572-41fa-96d0-2ce48697fa7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125113 Nov 02 15:04:42.167169 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2634/7222] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:04:42.868800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:42.869476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:42.877938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:42.878452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:42.879122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:42.880017 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:42.880474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:42.880899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:43.037693 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:43.047369 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7f5f356f-3989-4e59-9d6f-1bc494b05cd2 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.186195 Nov 02 15:04:43.047951 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4589/7223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:42 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:44.077831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:44.078574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:44.085095 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:44.085668 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:44.086179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:44.086889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:44.087381 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:44.087820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:44.244963 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:44.253904 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c36396c6-1c53-4853-8f94-ebb2ef1f5ec6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.183099 Nov 02 15:04:44.254692 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2635/7224] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:44 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:45.280651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:45.281928 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:45.288788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:45.289284 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:45.289725 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:45.290434 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:45.290889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:45.291346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:45.452453 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:45.461151 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b54a1313-55ed-42fb-a4d0-5df02bee992e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.187160 Nov 02 15:04:45.461803 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4590/7225] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:45 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:46.500614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:46.501274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:46.509068 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:46.509577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:46.510033 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:46.510749 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:46.511251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:46.511699 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:46.659136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:46.669704 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57360873-97fa-4afd-b35b-c62af6fde440 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.184968 Nov 02 15:04:46.670434 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2636/7226] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:46 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:47.695714 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:47.696273 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:47.706980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:47.707750 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:47.708251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:47.709061 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:47.709578 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:47.710073 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:47.863728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:47.875387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-a7ac09c9-e9c7-4915-9dd6-497b890e3004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.182997 Nov 02 15:04:47.883311 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4591/7227] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:47 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:48.901685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:48.902306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:48.910183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:48.910686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:48.911156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:48.911878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:48.912343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:48.912779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:49.059613 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:49.068506 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5054c9f9-1581-4df0-a243-8929fbc0726f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.170659 Nov 02 15:04:49.069239 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2637/7228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:48 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:04:50.092943 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:50.093514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:50.100432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:50.100909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:50.101341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:50.102024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:50.102474 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:50.102896 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:50.232661 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:50.240501 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-eae44bd8-55d5-47a3-97f8-724bd6dc076e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1692 microversion: 2.1 time: 0.151555 Nov 02 15:04:50.241078 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4592/7229] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:50 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:51.265440 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:51.265985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:51.273025 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:51.273516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:51.273965 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:51.274688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:51.275193 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:51.275633 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:51.408621 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:51.416723 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e3e89bfa-a75d-477c-a979-7c2676e45f4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1674 microversion: 2.1 time: 0.155841 Nov 02 15:04:51.417333 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2638/7230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:51 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:52.442082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:52.443600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:52.451083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:52.451593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:52.452071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:52.452805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:52.453303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:52.453720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:52.587800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:52.595538 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3c45f651-ddbd-4cba-a2e6-71b428491a94 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1677 microversion: 2.1 time: 0.158106 Nov 02 15:04:52.596108 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4593/7231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:52 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:52.618540 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:04:52.619207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:52.626851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:52.627315 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:52.627763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:52.628462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:52.628926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:52.629361 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:52.725763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137558) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 15:04:52.795818 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [96757c04-6a6b-4154-9c82-1e2a55b50ed1] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:04:53.803860 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [96757c04-6a6b-4154-9c82-1e2a55b50ed1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55210. Nov 02 15:04:53.807063 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e7919515-3554-4ad1-88c8-179576c085f0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648/action" status: 202 len: 0 microversion: 2.1 time: 1.192644 Nov 02 15:04:53.807717 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2639/7232] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:04:52 2022] POST /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648/action => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:04:53.816399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:53.817010 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:53.824060 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:53.825178 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:53.825619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:53.826314 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:53.826764 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:53.827244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:53.975379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:53.984714 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f86ca844-7fb8-4974-987b-0cbfd927144c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1625 microversion: 2.1 time: 0.172164 Nov 02 15:04:53.985922 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4594/7233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:53 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1625 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:54.046001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-43c67073-74a1-46b0-bc67-3f4cfbf30952 req-62dd515c-b3f1-4b08-9fb1-4b96dd8c4394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "name": "network-vif-unplugged", "status": "completed", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:04:54.057329 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-43c67073-74a1-46b0-bc67-3f4cfbf30952 req-62dd515c-b3f1-4b08-9fb1-4b96dd8c4394 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:54.057772 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-43c67073-74a1-46b0-bc67-3f4cfbf30952 req-62dd515c-b3f1-4b08-9fb1-4b96dd8c4394 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:54.058228 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-43c67073-74a1-46b0-bc67-3f4cfbf30952 req-62dd515c-b3f1-4b08-9fb1-4b96dd8c4394 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:54.069917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.compute.server_external_events [req-43c67073-74a1-46b0-bc67-3f4cfbf30952 req-62dd515c-b3f1-4b08-9fb1-4b96dd8c4394 service nova] Unable to find a host for instance f620604c-41be-4394-8a89-364de6ef5648. Dropping event network-vif-unplugged {{(pid=137558) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 15:04:54.070891 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-43c67073-74a1-46b0-bc67-3f4cfbf30952 req-62dd515c-b3f1-4b08-9fb1-4b96dd8c4394 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028899 Nov 02 15:04:54.071531 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2640/7234] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 15:04:55.009832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:55.010430 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:55.018044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:55.018533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:55.018973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:55.019712 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:55.020171 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:55.020594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:55.198463 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:55.207195 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3866ac6c-fa79-4dbe-932f-2760997965a3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.201329 Nov 02 15:04:55.207787 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4595/7235] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:55 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:56.233917 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:56.235456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:56.244274 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:56.244763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:56.245354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:56.246875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:56.247365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:56.247826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:56.399337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:56.419575 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7dabefef-1fa0-4e7d-a72b-8a1ca7224c8b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.191163 Nov 02 15:04:56.433455 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2641/7236] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:56 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:57.445092 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:57.445736 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:57.453298 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:57.453786 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:57.454227 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:57.454940 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:57.455429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:57.455883 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:57.477622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:57.604261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:57.615460 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f7cc8df1-689c-4ec3-b13a-2b82b0de480a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.174392 Nov 02 15:04:57.617089 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4596/7237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:57 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:58.640828 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:58.641878 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:58.644954 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:58.653102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:58.653602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:58.654052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:58.655131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:58.655256 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:58.655779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:58.659321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:58.801776 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:04:58.810355 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76b884f5-f48b-4890-8499-dde7739b2ff6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.173901 Nov 02 15:04:58.818639 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2642/7238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:58 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:04:59.835805 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:04:59.836702 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:04:59.844445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=31 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:04:59.846054 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:59.846698 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:59.847151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:04:59.847999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:04:59.848860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:04:59.849209 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:00.014779 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:00.023384 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-efe473c2-9324-4fd6-8e89-2a1b294bb5e8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.191833 Nov 02 15:05:00.024346 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4597/7239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:04:59 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:01.049468 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:01.050062 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:01.056844 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:01.057337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:01.057783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:01.059046 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:01.059542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:01.059977 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:01.205943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:01.215462 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-661fb507-c2c8-47a9-88d8-bfc5bd10abfc tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.169284 Nov 02 15:05:01.216092 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2643/7240] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:01 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:02.240519 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:02.241245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:02.248288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:02.248771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:02.249201 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:02.249888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:02.250334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:02.250874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:02.436756 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:02.468215 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2c517f8a-5c99-4d4f-b595-470b65434759 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.232113 Nov 02 15:05:02.472280 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4598/7241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:02 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:03.496306 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:03.496918 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:03.504096 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:03.504594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:03.505045 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:03.505750 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:03.506220 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:03.506661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:03.646168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:03.657471 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c28bc680-490a-4ff6-9abd-d21785b8abb5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.165211 Nov 02 15:05:03.658263 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2644/7242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:03 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:04.682488 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:04.683142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:04.690522 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:04.690999 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:04.691465 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:04.692151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:04.692854 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:04.693275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:04.826531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:04.834345 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-582d929f-ded4-4d43-b374-49227855a731 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.156111 Nov 02 15:05:04.834915 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4599/7243] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:04 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:05.858355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:05.858985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:05.865871 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:05.866367 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:05.866818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:05.867559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:05.868037 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:05.868505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:06.005572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:06.014092 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-0d7b285c-e7db-490b-bf1c-f7b2c557b538 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.160222 Nov 02 15:05:06.014950 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2645/7244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:05 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:07.039531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:07.040099 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:07.047460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:07.047942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:07.048378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:07.049067 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:07.049527 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:07.049950 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:07.184346 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:07.192528 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0d67441b-062b-4761-8517-7a90c2bf3cd0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.156872 Nov 02 15:05:07.193117 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4600/7245] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:07 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:08.144826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-46509088-89b3-46d4-93f6-69c70fea0c78 req-4da236f3-3bdb-4796-8e23-b0d0ed8452f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "name": "network-vif-plugged", "status": "completed", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:08.156654 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-46509088-89b3-46d4-93f6-69c70fea0c78 req-4da236f3-3bdb-4796-8e23-b0d0ed8452f5 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:08.157244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-46509088-89b3-46d4-93f6-69c70fea0c78 req-4da236f3-3bdb-4796-8e23-b0d0ed8452f5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:08.157923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-46509088-89b3-46d4-93f6-69c70fea0c78 req-4da236f3-3bdb-4796-8e23-b0d0ed8452f5 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:08.169662 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-46509088-89b3-46d4-93f6-69c70fea0c78 req-4da236f3-3bdb-4796-8e23-b0d0ed8452f5 service nova] Creating event network-vif-plugged:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:05:08.175585 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-46509088-89b3-46d4-93f6-69c70fea0c78 req-4da236f3-3bdb-4796-8e23-b0d0ed8452f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034535 Nov 02 15:05:08.176182 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2646/7246] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:05:08.216888 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:08.217448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:08.224697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:08.225182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:08.225616 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:08.226316 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:08.226769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:08.227220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:08.749156 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:08.756985 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-956f4b5a-1410-4b96-a256-a913a9b0599c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.544242 Nov 02 15:05:08.757565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4601/7247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:08 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:09.781620 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:09.782393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:09.789643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:09.790141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:09.790596 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:09.791334 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:09.792008 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:09.792962 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:09.932508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:09.948061 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d55fad9c-f61e-4761-a842-da9bc5bdc8c6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1683 microversion: 2.1 time: 0.170549 Nov 02 15:05:09.948665 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2647/7248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:09 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:10.973125 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:10.973664 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:10.980996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:10.981479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:10.981912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:10.982605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:10.983056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:10.983506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:11.113536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:11.121981 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e4a58d68-91a3-43d7-ad49-f4460d294f71 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1670 microversion: 2.1 time: 0.152819 Nov 02 15:05:11.122563 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4602/7249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:05:10 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:21.218822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=11 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:21.223985 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=38 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:21.225025 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:06:21.226733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:21.227498 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Nov 02 15:06:21.229536 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:21.234336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-b59ed5de-ede7-49f4-83a2-71d3082fde30 req-9b223921-5fbd-4aca-8b54-d8c4124da26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:06:21.237600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=11 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:21.238437 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=31 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:21.239963 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:06:21.245273 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 15:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 (ip 10.222.0.18) !!! Nov 02 15:06:21.257291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:21.261472 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:21.262038 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:21.262852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:21.263421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:21.264441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b59ed5de-ede7-49f4-83a2-71d3082fde30 req-9b223921-5fbd-4aca-8b54-d8c4124da26a service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:21.264960 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:21.270748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b59ed5de-ede7-49f4-83a2-71d3082fde30 req-9b223921-5fbd-4aca-8b54-d8c4124da26a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:21.271593 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-b59ed5de-ede7-49f4-83a2-71d3082fde30 req-9b223921-5fbd-4aca-8b54-d8c4124da26a service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:21.290692 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-b59ed5de-ede7-49f4-83a2-71d3082fde30 req-9b223921-5fbd-4aca-8b54-d8c4124da26a service nova] Creating event network-changed:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:06:21.298689 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-b59ed5de-ede7-49f4-83a2-71d3082fde30 req-9b223921-5fbd-4aca-8b54-d8c4124da26a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081366 Nov 02 15:06:21.301190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:06:21.303382 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4603/7250] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:06:21.414769 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f90f37ed-6a1a-40a8-9b37-66d52978132d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 204 len: 0 microversion: 2.1 time: 0.200387 Nov 02 15:06:21.415633 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2648/7251] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 15:06:21 2022] DELETE /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:06:21.424830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:21.425480 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:21.431757 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:21.432484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:21.433124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:21.434064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:21.434721 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:21.435406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:21.602860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:21.611051 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b01a326f-a8e9-480f-a5a9-a9fc8c9024d6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.190519 Nov 02 15:06:21.611655 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4604/7252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:21 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:22.634602 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:22.635374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:22.642286 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:22.642779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:22.643276 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:22.644073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:22.644421 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:22.644935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:22.841576 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:22.849934 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-67aec45d-08d8-40a7-8ec3-34acaddf7004 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 200 len: 1676 microversion: 2.1 time: 0.219642 Nov 02 15:06:22.850515 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2649/7253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:22 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:23.313872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-94806b8f-94f1-4566-b23c-fef6c27d4a2a req-08cfb208-26c5-486f-9eae-59803d729565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620604c-41be-4394-8a89-364de6ef5648", "name": "network-vif-deleted", "tag": "0e6024e2-ade9-4a6f-82d6-36cff2d581df"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:06:23.325153 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94806b8f-94f1-4566-b23c-fef6c27d4a2a req-08cfb208-26c5-486f-9eae-59803d729565 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:23.325621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94806b8f-94f1-4566-b23c-fef6c27d4a2a req-08cfb208-26c5-486f-9eae-59803d729565 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:23.326041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-94806b8f-94f1-4566-b23c-fef6c27d4a2a req-08cfb208-26c5-486f-9eae-59803d729565 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:23.336899 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-94806b8f-94f1-4566-b23c-fef6c27d4a2a req-08cfb208-26c5-486f-9eae-59803d729565 service nova] Creating event network-vif-deleted:0e6024e2-ade9-4a6f-82d6-36cff2d581df for instance f620604c-41be-4394-8a89-364de6ef5648 on n-h1-858238-3 Nov 02 15:06:23.342514 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-94806b8f-94f1-4566-b23c-fef6c27d4a2a req-08cfb208-26c5-486f-9eae-59803d729565 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032344 Nov 02 15:06:23.343172 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4605/7254] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:06:23.874747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:23.875348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: f620604c-41be-4394-8a89-364de6ef5648] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:23.882153 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:23.882648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:23.883117 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:23.883826 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:23.884295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:23.884736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:23.898138 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.wsgi [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] HTTP exception thrown: Instance f620604c-41be-4394-8a89-364de6ef5648 could not be found. Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Request method failure captured: Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: request: GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 HTTP/1.1 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Accept: application/json Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Accept-Encoding: identity Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Connection: close Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Content-Length: 0 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Content-Type: application/json Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Host: 10.222.0.18 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: Openstack-System-Scope: None Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: User-Agent: python-urllib3/1.26.12 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Auth-Token: gAAAAABjYoZ1qUSeyjrfgKfry2mPVG_9ZTVf_xUem2IS4qhmfIBGLIOQII4XUMBkHPCUn80xtm-mEN9n4MTLDCq3kNb3-ed3MMMOEFFVyApDO8TZsS3Z5jkteL0ZHCh6iuesigow3QwGrseHKz76oBQgNtyGbw3Ffs2qCIZ-SkbFQUHd5obwoxs Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Id: None Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Domain-Name: None Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Identity-Status: Confirmed Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Is-Admin-Project: True Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Id: default Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Domain-Name: Default Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Id: dbbe820d4e564c1d9fb4fe2a1d964e35 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Project-Name: tempest-TestShelveInstance-311730428 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Role: member,reader Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Roles: member,reader Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dbbe820d4e564c1d9fb4fe2a1d964e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dbbe820d4e564c1d9fb4fe2a1d964e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dbbe820d4e564c1d9fb4fe2a1d964e35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dbbe820d4e564c1d9fb4fe2a1d964e35"}]}] Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant: tempest-TestShelveInstance-311730428 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Id: dbbe820d4e564c1d9fb4fe2a1d964e35 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-Tenant-Name: tempest-TestShelveInstance-311730428 Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-User: tempest-TestShelveInstance-311730428-project Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Id: default Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-User-Domain-Name: Default Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-User-Id: 8389005a0ddf4529aa9c79f7da0652bd Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: X-User-Name: tempest-TestShelveInstance-311730428-project Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: method: > Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: exception: Instance f620604c-41be-4394-8a89-364de6ef5648 could not be found. Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: action_args: {'id': 'f620604c-41be-4394-8a89-364de6ef5648'} Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f620604c-41be-4394-8a89-364de6ef5648 could not be found. Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f620604c-41be-4394-8a89-364de6ef5648 could not be found. Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:06:23.899926 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f620604c-41be-4394-8a89-364de6ef5648 could not be found. Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: ERROR nova.api.openstack.wsgi Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Returning 404 to user: Instance f620604c-41be-4394-8a89-364de6ef5648 could not be found. {{(pid=137558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-711f080a-e04d-4eaa-97fd-1e943f44d98c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648" status: 404 len: 111 microversion: 2.1 time: 0.031340 Nov 02 15:06:23.905510 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2650/7255] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:23 2022] GET /compute/v2.1/servers/f620604c-41be-4394-8a89-364de6ef5648 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:06:24.068942 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23ccf1dc-e8a1-4d0e-af95-f8533362d453 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '.version_select at 0x7f6f8027c160>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:24.090892 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23ccf1dc-e8a1-4d0e-af95-f8533362d453 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-258393326" status: 202 len: 0 microversion: 2.1 time: 0.026896 Nov 02 15:06:24.096065 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4606/7256] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 15:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-258393326 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:06:24.114728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6c650a71-8f05-4552-aecf-3912bd9801d4 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'create', calling method: .version_select at 0x7f6f8228b670>, body: {"keypair": {"name": "tempest-TestShelveInstance-821053917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjUTpAYkbqcwpM2AHoKWP4pNXJMq5JnqOLYb0yZRw71lxM6qHlsFaNOmJowbO4DMihrQt0ijejOcZpdKlSe7dQ2tJif6qDIz+eB2380jYx/hmQxCC1CkCMvWrsQ+16XTg=="}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:06:24.130974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-6c650a71-8f05-4552-aecf-3912bd9801d4 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:06:24.136176 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-6c650a71-8f05-4552-aecf-3912bd9801d4 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for user 8389005a0ddf4529aa9c79f7da0652bd and project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'key_pairs'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:06:24.163114 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6c650a71-8f05-4552-aecf-3912bd9801d4 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052249 Nov 02 15:06:24.163743 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2651/7257] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 15:06:24 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:06:40.320780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:40.321537 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:40.325525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2052646501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-821053917", "security_groups": [{"name": "tempest-secgroup-smoke-510885333"}], "networks": [{"uuid": "f18f2526-8fba-408a-8ee0-a2251105c4d9"}], "block_device_mapping_v2": [{"uuid": "c1de7a8d-3564-4e33-be4e-1584331c2f6c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:06:40.442792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.network.neutron [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] validate_networks() for [('f18f2526-8fba-408a-8ee0-a2251105c4d9', None, None, None, None, None)] {{(pid=137559) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:06:40.862864 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Flavor limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:06:40.863342 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Image limits 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:06:40.863810 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Flavor pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:06:40.864215 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Image pref 0:0:0 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:06:40.864621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.virt.hardware [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137559) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:06:40.873403 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:40.873876 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:40.874303 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:40.875018 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:40.875497 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:40.875912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:40.893296 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:06:40.898377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Getting quotas for user 8389005a0ddf4529aa9c79f7da0652bd and project dbbe820d4e564c1d9fb4fe2a1d964e35. Resources: {'instances', 'ram', 'cores'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:06:40.956003 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Going to run 1 instances... {{(pid=137559) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:06:40.958247 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1de7a8d-3564-4e33-be4e-1584331c2f6c',volume_size=None,volume_type=None)] {{(pid=137559) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:06:41.087253 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e21e1248-3d93-41c2-9422-2073784a67df tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768231 Nov 02 15:06:41.087902 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4607/7258] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 15:06:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:06:41.100222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cbff9260-0dc5-4800-8abc-a28b2588589d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:41.100830 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cbff9260-0dc5-4800-8abc-a28b2588589d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:41.103591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:41.103690 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:41.104279 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:41.161651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cbff9260-0dc5-4800-8abc-a28b2588589d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:41.168654 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cbff9260-0dc5-4800-8abc-a28b2588589d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1088 microversion: 2.1 time: 0.072665 Nov 02 15:06:41.169219 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2652/7259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:41 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:42.191860 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-10e7c37c-ad4b-4b5c-8293-daa889d66121 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:42.192778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-10e7c37c-ad4b-4b5c-8293-daa889d66121 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:42.249548 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-10e7c37c-ad4b-4b5c-8293-daa889d66121 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:42.256598 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-10e7c37c-ad4b-4b5c-8293-daa889d66121 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1088 microversion: 2.1 time: 0.069369 Nov 02 15:06:42.257181 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4608/7260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:42 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:43.280277 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d2177a18-cabb-4835-af05-51a93e1da0be tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:43.281061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d2177a18-cabb-4835-af05-51a93e1da0be tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:43.336145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d2177a18-cabb-4835-af05-51a93e1da0be tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:43.343905 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d2177a18-cabb-4835-af05-51a93e1da0be tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1088 microversion: 2.1 time: 0.068430 Nov 02 15:06:43.344795 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2653/7261] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:43 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:44.368145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-23fbc566-cab3-4247-b938-ec7a5bd6886e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:44.368761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-23fbc566-cab3-4247-b938-ec7a5bd6886e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:44.426787 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-23fbc566-cab3-4247-b938-ec7a5bd6886e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:44.434653 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-23fbc566-cab3-4247-b938-ec7a5bd6886e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1088 microversion: 2.1 time: 0.070417 Nov 02 15:06:44.435257 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4609/7262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:44 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:45.458181 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:45.458926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:45.466428 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:45.466928 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:45.467478 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:45.468175 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:45.468643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:45.469689 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:45.530572 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:45.538732 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2253aabf-14bc-44cf-82ad-8d914f95e701 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1138 microversion: 2.1 time: 0.084390 Nov 02 15:06:45.539349 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2654/7263] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:45 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:06:46.563513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:46.564892 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:46.577140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:46.578106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:46.578916 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:46.579902 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:46.580710 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:46.581336 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:46.681014 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:46.690971 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-73734035-456b-4212-8e28-9995015eaa34 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1204 microversion: 2.1 time: 0.132280 Nov 02 15:06:46.691853 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4610/7264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:46 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1204 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:47.718471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:47.719599 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-0209d421-2964-42a9-8c12-d2abe6b00a4f req-7842c65d-5e21-40fe-a040-8b73b3fbf28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:06:47.720358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:47.730333 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:47.731180 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:47.731815 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:47.732738 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:47.733377 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:47.733547 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0209d421-2964-42a9-8c12-d2abe6b00a4f req-7842c65d-5e21-40fe-a040-8b73b3fbf28d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:47.733874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0209d421-2964-42a9-8c12-d2abe6b00a4f req-7842c65d-5e21-40fe-a040-8b73b3fbf28d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:47.734324 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:47.734488 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-0209d421-2964-42a9-8c12-d2abe6b00a4f req-7842c65d-5e21-40fe-a040-8b73b3fbf28d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:47.748584 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-0209d421-2964-42a9-8c12-d2abe6b00a4f req-7842c65d-5e21-40fe-a040-8b73b3fbf28d service nova] Creating event network-changed:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h2-858238-3 Nov 02 15:06:47.754296 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-0209d421-2964-42a9-8c12-d2abe6b00a4f req-7842c65d-5e21-40fe-a040-8b73b3fbf28d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129790 Nov 02 15:06:47.755597 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2655/7265] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:06:47.957491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:47.967256 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3f7b1160-a866-436f-b393-f502fbed6afa tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1271 microversion: 2.1 time: 0.253982 Nov 02 15:06:47.968037 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4611/7266] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:47 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:06:48.992734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:48.993485 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:48.999740 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:49.000244 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:49.000697 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:49.001401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:49.001872 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:49.002311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:49.138475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:49.146471 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-436cec67-6271-47f9-93f9-79bc8696c33c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1271 microversion: 2.1 time: 0.158938 Nov 02 15:06:49.147050 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2656/7267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:48 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:50.170417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:50.171039 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:50.178047 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:50.178533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:50.178971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:50.179691 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:50.180147 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:50.180571 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:50.312357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:50.320525 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e7477d5-e34c-4a48-b2c3-ec4a955f70ab tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1271 microversion: 2.1 time: 0.154533 Nov 02 15:06:50.321102 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4612/7268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:50 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:51.344186 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:51.344736 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:51.352498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:51.353006 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:51.353469 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:51.354282 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:51.354935 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:51.355417 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:51.500948 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:51.508973 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cd8c48bd-cca4-48da-b336-6201b1a10ddd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.168913 Nov 02 15:06:51.509566 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2657/7269] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:51 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:52.533164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:52.533788 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:52.535697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:52.541874 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:52.542357 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:52.542792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:52.543516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:52.543973 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:52.544394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:52.672761 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:52.680479 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6cb09f57-8328-41c3-86d2-57a4f8d1d63c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.151310 Nov 02 15:06:52.681058 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4613/7270] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:52 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:53.704579 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:53.705196 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:53.707988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=4 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:53.713985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:53.714475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:53.714926 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:53.715649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:53.716110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:53.716546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:53.850947 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:53.858954 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed74fb17-2161-4c89-800f-8d066f1e323c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.158393 Nov 02 15:06:53.859584 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2658/7271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:53 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:54.881830 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:54.882448 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:54.885222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=10 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:06:54.890591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:54.891075 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:54.891530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:54.892232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:54.892697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:54.893119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:55.027369 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:55.035356 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3d09b7e3-3957-4bad-99ac-e3ce40d9676a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.157394 Nov 02 15:06:55.035934 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4614/7272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:54 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:56.058874 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:56.059554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:56.066323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:56.066820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:56.067312 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:56.068284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:56.068752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:56.069191 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:56.198713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:56.206493 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-938a8884-e4e0-4cf7-9205-df6250817c4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.151700 Nov 02 15:06:56.207066 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2659/7273] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:56 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:57.230056 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:57.230666 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:57.237513 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:57.237987 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:57.238419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:57.239121 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:57.239568 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:57.240332 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:57.373170 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:57.380887 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3ce2b55c-85b6-4ec1-9cc6-cacbc1685190 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.154740 Nov 02 15:06:57.381455 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4615/7274] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:57 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:58.403907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:58.404532 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:58.411505 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:58.412000 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:58.412489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:58.413201 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:58.413670 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:58.414108 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:58.548462 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:58.556511 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3e55033d-ba79-4a20-a8cf-eac76832a0b3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.156530 Nov 02 15:06:58.557102 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2660/7275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:58 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:59.580518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:59.581122 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:59.587957 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:59.588432 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:59.589370 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:59.590049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:59.590499 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:59.590918 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:59.722982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:59.731508 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e16982d8-52af-44aa-9244-99fc073d547b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.154930 Nov 02 15:06:59.732099 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4616/7276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:06:59 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:07:00.663769 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-37dad8bc-c787-4fb9-8828-9caacd5e2c93 req-83b5b12d-4517-441b-97f2-c72726eacdbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "name": "network-vif-plugged", "status": "completed", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:07:00.674584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-37dad8bc-c787-4fb9-8828-9caacd5e2c93 req-83b5b12d-4517-441b-97f2-c72726eacdbc service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:00.675124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-37dad8bc-c787-4fb9-8828-9caacd5e2c93 req-83b5b12d-4517-441b-97f2-c72726eacdbc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:00.675575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-37dad8bc-c787-4fb9-8828-9caacd5e2c93 req-83b5b12d-4517-441b-97f2-c72726eacdbc service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:00.686935 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-37dad8bc-c787-4fb9-8828-9caacd5e2c93 req-83b5b12d-4517-441b-97f2-c72726eacdbc service nova] Creating event network-vif-plugged:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h2-858238-3 Nov 02 15:07:00.691877 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-37dad8bc-c787-4fb9-8828-9caacd5e2c93 req-83b5b12d-4517-441b-97f2-c72726eacdbc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031864 Nov 02 15:07:00.692757 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2661/7277] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:07:00.756183 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:07:00.756792 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:07:00.763665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:00.764222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:00.764614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:00.765547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:00.766009 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:00.766433 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:00.945635 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:07:00.954844 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-fe580153-bbdd-4ba5-bc57-c7d5e33d2b27 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1259 microversion: 2.1 time: 0.202703 Nov 02 15:07:00.955501 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4617/7278] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:07:00 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:07:01.984325 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:07:01.986610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:07:01.994721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:01.995290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:01.995747 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:01.996455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:01.996953 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:01.997389 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:02.147856 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:07:02.156461 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-4da34033-5ac4-4765-88e3-b6ec5fdd6681 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1443 microversion: 2.1 time: 0.181345 Nov 02 15:07:02.157712 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2662/7279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:07:01 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1443 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:07:02.180114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:07:02.180825 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:07:02.188405 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:02.188894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:02.189334 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:02.190070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:02.190523 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:02.190945 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:02.332417 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:07:02.341334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5070233b-f258-4789-a45a-d7f100ec384f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1443 microversion: 2.1 time: 0.165213 Nov 02 15:07:02.341916 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4618/7280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:07:02 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:07:04.276425 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-3880ec46-813b-4dff-a382-5543b5fc0854 req-e6e8201e-0f81-4e37-bef9-c0472502574c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:07:04.287179 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3880ec46-813b-4dff-a382-5543b5fc0854 req-e6e8201e-0f81-4e37-bef9-c0472502574c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:07:04.287710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3880ec46-813b-4dff-a382-5543b5fc0854 req-e6e8201e-0f81-4e37-bef9-c0472502574c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:07:04.288212 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-3880ec46-813b-4dff-a382-5543b5fc0854 req-e6e8201e-0f81-4e37-bef9-c0472502574c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:07:04.301278 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-3880ec46-813b-4dff-a382-5543b5fc0854 req-e6e8201e-0f81-4e37-bef9-c0472502574c service nova] Creating event network-changed:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h2-858238-3 Nov 02 15:07:04.306772 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-3880ec46-813b-4dff-a382-5543b5fc0854 req-e6e8201e-0f81-4e37-bef9-c0472502574c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Nov 02 15:07:04.308335 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2663/7281] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:08:56.696922 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:08:56.697739 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:08:56.698300 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:56.699068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=56 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:56.699977 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:08:56.700128 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92/action (ip 10.222.0.18) !!! Nov 02 15:08:56.702059 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:08:56.702192 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92/action (ip 10.222.0.18) !!! Nov 02 15:08:56.758485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:56.759022 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:56.765627 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:56.766103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:56.766560 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:56.767270 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:56.767720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:56.768140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:56.790387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.objects.instance [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lazy-loading 'flavor' on Instance uuid 4167422a-ae7c-45bf-9464-66411f385d92 {{(pid=137559) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:08:56.865382 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-580fe2d3-26b0-4b02-990f-88078b8bdb38 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92/action" status: 202 len: 0 microversion: 2.1 time: 0.170305 Nov 02 15:08:56.865991 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4619/7282] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:08:56 2022] POST /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:08:56.874279 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e82819bf-8a21-4687-82cd-782450aa05a3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:08:56.875112 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:08:56.875713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=28 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:56.876506 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=48 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:56.878008 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:08:56.878008 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 15:08:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 (ip 10.222.0.18) !!! Nov 02 15:08:56.887890 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:56.888614 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:56.901183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:56.901686 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:56.902128 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:56.902843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:56.903343 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:56.903779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:57.053029 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:57.061416 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0bab748-8ba6-40d7-80bd-332c575662e9 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.188987 Nov 02 15:08:57.062022 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2664/7283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:08:56 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:08:58.087455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:58.088191 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:58.096665 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:58.097151 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:58.097587 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:58.098291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:58.098748 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:58.099207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:58.104562 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55642. Nov 02 15:08:58.106803 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55640. Nov 02 15:08:58.236025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:58.243934 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-503ee5eb-00b4-4128-93c9-6c0280556be5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.162585 Nov 02 15:08:58.244514 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4620/7284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:08:58 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:08:59.267933 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:59.268563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:59.280791 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:59.281291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:59.281744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:59.282497 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:59.282967 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:59.283439 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:59.289358 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [e82819bf-8a21-4687-82cd-782450aa05a3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55646. Nov 02 15:08:59.291977 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55648. Nov 02 15:08:59.425305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:59.433231 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2d973e87-9d85-45a8-8792-6ce87d84687e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.169890 Nov 02 15:08:59.433805 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2665/7285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:08:59 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:00.458082 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:00.458695 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:00.465682 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:00.466166 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:00.466600 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:00.467364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:00.467822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:00.468245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:00.599181 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:00.607005 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ac6810f9-acdc-4d0e-bb8b-295ac5beba5a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.152897 Nov 02 15:09:00.607613 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4621/7286] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:00 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:01.629995 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:01.630619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:01.637288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:01.638113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:01.639205 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:01.639923 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:01.640394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:01.640834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:01.778132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:01.786747 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-eb02daf9-7e22-42c3-aab6-cb24904f4ba0 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.160800 Nov 02 15:09:01.787367 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2666/7287] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:01 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:02.809735 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:02.810347 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:02.817138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:02.817615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:02.818313 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:02.819002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:02.819476 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:02.819894 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:02.954893 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:02.962957 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f64e03d3-ea6b-47c7-a4fc-77c1f62eef4c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.157062 Nov 02 15:09:02.963563 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4622/7288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:02 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:03.987718 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:03.988321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:03.995388 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:03.995889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:03.996337 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:03.997048 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:03.997511 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:03.997993 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:04.138984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:04.147118 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-753a917a-245e-4946-8b58-a2c0a2eae1f1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.163350 Nov 02 15:09:04.147709 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2667/7289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:03 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:05.171969 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:05.172579 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:05.178559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:05.179044 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:05.179509 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:05.180199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:05.180678 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:05.181096 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:05.311536 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:05.319616 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4ae3e570-5541-4537-9edc-28ab3795f47f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.152576 Nov 02 15:09:05.320193 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4623/7290] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:05 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:06.343815 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:06.344443 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:06.351336 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:06.351837 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:06.352288 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:06.352992 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:06.353460 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:06.353901 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:06.485202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:06.493304 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-85534f82-1acc-409f-b460-ab739a6e23a7 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.153448 Nov 02 15:09:06.493890 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2668/7291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:06 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:07.517441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:07.517441 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:07.524602 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:07.525083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:07.525514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:07.526214 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:07.526671 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:07.527113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:07.704390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:07.719805 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5c8b1ed7-b94b-44d4-b641-c4a04d0741ec tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.206880 Nov 02 15:09:07.720397 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4624/7292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:07 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:08.742771 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:08.743370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:08.751028 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:08.751563 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:08.752022 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:08.752741 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:08.753217 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:08.753664 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:08.893692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:08.901925 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-79d8c590-adb2-4833-adc0-445aaa9f99eb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.163120 Nov 02 15:09:08.902506 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2669/7293] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:08 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:09.926585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:09.927373 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:09.934675 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:09.935205 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:09.935648 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:09.936361 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:09.936821 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:09.937248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:10.079684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:10.087742 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-9fcf9e4e-8e26-454d-9094-f130ee1a8624 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.166103 Nov 02 15:09:10.088316 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4625/7294] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:09 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:11.113270 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:11.113839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:11.121127 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.121628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.122077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.122823 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.123335 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.123774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.265537 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:11.272455 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-56442d91-34c0-4d0d-a458-4b479e130343 req-d8f02bf8-c4c1-4fae-b5bf-991e46395f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "name": "network-vif-unplugged", "status": "completed", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:09:11.273882 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5d1aeda3-5212-465e-b28f-f9fe7f96f39e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1569 microversion: 2.1 time: 0.164816 Nov 02 15:09:11.284611 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-56442d91-34c0-4d0d-a458-4b479e130343 req-d8f02bf8-c4c1-4fae-b5bf-991e46395f14 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.285552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-56442d91-34c0-4d0d-a458-4b479e130343 req-d8f02bf8-c4c1-4fae-b5bf-991e46395f14 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.285971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-56442d91-34c0-4d0d-a458-4b479e130343 req-d8f02bf8-c4c1-4fae-b5bf-991e46395f14 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.288208 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2670/7295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:11 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:09:11.299085 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:09:11.300125 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:11.300404 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-56442d91-34c0-4d0d-a458-4b479e130343 req-d8f02bf8-c4c1-4fae-b5bf-991e46395f14 service nova] Creating event network-vif-unplugged:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h2-858238-3 Nov 02 15:09:11.306931 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.307558 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.308135 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.309110 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.309651 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.310162 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.311417 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-56442d91-34c0-4d0d-a458-4b479e130343 req-d8f02bf8-c4c1-4fae-b5bf-991e46395f14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042439 Nov 02 15:09:11.312039 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4626/7296] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:09:11.345484 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=137558) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 15:09:11.418301 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f53c2981-1844-4c02-8a8e-b5c38e4a648e tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "POST /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92/action" status: 202 len: 0 microversion: 2.1 time: 0.123598 Nov 02 15:09:11.419793 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2671/7297] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:09:11 2022] POST /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:09:11.427829 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:11.428535 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:11.434658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.435182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.435618 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.436319 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:11.436769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:11.437394 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:11.573088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:11.582217 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8f8910bd-c246-408c-b50b-9b86adf55c1f tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1517 microversion: 2.1 time: 0.158506 Nov 02 15:09:11.582971 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4627/7298] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:11 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:12.609136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:12.609785 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:12.615934 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:12.616435 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:12.616881 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:12.617588 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:12.618059 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:12.618498 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:12.753940 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:12.762046 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9ee56f73-dc71-4d2c-86d6-9b77bcf0f401 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1519 microversion: 2.1 time: 0.157788 Nov 02 15:09:12.762631 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2672/7299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:12 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:13.786471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:13.787052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:13.794176 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:13.794670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:13.795428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:13.796070 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:13.796531 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:13.796956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:13.930797 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:13.940858 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-4de0b4a6-75c8-4aad-9b52-db08c00d3b53 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1519 microversion: 2.1 time: 0.158324 Nov 02 15:09:13.941834 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4628/7300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:13 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:14.965659 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:14.966921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:14.973834 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:14.974330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:14.974774 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:14.975499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:14.975966 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:14.976397 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:15.111665 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:15.119725 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e54841f0-6c3d-4f7c-b4ca-0832efbdea6c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1519 microversion: 2.1 time: 0.158023 Nov 02 15:09:15.120311 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2673/7301] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:14 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:16.143420 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:16.144083 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:16.150907 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:16.151414 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:16.151841 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:16.152521 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:16.152971 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:16.153389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:16.288567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:16.296633 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-f9622404-ded8-4e8b-ad64-e6681cef5bfb tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1519 microversion: 2.1 time: 0.157076 Nov 02 15:09:16.297320 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4629/7302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:16 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:17.320542 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:17.321109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:17.328597 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:17.329099 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:17.329552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:17.330257 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:17.330731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:17.331209 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:17.466371 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:17.474844 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a6edfdf3-3fb7-4ace-8d20-a83f817b2880 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.158609 Nov 02 15:09:17.475456 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2674/7303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:17 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:18.380251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-8ee9b585-6b99-4c83-8a01-7117f7c4e1fb req-1e7fdba3-a06c-4270-b0c1-2b909a5c8755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:09:18.390283 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8ee9b585-6b99-4c83-8a01-7117f7c4e1fb req-1e7fdba3-a06c-4270-b0c1-2b909a5c8755 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:18.390749 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8ee9b585-6b99-4c83-8a01-7117f7c4e1fb req-1e7fdba3-a06c-4270-b0c1-2b909a5c8755 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:18.391207 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-8ee9b585-6b99-4c83-8a01-7117f7c4e1fb req-1e7fdba3-a06c-4270-b0c1-2b909a5c8755 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:18.402643 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-8ee9b585-6b99-4c83-8a01-7117f7c4e1fb req-1e7fdba3-a06c-4270-b0c1-2b909a5c8755 service nova] Creating event network-changed:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h1-858238-3 Nov 02 15:09:18.409086 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-8ee9b585-6b99-4c83-8a01-7117f7c4e1fb req-1e7fdba3-a06c-4270-b0c1-2b909a5c8755 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082556 Nov 02 15:09:18.409886 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4630/7304] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:09:18.497892 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:18.498504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:18.505490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:18.505984 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:18.506452 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:18.507222 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:18.507693 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:18.508131 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:18.643409 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:18.651264 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-8ef2475d-8a59-4604-8c40-4453f035ea0d tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.157180 Nov 02 15:09:18.651773 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2675/7305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:18 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:19.674469 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:19.675232 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:19.682173 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:19.682650 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:19.683080 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:19.683934 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:19.684277 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:19.684658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:19.819306 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:19.827699 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-38891d6c-07a5-4020-adee-db60509dc7f8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.157479 Nov 02 15:09:19.828269 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4631/7306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:19 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:20.851731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:20.852580 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:20.861436 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:20.861943 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:20.862643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:20.863455 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:20.863925 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:20.864429 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:21.014474 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:21.022746 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-00e3b5a9-c60c-4f0d-b045-3ea40b386f74 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.174918 Nov 02 15:09:21.023383 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2676/7307] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:20 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:22.046124 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:22.046737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:22.053659 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:22.054140 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:22.054577 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:22.055728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:22.055728 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:22.056158 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:22.185912 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:22.194006 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-2fd9fe77-858e-4d61-80a4-e19166bd365b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.152127 Nov 02 15:09:22.194577 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4632/7308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:22 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:23.218449 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:23.219047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:23.225914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:23.226401 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:23.226851 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:23.227594 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:23.228041 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:23.228470 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:23.362394 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:23.370423 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2f7206bf-a2c6-4972-ad68-040cce72b275 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.156444 Nov 02 15:09:23.370999 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2677/7309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:23 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:24.393923 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:24.394525 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:24.401515 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:24.401997 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:24.402438 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:24.403160 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:24.403615 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:24.404553 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:24.535251 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:24.543022 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-47d1410d-8553-4f3b-abf7-0a56a46687cd tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.153128 Nov 02 15:09:24.543705 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4633/7310] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:24 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:25.567180 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:25.567843 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:25.574909 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:25.575438 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:25.576380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:25.577081 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:25.577549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:25.577988 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:25.706291 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:25.714180 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3ad36fc3-54ab-44af-8277-f750fb7d06d3 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.150922 Nov 02 15:09:25.714772 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2678/7311] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:25 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:26.739004 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:26.739591 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:26.742390 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=31 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:09:26.748559 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:26.749045 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:26.749483 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:26.750182 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:26.750641 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:26.751063 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:26.753718 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:09:26.886118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:26.894693 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3cd7142a-a4e8-473e-87d6-809be1b4a060 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.159683 Nov 02 15:09:26.895302 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4634/7312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:26 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:27.917842 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:27.918490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:27.921320 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:09:27.929113 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:27.929734 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:27.930246 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:27.931308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:27.931891 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:27.932456 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:27.937213 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:09:28.070811 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:28.079605 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-652f2825-50d7-4ad9-bff9-8a15b6114519 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.165720 Nov 02 15:09:28.080179 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2679/7313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:27 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:29.105046 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:29.105663 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:29.112059 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:29.112543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:29.112978 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:29.113669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:29.114128 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:29.114551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:29.252638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:29.260760 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-7256bef2-3e26-4858-80d6-964ea81eacf6 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.160244 Nov 02 15:09:29.261355 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4635/7314] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:29 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:29.394593 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-1a57f2df-0fa6-42f3-82f0-11ef9eec6da6 req-72241db7-fb47-4acc-8135-754baf9bcda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "name": "network-vif-plugged", "status": "completed", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:09:29.404744 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1a57f2df-0fa6-42f3-82f0-11ef9eec6da6 req-72241db7-fb47-4acc-8135-754baf9bcda3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:29.405207 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1a57f2df-0fa6-42f3-82f0-11ef9eec6da6 req-72241db7-fb47-4acc-8135-754baf9bcda3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:29.405792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-1a57f2df-0fa6-42f3-82f0-11ef9eec6da6 req-72241db7-fb47-4acc-8135-754baf9bcda3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:29.418505 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-1a57f2df-0fa6-42f3-82f0-11ef9eec6da6 req-72241db7-fb47-4acc-8135-754baf9bcda3 service nova] Creating event network-vif-plugged:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h1-858238-3 Nov 02 15:09:29.424306 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-1a57f2df-0fa6-42f3-82f0-11ef9eec6da6 req-72241db7-fb47-4acc-8135-754baf9bcda3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Nov 02 15:09:29.425063 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2680/7315] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:09:30.285457 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:30.286058 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:30.292935 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:30.293412 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:30.293847 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:30.294530 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:30.294982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:30.295428 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:30.424364 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:30.432125 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d7dfa026-8a1d-4340-8d05-bb7689d19d48 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1575 microversion: 2.1 time: 0.150619 Nov 02 15:09:30.432694 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4636/7316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:30 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:09:31.458198 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:09:31.458903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:09:31.465120 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:31.465604 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:31.466600 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:31.467321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:09:31.467783 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:09:31.468214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:09:31.646296 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:09:31.654819 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-57225ad4-022c-4596-a8cf-10dec4dc5f9c tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1562 microversion: 2.1 time: 0.201787 Nov 02 15:09:31.655437 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2681/7317] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:09:31 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1562 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:45.143994 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=5 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:10:45.144751 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=17 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:10:45.149004 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=5 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:10:45.149806 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=13 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:10:45.151794 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:10:45.151944 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:10:45.152168 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:10:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 (ip 10.222.0.18) !!! Nov 02 15:10:45.153888 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 15:10:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Nov 02 15:10:45.159956 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:45.160460 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:45.167102 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-b609b2b4-b6a9-48e6-b86d-a8f4104f7c21 req-3b8b2301-45be-43a9-abec-194f8a2174df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:10:45.173599 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:45.175393 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:45.176066 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:45.177939 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:45.178471 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:45.180399 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:45.181407 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b609b2b4-b6a9-48e6-b86d-a8f4104f7c21 req-3b8b2301-45be-43a9-abec-194f8a2174df service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:45.181907 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b609b2b4-b6a9-48e6-b86d-a8f4104f7c21 req-3b8b2301-45be-43a9-abec-194f8a2174df service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:45.182354 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-b609b2b4-b6a9-48e6-b86d-a8f4104f7c21 req-3b8b2301-45be-43a9-abec-194f8a2174df service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:45.195088 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-b609b2b4-b6a9-48e6-b86d-a8f4104f7c21 req-3b8b2301-45be-43a9-abec-194f8a2174df service nova] Creating event network-changed:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h1-858238-3 Nov 02 15:10:45.200208 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-b609b2b4-b6a9-48e6-b86d-a8f4104f7c21 req-3b8b2301-45be-43a9-abec-194f8a2174df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053288 Nov 02 15:10:45.201040 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2682/7318] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:10:45.212144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Going to try to terminate instance {{(pid=137559) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:10:45.304445 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-bd89e8e7-57de-4624-b088-82cea10624b8 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 204 len: 0 microversion: 2.1 time: 0.162288 Nov 02 15:10:45.305359 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4637/7319] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 15:10:45 2022] DELETE /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:10:45.314136 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:45.314857 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:45.321584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:45.322084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:45.322546 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:45.323446 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:45.323922 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:45.324369 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:45.471692 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:10:45.481024 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-a16b7224-c1d6-45fc-8dd7-e693f58c29c1 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.171089 Nov 02 15:10:45.481606 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2683/7320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:45 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:46.506604 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:46.507367 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:46.514581 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:46.515068 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:46.515534 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:46.516241 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:46.516697 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:46.517119 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:46.693404 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:10:46.702113 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-919d9abb-e915-41aa-a197-572feeeed17b tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1568 microversion: 2.1 time: 0.200361 Nov 02 15:10:46.702699 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4638/7321] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:46 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:47.250321 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-8a70f67b-cccb-4384-85fb-728418e4d3fb req-85c83c48-26b3-46e3-b5b0-a640d66edd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4167422a-ae7c-45bf-9464-66411f385d92", "name": "network-vif-deleted", "tag": "772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:10:47.261178 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a70f67b-cccb-4384-85fb-728418e4d3fb req-85c83c48-26b3-46e3-b5b0-a640d66edd8c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:47.261680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a70f67b-cccb-4384-85fb-728418e4d3fb req-85c83c48-26b3-46e3-b5b0-a640d66edd8c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:47.262124 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-8a70f67b-cccb-4384-85fb-728418e4d3fb req-85c83c48-26b3-46e3-b5b0-a640d66edd8c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:47.274304 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-8a70f67b-cccb-4384-85fb-728418e4d3fb req-85c83c48-26b3-46e3-b5b0-a640d66edd8c service nova] Creating event network-vif-deleted:772f8c30-ea3e-48c0-b4a4-eee4dbb8cf85 for instance 4167422a-ae7c-45bf-9464-66411f385d92 on n-h1-858238-3 Nov 02 15:10:47.279264 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-8a70f67b-cccb-4384-85fb-728418e4d3fb req-85c83c48-26b3-46e3-b5b0-a640d66edd8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Nov 02 15:10:47.279874 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2684/7322] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:10:47.725889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:47.726533 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:47.733423 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:47.733910 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:47.734341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:47.735033 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:47.735514 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:47.735938 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:47.798506 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:10:47.807238 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6e57d211-818b-469c-af72-63d1fc186a4a tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1219 microversion: 2.1 time: 0.085267 Nov 02 15:10:47.807833 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4639/7323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:47 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:48.833490 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:48.834129 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:48.840812 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:48.841323 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:48.841778 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:48.842508 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:48.843412 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:48.843521 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:48.909188 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:10:48.917620 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-d9821e3f-9ee1-43f8-80f7-00f71538a173 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1219 microversion: 2.1 time: 0.089446 Nov 02 15:10:48.918282 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2685/7324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:48 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:49.942473 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:49.943440 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:49.951518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:49.952013 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:49.952452 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:49.953157 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:49.953800 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:49.954435 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:50.025317 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:10:50.033481 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-0089f5b9-c64d-41a1-bcd9-af2bce1ebe60 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1219 microversion: 2.1 time: 0.095302 Nov 02 15:10:50.034066 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4640/7325] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:49 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:51.057251 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:51.057994 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:51.065292 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:51.065801 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:51.066258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:51.067012 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:51.068101 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:51.068550 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:51.134150 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8389005a0ddf4529aa9c79f7da0652bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbe820d4e564c1d9fb4fe2a1d964e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:10:51.142061 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cfd36e3a-0004-472b-9658-256957637c12 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 200 len: 1219 microversion: 2.1 time: 0.088724 Nov 02 15:10:51.142631 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2686/7326] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:51 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:10:52.165662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:52.166398 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] [instance: 4167422a-ae7c-45bf-9464-66411f385d92] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:10:52.173563 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:52.174042 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:52.174477 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:52.175244 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:10:52.175700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:10:52.176129 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:10:52.191969 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] HTTP exception thrown: Instance 4167422a-ae7c-45bf-9464-66411f385d92 could not be found. Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Request method failure captured: Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 HTTP/1.1 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoZ1qUSeyjrfgKfry2mPVG_9ZTVf_xUem2IS4qhmfIBGLIOQII4XUMBkHPCUn80xtm-mEN9n4MTLDCq3kNb3-ed3MMMOEFFVyApDO8TZsS3Z5jkteL0ZHCh6iuesigow3QwGrseHKz76oBQgNtyGbw3Ffs2qCIZ-SkbFQUHd5obwoxs Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: dbbe820d4e564c1d9fb4fe2a1d964e35 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestShelveInstance-311730428 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dbbe820d4e564c1d9fb4fe2a1d964e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/dbbe820d4e564c1d9fb4fe2a1d964e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/dbbe820d4e564c1d9fb4fe2a1d964e35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_dbbe820d4e564c1d9fb4fe2a1d964e35"}]}] Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestShelveInstance-311730428 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: dbbe820d4e564c1d9fb4fe2a1d964e35 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestShelveInstance-311730428 Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestShelveInstance-311730428-project Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: 8389005a0ddf4529aa9c79f7da0652bd Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestShelveInstance-311730428-project Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 4167422a-ae7c-45bf-9464-66411f385d92 could not be found. Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '4167422a-ae7c-45bf-9464-66411f385d92'} Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4167422a-ae7c-45bf-9464-66411f385d92 could not be found. Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4167422a-ae7c-45bf-9464-66411f385d92 could not be found. Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:10:52.194491 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4167422a-ae7c-45bf-9464-66411f385d92 could not be found. Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Returning 404 to user: Instance 4167422a-ae7c-45bf-9464-66411f385d92 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3b6fe36d-06e2-4181-a574-3606e30b88e5 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92" status: 404 len: 111 microversion: 2.1 time: 0.034235 Nov 02 15:10:52.199575 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4641/7327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:10:52 2022] GET /compute/v2.1/servers/4167422a-ae7c-45bf-9464-66411f385d92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:10:52.356777 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1a4238aa-9f8b-45e2-bd24-19b5bb26db35 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] Calling method '.version_select at 0x7f6f85e53ca0>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:10:52.388680 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1a4238aa-9f8b-45e2-bd24-19b5bb26db35 tempest-TestShelveInstance-311730428 tempest-TestShelveInstance-311730428-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-821053917" status: 202 len: 0 microversion: 2.1 time: 0.035344 Nov 02 15:10:52.389273 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2687/7328] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 15:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-821053917 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:11:10.316024 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:11:10.318289 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:11:10.573419 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-079b7bad-25d0-4b3a-a9e3-7731fe6924a5 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Action: 'create', calling method: .version_select at 0x7f6f819db040>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-793439450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACQ5oTXSxF3Bn2em7mSTRG0rNFvnl5A+ODk/IJQq/RAPY3JthKAejOoPeijSXyX9NaU+W647yHU+q6VodFqcmS7I+sOHHsNmpGFWZ6W+UxgxpwAlGwXc9DPDHHFi66OdQ=="}} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:11:10.590454 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-079b7bad-25d0-4b3a-a9e3-7731fe6924a5 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Getting quotas for project ed0fed4011db44ffb99dfe7aef95ad80. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:11:10.596057 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.quota [None req-079b7bad-25d0-4b3a-a9e3-7731fe6924a5 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Getting quotas for user be8739fc2a05458786f59c529cf99229 and project ed0fed4011db44ffb99dfe7aef95ad80. Resources: {'key_pairs'} {{(pid=137559) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:11:10.631603 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-079b7bad-25d0-4b3a-a9e3-7731fe6924a5 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.320812 Nov 02 15:11:10.632566 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4642/7329] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 15:11:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:11:11.627998 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=22 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:11:11.628986 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:11:11.634914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1172328049", "imageRef": "48ddc6ee-c34b-4aba-b773-45942271b1d5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-793439450", "security_groups": [{"name": "tempest-secgroup-smoke-1367260950"}], "networks": [{"uuid": "0746bc8b-c613-41e2-bf86-eb51bca96ea1"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:11:11.780023 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] validate_networks() for [('0746bc8b-c613-41e2-bf86-eb51bca96ea1', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:11:12.614941 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:11:12.615402 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:11:12.615887 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:11:12.616307 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:11:12.616730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:11:12.625645 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:12.626138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:12.626582 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:12.627344 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:12.627808 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:12.628240 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:12.647324 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Getting quotas for project ed0fed4011db44ffb99dfe7aef95ad80. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:11:12.652544 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Getting quotas for user be8739fc2a05458786f59c529cf99229 and project ed0fed4011db44ffb99dfe7aef95ad80. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:11:12.665295 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:11:12.667641 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ddc6ee-c34b-4aba-b773-45942271b1d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:11:12.715277 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-1fdd2778-1d97-40f6-b888-e33c1b22a869 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.089059 Nov 02 15:11:12.715860 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2688/7330] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 15:11:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:11:12.727162 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-78afb02d-7ea8-4ea2-ac70-b26629b6e774 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:12.727941 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-78afb02d-7ea8-4ea2-ac70-b26629b6e774 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:12.793487 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-78afb02d-7ea8-4ea2-ac70-b26629b6e774 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:12.800735 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-78afb02d-7ea8-4ea2-ac70-b26629b6e774 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1248 microversion: 2.1 time: 0.077491 Nov 02 15:11:12.815135 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4643/7331] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:12 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:13.826882 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:13.827617 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:13.835770 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:13.836318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:13.836800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:13.837612 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:13.838134 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:13.838578 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:13.936510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:13.962179 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-cbee5463-1a21-4438-ae51-6f6b9d9dd01b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1300 microversion: 2.1 time: 0.140257 Nov 02 15:11:13.979125 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2689/7332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:13 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1300 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:14.991722 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:14.993605 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:15.001291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:15.002071 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:15.002737 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:15.003996 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:15.004769 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:15.005350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:15.242326 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:15.250721 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d1e267d9-1c00-429a-adf1-160c3a1aea46 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1374 microversion: 2.1 time: 0.263888 Nov 02 15:11:15.263618 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4644/7333] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:14 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1374 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:15.539262 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f34fcb1f-f637-4038-8e52-92ed10fce471 req-b0e9d944-1d1d-4598-8232-e4e4fd319a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:11:15.549839 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f34fcb1f-f637-4038-8e52-92ed10fce471 req-b0e9d944-1d1d-4598-8232-e4e4fd319a1d service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:15.550591 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f34fcb1f-f637-4038-8e52-92ed10fce471 req-b0e9d944-1d1d-4598-8232-e4e4fd319a1d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:15.551748 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f34fcb1f-f637-4038-8e52-92ed10fce471 req-b0e9d944-1d1d-4598-8232-e4e4fd319a1d service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:15.563214 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f34fcb1f-f637-4038-8e52-92ed10fce471 req-b0e9d944-1d1d-4598-8232-e4e4fd319a1d service nova] Creating event network-changed:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:11:15.569057 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f34fcb1f-f637-4038-8e52-92ed10fce471 req-b0e9d944-1d1d-4598-8232-e4e4fd319a1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033150 Nov 02 15:11:15.569684 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2690/7334] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:11:16.275291 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:16.275872 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:16.282424 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:16.282899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:16.283358 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:16.284041 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:16.284490 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:16.284909 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:16.421703 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:16.429653 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-e55e12b1-e21b-4794-8930-9281be0785f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1374 microversion: 2.1 time: 0.158523 Nov 02 15:11:16.430225 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4645/7335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:16 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:17.454831 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:17.455496 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:17.462398 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:17.463622 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:17.464077 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:17.464792 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:17.465258 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:17.465688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:17.599700 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:17.607781 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-c3866fde-8916-4ead-b451-89b38f4b5ede tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1374 microversion: 2.1 time: 0.158090 Nov 02 15:11:17.608363 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2691/7336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:17 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:18.631245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:18.631863 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:18.638727 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:18.639248 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:18.639684 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:18.640378 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:18.640832 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:18.641286 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:18.776551 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:18.784334 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-567235a3-8b9e-4c99-881d-a2161c1f2866 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1374 microversion: 2.1 time: 0.157094 Nov 02 15:11:18.784919 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4646/7337] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:18 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:19.808733 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:19.809374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:19.815370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:19.815865 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:19.816308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:19.817005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:19.817465 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:19.818109 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:19.960138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:19.969614 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-4edac170-ea29-49ce-bf56-67394fcfe93e req-213ece8b-52ac-4a05-bd3c-a1799eb84913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "name": "network-vif-plugged", "status": "completed", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:11:19.987609 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4edac170-ea29-49ce-bf56-67394fcfe93e req-213ece8b-52ac-4a05-bd3c-a1799eb84913 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:19.988049 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4edac170-ea29-49ce-bf56-67394fcfe93e req-213ece8b-52ac-4a05-bd3c-a1799eb84913 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:19.988224 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-31946145-10d2-4767-b5bf-693204fc2ffa tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1374 microversion: 2.1 time: 0.183902 Nov 02 15:11:19.988479 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-4edac170-ea29-49ce-bf56-67394fcfe93e req-213ece8b-52ac-4a05-bd3c-a1799eb84913 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:19.988968 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2692/7338] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:19 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:19.999716 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-4edac170-ea29-49ce-bf56-67394fcfe93e req-213ece8b-52ac-4a05-bd3c-a1799eb84913 service nova] Creating event network-vif-plugged:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:11:20.005127 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-4edac170-ea29-49ce-bf56-67394fcfe93e req-213ece8b-52ac-4a05-bd3c-a1799eb84913 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115733 Nov 02 15:11:20.006032 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4647/7339] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:11:21.012581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:21.013143 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:21.020370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:21.020868 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:21.022183 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:21.022667 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:21.023168 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:21.023608 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:21.169574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:21.179361 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-481efe18-aa5f-4151-be91-78a974118942 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1374 microversion: 2.1 time: 0.170906 Nov 02 15:11:21.179951 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2693/7340] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:21 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:22.205088 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:22.205831 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:22.212134 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:22.212622 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:22.213064 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:22.213765 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:22.214222 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:22.214651 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:22.346078 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:22.354710 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-d2d5230d-c290-4649-8247-8f25e84c34c7 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1559 microversion: 2.1 time: 0.154823 Nov 02 15:11:22.355337 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4648/7341] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:22 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:22.379067 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:11:22.379713 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:11:22.386589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:22.387084 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:22.387562 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:22.388264 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:22.388731 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:22.389167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:22.523642 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:11:22.531565 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-76862f51-96e4-4f72-a46e-8a675fa2a158 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1559 microversion: 2.1 time: 0.156394 Nov 02 15:11:22.532141 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2694/7342] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:11:22 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:11:24.701349 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cb9add62-8b7c-4d7a-af0a-e2c4ee6bbcfe req-24fd5183-3da6-44a4-9daa-cfa8b190ae81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:11:24.706717 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=6 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:11:24.714818 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb9add62-8b7c-4d7a-af0a-e2c4ee6bbcfe req-24fd5183-3da6-44a4-9daa-cfa8b190ae81 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:11:24.715341 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb9add62-8b7c-4d7a-af0a-e2c4ee6bbcfe req-24fd5183-3da6-44a4-9daa-cfa8b190ae81 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:11:24.715778 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb9add62-8b7c-4d7a-af0a-e2c4ee6bbcfe req-24fd5183-3da6-44a4-9daa-cfa8b190ae81 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:11:24.728153 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cb9add62-8b7c-4d7a-af0a-e2c4ee6bbcfe req-24fd5183-3da6-44a4-9daa-cfa8b190ae81 service nova] Creating event network-changed:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:11:24.733588 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cb9add62-8b7c-4d7a-af0a-e2c4ee6bbcfe req-24fd5183-3da6-44a4-9daa-cfa8b190ae81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036226 Nov 02 15:11:24.734299 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4649/7343] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:13:19.583507 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:13:19.584503 n-d-858238-3 devstack@n-api.service[137558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e82819bf-8a21-4687-82cd-782450aa05a3] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:13:19.584875 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:19.585628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:19.586499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:19.587305 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=34 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:19.592619 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-920274"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:19.595016 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:19.603722 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:19.604214 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:19.604661 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:19.605358 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:19.605819 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:19.606319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:19.808852 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-f766af79-8220-4aab-92fe-34fec4d5861d tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "POST /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028/action" status: 202 len: 0 microversion: 2.1 time: 0.227323 Nov 02 15:13:19.810572 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2695/7344] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:13:19 2022] POST /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 15:13:26.456085 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:13:26.459017 n-d-858238-3 devstack@n-api.service[137559]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:13:26.460567 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:26.462387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=28 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:26.473297 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-cb018173-9c6a-4e10-8add-628ca79df537 req-78ac9fd5-7470-4342-ab3d-1db70715a396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "name": "network-vif-plugged", "status": "completed", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:26.485025 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb018173-9c6a-4e10-8add-628ca79df537 req-78ac9fd5-7470-4342-ab3d-1db70715a396 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:26.485516 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb018173-9c6a-4e10-8add-628ca79df537 req-78ac9fd5-7470-4342-ab3d-1db70715a396 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:26.485980 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-cb018173-9c6a-4e10-8add-628ca79df537 req-78ac9fd5-7470-4342-ab3d-1db70715a396 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:26.501101 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-cb018173-9c6a-4e10-8add-628ca79df537 req-78ac9fd5-7470-4342-ab3d-1db70715a396 service nova] Creating event network-vif-plugged:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:13:26.506824 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-cb018173-9c6a-4e10-8add-628ca79df537 req-78ac9fd5-7470-4342-ab3d-1db70715a396 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053183 Nov 02 15:13:26.508032 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4650/7345] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:13:32.356076 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:32.356903 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:32.363974 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1794860514", "imageRef": "beed71c0-dbae-4219-803d-b24d0e24e847", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-793439450", "security_groups": [{"name": "tempest-secgroup-smoke-1367260950"}], "networks": [{"uuid": "0746bc8b-c613-41e2-bf86-eb51bca96ea1"}]}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:32.390473 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [5099885e-905e-4941-a23d-e089dbf0a17c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56116. Nov 02 15:13:32.391291 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] [e82819bf-8a21-4687-82cd-782450aa05a3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56118. Nov 02 15:13:32.475224 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.network.neutron [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] validate_networks() for [('0746bc8b-c613-41e2-bf86-eb51bca96ea1', None, None, None, None, None)] {{(pid=137558) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:13:32.847001 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Flavor limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:13:32.847897 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Image limits 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:13:32.848427 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Flavor pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:13:32.848855 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Image pref 0:0:0 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:13:32.849284 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.virt.hardware [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:13:32.858151 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:32.858646 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:32.859187 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:32.859852 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:32.860319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:32.860757 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:32.877516 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Getting quotas for project ed0fed4011db44ffb99dfe7aef95ad80. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:13:32.882914 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.quota [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Getting quotas for user be8739fc2a05458786f59c529cf99229 and project ed0fed4011db44ffb99dfe7aef95ad80. Resources: {'instances', 'ram', 'cores'} {{(pid=137558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:13:32.896628 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Going to run 1 instances... {{(pid=137558) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:13:32.899192 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='beed71c0-dbae-4219-803d-b24d0e24e847',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:13:32.947336 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-930b81b0-c832-4d81-9b97-4eedbeea702e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.594591 Nov 02 15:13:32.947975 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2696/7346] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 15:13:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:13:32.960268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-951b0b8a-28ef-4777-9005-fe4004cd3861 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:32.960976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-951b0b8a-28ef-4777-9005-fe4004cd3861 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:32.995289 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [9d814c3c-84a6-4d05-a6f3-f698d4cc1cc6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56132. Nov 02 15:13:32.996877 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] [4c84253d-1202-40ac-b4a1-cc972b45717a] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56130. Nov 02 15:13:33.030612 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-951b0b8a-28ef-4777-9005-fe4004cd3861 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:33.038532 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-951b0b8a-28ef-4777-9005-fe4004cd3861 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1248 microversion: 2.1 time: 0.082551 Nov 02 15:13:33.039143 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4651/7347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:32 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:34.062293 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:34.063082 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:34.070818 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:34.071380 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:34.071840 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:34.072728 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:34.073206 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:34.073883 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:34.150557 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:34.159785 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-175eba26-a614-4f2c-ab32-ab4b36ec15e9 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1306 microversion: 2.1 time: 0.101727 Nov 02 15:13:34.160381 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2697/7348] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:34 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:35.184759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:35.185948 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:35.195594 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:35.199256 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:35.200485 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:35.201547 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:35.202103 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:35.202669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:35.373387 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:35.395187 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-511527e9-99bc-4ecd-822d-afd65fa6ae78 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.213598 Nov 02 15:13:35.396339 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4652/7349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:35 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:13:36.425598 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:36.426308 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:36.434155 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:36.434766 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:36.435921 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:36.436858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:36.437370 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:36.437796 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:36.442753 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-e9274242-6fc7-4be5-8a71-b0cc384c6828 req-5a3d3000-11fc-4557-833c-ad277bed228e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "name": "network-vif-unplugged", "status": "completed", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:36.463245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e9274242-6fc7-4be5-8a71-b0cc384c6828 req-5a3d3000-11fc-4557-833c-ad277bed228e service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:36.463245 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e9274242-6fc7-4be5-8a71-b0cc384c6828 req-5a3d3000-11fc-4557-833c-ad277bed228e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:36.463638 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-e9274242-6fc7-4be5-8a71-b0cc384c6828 req-5a3d3000-11fc-4557-833c-ad277bed228e service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:36.476562 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-e9274242-6fc7-4be5-8a71-b0cc384c6828 req-5a3d3000-11fc-4557-833c-ad277bed228e service nova] Creating event network-vif-unplugged:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:13:36.482747 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-e9274242-6fc7-4be5-8a71-b0cc384c6828 req-5a3d3000-11fc-4557-833c-ad277bed228e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047629 Nov 02 15:13:36.483730 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4653/7350] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:13:36.609763 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:36.628640 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-ed99f588-ce76-4214-8a54-10bba154365e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.207036 Nov 02 15:13:36.643774 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2698/7351] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:36 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:37.655906 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:37.656621 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:37.663449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:37.663976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:37.664413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:37.665118 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:37.665572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:37.666002 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:37.827145 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:37.835671 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-5bcd2be7-9b89-4c4f-aa35-60c733a4de69 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.185179 Nov 02 15:13:37.836474 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4654/7352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:37 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:38.858577 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:38.859342 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:38.866695 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:38.867318 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:38.867779 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:38.868503 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:38.868978 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:38.869430 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:39.032167 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:39.046543 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b0aaebb3-2f1c-4c54-854a-a11a56f0b988 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.191878 Nov 02 15:13:39.047164 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2699/7353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:38 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:40.070445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:40.071113 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:40.079112 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:40.079619 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:40.080268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:40.081169 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:40.081816 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:40.082413 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:40.234493 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:40.242768 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-601198f6-9e9b-4c13-84c1-22b13f4871e0 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.176506 Nov 02 15:13:40.244249 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4655/7354] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:40 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:41.274379 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:41.274983 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:41.282350 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:41.282858 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:41.283338 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:41.284074 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:41.284529 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:41.284975 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:41.446929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:41.458418 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-2ed2bef8-f633-4076-a7be-c8df15b355b8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.188802 Nov 02 15:13:41.459018 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2700/7355] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:41 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:42.481322 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:42.481986 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:42.488904 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:42.489389 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:42.489822 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:42.490518 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:42.491001 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:42.491449 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:42.635995 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:42.644177 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-3233dfb1-23cd-4735-9f4a-863e9dfcb80c tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.166810 Nov 02 15:13:42.644764 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4656/7356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:42 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:43.304319 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:43.305219 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell0:SELECT=6 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:43.386463 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-f68eb9ae-7d5b-4b12-b234-805a57e4aee3 req-b62a5b69-42b1-4102-9041-1f992a6cc219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c76dad-b15e-4583-ac63-8f68604f9545", "tag": "e4bf8c42-5cd6-4377-ae32-66d788c881f6"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:43.396393 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f68eb9ae-7d5b-4b12-b234-805a57e4aee3 req-b62a5b69-42b1-4102-9041-1f992a6cc219 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:43.396968 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f68eb9ae-7d5b-4b12-b234-805a57e4aee3 req-b62a5b69-42b1-4102-9041-1f992a6cc219 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:43.397504 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-f68eb9ae-7d5b-4b12-b234-805a57e4aee3 req-b62a5b69-42b1-4102-9041-1f992a6cc219 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:43.409623 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-f68eb9ae-7d5b-4b12-b234-805a57e4aee3 req-b62a5b69-42b1-4102-9041-1f992a6cc219 service nova] Creating event network-changed:e4bf8c42-5cd6-4377-ae32-66d788c881f6 for instance 34c76dad-b15e-4583-ac63-8f68604f9545 on n-h2-858238-3 Nov 02 15:13:43.414844 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-f68eb9ae-7d5b-4b12-b234-805a57e4aee3 req-b62a5b69-42b1-4102-9041-1f992a6cc219 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116167 Nov 02 15:13:43.415514 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2701/7357] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:13:43.668168 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:43.668773 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:43.670720 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell0:SELECT=2 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:13:43.677279 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:43.677759 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:43.678199 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:43.678889 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:43.679374 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:43.679795 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:43.828288 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:43.836448 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-b06793c7-f271-490d-aee9-86950b9770f6 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.172122 Nov 02 15:13:43.837034 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4657/7358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:43 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:44.861864 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:44.862575 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:44.869052 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:44.869552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:44.870007 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:44.870710 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:44.871200 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:44.871648 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:45.081790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:45.089572 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-6f2f9b2c-7118-42cc-9bde-1620c5a58e65 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.233368 Nov 02 15:13:45.090160 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2702/7359] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:44 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:46.112607 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:46.113184 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:46.120052 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:46.120552 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:46.120967 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:46.121658 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:46.122106 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:46.122529 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:46.255617 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:46.264552 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-562ba412-ca0a-4898-b94b-a7961c866c08 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.154778 Nov 02 15:13:46.265121 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4658/7360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:46 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:47.288685 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:47.289255 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:47.297820 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:47.298348 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:47.298800 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:47.299554 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:47.300039 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:47.300464 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:47.441148 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:47.449205 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-540ca499-d38b-4b57-9006-fcf49e5c0a94 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.164719 Nov 02 15:13:47.449791 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2703/7361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:47 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:48.472135 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:48.472752 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:48.479662 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:48.480144 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:48.480572 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:48.481268 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:48.481715 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:48.482669 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:48.544130 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [req-aed63086-255a-4aca-a195-40bcd03b969d req-d94ca281-2d69-4aa4-b290-285c5f54b256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c76dad-b15e-4583-ac63-8f68604f9545", "name": "network-vif-plugged", "status": "completed", "tag": "e4bf8c42-5cd6-4377-ae32-66d788c881f6"}]} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:48.556138 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-aed63086-255a-4aca-a195-40bcd03b969d req-d94ca281-2d69-4aa4-b290-285c5f54b256 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:48.556643 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-aed63086-255a-4aca-a195-40bcd03b969d req-d94ca281-2d69-4aa4-b290-285c5f54b256 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:48.557091 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [req-aed63086-255a-4aca-a195-40bcd03b969d req-d94ca281-2d69-4aa4-b290-285c5f54b256 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:48.573404 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.compute.server_external_events [req-aed63086-255a-4aca-a195-40bcd03b969d req-d94ca281-2d69-4aa4-b290-285c5f54b256 service nova] Creating event network-vif-plugged:e4bf8c42-5cd6-4377-ae32-66d788c881f6 for instance 34c76dad-b15e-4583-ac63-8f68604f9545 on n-h2-858238-3 Nov 02 15:13:48.578919 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [req-aed63086-255a-4aca-a195-40bcd03b969d req-d94ca281-2d69-4aa4-b290-285c5f54b256 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038502 Nov 02 15:13:48.580169 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2704/7362] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:13:48.626065 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:48.634217 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-8d1c3387-714a-4476-8893-a866ac871847 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.165909 Nov 02 15:13:48.634846 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4659/7363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:48 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:49.657902 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:49.658760 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:49.666075 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:49.666541 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:49.667032 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:49.667743 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:49.668216 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:49.668688 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:49.821574 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:49.830080 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-9714bcc9-db88-4b2c-b10f-964eb273fc7b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1374 microversion: 2.1 time: 0.176528 Nov 02 15:13:49.830698 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2705/7364] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:49 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:50.852172 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:50.852780 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:50.859504 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:50.859982 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:50.860411 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:50.861094 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:50.861543 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:50.861966 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:50.991035 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:50.999474 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-45ad0f09-c3b8-4822-b3c9-1a02e2d9d8ac tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1559 microversion: 2.1 time: 0.151298 Nov 02 15:13:51.000049 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4660/7365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:50 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:51.022073 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:13:51.022691 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:13:51.029552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:51.030044 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:51.030489 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:51.031241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:51.031706 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:51.032140 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:51.165190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:13:51.172890 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-23b122a9-1115-4c71-aaea-0ec88d8eb820 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1559 microversion: 2.1 time: 0.154701 Nov 02 15:13:51.173454 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2706/7366] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:13:51 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:13:53.054742 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-9b05d41d-ce22-4548-943c-786706ec5dff req-d98d58e0-76d7-4b6a-8f4d-daedf587f760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c76dad-b15e-4583-ac63-8f68604f9545", "tag": "e4bf8c42-5cd6-4377-ae32-66d788c881f6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:13:53.065806 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9b05d41d-ce22-4548-943c-786706ec5dff req-d98d58e0-76d7-4b6a-8f4d-daedf587f760 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:13:53.066293 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9b05d41d-ce22-4548-943c-786706ec5dff req-d98d58e0-76d7-4b6a-8f4d-daedf587f760 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:13:53.066729 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-9b05d41d-ce22-4548-943c-786706ec5dff req-d98d58e0-76d7-4b6a-8f4d-daedf587f760 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:13:53.078865 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-9b05d41d-ce22-4548-943c-786706ec5dff req-d98d58e0-76d7-4b6a-8f4d-daedf587f760 service nova] Creating event network-changed:e4bf8c42-5cd6-4377-ae32-66d788c881f6 for instance 34c76dad-b15e-4583-ac63-8f68604f9545 on n-h2-858238-3 Nov 02 15:13:53.084114 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-9b05d41d-ce22-4548-943c-786706ec5dff req-d98d58e0-76d7-4b6a-8f4d-daedf587f760 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034272 Nov 02 15:13:53.084716 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4661/7367] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:15:20.553773 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:15:20.554510 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=54 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:15:20.556231 n-d-858238-3 devstack@n-api.service[137558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:15:20.556450 n-d-858238-3 devstack@n-api.service[137558]: Wed Nov 2 15:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545/action (ip 10.222.0.18) !!! Nov 02 15:15:20.561924 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1186418588"}} {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:15:20.564266 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:20.573877 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:20.574309 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:20.574758 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:20.576005 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:20.576475 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:20.576913 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:20.915194 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-3199f3af-9dfb-4a97-a5ae-602a7706d21a tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "POST /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545/action" status: 202 len: 0 microversion: 2.1 time: 0.363244 Nov 02 15:15:20.916046 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2707/7368] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 15:15:20 2022] POST /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 15:15:27.040655 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_api:SELECT=26 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:15:27.042138 n-d-858238-3 devstack@n-api.service[137559]: DEBUG dbcounter [-] [137559] Writing DB stats nova_cell1:SELECT=54 {{(pid=137559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:15:27.043168 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:15:27.043630 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Nov 02 15:15:27.046781 n-d-858238-3 devstack@n-api.service[137559]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:15:27.047295 n-d-858238-3 devstack@n-api.service[137559]: Wed Nov 2 15:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Nov 02 15:15:27.058540 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-179dbdb2-9d82-4778-91e6-3c6c96c41a42 req-e194a423-65ea-4cfe-8710-cd12a4101bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c76dad-b15e-4583-ac63-8f68604f9545", "name": "network-vif-plugged", "status": "completed", "tag": "e4bf8c42-5cd6-4377-ae32-66d788c881f6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:15:27.074782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-179dbdb2-9d82-4778-91e6-3c6c96c41a42 req-e194a423-65ea-4cfe-8710-cd12a4101bc7 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:27.075445 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-179dbdb2-9d82-4778-91e6-3c6c96c41a42 req-e194a423-65ea-4cfe-8710-cd12a4101bc7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:27.076221 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-179dbdb2-9d82-4778-91e6-3c6c96c41a42 req-e194a423-65ea-4cfe-8710-cd12a4101bc7 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:27.089072 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-179dbdb2-9d82-4778-91e6-3c6c96c41a42 req-e194a423-65ea-4cfe-8710-cd12a4101bc7 service nova] Creating event network-vif-plugged:e4bf8c42-5cd6-4377-ae32-66d788c881f6 for instance 34c76dad-b15e-4583-ac63-8f68604f9545 on n-h2-858238-3 Nov 02 15:15:27.113433 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-179dbdb2-9d82-4778-91e6-3c6c96c41a42 req-e194a423-65ea-4cfe-8710-cd12a4101bc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075900 Nov 02 15:15:27.117550 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4662/7369] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:15:35.908789 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_api:SELECT=2 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:15:35.909584 n-d-858238-3 devstack@n-api.service[137558]: DEBUG dbcounter [-] [137558] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:15:35.913585 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-aad70f08-f445-4ee8-9f25-a67656e138ea req-7bc545f5-8d92-49b3-a4b5-cfaac249639f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c76dad-b15e-4583-ac63-8f68604f9545", "tag": "e4bf8c42-5cd6-4377-ae32-66d788c881f6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:15:35.914071 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:35.914190 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:35.924838 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-aad70f08-f445-4ee8-9f25-a67656e138ea req-7bc545f5-8d92-49b3-a4b5-cfaac249639f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:35.925382 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-aad70f08-f445-4ee8-9f25-a67656e138ea req-7bc545f5-8d92-49b3-a4b5-cfaac249639f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:35.925929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:35.926102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-aad70f08-f445-4ee8-9f25-a67656e138ea req-7bc545f5-8d92-49b3-a4b5-cfaac249639f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:35.926680 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:35.927156 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:35.927929 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:35.928624 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:35.929132 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:35.937876 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-aad70f08-f445-4ee8-9f25-a67656e138ea req-7bc545f5-8d92-49b3-a4b5-cfaac249639f service nova] Creating event network-changed:e4bf8c42-5cd6-4377-ae32-66d788c881f6 for instance 34c76dad-b15e-4583-ac63-8f68604f9545 on n-h2-858238-3 Nov 02 15:15:35.944170 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-aad70f08-f445-4ee8-9f25-a67656e138ea req-7bc545f5-8d92-49b3-a4b5-cfaac249639f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034233 Nov 02 15:15:35.944170 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4663/7370] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:15:35.959034 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:15:36.058685 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-e26a8158-d04e-46c5-bcdb-e3185fdf73fc tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 204 len: 0 microversion: 2.1 time: 0.151862 Nov 02 15:15:36.059577 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2708/7371] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 15:15:35 2022] DELETE /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:15:36.068320 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:36.069102 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:36.076253 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:36.076870 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:36.077379 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:36.078164 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:36.078692 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:36.079220 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:36.242261 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:15:36.250895 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-27613b5d-2674-4117-a489-13f91d387f47 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1684 microversion: 2.1 time: 0.186385 Nov 02 15:15:36.252933 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4664/7372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:36 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:15:37.278092 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:37.279330 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:37.289996 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:37.290794 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:37.291589 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:37.292374 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:37.292853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:37.293311 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:37.453932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:15:37.463756 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-5fc2f0fb-432d-4a9e-8524-0b72f4b9414b tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1684 microversion: 2.1 time: 0.191723 Nov 02 15:15:37.464418 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2709/7373] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:37 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1684 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:15:38.303228 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-61202903-d094-4f37-bfe4-c188ddc43a61 req-df6c6f5d-02ae-438b-af55-ae132a9b9b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c76dad-b15e-4583-ac63-8f68604f9545", "name": "network-vif-deleted", "tag": "e4bf8c42-5cd6-4377-ae32-66d788c881f6"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:15:38.313072 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-61202903-d094-4f37-bfe4-c188ddc43a61 req-df6c6f5d-02ae-438b-af55-ae132a9b9b0f service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:38.313542 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-61202903-d094-4f37-bfe4-c188ddc43a61 req-df6c6f5d-02ae-438b-af55-ae132a9b9b0f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:38.314350 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-61202903-d094-4f37-bfe4-c188ddc43a61 req-df6c6f5d-02ae-438b-af55-ae132a9b9b0f service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:38.328517 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-61202903-d094-4f37-bfe4-c188ddc43a61 req-df6c6f5d-02ae-438b-af55-ae132a9b9b0f service nova] Creating event network-vif-deleted:e4bf8c42-5cd6-4377-ae32-66d788c881f6 for instance 34c76dad-b15e-4583-ac63-8f68604f9545 on n-h2-858238-3 Nov 02 15:15:38.335218 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-61202903-d094-4f37-bfe4-c188ddc43a61 req-df6c6f5d-02ae-438b-af55-ae132a9b9b0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093880 Nov 02 15:15:38.335844 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4665/7374] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:15:38.493480 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:38.494061 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:38.501649 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:38.502141 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:38.502586 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:38.503340 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:38.503803 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:38.504237 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:38.539290 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:38.539790 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:38.540253 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:38.540709 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lazy-loading 'fault' on Instance uuid 34c76dad-b15e-4583-ac63-8f68604f9545 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:15:38.590944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:15:38.601482 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-fcb25ea3-9607-49be-a662-a4ee029fdddf tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 200 len: 1338 microversion: 2.1 time: 0.111862 Nov 02 15:15:38.602097 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2710/7375] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:38 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:15:39.626970 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:39.627700 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: 34c76dad-b15e-4583-ac63-8f68604f9545] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:39.634793 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:39.635305 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:39.635743 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:39.636429 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:39.636882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:39.637304 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:39.650492 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] HTTP exception thrown: Instance 34c76dad-b15e-4583-ac63-8f68604f9545 could not be found. Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Request method failure captured: Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 HTTP/1.1 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoiIhTmVPJJ9LYEIgHj7i87pmRG2-KaJFAX6TZFFqiA9F_6ryZBANwXtoLv6UGVfokpYO1MVGxewRBfk2U029dgKwmt9STYyEpVLoVFuMXV0g7jTUWjsGCHcbIFADrnNzuuYLk6KeZrd4GHbQPWWvj_w-If9iuFGkKZ6SdifaqC802A Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ed0fed4011db44ffb99dfe7aef95ad80 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestSnapshotPattern-1968049470 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed0fed4011db44ffb99dfe7aef95ad80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed0fed4011db44ffb99dfe7aef95ad80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed0fed4011db44ffb99dfe7aef95ad80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed0fed4011db44ffb99dfe7aef95ad80"}]}] Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestSnapshotPattern-1968049470 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ed0fed4011db44ffb99dfe7aef95ad80 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestSnapshotPattern-1968049470 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestSnapshotPattern-1968049470-project Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: be8739fc2a05458786f59c529cf99229 Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestSnapshotPattern-1968049470-project Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance 34c76dad-b15e-4583-ac63-8f68604f9545 could not be found. Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': '34c76dad-b15e-4583-ac63-8f68604f9545'} Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c76dad-b15e-4583-ac63-8f68604f9545 could not be found. Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c76dad-b15e-4583-ac63-8f68604f9545 could not be found. Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:15:39.652133 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c76dad-b15e-4583-ac63-8f68604f9545 could not be found. Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Returning 404 to user: Instance 34c76dad-b15e-4583-ac63-8f68604f9545 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-6370a200-4fef-449a-b005-f47e88f661a8 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545" status: 404 len: 111 microversion: 2.1 time: 0.031468 Nov 02 15:15:39.658565 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4666/7376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:39 2022] GET /compute/v2.1/servers/34c76dad-b15e-4583-ac63-8f68604f9545 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:15:40.983985 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:40.984610 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:40.987036 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-f1c1b901-87fe-4785-9121-bd880ef090a2 req-407d9ad8-ee4b-434a-9269-e5e4e1c24db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:15:40.991944 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:40.992559 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:40.993889 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:40.994848 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:40.995420 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:40.995932 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:40.998868 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f1c1b901-87fe-4785-9121-bd880ef090a2 req-407d9ad8-ee4b-434a-9269-e5e4e1c24db3 service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:40.999384 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f1c1b901-87fe-4785-9121-bd880ef090a2 req-407d9ad8-ee4b-434a-9269-e5e4e1c24db3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:40.999801 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-f1c1b901-87fe-4785-9121-bd880ef090a2 req-407d9ad8-ee4b-434a-9269-e5e4e1c24db3 service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:41.013023 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-f1c1b901-87fe-4785-9121-bd880ef090a2 req-407d9ad8-ee4b-434a-9269-e5e4e1c24db3 service nova] Creating event network-changed:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:15:41.018797 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-f1c1b901-87fe-4785-9121-bd880ef090a2 req-407d9ad8-ee4b-434a-9269-e5e4e1c24db3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037117 Nov 02 15:15:41.019456 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4667/7377] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:15:41.026447 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Going to try to terminate instance {{(pid=137558) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:15:41.116482 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-be6c6e92-a6cf-4fdc-a30f-8658690f1106 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 204 len: 0 microversion: 2.1 time: 0.136387 Nov 02 15:15:41.121037 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2711/7378] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 15:15:40 2022] DELETE /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:15:41.127484 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:41.128466 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:41.135351 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:41.136142 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:41.136771 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:41.137478 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:41.138114 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:41.138784 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:41.291899 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.policy [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137559) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:15:41.301102 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-12fede6e-5afc-4923-92f5-e2c30879cbcb tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1683 microversion: 2.1 time: 0.179039 Nov 02 15:15:41.301723 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4668/7379] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:41 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:15:42.325581 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:42.326202 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:42.333549 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:42.334047 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:42.334499 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:42.335241 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:42.335711 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:42.336159 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:42.526552 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:15:42.534454 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-b57675c7-9155-4afe-a20b-3e1174d18971 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1683 microversion: 2.1 time: 0.213510 Nov 02 15:15:42.535055 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2712/7380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:42 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:15:43.123976 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [req-7a96c7b0-3e83-4dd3-affb-6e8cbcad0b01 req-1df1b9a4-444d-4d83-a7f9-778b7e12868c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc2f413-fa49-4cb1-b48f-e9bb26cea028", "name": "network-vif-deleted", "tag": "1a1d6d75-73a9-4e28-8a65-6f38059c6725"}]} {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:15:43.134760 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7a96c7b0-3e83-4dd3-affb-6e8cbcad0b01 req-1df1b9a4-444d-4d83-a7f9-778b7e12868c service nova] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:43.135275 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7a96c7b0-3e83-4dd3-affb-6e8cbcad0b01 req-1df1b9a4-444d-4d83-a7f9-778b7e12868c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:43.135701 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [req-7a96c7b0-3e83-4dd3-affb-6e8cbcad0b01 req-1df1b9a4-444d-4d83-a7f9-778b7e12868c service nova] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:43.149387 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.compute.server_external_events [req-7a96c7b0-3e83-4dd3-affb-6e8cbcad0b01 req-1df1b9a4-444d-4d83-a7f9-778b7e12868c service nova] Creating event network-vif-deleted:1a1d6d75-73a9-4e28-8a65-6f38059c6725 for instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 on n-h1-858238-3 Nov 02 15:15:43.155549 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [req-7a96c7b0-3e83-4dd3-affb-6e8cbcad0b01 req-1df1b9a4-444d-4d83-a7f9-778b7e12868c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036092 Nov 02 15:15:43.156297 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4669/7381] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 15:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:15:43.559730 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:43.560365 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.compute.api [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137558) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:43.568853 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:43.569355 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:43.569805 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:43.570520 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:43.570990 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:43.571721 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:43.604145 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:43.604752 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:43.605242 n-d-858238-3 devstack@n-api.service[137558]: DEBUG oslo_concurrency.lockutils [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:43.605732 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.objects.instance [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lazy-loading 'fault' on Instance uuid bfc2f413-fa49-4cb1-b48f-e9bb26cea028 {{(pid=137558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:15:43.652782 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.policy [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8739fc2a05458786f59c529cf99229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0fed4011db44ffb99dfe7aef95ad80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137558) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:15:43.660084 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-7ab6817a-7229-43f9-8304-6a79071efc62 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 200 len: 1338 microversion: 2.1 time: 0.105681 Nov 02 15:15:43.660659 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2713/7382] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:43 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:15:44.684670 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '>' {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:44.685281 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.compute.api [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] [instance: bfc2f413-fa49-4cb1-b48f-e9bb26cea028] Fetching instance by UUID {{(pid=137559) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:15:44.692406 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:44.692882 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:44.693308 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:44.693989 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Acquiring lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:15:44.694437 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:15:44.694857 n-d-858238-3 devstack@n-api.service[137559]: DEBUG oslo_concurrency.lockutils [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Lock "9d7d2220-711a-49ba-b1ed-85ca0f1895b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:15:44.708770 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.wsgi [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] HTTP exception thrown: Instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 could not be found. Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Request method failure captured: Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: request: GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 HTTP/1.1 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Accept: application/json Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Accept-Encoding: identity Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Connection: close Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Content-Length: 0 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Content-Type: application/json Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Host: 10.222.0.18 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: Openstack-System-Scope: None Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: User-Agent: python-urllib3/1.26.12 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Auth-Token: gAAAAABjYoiIhTmVPJJ9LYEIgHj7i87pmRG2-KaJFAX6TZFFqiA9F_6ryZBANwXtoLv6UGVfokpYO1MVGxewRBfk2U029dgKwmt9STYyEpVLoVFuMXV0g7jTUWjsGCHcbIFADrnNzuuYLk6KeZrd4GHbQPWWvj_w-If9iuFGkKZ6SdifaqC802A Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Id: None Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Domain-Name: None Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Identity-Status: Confirmed Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Is-Admin-Project: True Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Id: default Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Domain-Name: Default Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Id: ed0fed4011db44ffb99dfe7aef95ad80 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Project-Name: tempest-TestSnapshotPattern-1968049470 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Role: member,reader Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Roles: member,reader Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed0fed4011db44ffb99dfe7aef95ad80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed0fed4011db44ffb99dfe7aef95ad80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed0fed4011db44ffb99dfe7aef95ad80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed0fed4011db44ffb99dfe7aef95ad80"}]}] Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant: tempest-TestSnapshotPattern-1968049470 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Id: ed0fed4011db44ffb99dfe7aef95ad80 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-Tenant-Name: tempest-TestSnapshotPattern-1968049470 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-User: tempest-TestSnapshotPattern-1968049470-project Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Id: default Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Domain-Name: Default Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Id: be8739fc2a05458786f59c529cf99229 Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: X-User-Name: tempest-TestSnapshotPattern-1968049470-project Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: method: > Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: exception: Instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 could not be found. Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: action_args: {'id': 'bfc2f413-fa49-4cb1-b48f-e9bb26cea028'} Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: {{(pid=137559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 could not be found. Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 could not be found. Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:15:44.710397 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 could not be found. Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: ERROR nova.api.openstack.wsgi Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: DEBUG nova.api.openstack.wsgi [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Returning 404 to user: Instance bfc2f413-fa49-4cb1-b48f-e9bb26cea028 could not be found. {{(pid=137559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: INFO nova.api.openstack.requestlog [None req-ad91ce39-e4b3-46a5-979d-9adbab684e86 tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028" status: 404 len: 111 microversion: 2.1 time: 0.032313 Nov 02 15:15:44.715782 n-d-858238-3 devstack@n-api.service[137559]: [pid: 137559|app: 0|req: 4670/7383] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 15:15:44 2022] GET /compute/v2.1/servers/bfc2f413-fa49-4cb1-b48f-e9bb26cea028 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:15:44.879632 n-d-858238-3 devstack@n-api.service[137558]: DEBUG nova.api.openstack.wsgi [None req-19d32ee6-dc97-4016-a6de-96c0833b7b2e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] Calling method '.version_select at 0x7f6f85e99a60>' {{(pid=137558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:15:44.913580 n-d-858238-3 devstack@n-api.service[137558]: INFO nova.api.openstack.requestlog [None req-19d32ee6-dc97-4016-a6de-96c0833b7b2e tempest-TestSnapshotPattern-1968049470 tempest-TestSnapshotPattern-1968049470-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-793439450" status: 202 len: 0 microversion: 2.1 time: 0.038007 Nov 02 15:15:44.914174 n-d-858238-3 devstack@n-api.service[137558]: [pid: 137558|app: 0|req: 2714/7384] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Nov 2 15:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-793439450 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)